set the preserveViewport option of the DirectionsRenderer if you don't want it to zoom to fit the directions.
preserveViewport | boolean | By default, the input map is centered and zoomed to the bounding box of this set of directions. If this option is set to true, the viewport is left unchanged, unless the map's center and zoom were never set.