ChartJS: Can I stop the graph from resizing when the xAxis labels change in length

Question

I have a line graph whose x-Axis consists of times by the minute. This graph also has the ability to pan with the mouse. When I pan from times consisting of 6 characters to 7 ch