What causes readline to skip to start of line when using arrow key to backup in a history line

Question

I am working on a Debian VM and have experienced a strange behaviour when using the arrow key to position the cursor to edit an earlier line in the command history.