SqlDataReader misbehaves in relation to primary key column

Question

After a trivial mod to one of our internal database apps caused havoc, I nailed it down to SqlDataReader misbehaving compared to SqlDataAdapter and also its OleDb counterpar