Preview callback in Camera2 is significantly slower than in Camera1

Question

It is 2017 and I am finally starting switching from Camera1 to Camera2. In Camera1 I was greatly relying on setPreviewCallbackWithBuffer() to perform a real time fr