Adam optimizer in sPacy giving strange results

Question

I have the following toy example to play with the TextCategorizer CNN model in sPacy. Given the distribution of my input dataset, I am expecting the test results to