Solr increase maxDirectMemory leading to slow query

Question

I am working on a project using Solr and HBase. They are all integrated with CDH(version 5.13.3). Recently I find queries become slower and slower. So I increase the Solr MaxDir