Decreasing the number of kernel in CNN

Question

I know how to increase the number of the kernel in CNN, and what is the purpose and how we can do it, but I don\'t how the logic behind decreasing the kernel after increasing an