How to restrict permission to a user to access a folder in the Data Lake if the RBAC permission allows AD Group level access?

Question

I have an AAD Group that is allowed to access the Data Lake Gen 2 via RBAC. However, there are some people in the AAD Group that should not be allowed to see some of the files/f