User with Owner Role in Google Cloud gets 403 when Using Gmail Api

Question

With gcloud I am logged into a terminal window with my email address, me@gmail.com. This project has the Gmail API enabled, and I am owner of this conf