GoogleDrive API, will my App (and the hosting owners) have access to all Google Drive files associated with my email?

Question

Does it mean that if I upload oauth-credentials.json and service-account-credentials.json to my hosting, they will have access (potentially) to all of my Google Drive data?<