EDIT:
I have found that removing import django_heroku from my settings.py file allows me to push my static files to my AWS bucket. When I u
import django_heroku
For anyone facing the same problem, the solution for me was: django_heroku.settings(locals(), staticfiles=False)
django_heroku.settings(locals(), staticfiles=False)
which is also detailed at this github issue.