django annotate on large data (SLOW) - an alternative?

Question

I have 2 models:

Follower has 10M queries

class Follower(models.Model):
    identifier = models.BigIntegerField(
        _("identifier"), uni