Celery dies with DBPageNotFoundError

Question

I have 3 machines with celery workers and rabbitmq as a broker, one worker is running with beat flag, all of this is managed by supervisor, and sometimes celery dies with su

Answer 1

I had to remove some temp files in the /tmp directory. One was named celeryd-<NAME_OF_WORKER>-state and also celeryd-<NAME_OF_WORKER>-state-renamed. After removing those and I was able to restart my affected worker.

Answer 2

I've ran into this issue and the cause was a corrupted db file (usually named "celerybeat-schedule"). Solution would be to delete the existing db file and restart the process.

Relavent:bsddb.db.DBPageNotFoundError https://mail.python.org/pipermail/python-list/2009-October/554552.html