I\'ve been running a flask application with a celery worker and redis in three separated docker containers without any issue.
This is how I start it:
cele
For anyone who use the docker-airflow, I used the folk of puckel/docker-airflow Just need to modify the dockerfile by adding
&& pip install 'redis>=2.10.5,<3'\
replace celery[redis]
with only celery
, by adding celery in apache-airflow built-in module i.e.,
&& pip install apache-airflow[crypto,celery,postgres,hive,jdbc,mysql]==$AIRFLOW_VERSION
Update: They also change the docker-airflow dockerfile recently to fix this bug, see here