celerybeat

Prevent Celery Beat from running the same task

由 狂风中的少年 提交于 2019-12-07 09:30:34
问题 I have a scheduled celery running tasks every 30 seconds. I have one that runs as task daily, and another one that runs weekly on a user specified time and day of the week. It checks for the "start time" and the "next scheduled date". The next scheduled date does not update until the task is completed. However, I want to know how to make sure that the celery beat is only running the task once. I see that right now, celery will run a certain task multiple times until that task's next scheduled

Correct setup of django redis celery and celery beats

由 巧了我就是萌 提交于 2019-12-06 20:15:54
问题 I have being trying to setup django + celery + redis + celery_beats but it is giving me trouble. The documentation is quite straightforward, but when I run the django server, redis, celery and celery beats, nothing gets printed or logged (all my test task does its log something). This is my folder structure: - aenima - aenima - __init__.py - celery.py - criptoball - tasks.py celery.py looks like this: from __future__ import absolute_import, unicode_literals import os from django.conf import

Celery beat - different time zone per task

由 不羁岁月 提交于 2019-12-06 13:53:19
I am using celery beat to schedule some tasks. I'm able to use the CELERY_TIMEZONE setting to schedule the tasks using the crontab schedule and it runs at the scheduled time in the mentioned time zone. But I want to be able to setup multiple such tasks for different timezones in the same application (single django settings.py). I know which task needs to run in what timezone when the task is being scheduled. Is it possible to specify a different timezone for each of the tasks? I'm using django (1.4) with celery (3.0.11) and django celery (3.0.11). I've looked at the djcelery.schedulers

How to access the orm with celery tasks?

由 三世轮回 提交于 2019-12-06 05:16:31
问题 I'm trying to flip a boolean flag for particular types of objects in my database using sqlalchemy+celery beats. But how do I access my orm from the tasks.py file? from models import Book from celery.decorators import periodic_task from application import create_celery_app celery = create_celery_app() # Create celery: http://flask.pocoo.org/docs/0.10/patterns/celery/ # This task works fine @celery.task def celery_send_email(to,subject,template): with current_app.app_context(): msg = Message(

Celery beat not starting EOFError('Ran out of input')

由 不羁的心 提交于 2019-12-06 04:28:33
Everything worked perfectly fine until: celery beat v3.1.18 (Cipater) is starting. __ - ... __ - _ Configuration -> . broker -> amqp://user:**@staging-api.user-app.com:5672// . loader -> celery.loaders.app.AppLoader . scheduler -> celery.beat.PersistentScheduler . db -> /tmp/beat.db . logfile -> [stderr]@%INFO . maxinterval -> now (0s) [2015-09-25 17:29:24,453: INFO/MainProcess] beat: Starting... [2015-09-25 17:29:24,457: CRITICAL/MainProcess] beat raised exception <class 'EOFError'>: EOFError('Ran out of input',) Traceback (most recent call last): File "/home/user/staging/venv/lib/python3.4

Django Celery Scheduling a manage.py command

由 烂漫一生 提交于 2019-12-06 04:05:36
I need to update the solr index on a schedule with the command: (env)$ ./manage.py update_index I've looked through the Celery docs and found info on scheduling, but haven't been able to find a way to run a django management command on a schedule and inside a virtualenv. Would this be better run on a normal cron? And if so how would I run it inside the virtualenv? Anyone have experience with this? Thanks for the help! To run your command periodically from a cron job, just wrap the command in a bash script that loads the virtualenv. For example, here is what we do to run manage.py commands:

Daemonize Celerybeat in Elastic Beanstalk(AWS)

由 会有一股神秘感。 提交于 2019-12-06 01:38:51
问题 I am trying to run celerybeat as a daemon in Elastic beanstalk. Here is my config file: files: "/opt/python/log/django.log": mode: "000666" owner: ec2-user group: ec2-user content: | # Log file encoding: plain "/opt/elasticbeanstalk/hooks/appdeploy/post/run_supervised_celeryd.sh": mode: "000755" owner: root group: root content: | #!/usr/bin/env bash # Get django environment variables celeryenv=`cat /opt/python/current/env | tr '\n' ',' | sed 's/%/%%/g' | sed 's/export //g' | sed 's/$PATH/%

Replacing Celerybeat with Chronos

由 拥有回忆 提交于 2019-12-05 20:26:06
问题 How mature is Chronos? Is it a viable alternative to scheduler like celery-beat? Right now our scheduling implements a periodic "heartbeat" task that checks of "outstanding" events and fires them if they are overdue. We are using python-dateutil's rrule for defining this. We are looking at alternatives to this approach, and Chronos seems a very attactive alternative: 1) it would mitigate the necessity to use a heartbeat schedule task, 2) it supports RESTful submission of events with ISO8601

celery beat schedule: run task instantly when start celery beat?

由 北慕城南 提交于 2019-12-05 17:43:04
问题 If I create a celery beat schedule, using timedelta(days=1) , the first task will be carried out after 24 hours, quote celery beat documentation: Using a timedelta for the schedule means the task will be sent in 30 second intervals ( the first task will be sent 30 seconds after celery beat starts , and then every 30 seconds after the last run). But the fact is that in a lot of situations it's actually important that the the scheduler run the task at launch, But I didn't find an option that

Maximum clients reached on Heroku and Redistogo Nano

由 强颜欢笑 提交于 2019-12-05 03:03:47
I am using celerybeat on Heroku with RedisToGo Nano addon There is one web dyno and one worker dyno The celerybeat worker is set to perform a task every minute. The problem is: Whenever I deploy a new commit, dynos restart, and I get this error 2014-02-27T13:19:31.552352+00:00 app[worker.1]: Traceback (most recent call last): 2014-02-27T13:19:31.552352+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/celery/worker/consumer.py", line 389, in start 2014-02-27T13:19:31.552352+00:00 app[worker.1]: self.reset_connection() 2014-02-27T13:19:31.552352+00:00 app[worker.1]:
订阅 celerybeat