beanstalkd

How to pass arguments to homebrew service

落爺英雄遲暮 提交于 2019-12-05 20:30:45
I have installed beanstalkd using homebrew but am unable to increase the maximum job size. This is normally done by passing the -z argument as "-z byte_size" All attempts to edit the formula for myself have failed to increase the job size as needed. How do I successfully pass the -z argument in homebrew to increase the maximum job size. I have tried using "brew edit beanstalkd" and modified the file adding a second "string" value with the -z 10000000 but this didn't seem to help. 来源: https://stackoverflow.com/questions/41880429/how-to-pass-arguments-to-homebrew-service

Simple scalable work/message queue with delay

谁都会走 提交于 2019-12-04 05:16:50
I need to set up a job/message queue with the option to set a delay for the task so that it's not picked up immediately by a free worker, but after a certain time (can vary from task to task). I looked into a couple of linux queue solutions (rabbitmq, gearman, memcacheq), but none of them seem to offer this feature out of the box. Any ideas on how I could achieve this? Thanks! I've used BeanstalkD to great effect, using the delay option on inserting a new job to wait several seconds till the item becomes available to be reserved. If you are doing longer-term delays (more than say 30 seconds),

Rails: Can I run backgrounds jobs in a different server?

不想你离开。 提交于 2019-12-03 16:45:52
Is it possible to host the application in one server and queue jobs in another server? Possible examples: Two different EC2 instances, one with the main server and the second with the queueing service. Host the app in Heroku and use an EC2 instance with the queueing service Is that possible? Thanks Yes, definitely. We have delayed_job set up that way where I work. There are a couple of requirements for it to work: The servers have to have synced clocks. This is usually not a problem as long as the server timezones are all set to the same. The servers all have to access the same database. To do

Stats/Monitor/Inspector for beanstalkd

青春壹個敷衍的年華 提交于 2019-12-03 03:44:08
问题 Does anyone know of an app that can monitor a beanstalkd queue? I'm looking for something that shows stats on tubes and jobs, and allows you to inspect the details. I'm not really picky about language/platform, just want to know if there's something out there before I write my own. 回答1: All of these and at least two others are listed on the beanstalkd wiki tools page: https://github.com/kr/beanstalkd/wiki/Tools The best ones are: http://github.com/ptrofimov/beanstalk_console — a web admin

Unable to get Beanstalkd Queue to work for PHP

随声附和 提交于 2019-12-02 11:31:31
问题 I have Ubuntu running XAMPP ( the lamp stack: Linux, Apache, MySQL, PHP, Pear ). I would like to use PHP and Beanstalkd together to make a simple queue that when a user goes on page1.php , a JOB is sent to the QUEUE for a WORKER to capture. The JOB would be an SQL statement that the WORKER would then execute: What I have done so far is: Installed Beanstalkd: sudo apt-get install beanstalkd Developed php code and the "job" that has to be done in page1.php . The job would be to send the sql

Unable to get Beanstalkd Queue to work for PHP

眉间皱痕 提交于 2019-12-02 04:44:06
I have Ubuntu running XAMPP ( the lamp stack: Linux, Apache, MySQL, PHP, Pear ). I would like to use PHP and Beanstalkd together to make a simple queue that when a user goes on page1.php , a JOB is sent to the QUEUE for a WORKER to capture. The JOB would be an SQL statement that the WORKER would then execute: What I have done so far is: Installed Beanstalkd: sudo apt-get install beanstalkd Developed php code and the "job" that has to be done in page1.php . The job would be to send the sql statement $sql to the queue for the workers to execute (in future versions the job will be much more

beanstalkd队列

感情迁移 提交于 2019-12-01 11:48:50
数据结构里面的队列是先进先出的数据结构,在服务器开发中使用队列可以有效的实现任务的异步处理,把耗时的任务放在一个队列中,由消费者去自动处理,比如客户端用户把错题生成pdf文件下载,可以在客户端点击生成的时候把任务放入队列异步处理,然后直接先返回给用户结果,而不必让用户等待。 队列用处 异步处理:用户注册后查找数据库发送邮件推荐商品,把推荐商品放入队列。 系统解耦:上面的过程将用户注册和推荐商品分离开来了。 定时任务: 把考生的试卷提交信息提前放入队列,每天固定某个时间实现自动批改选择题。 beanstalkd工具 beanstalked 是一个简单的快速的通用的轻量级内存队列,可以实现百万级任务处理。 特性 优先级:可以设置任务的优先级 延迟: 设置任务多少秒后才允许被消费者使用 持久化:定时刷新数据到文件,服务器挂掉后数据依旧存在 超时会重发:消费者必须在指定时间内完成任务,否则就会重新放入管道 任务预留:消费者先暂时跳过任务不处理 任务和管道 任务的状态转换 ready:任务已经准备好了,可以给消费者使用。 delay:任务放入管道的时候设置了延迟时间。 reserve:消费者把任务读取出来 buried:任务先放在一边,以后还会用 delete:任务从队列删除 安装 地址: https://github.com/kr/beanstalkd 可以通过源代码安装或者包管理工具

Problems on select module on Python 2.5

坚强是说给别人听的谎言 提交于 2019-12-01 09:10:27
I have an application in Python 2.5 that listens to a beanstalk queue. It works fine on all machines I tested so far, except from my newly acquired MacBook Pro. On that computer, when I try to run it I get this error: Traceback (most recent call last): File "jobs.py", line 181, in <module> Jobs().start() File "jobs.py", line 154, in start self.jobQueue = Queue() File "src/utils/queue.py", line 16, in __init__ self.connection = serverconn.ServerConn(self.server, self.port) File "src/beanstalk/serverconn.py", line 25, in __init__ self.poller = select.poll() AttributeError: 'module' object has no

Problems on select module on Python 2.5

人走茶凉 提交于 2019-12-01 06:48:54
问题 I have an application in Python 2.5 that listens to a beanstalk queue. It works fine on all machines I tested so far, except from my newly acquired MacBook Pro. On that computer, when I try to run it I get this error: Traceback (most recent call last): File "jobs.py", line 181, in <module> Jobs().start() File "jobs.py", line 154, in start self.jobQueue = Queue() File "src/utils/queue.py", line 16, in __init__ self.connection = serverconn.ServerConn(self.server, self.port) File "src/beanstalk

Using ffmpeg, PHP and beanstalk

馋奶兔 提交于 2019-11-30 16:08:34
问题 I am very new to ffmpeg and beanstalk and I need a little help. I want to use beanstalk to queue files for ffmpeg to convert. I've downloaded, installed and started beanstalkd (also installed libevent as it suggests to) and i've downloaded a PHP client for beanstalkd; http://sourceforge.net/projects/beanstalk/ Now after download the client and putting it on my server, I have done nothing but use the example from the client and i'm getting this error; Fatal error : Maximum execution time of 30