task-queue

Return data from Laravel Jobs

由 血红的双手。 提交于 2019-12-07 05:09:20
问题 I am developing API on Laravel for mobile application. Methods will make requests to other API's , combine and filter data, changing it's structure etc. One of the requirements to app is to respond no more than 30 seconds, or not respond at all. So, I have to repeat requests as much as I have time. I trying to realize that with Laravel Queues, and currently have something like that in my Job class: private $apiActionName; public function __construct($apiActionName) { $this->apiActionName =

What is meant by 'bucket-size' of queue in the google app engine?

由 ﹥＞﹥吖頭↗ 提交于 2019-12-06 16:51:12
问题 Google app engine task queues have configuration as (example) <queue> <name>mail-queue</name> <rate>5/m</rate> <bucket-size>10</bucket-size> </queue> Here, what does the 'bucket-size' mean? I could not find a comprehensive documentation about this in google app engine documentation. Does specifying this as 10 means that if 100 tasks are queued at an instant only 10 of those will be put in the queue and rest will be ignored? 回答1: bucket-size is perfectly described here: Limits the burstiness

Java GAE Task Queue CallNotFoundException

由 别等时光非礼了梦想. 提交于 2019-12-06 09:41:52
问题 When trying to implement a push queue, I am getting the following error: com.google.apphosting.api.ApiProxy$CallNotFoundException: Can't make API call taskqueue.BulkAdd in a thread that is neither the original request thread nor a thread created by ThreadManager Within my servlet's doPost() method, here is my task: Queue queue = QueueFactory.getQueue("rating-queue"); queue.add(TaskOptions.Builder.withUrl("/addrating") .param("function", function) .param("user_id", Integer.toString(user_id))

queue.yaml not working in App engine (development)

由 北城余情 提交于 2019-12-06 00:56:33
I'm trying to use "queue.yaml" to define queues in a Google App Engine app (Java version). queue: - name: default rate: 5/s - name: availableTicketsAlert rate: 5/s - name: billingReminder rate: 5/s - name: cseIndexing mode: pull When I try to see if they've been created correctly in this URL: /_ah/admin/taskqueue, I only see "default" queue. Instead, If I try to create the using with the XML file all works correctly (queue.xml): <queue-entries> <queue> <name>default</name> <rate>5/s</rate> </queue> <queue> <name>availableTicketsAlert</name> <rate>5/s</rate> </queue> <queue> <name

Web Application Architecture - Job/Task Queue needed?

由 我的梦境 提交于 2019-12-05 19:02:34
问题 I am currently designing a web application that will allow users to schedule tasks which will be executed against an HTTP API (on behalf of them). The tasks can be recurring and the minimal time resolution that can be used for scheduling will be one minute. Because of the nature of the tasks I think it makes sense to execute them asynchronously. However, how should the architecture of this part look like? I thought about using a task queue to create tasks by the web application and let them

A queueing system for Perl

由 拥有回忆 提交于 2019-12-05 03:54:55
I'm working on a Perl project which needs a FIFO message queue for distributing tasks between several processes on a single machine (UNIX). The queue size may grow up to 1M jobs. I've tried IPC::DirQueue , but it becomes awfully slow with 50k or so jobs enqueued. What are good alternatives to this module which can be used in Perl? I've had pretty good success with using ZeroMQ for this sort of problem, both with Perl and other languages. In my experience, the ZeroMQ module appears to be the most reliable binding for Perl currently. I haven't tried it under the conditions you list, but Thread:

Is there a way to know when a set of app engine task queue tasks have completed?

由 ぐ巨炮叔叔 提交于 2019-12-05 02:29:41
问题 is there a way to determine when a set of Google App Engine tasks (and child tasks they spawn) have all completed? Let's say that I have 100 tasks to execute and 10 of those spawn 10 child tasks each. That's 200 tasks. Let's also say that those child tasks might spawn more tasks, recursively, etc... Is there a way to determine when all tasks have completed? I tried using the app engine pipeline API, but it doesn't look like it's going to work out for my particular use case, even though it is

What is meant by 'bucket-size' of queue in the google app engine?

由 痞子三分冷 提交于 2019-12-04 22:28:41
Google app engine task queues have configuration as (example) <queue> <name>mail-queue</name> <rate>5/m</rate> <bucket-size>10</bucket-size> </queue> Here, what does the 'bucket-size' mean? I could not find a comprehensive documentation about this in google app engine documentation. Does specifying this as 10 means that if 100 tasks are queued at an instant only 10 of those will be put in the queue and rest will be ignored? bucket-size is perfectly described here : Limits the burstiness of the queue's processing, i.e. a higher bucket size allows bigger spikes in the queue's execution rate. For

Java GAE Task Queue CallNotFoundException

由 旧巷老猫 提交于 2019-12-04 17:47:18
When trying to implement a push queue, I am getting the following error: com.google.apphosting.api.ApiProxy$CallNotFoundException: Can't make API call taskqueue.BulkAdd in a thread that is neither the original request thread nor a thread created by ThreadManager Within my servlet's doPost() method, here is my task: Queue queue = QueueFactory.getQueue("rating-queue"); queue.add(TaskOptions.Builder.withUrl("/addrating") .param("function", function) .param("user_id", Integer.toString(user_id)) .param("item_id", Integer.toString(item_id)) .param("is_user", Boolean.toString(isUser))); In my web.xml

Dynamic queue creation with RabbitMQ

由 守給你的承諾、 提交于 2019-12-04 02:59:21
问题 I've been learning RabbitMQ various topologies, however, I couldn't find any reference to dynamic queue creation (aka Declare Queue) emitted from a producer. The idea would be to create queues dynamically depending on a particular event (e.g a HTTP request). The queue would be temporary with a TTL set and named after the event ID. A consumer could then, subscribe to the topic "event.*" and merge all the messages related to it. Example: HTTP POST "Create user" received producer creates a queue
订阅 task-queue