sidekiq

I'm working on extrapolating an extensive background task to a sidekiq worker (first time working with sidekiq). I've been able to get this to run correctly. But I'm not sure how to check on the progress of the sidekiq worker - what's the best way to check to see if the worker is done with the perform_async function? AutoWorker sidekiq task: class AutoWorker include Sidekiq::Worker def perform(lead_id, cars) logger.info "WORKER CREATED" lead = Lead.find(lead_id) response = ZipCodeCheck.new(cars: cars, lead: lead).execute end end called from my controller: def update respond_to do |format| if

Lets say I have a Sidekiq task that processes products to my database. Each product is grouped by store, so an overly simplified example of my code would be something like this... stores.each do |store| store.products.each do |product| ProductWorker.perform_async(product.id) end end When all the products from one store have run. I'd like to update the stores last_updated column with the current time. But only when the last task for that store has run. How can I achieve this? This is exactly what Sidekiq Pro's Batches feature is designed to solve: https://github.com/mperham/sidekiq/wiki/Batches

Is there a way to get a list of all the jobs currently in the queue and running? Basically, I want to know if a job of given class is already there, I don't want to insert my other job. I've seen other option but I want to do it this way. I can see here how to get the list of jobs in the queue. queue = Sidekiq::Queue.new("mailer") queue.each do |job| job.klass # => 'MyWorker' end from what I understand this will not include processing/running jobs. Any way to get them? if you want to list all currently running jobs from console, try this workers = Sidekiq::Workers.new workers.each do |_process

I have several scheduled jobs running like this: MyWorker.perform_at(3.hours.from_now, 'mike', 1) I am wondering, if later, say an hour later, I feel like I want to cancel this job, how would I go about doing that? I've recently written a bit of code to handle this, it's available in my branch of the sidekiq-status gem. You can view it, or use it here: https://github.com/Robinson7D/sidekiq-status (You would have to use that as the git: information in the gemfile, currently, until the main fork of the project implements this) To use it, first you store the job_identifier: job_identifier =

I'm not familiar with the internals of Sidekiq and am wondering if it's okay to launch several Sidekiq instances with the same configuration (processing the same queues). Is it possible that 2 or more Sidekiq instances will process the same message from a queue? UPDATE: I need to know if there is a possible conflict, when running Sidekiq on more than 1 machine Yes, sidekiq can absolutely run many processes against the same queue. Redis will just give the message to a random process. Nope, I've ran Sidekiqs in different machines with no issues. Each of the Sidekiqs read from the same redis

I asked two additional questions before this on Stack Overflow, but got very little help and I thought I would ask an open question for posterity. I have spent time parsing the AWS-SDK API docs and found very little direct answers to my needs. I have also posted on the AWS forums and haven't been able to get a good response there. A simple, comprehensive, step-by-step solution seems impossible to find. What I have completed: Uploading with CarrierWave direct to s3. I followed Railscast #383 and adapted it to my needs. I am able to "retrieve" my files from my s3 bucket. Details about what I've