Say you need to send out an email campaign ASAP to a gagillion users and the time window when people generally respond to emails is quickly shrinking.
What do you do? Start a Resque worker for each campaign of 10K users or so instead of just letting the campaigns send on one process for hours.
Log onto the machine where you want the workers to run and use this command:
bundle exec env RAILS_ENV=production COUNT=4 QUEUE=campaign_urgent rake environment resque:workers
COUNT is the number of workers you want to start. When using COUNT, be sure to use the rake task "resque:workers" instead of "resque:work"
To start a single resque worker, use this command:
bundle exec env RAILS_ENV=production QUEUE=campaign_urgent rake environment resque:work
When doing this, I recommend using screen so that if you want to get out of your terminal window while the jobs are running your workers won't die. When you log onto the machine for the workers,
- start your worker(s) using the above commands
- detach from screen using ctrl + a and ctrl + d
Define your Job to run on the new fancy workers
class Jobs::SendUrgentCampaignEmail @queue = :campaign_urgent def self.perform(campaign_id) # mail out your campaign end end
It is important that the @queue variable in the job you define matches the QUEUE that you set up in the resque:workers task. This is how the worker knows to grab this job. Now that you have your workers started up, queue up a job. In Console on the machine with the workers, run:
Resque.enqueue(Jobs::SendUrgentCampaignEmail, campaign.id)
When your jobs are all done, re-attach to screen and kill your excess workers
`screen -list` to see all screens
`screen -D -r '1234.name_of_screen'` to reattach to the screen
In a console, remove the urgent queue you made for this task
>> queue_name = "campaign_urgent"
>> Resque.remove_queue(queue_name)
jbbartram-illu
izzy806
pixelskylines
discoholicmusic
tangentwithtanner
prguitarman
