SF Django Meetup: Asynchronous Events and Architecture

Usual Suspects

InfoScout, along with many other companies needing to implement asynchronous functions with Django use Celery and RabbitMQ. We got a quick walkthrough of the parts needed to set up celery with Django and how do you denote a method that should be run asynchronously.

Takeaways

There was some great insight if you plan on implementing celery for your Django application soon:

• Set up different boxes for running asynchronous tasks based on what those tasks are doing
• Create separate high priority and low priority queues
• Do not pass ORM objects to asynchronous tasks, preferrably send the primary key and let the task fetch it from the database
• Use Flower to monitor the status of your queue
• Keep your tasks small so if they fail, they will fail fast. Retried failed tasks, won't have to redo a lot of work.

Meetup, Slides, InfoScout