SF Django Meetup: Asynchronous Events and Architecture

Rudy Mutter

February 4, 2015

Last month, we met on January 28th at InfoScout's offices to hear from their head engineer and co-founder, Jon Brelig about how they architected their asynchronous operations.

‍

Usual Suspects

InfoScout, along with many other companies needing to implement asynchronous functions with Django use Celery and RabbitMQ. We got a quick walkthrough of the parts needed to set up celery with Django and how do you denote a method that should be run asynchronously.

Takeaways

There was some great insight if you plan on implementing celery for your Django application soon:

Set up different boxes for running asynchronous tasks based on what those tasks are doing
Create separate high priority and low priority queues
Do not pass ORM objects to asynchronous tasks, preferrably send the primary key and let the task fetch it from the database
Use Flower to monitor the status of your queue
Keep your tasks small so if they fail, they will fail fast. Retried failed tasks, won't have to redo a lot of work.

Meetup, Slides, InfoScout

Rudy Mutter is a CTO + Founding Partner at Yeti. He found his passion for technology as a youth, spending his childhood developing games and coding websites. Rudy now resides in the Yeti Cave where he architects Yeti’s system and heads up project production.

Connect with Rudy on Linkedin

You Might also like...

Shopify Checkout Using UI Extensions

At Yeti we recently created a custom Shopify App using Checkout UI extensions to pull real-time data from a client’s Enterprise Resource Planning (ERP) system into Shopify. By the end of this article you will better understand what Shopify Checkout UI extensions are, how to approach building them, and some of the things to keep in mind during the implementation process.

An Introduction to Neural Networks

Join James McNamara in this insightful talk as he navigates the intricate world of neural networks, deep learning, and artificial intelligence. From the evolution of architectures like CNNs and RNNs to groundbreaking techniques like word embeddings and transformers, discover the transformative impact of AI in image recognition, natural language processing, and even coding assistance.

The Symbolicon: My Journey to an Ineffective 10-key Keyboard

Join developer Jonny in exploring the Symbolicon, a unique 10-key custom keyboard inspired by the Braille alphabet. Delve into the conceptualization, ideas, and the hands-on process of building this unique keyboard!

SF Django Meetup: Asynchronous Events and Architecture

Usual Suspects

Takeaways

You Might also like...

Ready for your new product adventure?

Let’s Talk

Company

SF Django Meetup: Asynchronous Events and Architecture

Usual Suspects

Takeaways

You Might also like...

Ready for your new product adventure?

Let’s Talk

Company

Join 10K+ people getting helpful guides, exciting case studies and much more in our newsletter.

Connect with Yeti