Paul's Programming Notes     Archive     Feed     Github

Celery - Tuning worker_prefetch_multiplier

I came across an interesting article that talks about speeding up the processing of fast running celery tasks by tuning worker_prefetch_multiplier: https://www.lorenzogil.com/blog/2020/03/01/celery-tasks/

The default scheduling strategy in Celery is now “fair”, so part of the article doesn’t apply anymore.