I've a python celery-redis queue processing uploads and downloads worth gigs and gigs of data at a time.
Few of the uploads takes upto few hours. However once such a task finishes, I'm witnessing this bizarre celery behaviour that the celery scheduler is rerunning the just concluded task again by sending it again to the worker (I'm running a single worker) And it just happened 2times on the same task!
Can someone help me know why is this happening and how can I prevent it?
The tasks are definitely finishing cleanly with no errors reported just that these are extremely long running tasks.
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…