The following seems to have worked for a few people so I'm submitting it as the answer:
python manage.py celerybeat --pidfile= --schedule=/var/my_app/celerybeat-schedule
--pidfile=
(an empty string as the pidfile arg) seems to stop one being created.
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…