I'm using Dask to process research batches, which are quite heavy (from few minutes to few hours). There's no communication between the tasks and they produce only side results. I'm using a machine which already virtualizes resources beneath it (~ 30 CPUs), so I'm just running LocalCluster
. Is there any way to assign a specific CPU to a task? In docs there're only examples with gpu and memory.
I've tried to assign CPU in a similar way, but the tasks won't even start to process.
client.submit(process, d, resources={'CPU': 1}) for d in data]
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…