When I run gensim's LdaMulticore
model on a machine with 12 cores, using:
lda = LdaMulticore(corpus, num_topics=64, workers=10)
I get a logging message that says
using serial LDA version on this node
A few lines later, I see another loging message that says
training LDA model using 10 processes
When I run top, I see 11 python processes have been spawned, but 9 are sleeping, I.e. only one worker is active. The machine has 24 cores, and is not overwhelmed by any means. Why isn't LdaMulticore running in parallel mode?
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…