pandas - How to use TF-IDF in PMID columns

Question

Dataframe:

Code:

def word_count(sentence):
    return len(sentence.split())
    
df['word_count'] = df['PMID'].apply(word_count)
df.tail(10)

question from:https://stackoverflow.com/questions/65900684/how-to-use-tf-idf-in-pmid-columns

Answer 1

You can make use of TfidfVectorizer.

from sklearn.feature_extraction.text import TfidfVectorizer

v = TfidfVectorizer()
x = v.fit_transform(df['PMID'])