python - Save pysaprk dataframe in libsvm format to s3

Question

I have a pyspark data frame with two columns - features and label.

features is a sparse vector I have created after multiple transformations and finally used vectorassembler. I want to write this dataframe to s3 in libsvm format but I am struggling to get any leads on how to do that.

Edit 1: Looking for a solution without converting the dataframe to RDD

question from:https://stackoverflow.com/questions/65841862/save-pysaprk-dataframe-in-libsvm-format-to-s3

Answer 1

Waitting for answers