I got stuck into an issue which already has wasted 3 days of mine. I have a dataproc cluster 1.5 and i also did setup SQL Server on google VM running centos 7 OS. But i am unable to connect SQL Server through pyspark from dataproc cluster. You can find the error snapshot in the attachment. SSL encryption is disabled on SQL server. I can access SQL server through sqlcmd(installed on dataproc cluster) and also through PYMSSQL library from dataproc cluster. But not with pyspark. The same error occurs while trying to access MSSQL from Sqoop as well.
Kindly, guide me i have tried all possible solution available on internet but still no luck for me.
Thanks in advance.
My Connection String is:
df = spark.read.format("jdbc")
.option("url", "jdbc:sqlserver://x.x.x.x:1433;encrypt=false;databaseName=gcp")
.option("dbtable", "xxx")
.option("user", "xxx")
.option("password", "xxxx")
.option("driver", "com.microsoft.sqlserver.jdbc.SQLServerDriver").load()
Connection Error Snapshot
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…