Re: kerberos auth for MS SQL server jdbc driver

2018-10-16 Thread Foster Langbein
elo Vanzin > *Sent:* Monday, October 15, 2018 18:32 > *To:* foster.langb...@riskfrontiers.com > *Cc:* user > *Subject:* Re: kerberos auth for MS SQL server jdbc driver > > > > Spark only does Kerberos authentication on the driver. For executors it > currently only suppo

Re: kerberos auth for MS SQL server jdbc driver

2018-10-16 Thread Foster Langbein
Thanks Marcelo, that makes a lot of sense to me now. Do you know if there are any plans to expand Kerberos auth to the executors? The current executor behaviour is quite curious - you can see in the trace information that it consumes the jaas conf file and keytab (indeed they're required - it will

RE: kerberos auth for MS SQL server jdbc driver

2018-10-15 Thread Luca Canali
://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Spark_Executors_Kerberos_HowTo.md Regards, Luca From: Marcelo Vanzin Sent: Monday, October 15, 2018 18:32 To: foster.langb...@riskfrontiers.com Cc: user Subject: Re: kerberos auth for MS SQL server jdbc driver Spark only does Kerberos

Re: kerberos auth for MS SQL server jdbc driver

2018-10-15 Thread Marcelo Vanzin
Spark only does Kerberos authentication on the driver. For executors it currently only supports Hadoop's delegation tokens for Kerberos. To use something that does not support delegation tokens you have to manually manage the Kerberos login in your code that runs in executors, which might be trick

kerberos auth for MS SQL server jdbc driver

2018-10-15 Thread Foster Langbein
Has anyone gotten spark to write to SQL server using Kerberos authentication with Microsoft's JDBC driver? I'm having limited success, though in theory it should work. I'm using a YARN-mode 4-node Spark 2.3.0 cluster and trying to write a simple table to SQL Server 2016. I can get it to work if I