RE: Kicking off the process around Spark 2.2.1

2017-11-02 Thread Kevin Grealish
Any update on expected 2.2.1 (or 2.3.0) release process? From: Felix Cheung [mailto:felixcheun...@hotmail.com] Sent: Thursday, October 26, 2017 10:04 AM To: Sean Owen ; Holden Karau Cc: dev@spark.apache.org Subject: Re: Kicking off the process around Spark 2.2.1 Yes! I can take on RM for 2.2.1.

regression: no longer able to use HDFS wasbs:// path for additional python files on LIVY batch submit

2016-09-30 Thread Kevin Grealish
I'm seeing a regression when submitting a batch PySpark program with additional files using LIVY. This is YARN cluster mode. The program files are placed into the mounted Azure Storage before making the call to LIVY. This is happening from an application which has credentials for the storage and

RE: regression: no longer able to use HDFS wasbs:// path for additional python files on LIVY batch submit

2016-10-03 Thread Kevin Grealish
Great. Thanks for the pointer. I see the fix is in 2.0.1-rc4. Will there be a 1.6.3? If so, how are fixes considered for backporting? From: Steve Loughran [mailto:ste...@hortonworks.com] Sent: Monday, October 3, 2016 5:40 AM To: Kevin Grealish Cc: Apache Spark Dev Subject: Re: regression: no