Re: [ANNOUNCE] Announcing Apache Spark 2.4.1

2019-04-04 Thread Andrew Melo
Hello, I'm not sure if this is the proper place to report it, but the 2.4.1 version of the config docs apparently didn't render right into HTML (scroll down to "Compression and Serialization") https://spark.apache.org/docs/2.4.1/configuration.html#available-properties By comparison, the 2.4.0 ve

[ANNOUNCE] Announcing Apache Spark 2.4.1

2019-04-04 Thread DB Tsai
+user list We are happy to announce the availability of Spark 2.4.1! Apache Spark 2.4.1 is a maintenance release, based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4.0 users to upgrade to this stable release. In Apache Spark 2.4.1, Scala 2.12 support is GA, and it'

DataSourceV2 sync 3 April 2019

2019-04-04 Thread Ryan Blue
Hi everyone, here are my notes from last night’s DSv2 sync. As usual, please reply with comments or corrections. Sorry for the lack of notes for the last meeting. I lost them when my laptop battery died. rb *Topics*: - Open pull requests - PR #24233: Remove SaveMode ( https://gi

[ANNOUNCE] Announcing Apache Spark 2.4.1

2019-04-04 Thread DB Tsai
We are happy to announce the availability of Spark 2.4.1! Apache Spark 2.4.1 is a maintenance release, based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4.0 users to upgrade to this stable release. In Apache Spark 2.4.1, Scala 2.12 support is GA, and it's no longer