Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

2018-01-21 Thread Jacek Laskowski
Hi, http://spark.apache.org/developer-tools.html#nightly-builds reads: > Spark nightly packages are available at: > Latest master build: https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest but the URL gives 404. Is this intended? Pozdrawiam, Jacek Laskowski https://ab

Work-in-progress PySpark dependency management package (external)

2018-01-21 Thread Holden Karau
Hi Y'all, Over the past few years a lot of people have talked to me about their difficulty managing dependencies with PySpark. Some folks and I (not as part of the official Spark project or anything official like that) put together a quick proof-of-concept library called "coffee-boat" to make it a