Re: Benchmark Java/Scala/Python for Apache spark

2019-03-11 Thread Dylan Guedes
Btw, even if you are using Python you can register your UDFs in Scala and use them in Python. On Mon, Mar 11, 2019 at 6:55 AM Jonathan Winandy wrote: > Hello Snehasish > > If you are not using UDFs, you will have very similar performance with > those languages on SQL. > > So it go down to : > *

Build does not generate kafka-0-8-assembly jar

2018-03-08 Thread Dylan Guedes
Hello, I'm trying to run the python tests using the `run-tests` script, but I'm experiencing the following error: Exception: Failed to find Spark Streaming kafka assembly jar in /home/dguedes/Downloads/spark/external/kafka-0-8-assembly. You need to build Spark with 'build/sbt assembly/package str