Hi,
I cloned spark master branch from github and was built successfully
using the mvn -DskipTests clean package command.
But the python/run-tests command fails. Please see the log below:
Running PySpark tests. Output is in python/unit-tests.log.
Testing with Python version:
Python 2.7.3
Run core tests ...
Running test: pyspark/rdd.py
Running test: pyspark/context.py
Running test: pyspark/conf.py
Running test: pyspark/broadcast.py
Running test: pyspark/accumulators.py
Running test: pyspark/serializers.py
Running test: pyspark/profiler.py
Running test: pyspark/shuffle.py
Running test: pyspark/tests.py
Run sql tests ...
Running test: pyspark/sql/_types.py
Running test: pyspark/sql/context.py
Running test: pyspark/sql/dataframe.py
Running test: pyspark/sql/functions.py
Running test: pyspark/sql/tests.py
Run mllib tests ...
Running test: pyspark/mllib/classification.py
Running test: pyspark/mllib/clustering.py
Running test: pyspark/mllib/evaluation.py
Running test: pyspark/mllib/feature.py
Running test: pyspark/mllib/fpm.py
Running test: pyspark/mllib/linalg.py
Running test: pyspark/mllib/rand.py
Running test: pyspark/mllib/recommendation.py
Running test: pyspark/mllib/regression.py
Running test: pyspark/mllib/stat/_statistics.py
Running test: pyspark/mllib/tree.py
Running test: pyspark/mllib/util.py
Running test: pyspark/mllib/tests.py
Run ml tests ...
Running test: pyspark/ml/feature.py
Running test: pyspark/ml/classification.py
Running test: pyspark/ml/tests.py
Run streaming tests ...
Failed to find Spark Streaming Kafka assembly jar in
/home/xyz/spark/external/kafka-assembly
You need to build Spark with 'build/sbt assembly/assembly
streaming-kafka-assembly/assembly' or 'build/mvn package' before running
this program
Is anybody facing the same problem?
Regards,
Hrishikesh
