Decision Tree Model

2015-10-01 Thread hishamm
Hi, I am using SPARK 1.4.0, Python and Decision Trees to perform machine learning classification. I test it by creating the predictions and zip it to the test data, as following: *predictions = tree_model.predict(test_data.map(lambda a: a.features)) labels = test_data.map(lambda a: a.label).z

spark-submit in deployment mode with the "--jars" option

2015-06-28 Thread hishamm
Hi, I want to deploy my application on a standalone cluster. Spark submit acts in strange way. When I deploy the application in *"client"* mode, everything works well and my application can see the additional jar files. Here is the command: > spark-submit --master spark://1.2.3.4:7077 --deplo