Re: Start python script with SparkLauncher

2015-11-11 Thread Andrejs
Thanks Ted, that helped me, it turned out that I wrongly formated the name of the server, I had to add spark:// in front of server name. Cheers, Andrejs On 11/11/15 14:26, Ted Yu wrote: Please take a look at launcher/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java to see how ap

Re: Start python script with SparkLauncher

2015-11-11 Thread Ted Yu
Please take a look at launcher/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java to see how app.getInputStream() and app.getErrorStream() are handled. In master branch, the Suite is located at core/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java FYI On Wed, Nov 11,

Start python script with SparkLauncher

2015-11-11 Thread Andrejs
Hi all, I'm trying to call a python script from a scala application. Below is part of my code. My problem is that it doesn't work, but it also doesn't provide any error message, so I can't debug it. val spark =new SparkLauncher().setSparkHome("/home/user/spark-1.4.1-bin-hadoop2.6") .setApp