Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

2017-08-18 Thread Sathish Jayaraman
Hey Aviem, Thank you for noticing. You were right, I was able to run all my jobs in Spark 1.6.3. You are awesome!!! Regards, Sathish. J On 16-Aug-2017, at 3:23 PM, Aviem Zur mailto:aviem...@gmail.com>> wrote: 2.0.0. I really doubt if its Spark setup issue. I wrote a native Spark applicatio

Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

2017-08-03 Thread Sathish Jayaraman
Hi, Thanks for trying it out. I was running the job in local single node setup. I also spawn a HDInsights cluster in Azure platform just to test the WordCount program. Its the same result there too, stuck at the Evaluating ParMultiDo step. It runs fine in mvn compile exec, but when bundled int

Re: Spark job hangs up at Evaluating ParMultiDo(ParseInput)

2017-08-03 Thread Sathish Jayaraman
ltiDo(ExtractWords)’. Regards, Sathish. J On 01-Aug-2017, at 4:16 PM, Sathish Jayaraman mailto:sath...@quartic.ai>> wrote: Hi JB, Not when I submit is using the option —master local. But when I submit with with spark master’s port, The job executes and hangs at step 'Registerin

Spark job hangs up at Evaluating ParMultiDo(ParseInput)

2017-08-01 Thread Sathish Jayaraman
Hi, I am trying to execute Beam example in local spark setup. When I try to submit the sample WordCount jar via spark-submit, the job just hangs at 'INFO SparkRunner$Evaluator: Evaluating ParMultiDo(ExtractWords)’. But it runs fine when executed directly. Below is the command I used to submit t