Re: Re: Spark streaming doesn't print output when working with standalone master

Thanks Akhil. From: Akhil Das Date: 2015-02-20 16:29 To: bit1...@163.com CC: user Subject: Re: Re: Spark streaming doesn't print output when working with standalone master local[3] spawns 3 threads on 1 core :) Thanks Best Regards On Fri, Feb 20, 2015 at 12:50 PM, bit1...@163.com

Re: Re: Spark streaming doesn't print output when working with standalone master

ecutor > as --master local[3] --executor-memory 512M --total-executor-cores 3. Since > I have only one core, why does this work? > > -- > bit1...@163.com > > > *From:* Akhil Das > *Date:* 2015-02-20 15:13 > *To:* bit1...@163.com > *CC:*

Re: Re: Spark streaming doesn't print output when working with standalone master

Das Date: 2015-02-20 15:13 To: bit1...@163.com CC: user Subject: Re: Spark streaming doesn't print output when working with standalone master While running the program go to your clusters webUI (that runs on 8080, prolly at hadoop.master:8080) and see how many cores are allocated to the pr

Re: Spark streaming doesn't print output when working with standalone master

While running the program go to your clusters webUI (that runs on 8080, prolly at hadoop.master:8080) and see how many cores are allocated to the program, it should be >= 2 for the stream to get processed. [image: Inline image 1] Thanks Best Regards On Fri, Feb 20, 2015 at 9:29 AM, bit1...@16

Spark streaming doesn't print output when working with standalone master

Hi, I am trying the spark streaming log analysis reference application provided by Databricks at https://github.com/databricks/reference-apps/tree/master/logs_analyzer When I deploy the code to the standalone cluster, there is no output at will with the following shell script.Which means, the w