There are 4 cores on my system.
Running spark with setMaster("local[2]") results in:
PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+
COMMAND
7 root 20
OK, sorry, I am running in local mode.
Just a very small setup...
(changed the subject)
On 25.07.2016 20:01, Mich Talebzadeh wrote:
> Hi,
>
> From your reference I can see that you are running in local mode with
> two cores. But that is not standalone.
>
> Can you please c
Dear all,
I am running spark on one host ("local[2]") doing calculations like this
on a socket stream.
mainStream = socketStream.filter(lambda msg:
msg['header'].startswith('test')).map(lambda x: (x['host'], x) )
s1 = mainStream.updateStateByKe
