Re: Spark Streaming reads from stdin or output from command line utility

2015-06-12 Thread Gerard Maas
From: Tathagata Das > Date: Thursday, June 11, 2015 at 11:43 PM > > To: Heath Guo > Cc: user > Subject: Re: Spark Streaming reads from stdin or output from command line > utility > > Is it a lot of data that is expected to come through stdin? I mean is > it even worth

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Heath Guo
15 at 8:11 PM To: Heath Guo mailto:heath...@fb.com>> Cc: user mailto:user@spark.apache.org>> Subject: Re: Spark Streaming reads from stdin or output from command line utility Are you going to receive data from one stdin from one machine, or many stdins on many machines? On Thu, Jun

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Tathagata Das
so I'm working with Scala. > It would be great if you could talk about multi stdin case as well! > Thanks. > > From: Tathagata Das > Date: Thursday, June 11, 2015 at 8:11 PM > To: Heath Guo > Cc: user > Subject: Re: Spark Streaming reads from stdin or output from c

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Heath Guo
: Heath Guo mailto:heath...@fb.com>> Cc: user mailto:user@spark.apache.org>> Subject: Re: Spark Streaming reads from stdin or output from command line utility Are you going to receive data from one stdin from one machine, or many stdins on many machines? On Thu, Jun 11, 2015 at 7:25 P

Re: Spark Streaming reads from stdin or output from command line utility

2015-06-11 Thread Tathagata Das
Are you going to receive data from one stdin from one machine, or many stdins on many machines? On Thu, Jun 11, 2015 at 7:25 PM, foobar wrote: > Hi, I'm new to Spark Streaming, and I want to create a application where > Spark Streaming could create DStream from stdin. Basically I have a command