Yes, socketTextStream starts a TCP client that tries to connect to a TCP server (localhost:9999 in your case). If there is a server running on that port that can send data to connected TCP connections, then you will receive data in the stream.
Did you check out the quick example in the streaming programming guide? http://spark.apache.org/docs/latest/streaming-programming-guide.html That has instructions to start a netcat server on port 9999 and send data to spark streaming through that. TD On Fri, Dec 12, 2014 at 9:54 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > socketTextStream is Socket client which will read from a TCP ServerSocket. > > Thanks > Best Regards > > On Fri, Dec 12, 2014 at 7:21 PM, Guillermo Ortiz <konstt2...@gmail.com> > wrote: >> >> I dont' understand what spark streaming socketTextStream is waiting... >> is it like a server so you just have to send data from a client?? or >> what's it excepting? >> >> 2014-12-12 14:19 GMT+01:00 Akhil Das <ak...@sigmoidanalytics.com>: >> > I have created a Serversocket program which you can find over here >> > https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to >> > the >> > given port and when the client connects, it will send the contents of >> > the >> > given file. I'm attaching the executable jar also, you can run the jar >> > as: >> > >> > java -jar SocketBenchmark.jar student 12345 io >> > >> > Here student is the file which will be sent to the client whoever >> > connects >> > on 12345, i have it tested and is working with SparkStreaming >> > (socketTextStream). >> > >> > >> > Thanks >> > Best Regards >> > >> > On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <konstt2...@gmail.com> >> > wrote: >> >> >> >> Hi, >> >> >> >> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and >> >> filter some data sent with a Java Socket but it's not working... it >> >> works when I use ncat >> >> >> >> Why is it not working?? >> >> >> >> My sparkcode is just this: >> >> val sparkConf = new >> >> SparkConf().setMaster("local[2]").setAppName("Test") >> >> val ssc = new StreamingContext(sparkConf, Seconds(5)) >> >> val lines = ssc.socketTextStream("localhost", 9999) >> >> val errorLines = lines.filter(_.contains("hello")) >> >> errorLines.print() >> >> >> >> I created a client socket which sends data to that port, but it could >> >> connect any address, I guess that Spark doesn't work like a >> >> serverSocket... what's the way to send data from a socket with Java to >> >> be able to read from socketTextStream?? >> >> >> >> --------------------------------------------------------------------- >> >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >> > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
