I dont' understand what spark streaming socketTextStream is waiting... is it like a server so you just have to send data from a client?? or what's it excepting?
2014-12-12 14:19 GMT+01:00 Akhil Das <[email protected]>: > I have created a Serversocket program which you can find over here > https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to the > given port and when the client connects, it will send the contents of the > given file. I'm attaching the executable jar also, you can run the jar as: > > java -jar SocketBenchmark.jar student 12345 io > > Here student is the file which will be sent to the client whoever connects > on 12345, i have it tested and is working with SparkStreaming > (socketTextStream). > > > Thanks > Best Regards > > On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <[email protected]> > wrote: >> >> Hi, >> >> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and >> filter some data sent with a Java Socket but it's not working... it >> works when I use ncat >> >> Why is it not working?? >> >> My sparkcode is just this: >> val sparkConf = new >> SparkConf().setMaster("local[2]").setAppName("Test") >> val ssc = new StreamingContext(sparkConf, Seconds(5)) >> val lines = ssc.socketTextStream("localhost", 9999) >> val errorLines = lines.filter(_.contains("hello")) >> errorLines.print() >> >> I created a client socket which sends data to that port, but it could >> connect any address, I guess that Spark doesn't work like a >> serverSocket... what's the way to send data from a socket with Java to >> be able to read from socketTextStream?? >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
