socketTextStream is Socket client which will read from a TCP ServerSocket. Thanks Best Regards
On Fri, Dec 12, 2014 at 7:21 PM, Guillermo Ortiz <[email protected]> wrote: > > I dont' understand what spark streaming socketTextStream is waiting... > is it like a server so you just have to send data from a client?? or > what's it excepting? > > 2014-12-12 14:19 GMT+01:00 Akhil Das <[email protected]>: > > I have created a Serversocket program which you can find over here > > https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to > the > > given port and when the client connects, it will send the contents of the > > given file. I'm attaching the executable jar also, you can run the jar > as: > > > > java -jar SocketBenchmark.jar student 12345 io > > > > Here student is the file which will be sent to the client whoever > connects > > on 12345, i have it tested and is working with SparkStreaming > > (socketTextStream). > > > > > > Thanks > > Best Regards > > > > On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <[email protected]> > > wrote: > >> > >> Hi, > >> > >> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and > >> filter some data sent with a Java Socket but it's not working... it > >> works when I use ncat > >> > >> Why is it not working?? > >> > >> My sparkcode is just this: > >> val sparkConf = new > >> SparkConf().setMaster("local[2]").setAppName("Test") > >> val ssc = new StreamingContext(sparkConf, Seconds(5)) > >> val lines = ssc.socketTextStream("localhost", 9999) > >> val errorLines = lines.filter(_.contains("hello")) > >> errorLines.print() > >> > >> I created a client socket which sends data to that port, but it could > >> connect any address, I guess that Spark doesn't work like a > >> serverSocket... what's the way to send data from a socket with Java to > >> be able to read from socketTextStream?? > >> > >> --------------------------------------------------------------------- > >> To unsubscribe, e-mail: [email protected] > >> For additional commands, e-mail: [email protected] > >> > > >
