Re: spark streaming filestream API

2015-10-14 Thread Akhil Das
Akhil Das [mailto:ak...@sigmoidanalytics.com] > *Sent:* Wednesday, October 14, 2015 5:31 PM > *To:* Chandra Mohan, Ananda Vel Murugan > *Cc:* user > *Subject:* Re: spark streaming filestream API > > > > Key and Value are the ones that you are using with your InputFormat. Eg:

RE: spark streaming filestream API

2015-10-14 Thread Chandra Mohan, Ananda Vel Murugan
: Re: spark streaming filestream API Key and Value are the ones that you are using with your InputFormat. Eg: JavaReceiverInputDStream lines = jssc.fileStream("/sigmoid", LongWritable.class, Text.class, TextInputFormat.class); TextInputFormat uses the LongWritable as Key and Text as Val

Re: spark streaming filestream API

2015-10-14 Thread Akhil Das
Key and Value are the ones that you are using with your InputFormat. Eg: JavaReceiverInputDStream lines = jssc.fileStream("/sigmoid", LongWritable.class, Text.class, TextInputFormat.class); TextInputFormat uses the LongWritable as Key and Text as Value classes. If your data is plain CSV or text