Re: Problem with File Streams

2015-01-17 Thread Leonidas Fegaras
My key/value classes are custom serializable classes. It looks like a bug. So I filed it on JIRA as SPARK-5297 Thanks Leonidas On 01/17/2015 03:07 AM, Akhil Das wrote: Try: JavaPairDStream foo = ssc.fileStream("/sigmoid/foo"); Thanks Best Regards On Sat, Jan 17, 2015 at 4:24 AM, Leonida

Re: Problem with File Streams

2015-01-17 Thread Akhil Das
Try: JavaPairDStream foo = ssc.fileStream("/sigmoid/foo"); Thanks Best Regards On Sat, Jan 17, 2015 at 4:24 AM, Leonidas Fegaras wrote: > Dear Spark users, > I have a problem using File Streams in Java on Spark 1.2.0. I can process > hadoop files in local mode using: > > spark_context.newAPI