Re: Any patterns for multiplexing the streaming data

2014-11-07 Thread Anand Iyer
Hi TD, This is a common pattern that is emerging today. Kafka --> SS --> Kafka. Spark Streaming comes with a built in consumer to read from Kafka. It will be great to have an easy way for users to write back to Kafka without having to code a customer producer using the Kafka Producert APIs. Are

Re: AVRO specific records

2014-11-05 Thread Anand Iyer
You can also use the Kite SDK to read/write Avro records: https://github.com/kite-sdk/kite-examples/tree/master/spark - Anand On Wed, Nov 5, 2014 at 2:24 PM, Laird, Benjamin < benjamin.la...@capitalone.com> wrote: > Something like this works and is how I create an RDD of specific records. > > va