Re: Spark-Streaming: output to cassandra

2014-12-05 Thread m.sarosh
eam to List. Thanks and Regards, Md. Aiman Sarosh. Accenture Services Pvt. Ltd. Mob #: (+91) - 9836112841. From: Helena Edelson Sent: Friday, December 5, 2014 9:12 PM To: Sarosh, M. Cc: user Subject: Re: Spark-Streaming: output to cassandra I think

Re: Spark-Streaming: output to cassandra

2014-12-05 Thread Helena Edelson
String>() > { > public List call(Tuple2 message) > { > String k = message._1(); > String v = message._2(); > TestTable tbl = new TestTable(k,v); > list.put(tbl); > } > } > ); > but seems some type mis-match happenning. > Please help. > > > > > Th

Re: Spark-Streaming: output to cassandra

2014-12-05 Thread m.sarosh
s and Regards, Md. Aiman Sarosh. Accenture Services Pvt. Ltd. Mob #: (+91) - 9836112841. ________ From: Helena Edelson Sent: Friday, December 5, 2014 6:26 PM To: Sarosh, M. Cc: user@spark.apache.org Subject: Re: Spark-Streaming: output to cassandra You can just d

Re: Spark-Streaming: output to cassandra

2014-12-05 Thread Helena Edelson
You can just do You can just do something like this, the Spark Cassandra Connector handles the rest KafkaUtils.createStream[String, String, StringDecoder, StringDecoder]( ssc, kafkaParams, Map(KafkaTopicRaw -> 10), StorageLevel.DISK_ONLY_2) .map { case (_, line) => line.split(",")} .map(Ra

Re: Spark-Streaming: output to cassandra

2014-12-05 Thread Jay Vyas
B and >> killing it. So its a kind of ungraceful termination. So in this case will >> the data in my App DStream get written into Cassandra? >> >> >> >> Thanks and Regards, >> >> Md. Aiman Sarosh. >> Accenture Services Pvt. Ltd. >> Mob #

Re: Spark-Streaming: output to cassandra

2014-12-04 Thread Akhil Das
ata in my App DStream get written into Cassandra? > > > > >Thanks and Regards, > > *Md. Aiman Sarosh.* > Accenture Services Pvt. Ltd. > Mob #: (+91) - 9836112841. >------ > *From:* Gerard Maas > *Sent:* Thursday, December 4, 2014 10:

Re: Spark-Streaming: output to cassandra

2014-12-04 Thread m.sarosh
_ From: Gerard Maas Sent: Thursday, December 4, 2014 10:22 PM To: Akhil Das Cc: Sarosh, M.; user@spark.apache.org Subject: Re: Spark-Streaming: output to cassandra I guess he's already doing so, given the 'saveToCassandra' usage. What I don't understand is the question "ho

Re: Spark-Streaming: output to cassandra

2014-12-04 Thread Gerard Maas
I guess he's already doing so, given the 'saveToCassandra' usage. What I don't understand is the question "how do I specify a batch". That doesn't make much sense to me. Could you explain further? -kr, Gerard. On Thu, Dec 4, 2014 at 5:36 PM, Akhil Das wrote: > You can use the datastax's Cassand

Re: Spark-Streaming: output to cassandra

2014-12-04 Thread Akhil Das
You can use the datastax's Cassandra connector. Thanks Best Regards On Thu, Dec 4, 2014 at 8:21 PM, wrote: > Hi, > > > I have written the code below which is streaming data from kafka, and > printing to the co