Writing Integration test with Embedded Kafka

2020-03-06 Thread Something Something
I am trying to write an integration test using Embedded Kafka but I keep getting NullPointerException. My test case is very simple. It has following steps: 1. Read a JSON file & write messages to an inputTopic. 2. Perform a 'readStream' operation. 3. Do a 'select' on the Stream. This thro

Re: Integrating Kafka with Stateful Spark Streaming

2020-03-04 Thread Something Something
By simply adding 'toJSON' before 'writeStream' the problem was fixed. Maybe it will help someone. On Wed, Mar 4, 2020 at 10:38 AM Something Something < mailinglist...@gmail.com> wrote: > Yes, I have. No response from them. I thought someone in Kafka community &g

Re: Integrating Kafka with Stateful Spark Streaming

2020-03-04 Thread Something Something
symptom to Kafka. > > Boyang > > On Wed, Mar 4, 2020 at 7:37 AM Something Something < > mailinglist...@gmail.com> > wrote: > > > Need help integrating Kafka with 'Stateful Spark Streaming' application. > > > > In a Stateful Spark Streaming application

Integrating Kafka with Stateful Spark Streaming

2020-03-04 Thread Something Something
Need help integrating Kafka with 'Stateful Spark Streaming' application. In a Stateful Spark Streaming application I am writing the 'OutputRow' in the 'updateAcrossEvents' but I keep getting this error (*Required attribute 'value' not found*) while it's trying to write to Kafka. I know from the do

Re: JavaKafkaWordCount not working under Spark Streaming

2014-11-10 Thread Something Something
I am not running locally. The Spark master is: "spark://:7077" On Mon, Nov 10, 2014 at 3:47 PM, Tathagata Das wrote: > What is the Spark master that you are using. Use local[4], not local > if you are running locally. > > On Mon, Nov 10, 2014 at 3:01 PM, Something Som

JavaKafkaWordCount not working under Spark Streaming

2014-11-10 Thread Something Something
I am embarrassed to admit but I can't get a basic 'word count' to work under Kafka/Spark streaming. My code looks like this. I don't see any word counts in console output. Also, don't see any output in UI. Needless to say, I am newbie in both 'Spark' as well as 'Kafka'. Please help. Thanks.

Re: Adding Kafka dependencies in Play Framework

2013-11-25 Thread Something Something
= "com.sun.jmx"), ExclusionRule(organization = "javax.jms"), ExclusionRule(organization = "org.slf4j") ) ) play.Project.playScalaSettings On Mon, Nov 25, 2013 at 8:28 AM, Something Something < mailinglist...@gmail.com> wrote: > Getting this error message w

Re: Adding Kafka dependencies in Play Framework

2013-11-25 Thread Something Something
ert" % "1.3.1", >"ch.qos.logback" % "logback-classic" % "1.0.13", >"org.mashupbots.socko" % "socko-webserver_2.9.2" % "0.2.2", >"nl.grons" % "metrics-scala_2.9.2" % "3.0.0",

Adding Kafka dependencies in Play Framework

2013-11-24 Thread Something Something
Let me start off by saying I am a newbie to Kafka, Play as well as Scala. Trying to write an application under Play Framework in which an 'Actor' will write a message to Kafka queue. There's sample code available under ./core/src/main/scala/kafka/producer/ConsoleProducer.scala for me to copy, so