Thanks, That is what I am missing. I have added cache before action, and
that 2nd processing is avoided.
2016-09-10 5:10 GMT-07:00 Cody Koeninger :
> Hard to say without seeing the code, but if you do multiple actions on an
> Rdd without caching, the Rdd will be computed multiple times.
>
> On Se
he-spark-user-list.
1001560.n3.nabble.com/spark-streaming-kafka-connector-
questions-tp27681p27687.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
hed without really doing the
work.
Help is hugely appreciated.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/spark-streaming-kafka-connector-questions-tp27681p27687.html
Sent from the Apache Spark User List mailing list archive at Nabble.
ils
> >
> > kafkaParams.put("auto.commit.enable", "true");
> > kafkaParams.put("auto.commit.interval.ms", "1000");
> > kafkaParams.put("zookeeper.session.timeout.ms", "6");
ommit.enable", "true");
> kafkaParams.put("auto.commit.interval.ms", "1000");
> kafkaParams.put("zookeeper.session.timeout.ms", "6");
> kafkaParams.put("zookeeper.connection.timeout.ms", "6");
>
> Still not
uot;auto.commit.interval.ms", "1000");
kafkaParams.put("zookeeper.session.timeout.ms", "6");
kafkaParams.put("zookeeper.connection.timeout.ms", "6");
Still not working.
Help is greatly appreciated !
--
View this message in context:
http://apac
