For receiver approach, have you tried Ryan's workaround ? Btw I don't see the errors you faced because there was no attachment.
> On Feb 23, 2016, at 3:39 AM, vaibhavrtk1 <learnings.vaib...@gmail.com> wrote: > > Hello > > I have tried with Direct API but i am getting this an error, which is being > tracked here https://issues.apache.org/jira/browse/SPARK-5594 > > I also tried using Receiver approach with Write Ahead Logs ,then this issue > comes > https://issues.apache.org/jira/browse/SPARK-12407 > > In both cases it seems it is not able to get the broadcasted variable from > checkpoint directory. > Attached is the screenshot of errors I faced with both approaches. > > What do you guys suggest for solving this issue? > > > Vaibhav Nagpal > 9535433788 > > >> On Tue, Feb 23, 2016 at 1:50 PM, Gideon [via Apache Spark User List] >> <[hidden email]> wrote: >> Regarding the spark streaming receiver - can't you just use Kafka direct >> receivers with checkpoints? So when you restart your application it will >> read where it last stopped and continue from there >> Regarding limiting the number of messages - you can do that by setting >> spark.streaming.receiver.maxRate. Read more about it here >> >> If you reply to this email, your message will be added to the discussion >> below: >> http://apache-spark-user-list.1001560.n3.nabble.com/Read-from-kafka-after-application-is-restarted-tp26291p26303.html >> To unsubscribe from Read from kafka after application is restarted, click >> here. >> NAML > > > Capture.JPG (222K) Download Attachment > Capture1.JPG (169K) Download Attachment > > View this message in context: Re: Read from kafka after application is > restarted > Sent from the Apache Spark User List mailing list archive at Nabble.com.
