Hi Vaibhav, Please try with Kafka direct API approach. Is this not working ?
-- Padma Ch On Tue, Feb 23, 2016 at 12:36 AM, vaibhavrtk1 [via Apache Spark User List] < ml-node+s1001560n26291...@n3.nabble.com> wrote: > Hi > > I am using kafka with spark streaming 1.3.0 . When the spark application > is not running kafka is still receiving messages. When i start the > application those messages which have already been received when spark was > not running are not processed. I am using a unreliable receiver based > approach. > > What can I do to process earlier messages also, which came while > application was shut down? > > PS: If application was down for a long time can i also limit the max > number of message consumed in one batch interval? > > Regards > Vaibhav > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Read-from-kafka-after-application-is-restarted-tp26291.html > To start a new topic under Apache Spark User List, email > ml-node+s1001560n1...@n3.nabble.com > To unsubscribe from Apache Spark User List, click here > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=bGVhcm5pbmdzLmNoaXR0dXJpQGdtYWlsLmNvbXwxfC03NzExMjUwMg==> > . > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Read-from-kafka-after-application-is-restarted-tp26291p26292.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
