I think that it's a kafka error, but I'm starting thinking if it could be something about elasticsearch since I have seen more people with same error using elasticsearch. I have no idea.
2016-05-06 11:05 GMT+02:00 Guillermo Ortiz <konstt2...@gmail.com>: > I'm trying to read data from Spark and index to ES with its library > (es-hadoop 2.2.1 version). > IIt was working right for a while but now it has started to happen this error. > I have delete the checkpoint and even the kafka topic and restart all > the machines with kafka and zookeeper but it didn't fix it. > > User class threw exception: org.apache.spark.SparkException: Job > aborted due to stage failure: Task 4 in stage 1.0 failed 4 times, most > recent failure: Lost task 4.3 in stage 1.0 (TID 12, xxxxxxxxx): > java.lang.AssertionError: assertion failed: Ran out of messages before > reaching ending offset 1226116 for topic kafka-global-paas partition 7 > start 1212156. This should not happen, and indicates that messages may > have been lost > at scala.Predef$.assert(Predef.scala:179) > at > org.apache.spark.streaming.kafka.KafkaRDD$KafkaRDDIterator.getNext(KafkaRDD.scala:211) > at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71) > at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388) > at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327) > > I read some threads with this error but it didn't help me. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
