Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
somewhat large scale stream processor tomorrow. CCing: Cody Koeninger Best, Justin On Jan 23, 2018, at 10:48 PM, namesuperwood namesuperw...@gmail.com wrote: Hi all kafka version : kafka_2.11-0.11.0.2 spark version : 2.0.1 A topic-partition "adn-tracking,15" in kafka who&

Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
23, 2018, at 10:48 PM, namesuperwood namesuperw...@gmail.com wrote: Hi all kafka version : kafka_2.11-0.11.0.2 spark version : 2.0.1 A topic-partition "adn-tracking,15" in kafka who's earliest offset is1255644602 andlatest offset is1271253441. While starting a spark strea

uncontinuous offset in kafka will cause the spark streaming failure

2018-01-23 Thread namesuperwood
Hi all kafka version : kafka_2.11-0.11.0.2 spark version : 2.0.1 A topic-partition "adn-tracking,15" in kafka who's earliest offset is1255644602 andlatest offset is1271253441. While starting a spark streaming to process the data from the topic , we got a exception with "Got wrong record X