Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-24 Thread Cody Koeninger
nuous offset in kafka will cause the spark streamingfailure > > Yes. My spark streaming application works with uncompacted topic. I will > check the patch. > > > wood.super > > 原始邮件 > 发件人: Justin Miller > 收件人: namesuperwood > 抄送: user; Cody Koeninger > 发送时间: 2018年1月2

Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
间:2018年1月24日(周三) 14:45 主题:Re: uncontinuous offset in kafka will cause the spark streamingfailure Yes. My spark streaming application works with uncompacted topic. I will check the patch. wood.super 原始邮件 发件人:Justin millerjustin.mil...@protectwise.com 收件人:namesuperwoodnamesuperw...@gmail.com 抄送

Re: uncontinuous offset in kafka will cause the spark streamingfailure

2018-01-23 Thread namesuperwood
: uncontinuous offset in kafka will cause the spark streamingfailure We appear to be kindred spirits, I’ve recently run into the same issue. Are you running compacted topics? I’ve run into this issue on non-compacted topics as well, it happens rarely but is still a pain. You might check out this