Re: Got Error Produce Respons with Correlation Id.

2020-03-13 Thread Jeremiah Adams
Do you see the Samza job hanging after that? The job does not hang. Is the checkpointed offset metrics incrementing in this case? We do get incremented offsets. Not clear on your claiming: "logs stop at that point". No logs are written after the WARN lines? My apologies for the confusion - I

Re: Got Error Produce Respons with Correlation Id.

2020-03-13 Thread Yi Pan
Hi, Jeremiah, >From what you have answered, it looks to me as a transient error (probably timeout due to some transient network errors as you mentioned) and your job was able to retry/recover and make progress. Just one thing to confirm: I saw your configured task.commit.ms=-1, and you have menti

Re: Got Error Produce Respons with Correlation Id.

2020-03-13 Thread Jeremiah Adams
Yes, I explicitly commit via code for this job as an effort to ensure only once processing. Thanks for taking the time to look into our concerns. Jeremiah Adams Software Engineer www.helixeducation.com Blog | Twitter | Facebook | LinkedIn From: Yi Pan

Re: Got Error Produce Respons with Correlation Id.

2020-03-13 Thread Yi Pan
Cool! Sounds good to me! Happy to be the help! -Yi On Fri, Mar 13, 2020 at 1:13 PM Jeremiah Adams wrote: > Yes, I explicitly commit via code for this job as an effort to ensure only > once processing. > > Thanks for taking the time to look into our concerns. > > Jeremiah Adams > Software Engine