ere
> at
> > > that particular time when the error occurred in the App side.
> > >
> > > Cheers!
> > >
> > >
> > >
> > > On Tue, Sep 3, 2019 at 12:38 PM Dimitry Lvovsky
> > > wrote:
> > >
> > > > Hi all,
&
> that particular time when the error occurred in the App side.
> >
> > Cheers!
> >
> >
> >
> > On Tue, Sep 3, 2019 at 12:38 PM Dimitry Lvovsky
> > wrote:
> >
> > > Hi all,
> > > We have a streaming app running for over a year now without
>
> Cheers!
>
>
>
> On Tue, Sep 3, 2019 at 12:38 PM Dimitry Lvovsky
> wrote:
>
> > Hi all,
> > We have a streaming app running for over a year now without much incident
> > until recently. Suddenly the process keeps failing after a minute or so
> > with
gt; until recently. Suddenly the process keeps failing after a minute or so
> with a failed to rebalance exception caused by Unexpected error in
> InitProducerIdResponse; The server experienced an unexpected error when
> processing the request. Please see stack trace at end of the email
Hi all,
We have a streaming app running for over a year now without much incident
until recently. Suddenly the process keeps failing after a minute or so
with a failed to rebalance exception caused by Unexpected error in
InitProducerIdResponse; The server experienced an unexpected error when
ing two kafka-streams stateful
> > > > applications. From the very beginning of the app lifecycle, instances
> > > > struggle to reassign correctly partitions between them which
> eventually
> > > > leads them to
> > > >
> > > > org.apache
From the very beginning of the app lifecycle, instances
> > > struggle to reassign correctly partitions between them which eventually
> > > leads them to
> > >
> > > org.apache.kafka.streams.errors.StreamsException: stream-thread
> > > > [pws-budget-streams-client-mapper-StreamThread-13] Failed to
> rebala
fying the problem, I'm running two kafka-streams stateful
> > applications. From the very beginning of the app lifecycle, instances
> > struggle to reassign correctly partitions between them which eventually
> > leads them to
> >
> > org.apache.kafka.streams.errors
tions between them which eventually
> leads them to
>
> org.apache.kafka.streams.errors.StreamsException: stream-thread
> > [pws-budget-streams-client-mapper-StreamThread-13] Failed to rebalance.
>
>
> Due to
>
> Caused by: org.apache.kafka.common.errors.TimeoutExcepti
ce this morning.
> > Specifying the problem, I'm running two kafka-streams stateful
> > applications. From the very beginning of the app lifecycle, instances
> > struggle to reassign correctly partitions between them which eventually
> > leads them to
> >
> > org.
e, instances
> struggle to reassign correctly partitions between them which eventually
> leads them to
>
> org.apache.kafka.streams.errors.StreamsException: stream-thread
> > [pws-budget-streams-client-mapper-StreamThread-13] Failed to rebalance.
>
>
> Due to
>
> Caused
From the very beginning of the app lifecycle, instances
struggle to reassign correctly partitions between them which eventually
leads them to
org.apache.kafka.streams.errors.StreamsException: stream-thread
> [pws-budget-streams-client-mapper-StreamThread-13] Failed to rebalance.
Due to
C
der builder = new KStreamBuilder();
>>>>>>>>>> KStream kStream =
>>>>>>>>>> builder.stream(appOptions.getInput().getTopic());
>>>>>>>>>> kStream.process(() -> processor
the instance,
> >>> the
> >>>>>>> folders
> >>>>>>>> under /tmp/kafka-streams// only have a .lock file.
> >>>>>>>>
> >>>>>>>> This seems to have been bootst
;>>>>
>>>>>>>> org.apache.kafka.clients.consumer.CommitFailedException: Commit
>>>>>> cannot be
>>>>>>>> completed since the group has already rebalanced and assigned
>>> the
>>>>>>>> partitions to another member. This me
at the poll loop is spending too much time
>>> > > message
>>> > > > > > processing. You can address this either by increasing the
>>> session
>>> > > > timeout
>>> > > > > > or by reducing the maximum size of batches returned
it.interval.ms", nonetheless, shouldn't Kafka Streams not
>> > worry
>> > > > > about
>> > > > > > state dirs if there are no state stores? Since it doesn't seem
>> to
>> > do
>> > > so
>> > > > > > automatically, ca
M Matthias J. Sax <
> > > matth...@confluent.io
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Great! :)
> > > > > >>
> > > > > >> On 5/16/17 2:31 AM, Sameer Kumar wrote:
> > > &
ors
> > dont
> > > > >> come
> > > > >>> now.
> > > > >>>
> > > > >>> -Sameer.
> > > > >>>
> > > > >>> On Fri, May 5, 2017 at 7:53 AM, Sameer Kum
find any errors. Thanks for the help
> > > though.
> > > >>>>
> > > >>>> -Sameer.
> > > >>>>
> > > >>>> On Fri, May 5, 2017 at 3:37 AM, Matthias J. Sax <
> > > matth...@confluent.
th...@confluent.io>
> > >>>> wrote:
> > >>>>
> > >>>>> Did you see Eno's reply?
> > >>>>>
> > >>>>> Please try out Streams 0.10.2.1 -- this should be fixed there. If
> > not,
> >>>>> -Matthias
> >>>>>
> >>>>> On 5/3/17 10:49 PM, Sameer Kumar wrote:
> >>>>>> My brokers are on version 10.1.0 and my clients are on version
> 10.2.0.
> >>>>>> Also, do a reply to all, I
currently not subscribed to the list.
>>>>>>
>>>>>> -Sameer.
>>>>>>
>>>>>> On Wed, May 3, 2017 at 6:34 PM, Sameer Kumar
>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>
t;>>> few hours before outputting with failure to rebalance errors.
> >>>>>
> >>>>>
> >>>>> I couldnt understand why this happened but I saw one strange
> >>> behaviour...
> >>>>>
>
>>>>> at 16:53 on node1, I saw "Failed to lock the state directory" error,
>>> this
>>>>> might have caused the partitions to relocate and hence the error.
>>>>>
>>>>>
>>>>>
>>>>> I am attaching
e strange
>> behaviour...
>> >>
>> >> at 16:53 on node1, I saw "Failed to lock the state directory" error,
>> this
>> >> might have caused the partitions to relocate and hence the error.
>> >>
>> >>
>> >>
>>
attaching detailed logs for both the nodes, please see if you can
> >> help.
> >>
> >>
> >>
> >> Some of the logs for quick reference are these.
> >>
> >>
> >>
> >> 2017-05-03 16:53:53 ERROR Kafka10Base:44 - Exception c
ese.
>>
>>
>>
>> 2017-05-03 16:53:53 ERROR Kafka10Base:44 - Exception caught in thread
>> StreamThread-2
>>
>> org.apache.kafka.streams.errors.StreamsException: stream-thread
>> [StreamThread-2] Failed to rebalance
>>
>>
> StreamThread-2
>
> org.apache.kafka.streams.errors.StreamsException: stream-thread
> [StreamThread-2] Failed to rebalance
>
> at org.apache.kafka.streams.proce
> ssor.internals.StreamThread.runLoop(StreamThread.java:612)
>
>
> org.apache.kafka.streams.errors.StreamsException: stream-thread
> [StreamThread-2] Failed to rebalance
>
> at
> org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:612)
>
>
30 matches
Mail list logo
