Kafka 2.7.0 processor API and streams-test-utils changes

2021-02-04 Thread Upesh Desai
direction if this has indeed been changed/fixed or need to raise an issue to have this updated in the next release? Cheers! Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal

Re: Kafka 2.7.0 processor API and streams-test-utils changes

2021-02-07 Thread Upesh Desai
Hi John, Guozhang, No problem, I’ll keep an eye out for the change! Thanks for letting me know, I will give my change a try with your example. Appreciate the quick reply! Best, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: John Roesler Date

Kafka Streams Processor API state stores not restored via changelog topics

2021-03-23 Thread Upesh Desai
feredLimitIndex; Where ‘changelogMetadata.bufferedLimitIndex’ always == 0. My question to you all is, 1) Is this expected behavior? 2) If not, is it a bug? Hope to get some clarity, and thanks in advance! Best, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-24 Thread Upesh Desai
to an empty byte array `new byte[0]`. A couple other variations I have tried are setting to a non-empty static byte array such as `new byte[1]` or `new byte[]{1}`. Hope this gives a little more clarity and hope to hear from you soon. Thanks, Upesh Upesh Desai | Senior Software Developer | ude

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-25 Thread Upesh Desai
just set to compact. We also confirmed that this does not happen when we run everything on Kafka version 2.6. Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Thursday, March 25, 2021 at 4:01 PM To: Users Cc: Bart Lilje

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-25 Thread Upesh Desai
instantly. Best, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Thursday, March 25, 2021 at 6:31 PM To: Users Subject: Re: Kafka Streams Processor API state stores not restored via changelog topics BTW, yes that indicates the

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-29 Thread Upesh Desai
first and only record written to the store/changelog. Is there anything else we can try to resolve this issue or give us more insight into where this issue could originate from? Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Upesh Desai

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-30 Thread Upesh Desai
as generated as part of a punctuation. So my next key question is: is this changelog record generated, i.e. its put call triggered, from processing an input record, or from a punctuation call? Guozhang On Mon, Mar 29, 2021 at 2:01 PM Upesh Desai wrote: > Hi Guozhang, > > > > Wh

Re: Kafka Streams Processor API state stores not restored via changelog topics

2021-03-30 Thread Upesh Desai
Hi Guozhang, We can confirm the behavior with the 2.7.1 release. Appreciate all the help! Cheers, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Guozhang Wang Date: Tuesday, March 30, 2021 at 2:10 PM To: Users Cc: Bart Lilje Subject: Re: Kafka

State Store Data Retention

2021-04-18 Thread Upesh Desai
periodically remove old data from the stores? I’m using kafka 2.7.0 components across the board (broker, connect, etc.). Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not

Kafka Connect Dist. Worker Does not join group

2021-04-22 Thread Upesh Desai
configuration I am missing? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented are

Re: Kafka Connect Dist. Worker Does not join group

2021-05-04 Thread Upesh Desai
Hello, I wanted to follow up to see if anyone has ever experienced such behavior with Kafka Connect? Any guidance would be greatly appreciated! Thanks, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Upesh Desai Date: Thursday, April 22, 2021 at 4

Re: [VOTE] 2.7.1 RC2

2021-05-19 Thread Upesh Desai
Excuse me if this is the wrong thread to ask, but I was curious as to if there was an updated timeline for the release of 2.7.1? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS

Kafka Streams Testing Suite Question

2021-10-08 Thread Upesh Desai
follow the life cycle of the production streams code, life cycle and logic? Thanks in advance, Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the

Kafka Streams possible partitioner bug

2022-11-18 Thread Upesh Desai
Thanks in advance! Upesh Desai Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented are solely those of t

Re: Kafka Streams possible partitioner bug

2022-11-20 Thread Upesh Desai
help for now, and we will look out for the new config when it comes out. Thanks for the quick help, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Sophie Blee-Goldman Date: Friday, November 18, 2022 at 7:35 PM To: users@kafka.apache.org Subject: Re

Custom Kafka Streams State Restore Logic

2023-01-13 Thread Upesh Desai
key()) ); ChangelogRecordDeserializationHelper.applyChecksAndUpdatePosition( record, consistencyEnabled, position ); } } ); Thanks in advance! Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.

Re: Custom Kafka Streams State Restore Logic

2023-01-18 Thread Upesh Desai
starting to process. Any advice on Kafka streams / state store logic would be appreciated! -Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Matthias J. Sax Date: Wednesday, January 18, 2023 at 12:50 AM To: users@kafka.apache.org Subject: Re: Custom

Re: Custom Kafka Streams State Restore Logic

2023-01-23 Thread Upesh Desai
performant enough thus far! Thanks for your help. Cheers, Upesh Upesh Desai | Senior Software Developer | ude...@itrsgroup.com www.itrsgroup.com From: Matthias J. Sax Date: Monday, January 23, 2023 at 8:05 PM To: users@kafka.apache.org Subject: Re: Custom Kafka Streams State Restore Logic

Kafka Consumer Health Check

2023-03-07 Thread Upesh Desai
. Thanks in advance! Upesh Upesh Desai Senior Software Developer ude...@itrsgroup.com www.itrsgroup.com Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions presented are solely those of the

Kafka Broker Backups

2023-11-14 Thread Upesh Desai
not always be exactly at the same time. Thanks in advance! Upesh Upesh Desai| Senior Software Developer ude...@itrsgroup.com ITRS Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility for the contents of this message. Any view or opinions

KRaft Migration Prod Ready?

2024-07-02 Thread Upesh Desai
://strimzi.io/blog/2024/03/21/kraft-migration/ - https://www.confluent.io/blog/introducing-apache-kafka-3-6/ Thanks in advance! Upesh Desai| Senior Software Developer ude...@itrsgroup.com ITRS Internet communications are not secure and therefore the ITRS Group does not accept legal responsibility

Re: KRaft Migration Prod Ready?

2024-07-17 Thread Upesh Desai
4. Restart the controller(s) with the migration configuration removed 5. Remove ZK instances Please let me know if this understanding is correct and/or if there is any other documentation on how to properly migrate when running on Kubernetes! Thanks in advance, Upesh Upesh Desai| Senior