[jira] [Commented] (KAFKA-13292) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414771#comment-17414771 ] Matthias J. Sax commented on KAFKA-13292: - Fair enough. In the end, {{InvalidPid

[jira] [Commented] (KAFKA-13267) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414777#comment-17414777 ] Matthias J. Sax commented on KAFKA-13267: - According to [KIP-671|https://cwiki.

[GitHub] [kafka] cadonna commented on pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-09-14 Thread GitBox
cadonna commented on pull request #10678: URL: https://github.com/apache/kafka/pull/10678#issuecomment-918910442 @ijuma Are you fine with me merging this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Created] (KAFKA-13297) smt to rename schemas based on regex

2021-09-14 Thread Martin Sillence (Jira)
Martin Sillence created KAFKA-13297: --- Summary: smt to rename schemas based on regex Key: KAFKA-13297 URL: https://issues.apache.org/jira/browse/KAFKA-13297 Project: Kafka Issue Type: New Fe

[GitHub] [kafka] dajac opened a new pull request #11325: MINOR: Update version in documentation to 2.8.1

2021-09-14 Thread GitBox
dajac opened a new pull request #11325: URL: https://github.com/apache/kafka/pull/11325 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade not

[jira] [Commented] (KAFKA-13191) Kafka 2.8 - simultaneous restarts of Kafka and zookeeper result in broken cluster

2021-09-14 Thread Chris Borckholder (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414854#comment-17414854 ] Chris Borckholder commented on KAFKA-13191: --- We are seeing similar issues afte

[GitHub] [kafka] dongjinleekr commented on pull request #11324: KAFKA-13294: Upgrade Netty to 4.1.68 for CVE fixes

2021-09-14 Thread GitBox
dongjinleekr commented on pull request #11324: URL: https://github.com/apache/kafka/pull/11324#issuecomment-919050807 @kkonstantine Should it be merged into 3.0.0? or only for 2.8.1? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Comment Edited] (KAFKA-7360) Code example in "Accessing Processor Context" misses a closing parenthesis

2021-09-14 Thread Vijay (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413701#comment-17413701 ] Vijay edited comment on KAFKA-7360 at 9/14/21, 11:35 AM: - [~sekno

[jira] [Created] (KAFKA-13298) Improve documentation on EOS KStream requirements

2021-09-14 Thread Jira
F Méthot created KAFKA-13298: Summary: Improve documentation on EOS KStream requirements Key: KAFKA-13298 URL: https://issues.apache.org/jira/browse/KAFKA-13298 Project: Kafka Issue Type: Improve

[GitHub] [kafka] dajac merged pull request #11325: MINOR: Update version in documentation to 2.8.1

2021-09-14 Thread GitBox
dajac merged pull request #11325: URL: https://github.com/apache/kafka/pull/11325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] showuon commented on pull request #11227: KAFKA-13211: add support for infinite range query for WindowStore

2021-09-14 Thread GitBox
showuon commented on pull request #11227: URL: https://github.com/apache/kafka/pull/11227#issuecomment-919127815 @patrickstuedi , the PR(#11292) is merged into trunk. I've rebased this PR, so it is good to review now. Thank you. -- This is an automated message from the Apache Git Service

[GitHub] [kafka] ccding commented on pull request #11080: KAFKA-13149: fix NPE for record==null when handling a produce request

2021-09-14 Thread GitBox
ccding commented on pull request #11080: URL: https://github.com/apache/kafka/pull/11080#issuecomment-919272706 The tests Jason kicked in failed two tests: ``` Build / JDK 8 and Scala 2.12 / testDescribeTopicsWithIds() – kafka.api.PlaintextAdminIntegrationTest Build / JDK 11 and Sc

[GitHub] [kafka] dengziming commented on pull request #11310: KAFKA-13279: Implement CreateTopicsPolicy for KRaft

2021-09-14 Thread GitBox
dengziming commented on pull request #11310: URL: https://github.com/apache/kafka/pull/11310#issuecomment-919288093 Should we also change the integration test `CreateTopicsRequestWithPolicyTest` to support KRaft mode? the change LGTM. -- This is an automated message from the Apache Git S

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13272: Component/s: (was: streams) core > KStream offset stuck after brokers

[jira] [Comment Edited] (KAFKA-13267) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414777#comment-17414777 ] Matthias J. Sax edited comment on KAFKA-13267 at 9/14/21, 4:35 PM: ---

[jira] [Updated] (KAFKA-13289) Bulk processing correctly ordered input data through a join with kafka-streams results in `Skipping record for expired segment`

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13289: Priority: Minor (was: Major) > Bulk processing correctly ordered input data through a joi

[jira] [Created] (KAFKA-13299) Accept listeners that have the same port but use IPv4 vs IPv6

2021-09-14 Thread Matthew de Detrich (Jira)
Matthew de Detrich created KAFKA-13299: -- Summary: Accept listeners that have the same port but use IPv4 vs IPv6 Key: KAFKA-13299 URL: https://issues.apache.org/jira/browse/KAFKA-13299 Project: Ka

[GitHub] [kafka] hachikuji merged pull request #11080: KAFKA-13149: fix NPE for record==null when handling a produce request

2021-09-14 Thread GitBox
hachikuji merged pull request #11080: URL: https://github.com/apache/kafka/pull/11080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubsc

[jira] [Resolved] (KAFKA-13149) Null Pointer Exception for record==null when handling a produce request

2021-09-14 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13149. - Fix Version/s: 3.0.1 Resolution: Fixed > Null Pointer Exception for record==null

[jira] [Assigned] (KAFKA-13261) KTable to KTable foreign key join loose events when using several partitions

2021-09-14 Thread Victoria Xia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victoria Xia reassigned KAFKA-13261: Assignee: Victoria Xia > KTable to KTable foreign key join loose events when using severa

[jira] [Assigned] (KAFKA-13268) Add more integration tests for Table Table FK joins with repartitioning

2021-09-14 Thread Victoria Xia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victoria Xia reassigned KAFKA-13268: Assignee: Victoria Xia > Add more integration tests for Table Table FK joins with reparti

[jira] [Commented] (KAFKA-7408) Truncate to LSO on unclean leader election

2021-09-14 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415051#comment-17415051 ] Jason Gustafson commented on KAFKA-7408: [~jagsancio] The basic idea was to trunc

[GitHub] [kafka] venkatesh010 commented on pull request #6233: KAFKA-7902: Replace original loginContext if SASL/OAUTHBEARER refresh login fails

2021-09-14 Thread GitBox
venkatesh010 commented on pull request #6233: URL: https://github.com/apache/kafka/pull/6233#issuecomment-919344102 We are facing this issue with Confluent - 5.5.1 (apache kafka - 2.5.x) Which is superior to 2.2.1 Actually issue is not easily reproducable and difficult to prov

[GitHub] [kafka] hachikuji commented on a change in pull request #11186: KAFKA-13162: Ensure ElectLeaders is properly handled in KRaft

2021-09-14 Thread GitBox
hachikuji commented on a change in pull request #11186: URL: https://github.com/apache/kafka/pull/11186#discussion_r708533935 ## File path: core/src/main/scala/kafka/server/metadata/BrokerMetadataPublisher.scala ## @@ -117,6 +117,8 @@ class BrokerMetadataPublisher(conf: KafkaC

[GitHub] [kafka] guozhangwang commented on pull request #10798: KAFKA-9168: Adding direct byte buffer support to rocksdb state store

2021-09-14 Thread GitBox
guozhangwang commented on pull request #10798: URL: https://github.com/apache/kafka/pull/10798#issuecomment-919419275 > hey @guozhangwang , that makes perfect sense to me. Based upon the discussion me and @patrickstuedi had on this thread, I think to reap the real benefits, the optimisatio

[jira] [Commented] (KAFKA-13268) Add more integration tests for Table Table FK joins with repartitioning

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415109#comment-17415109 ] Guozhang Wang commented on KAFKA-13268: --- I just did that in a recent PR: https://

[jira] [Commented] (KAFKA-13292) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread NEERAJ VAIDYA (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415181#comment-17415181 ] NEERAJ VAIDYA commented on KAFKA-13292: --- Thanks [~mjsax] So, to summarize : Will

[jira] [Commented] (KAFKA-9861) Process Simplification - Community Validation of Kafka Release Candidates

2021-09-14 Thread Israel Ekpo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415182#comment-17415182 ] Israel Ekpo commented on KAFKA-9861: To encourage other community members to particip

[jira] [Commented] (KAFKA-9861) Process Simplification - Community Validation of Kafka Release Candidates

2021-09-14 Thread Israel Ekpo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415183#comment-17415183 ] Israel Ekpo commented on KAFKA-9861: I would like it to be merged into the main kafka

[jira] [Created] (KAFKA-13300) Kafka ACL Restriction Group Is not being applied

2021-09-14 Thread Adriano Jesus (Jira)
Adriano Jesus created KAFKA-13300: - Summary: Kafka ACL Restriction Group Is not being applied Key: KAFKA-13300 URL: https://issues.apache.org/jira/browse/KAFKA-13300 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415195#comment-17415195 ] Guozhang Wang commented on KAFKA-13295: --- As we talked about the potential fix in t

[jira] [Commented] (KAFKA-7408) Truncate to LSO on unclean leader election

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415198#comment-17415198 ] Guozhang Wang commented on KAFKA-7408: -- Hey [~hachikuji], a quick question: If we ju

[jira] [Assigned] (KAFKA-13249) Checkpoints do not contain latest offsets on shutdown when using EOS

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-13249: - Assignee: Oliver Hutchison > Checkpoints do not contain latest offsets on shutdown when

[jira] [Resolved] (KAFKA-13249) Checkpoints do not contain latest offsets on shutdown when using EOS

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13249. --- Fix Version/s: 3.1.0 Resolution: Fixed > Checkpoints do not contain latest offsets on

[GitHub] [kafka] guozhangwang commented on pull request #11283: KAFKA-13249: Always update changelog offsets before writing the checkpoint file

2021-09-14 Thread GitBox
guozhangwang commented on pull request #11283: URL: https://github.com/apache/kafka/pull/11283#issuecomment-919580172 I resolved some conflicts and cherry-picked to 2.8; there are too many conflicts in 2.7 though. -- This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (KAFKA-13249) Checkpoints do not contain latest offsets on shutdown when using EOS

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13249: -- Fix Version/s: 2.8.2 > Checkpoints do not contain latest offsets on shutdown when using EOS >

[jira] [Commented] (KAFKA-13267) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415244#comment-17415244 ] Guozhang Wang commented on KAFKA-13267: --- I agree, and as you mentioned in the othe

[jira] [Commented] (KAFKA-13292) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2021-09-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415251#comment-17415251 ] Matthias J. Sax commented on KAFKA-13292: - KIP-671 won't avoid the exception, bu

[jira] [Commented] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415256#comment-17415256 ] Guozhang Wang commented on KAFKA-10643: --- [~eran-levy] Just for the static membersh

[GitHub] [kafka] guozhangwang commented on pull request #11278: KAFKA-12648: Enforce size limits for each task's cache

2021-09-14 Thread GitBox
guozhangwang commented on pull request #11278: URL: https://github.com/apache/kafka/pull/11278#issuecomment-919601918 > @guozhangwang I think there are defiantly questions to be answered about this and really what we want to the user to achieve. I think the maxbufferedbytes is really being

[GitHub] [kafka] guozhangwang commented on a change in pull request #11272: KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides

2021-09-14 Thread GitBox
guozhangwang commented on a change in pull request #11272: URL: https://github.com/apache/kafka/pull/11272#discussion_r708747814 ## File path: streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java ## @@ -611,6 +611,7 @@ public synchronized Topology build() {

[GitHub] [kafka] guozhangwang commented on pull request #11272: KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides

2021-09-14 Thread GitBox
guozhangwang commented on pull request #11272: URL: https://github.com/apache/kafka/pull/11272#issuecomment-919603159 `Checkstyle rule violations were found.` :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] junrao commented on a change in pull request #10914: [KAFKA-8522] Streamline tombstone and transaction marker removal

2021-09-14 Thread GitBox
junrao commented on a change in pull request #10914: URL: https://github.com/apache/kafka/pull/10914#discussion_r708747148 ## File path: core/src/main/scala/kafka/log/LogCleaner.scala ## @@ -622,26 +628,35 @@ private[log] class Cleaner(val id: Int, * @param sourceRecords Th

[GitHub] [kafka] guozhangwang commented on a change in pull request #11272: KAFKA-12648: introduce TopologyConfig and TaskConfig for topology-level overrides

2021-09-14 Thread GitBox
guozhangwang commented on a change in pull request #11272: URL: https://github.com/apache/kafka/pull/11272#discussion_r708751965 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/namedtopology/KafkaStreamsNamedTopologyWrapper.java ## @@ -112,10 +

[GitHub] [kafka] mjsax commented on a change in pull request #11252: KAFKA-13216: Use a KV with list serde for the shared store

2021-09-14 Thread GitBox
mjsax commented on a change in pull request #11252: URL: https://github.com/apache/kafka/pull/11252#discussion_r708758100 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamKStreamJoin.java ## @@ -209,37 +210,39 @@ private void emitNonJoinedO

[GitHub] [kafka] mjsax commented on a change in pull request #11252: KAFKA-13216: Use a KV with list serde for the shared store

2021-09-14 Thread GitBox
mjsax commented on a change in pull request #11252: URL: https://github.com/apache/kafka/pull/11252#discussion_r708758796 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/ListValueStore.java ## @@ -0,0 +1,147 @@ +/* + * Licensed to the Apache Softwa

[jira] [Commented] (KAFKA-13261) KTable to KTable foreign key join loose events when using several partitions

2021-09-14 Thread Victoria Xia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415337#comment-17415337 ] Victoria Xia commented on KAFKA-13261: -- Hey [~vvcephei] [~abellemare] [~guozhang] I