[jira] [Updated] (KAFKA-10376) Add end timestamp to Time Window key. Update TimeWindow Serializer/Deserializer to set end of window.

2020-08-09 Thread BPR (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BPR updated KAFKA-10376: Description: The end timestamp is not currently added to the end of the key for Time Window aggregates. Update th

[jira] [Updated] (KAFKA-10376) Add end timestamp to Time Window key. Update TimeWindow Serializer/Deserializer to set end of window.

2020-08-09 Thread BPR (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BPR updated KAFKA-10376: Description: Aggregate stream consumers are not currently able to get the end timestamp for Time Windows from the

[jira] [Updated] (KAFKA-10376) Add end timestamp to Time Window key. Update TimeWindow Serializer/Deserializer to set end of window.

2020-08-09 Thread BPR (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BPR updated KAFKA-10376: Labels: Aggregation Deserialize Key (was: Deserialize) > Add end timestamp to Time Window key. Update TimeWindow

[jira] [Commented] (KAFKA-9752) Consumer rebalance can be stuck after new member timeout with old JoinGroup version

2020-08-09 Thread Dibyendu Bhattacharya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173850#comment-17173850 ] Dibyendu Bhattacharya commented on KAFKA-9752: -- Hi [~ijuma] [~hachikuji], I

[GitHub] [kafka] lbradstreet opened a new pull request #9147: MINOR: supervise TransactionalMessageCopier producer

2020-08-09 Thread GitBox
lbradstreet opened a new pull request #9147: URL: https://github.com/apache/kafka/pull/9147 transactions_test and group_mode_transactions_test have proven quite brittle around timeouts (see 67f5b5de77d67c02edb335737215312d099a1cac, e099b58df5b3e4f87173fc55880f9c343308739f, d9fe30dab

[jira] [Assigned] (KAFKA-8812) Rebalance Producers

2020-08-09 Thread Werner Daehn (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Werner Daehn reassigned KAFKA-8812: --- Assignee: Matthias J. Sax (was: Werner Daehn) > Rebalance Producers > --- >

[GitHub] [kafka] lbradstreet commented on a change in pull request #9147: MINOR: supervise TransactionalMessageCopier producer

2020-08-09 Thread GitBox
lbradstreet commented on a change in pull request #9147: URL: https://github.com/apache/kafka/pull/9147#discussion_r467590975 ## File path: tools/src/main/java/org/apache/kafka/tools/TransactionalMessageCopier.java ## @@ -345,39 +357,55 @@ public void onPartitionsAssigned(Col

[jira] [Created] (KAFKA-10377) Delete Useless Code

2020-08-09 Thread Bingkun.ji (Jira)
Bingkun.ji created KAFKA-10377: -- Summary: Delete Useless Code Key: KAFKA-10377 URL: https://issues.apache.org/jira/browse/KAFKA-10377 Project: Kafka Issue Type: Improvement Components:

[jira] [Updated] (KAFKA-10376) Add end timestamp to Time Window key. Update TimeWindow Serializer/Deserializer to set end of window.

2020-08-09 Thread BPR (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BPR updated KAFKA-10376: Description: Aggregate stream consumers are not currently able to get the end timestamp for Time Windows from the

[jira] [Created] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Mohammad Abdelqader (Jira)
Mohammad Abdelqader created KAFKA-10378: --- Summary: issue when create producer using java Key: KAFKA-10378 URL: https://issues.apache.org/jira/browse/KAFKA-10378 Project: Kafka Issue Typ

[jira] [Resolved] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Mohammad Abdelqader (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Abdelqader resolved KAFKA-10378. - Fix Version/s: 2.6.0 Resolution: Fixed Solve by add  [jackson-databind|ht

[jira] [Comment Edited] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Mohammad Abdelqader (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173948#comment-17173948 ] Mohammad Abdelqader edited comment on KAFKA-10378 at 8/9/20, 6:43 PM:

[jira] [Updated] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10378: Priority: Critical (was: Major) > issue when create producer using java > ---

[jira] [Commented] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173951#comment-17173951 ] Ismael Juma commented on KAFKA-10378: - Thanks for the filing the issue. This looks l

[jira] [Updated] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10378: Issue Type: Bug (was: Test) > issue when create producer using java > ---

[jira] [Updated] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10378: Fix Version/s: (was: 2.6.0) 2.6.1 > issue when create producer using java >

[jira] [Reopened] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-10378: - > issue when create producer using java > - > >

[jira] [Updated] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10378: Fix Version/s: 2.7.0 > issue when create producer using java > ---

[jira] [Updated] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10378: Priority: Blocker (was: Critical) > issue when create producer using java > -

[jira] [Commented] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173952#comment-17173952 ] Ismael Juma commented on KAFKA-10378: - I reopened the issue since this needs to be f

[jira] [Commented] (KAFKA-10378) issue when create producer using java

2020-08-09 Thread Mohammad Abdelqader (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173953#comment-17173953 ] Mohammad Abdelqader commented on KAFKA-10378: - Thank you Ismael  > issue wh

[jira] [Resolved] (KAFKA-10105) Regression in group coordinator dealing with flaky clients joining while leaving

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-10105. - Resolution: Duplicate Closing as duplicate of KAFKA-9752. Please reopen if reproduced with 2.5.0

[jira] [Resolved] (KAFKA-9935) Kafka not releasing member from Consumer Group

2020-08-09 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-9935. Resolution: Duplicate Closing as duplicate of KAFKA-9752. Please reopen if reproduced with 2.5.0 or

[GitHub] [kafka] vvcephei commented on pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with adapters

2020-08-09 Thread GitBox
vvcephei commented on pull request #9004: URL: https://github.com/apache/kafka/pull/9004#issuecomment-671134339 Just one unrelated test failure: ``` org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[true] failed, log available in /

[GitHub] [kafka] vvcephei merged pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with adapters

2020-08-09 Thread GitBox
vvcephei merged pull request #9004: URL: https://github.com/apache/kafka/pull/9004 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei commented on pull request #9004: KAFKA-10261: Introduce the KIP-478 apis with adapters

2020-08-09 Thread GitBox
vvcephei commented on pull request #9004: URL: https://github.com/apache/kafka/pull/9004#issuecomment-671134513 Merged to trunk. Thanks for the review @abbccdda ! This is an automated message from the Apache Git Service. To r

[jira] [Resolved] (KAFKA-10261) Introduce the KIP-478 processors with shims

2020-08-09 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-10261. -- Resolution: Fixed > Introduce the KIP-478 processors with shims >

[jira] [Updated] (KAFKA-10261) Introduce the KIP-478 processors with shims

2020-08-09 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10261: - Fix Version/s: 2.7.0 > Introduce the KIP-478 processors with shims > ---

[jira] [Created] (KAFKA-10379) Implement the KIP-478 StreamBuilder#addGlobalStore()

2020-08-09 Thread John Roesler (Jira)
John Roesler created KAFKA-10379: Summary: Implement the KIP-478 StreamBuilder#addGlobalStore() Key: KAFKA-10379 URL: https://issues.apache.org/jira/browse/KAFKA-10379 Project: Kafka Issue Ty

[GitHub] [kafka] vvcephei opened a new pull request #9148: KAFKA-10379: Implement the KIP-478 StreamBuilder#addGlobalStore()

2020-08-09 Thread GitBox
vvcephei opened a new pull request #9148: URL: https://github.com/apache/kafka/pull/9148 From KIP-478, implement the new StreamBuilder#addGlobalStore() overload that takes a stateUpdateSupplier fully typed Processor. Where necessary, use the adapters to make the old APIs defer to t

[jira] [Created] (KAFKA-10380) Make dist flatten rocksdbjni

2020-08-09 Thread Adrian Cole (Jira)
Adrian Cole created KAFKA-10380: --- Summary: Make dist flatten rocksdbjni Key: KAFKA-10380 URL: https://issues.apache.org/jira/browse/KAFKA-10380 Project: Kafka Issue Type: Task Compone

[GitHub] [kafka] vvcephei commented on a change in pull request #9148: KAFKA-10379: Implement the KIP-478 StreamBuilder#addGlobalStore()

2020-08-09 Thread GitBox
vvcephei commented on a change in pull request #9148: URL: https://github.com/apache/kafka/pull/9148#discussion_r467671774 ## File path: streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java ## @@ -499,7 +500,7 @@ public synchronized StreamsBuilder addStateStore(fi

[jira] [Commented] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2020-08-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174105#comment-17174105 ] Luke Chen commented on KAFKA-10340: --- Will improve the logging in this area. Proposed

[jira] [Comment Edited] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2020-08-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174105#comment-17174105 ] Luke Chen edited comment on KAFKA-10340 at 8/10/20, 6:38 AM: -

[jira] [Comment Edited] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2020-08-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174105#comment-17174105 ] Luke Chen edited comment on KAFKA-10340 at 8/10/20, 6:38 AM: -

[jira] [Comment Edited] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2020-08-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174105#comment-17174105 ] Luke Chen edited comment on KAFKA-10340 at 8/10/20, 6:40 AM: -

[GitHub] [kafka] showuon opened a new pull request #9149: KAFKA-10340: improve the logging to help user know what is going on

2020-08-09 Thread GitBox
showuon opened a new pull request #9149: URL: https://github.com/apache/kafka/pull/9149 Improve the logging in `maybeCreateTopic` to let user know if `!topicCreation.isTopicCreationRequired(topic)`, we won't create this topic because the topic creation setting is disabled or the topic nam

[jira] [Comment Edited] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2020-08-09 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174105#comment-17174105 ] Luke Chen edited comment on KAFKA-10340 at 8/10/20, 6:45 AM: -

[GitHub] [kafka] showuon commented on a change in pull request #9149: KAFKA-10340: improve the logging to help user know what is going on

2020-08-09 Thread GitBox
showuon commented on a change in pull request #9149: URL: https://github.com/apache/kafka/pull/9149#discussion_r467713932 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSourceTask.java ## @@ -363,6 +363,7 @@ private boolean sendRecords() {

[GitHub] [kafka] showuon commented on pull request #9149: KAFKA-10340: improve the logging to help user know what is going on

2020-08-09 Thread GitBox
showuon commented on pull request #9149: URL: https://github.com/apache/kafka/pull/9149#issuecomment-671191319 @kkonstantine , could you help review this PR to improve logging? Thanks. This is an automated message from the Ap