[jira] [Created] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
Marek created KAFKA-10401: - Summary: GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3 Key: KAFKA-10401 URL: https://issues.apache.org/jira/browse/KAFKA-10401 Proje

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-14 Thread Marek (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek updated KAFKA-10401: -- Description: While reading group metadata information from ByteBuffer GroupMetadataManager reads current_stat

[jira] [Commented] (KAFKA-6585) Consolidate duplicated logic on reset tools

2020-08-14 Thread Francesco Nobilia (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177563#comment-17177563 ] Francesco Nobilia commented on KAFKA-6585: -- [~Samuel Hawker] are you still worki

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177566#comment-17177566 ] Vagesh Mathapati commented on KAFKA-10396: -- i tried with  [https://centos.pkgs.

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177573#comment-17177573 ] Vagesh Mathapati commented on KAFKA-10396: -- Is there anything which i can check

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177574#comment-17177574 ] Rohan Desai commented on KAFKA-10396: - [~vmathapati] it should show up on your pmap.

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177577#comment-17177577 ] Rohan Desai commented on KAFKA-10396: - It may also be a different problem. Something

[GitHub] [kafka] chia7712 commented on pull request #9162: MINOR: refactor Log to get rid of "return" in nested anonymous function

2020-08-14 Thread GitBox
chia7712 commented on pull request #9162: URL: https://github.com/apache/kafka/pull/9162#issuecomment-673942147 only ```shouldUpgradeFromEosAlphaToEosBeta``` fails. retest this please This is an automated message from the Apa

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177579#comment-17177579 ] Vagesh Mathapati commented on KAFKA-10396: -- I can see below output for pmap -X

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177610#comment-17177610 ] Rohan Desai commented on KAFKA-10396: - In addition to configuring the write buffer m

[GitHub] [kafka] jeqo commented on a change in pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-14 Thread GitBox
jeqo commented on a change in pull request #9137: URL: https://github.com/apache/kafka/pull/9137#discussion_r470536034 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/AbstractKeyValueStoreTest.java ## @@ -188,7 +188,55 @@ public void testPutGetRang

[GitHub] [kafka] sanketfajage opened a new pull request #9180: MINOR: corrected unit tests

2020-08-14 Thread GitBox
sanketfajage opened a new pull request #9180: URL: https://github.com/apache/kafka/pull/9180 Corrected unit tests. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674091814 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (KAFKA-10402) Upgrade python version in system tests

2020-08-14 Thread Nikolay Izhikov (Jira)
Nikolay Izhikov created KAFKA-10402: --- Summary: Upgrade python version in system tests Key: KAFKA-10402 URL: https://issues.apache.org/jira/browse/KAFKA-10402 Project: Kafka Issue Type: Impr

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470673412 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470675300 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-14 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470678123 ## File path: core/src/main/scala/kafka/cluster/Partition.scala ## @@ -255,6 +255,10 @@ class Partition(val topicPartition: TopicPartition, def isAdding

[jira] [Assigned] (KAFKA-9516) Flaky Test PlaintextProducerSendTest#testNonBlockingProducer

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-9516: - Assignee: Rajini Sivaram > Flaky Test PlaintextProducerSendTest#testNonBlockingProducer

[GitHub] [kafka] rajinisivaram opened a new pull request #9181: KAFKA-9516; Increase timeout in testNonBlockingProducer to make it more reliable

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9181: URL: https://github.com/apache/kafka/pull/9181 The test has been timing out occasionally and it is on the first send on a producer, so increasing timeout to 30s similar to some of the other timeouts in BaseProducerSendTest. ### Committe

[jira] [Commented] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread yazgoo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177821#comment-17177821 ] yazgoo commented on KAFKA-5896: --- I still encountered this exception in CP 2.5, shouldn't th

[jira] [Comment Edited] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread yazgoo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177821#comment-17177821 ] yazgoo edited comment on KAFKA-5896 at 8/14/20, 3:11 PM: - I still

[jira] [Created] (KAFKA-10403) Replace scala collection by java collection in generating MBeans attributes

2020-08-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10403: -- Summary: Replace scala collection by java collection in generating MBeans attributes Key: KAFKA-10403 URL: https://issues.apache.org/jira/browse/KAFKA-10403 Proje

[GitHub] [kafka] chia7712 opened a new pull request #9182: KAFKA-10403 Replace scala collection by java collection in generating…

2020-08-14 Thread GitBox
chia7712 opened a new pull request #9182: URL: https://github.com/apache/kafka/pull/9182 issue: https://issues.apache.org/jira/browse/KAFKA-10403 It seems to me the metrics is a "kind" of public interface so users should be able to access metrics of kafka server without scala library

[GitHub] [kafka] ijuma commented on pull request #9182: KAFKA-10403 Replace scala collection by java collection in generating…

2020-08-14 Thread GitBox
ijuma commented on pull request #9182: URL: https://github.com/apache/kafka/pull/9182#issuecomment-674160788 Can you please include more detail on how it fails currently? I assume it's some kind of deserialization error? Thi

[jira] [Created] (KAFKA-10404) Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover

2020-08-14 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-10404: --- Summary: Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover Key: KAFKA-10404 URL: https://issues.apache.org/jira/browse/KAFKA-10404 Project: Kafka

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674162578 Java 8 failed on an unrelated test `kafka.api.SaslSslConsumerTest.testCoordinatorFailover` created a Jira ticket. retest this please --

[jira] [Assigned] (KAFKA-10404) Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-10404: -- Assignee: Rajini Sivaram > Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFa

[GitHub] [kafka] rajinisivaram opened a new pull request #9183: KAFKA-10404; Use higher poll timeout to avoid rebalance in testCoordinatorFailover

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9183: URL: https://github.com/apache/kafka/pull/9183 Tests use 6s poll timeout, which isn't sufficient to ensure that clients don't leave the group due to poll timeout. The PR increases poll timeout to 15s. Session timeout of 5s is also low, but lea

[GitHub] [kafka] ijuma commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-08-14 Thread GitBox
ijuma commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-674193106 @mjsax did you run checkstyle and spotBugs before pushing the 2.6 change? It seems like it broke the build: https://ci-builds.apache.org/job/Kafka/job/kafka-2.6-jdk8/3/console

[jira] [Assigned] (KAFKA-8033) Flaky Test PlaintextConsumerTest#testFetchInvalidOffset

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reassigned KAFKA-8033: - Assignee: Rajini Sivaram > Flaky Test PlaintextConsumerTest#testFetchInvalidOffset > ---

[jira] [Commented] (KAFKA-5896) Kafka Connect task threads never interrupted

2020-08-14 Thread Ewen Cheslack-Postava (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177973#comment-17177973 ] Ewen Cheslack-Postava commented on KAFKA-5896: -- [~yazgoo] It looks like this

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vagesh Mathapati updated KAFKA-10396: - Attachment: CustomRocksDBConfig.java > Overall memory of container keep on growing due t

[GitHub] [kafka] rajinisivaram opened a new pull request #9184: KAFKA-8033; Wait for NoOffsetForPartitionException in testFetchInvalidOffset

2020-08-14 Thread GitBox
rajinisivaram opened a new pull request #9184: URL: https://github.com/apache/kafka/pull/9184 We wait only 50ms in consumer.poll() and expect NoOffsetForPartitionException, but the exception is thrown only when initializing partition offsets after coordinator is known. Increased poll time

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177982#comment-17177982 ] Vagesh Mathapati commented on KAFKA-10396: -- [~desai.p.rohan] Thanks a lot . Loo

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-14 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177994#comment-17177994 ] Vagesh Mathapati commented on KAFKA-10396: -- In my microservice i am using globa

[jira] [Commented] (KAFKA-10158) Fix flaky kafka.admin.TopicCommandWithAdminClientTest#testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

2020-08-14 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177995#comment-17177995 ] Rajini Sivaram commented on KAFKA-10158: [~bbyrne] We can close this now, right?

[jira] [Created] (KAFKA-10405) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2020-08-14 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-10405: --- Summary: Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState Key: KAFKA-10405 URL: https://issues.apache.org/jira/browse/KAFKA-10

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-14 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-674229113 Java 8 passed Java 14 failed with `org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState` Java 11 failed with `kafka.api.PlaintextAdmi

[jira] [Commented] (KAFKA-9263) Reocurrence: Transient failure in kafka.api.PlaintextAdminIntegrationTest.testLogStartOffsetCheckpoint and kafka.api.PlaintextAdminIntegrationTest.testAlterReplicaLogDi

2020-08-14 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178021#comment-17178021 ] Bill Bejeck commented on KAFKA-9263:   Test failure  [https://builds.apache.org/job/

[GitHub] [kafka] ijuma commented on pull request #9180: MINOR: corrected unit tests

2020-08-14 Thread GitBox
ijuma commented on pull request #9180: URL: https://github.com/apache/kafka/pull/9180#issuecomment-674304221 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Commented] (KAFKA-9543) Consumer offset reset after new segment rolling

2020-08-14 Thread Andrey Klochkov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178099#comment-17178099 ] Andrey Klochkov commented on KAFKA-9543: This issue is marked as fixed in 2.4.2 a