[jira] [Created] (KAFKA-8634) Update ZooKeeper to 3.5.5

Ismael Juma created KAFKA-8634: -- Summary: Update ZooKeeper to 3.5.5 Key: KAFKA-8634 URL: https://issues.apache.org/jira/browse/KAFKA-8634 Project: Kafka Issue Type: Improvement Repor

[jira] [Resolved] (KAFKA-7178) Is kafka compatible with zookeeper 3.5.x ?

[ https://issues.apache.org/jira/browse/KAFKA-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7178. Resolution: Duplicate KAFKA-8634 tracks updating to ZK 3.5.x. > Is kafka compatible with zookeeper

[jira] [Created] (KAFKA-8635) Unnecessary wait when looking up coordinator before transactional request

Denis Washington created KAFKA-8635: --- Summary: Unnecessary wait when looking up coordinator before transactional request Key: KAFKA-8635 URL: https://issues.apache.org/jira/browse/KAFKA-8635 Project

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

Hey Colin, I've got A couple more minor questions: AlterPartitionAssignmentsRequest: Should we make the `Topics` and `Partitions` field nullable as well, so we can appropriately cancel pending reassignments at all levels of granularity? I think this will be consistent with the rest of the request

Re: [DISCUSS] KIP-435: Internal Partition Reassignment Batching

Hey Stanislav, Thanks for the thorough look at the KIP! :) > Let me first explicitly confirm my understanding of the configs and the > algorithm: > * reassignment.parallel.replica.count - the maximum total number of > replicas that we can move at once, *per partition* > * reassignment.parallel.pa

[VOTE] KIP-484: Expose metrics for group and transaction metadata loading duration

Hi, I'd like to start a vote thread for KIP-484. This addition will provide visibility for how long partitions take to load in order to understand some inactivity seen in the consumer group. More info at https://cwiki.apache.org/confluence/display/KAFKA/KIP-484%3A+Expose+metrics+for+group+and+tra

[jira] [Created] (KAFKA-8636) Document behavior change for static members with `max.poll.interval.ms`

Boyang Chen created KAFKA-8636: -- Summary: Document behavior change for static members with `max.poll.interval.ms` Key: KAFKA-8636 URL: https://issues.apache.org/jira/browse/KAFKA-8636 Project: Kafka

Broker Startup Time (Prolonged URPs)

Hi All, I'm currently doing some work into investigating why our Kafka deployment has a prolonged period of URPs after a restart 30-45 minutes. At the moment we use a replication factor of 2 due to the cost associated with having another copy of each partition, however, we do plan to move to rep

[jira] [Created] (KAFKA-8637) WriteBatch objects leak off-heap memory

Sophie Blee-Goldman created KAFKA-8637: -- Summary: WriteBatch objects leak off-heap memory Key: KAFKA-8637 URL: https://issues.apache.org/jira/browse/KAFKA-8637 Project: Kafka Issue Type:

Re: Possible implementation for KAFKA-560

Hi Carlos, This is a really useful feature and we would like to have it as well. I think high_watermark == log_start_offset is a good starting point to consider but we may also have a case where the topic is empty and the clients producing it may be offline so we might end up garbage

Re: Possible implementation for KAFKA-560

I love it and also have few use-cases. Agree with Harsha that we need a KIP. To cover edge-cases and also clearly define the expected behavior, whether it will be implemented in the admin client or in a tool, etc. Gwen On Mon, Jul 8, 2019 at 1:52 PM Harsha wrote: > > Hi Carlos, >Thi

Kafka enable.auto.commit to false for executor even when its set to true

Hi Team, Even when I am setting the enable.auto.commit to true explicitly, its getting set to false during runtime. Its shows the below logs: 19/07/08 10:57:16 WARN KafkaUtils: overriding enable.auto.commit to false for executor 19/07/08 10:57:16 WARN KafkaUtils: overriding auto.offset.reset to

Re: PR review

Hello, A few requests have been sent already. Could this please be reviewed ? Our business implementation is holding due to this change. On Thu, 4 Jul 2019 at 13:33, M. Manna wrote: > https://github.com/apache/kafka/pull/6771 > > Could this be reviewed please ? > > On Wed, 3 Jul 2019 at 11:35

[jira] [Resolved] (KAFKA-6771) Make specifying partitions in RoundTripWorkload, ProduceBench more flexible

[ https://issues.apache.org/jira/browse/KAFKA-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe resolved KAFKA-6771. Resolution: Fixed > Make specifying partitions in RoundTripWorkload, ProduceBench more flex

[jira] [Created] (KAFKA-8638) Preferred Leader Blacklist (deprioritized list)

GEORGE LI created KAFKA-8638: Summary: Preferred Leader Blacklist (deprioritized list) Key: KAFKA-8638 URL: https://issues.apache.org/jira/browse/KAFKA-8638 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-447: Producer scalability for exactly once semantics

Hey Guozhang, I will correct my statement from last email. I don't think the read_committed (3.a) is necessary to be added to the OffsetFetch request, as if we are using EOS application, the underlying consumers within the group should always back off when there is pending offsets. Let me know if

Re: PR review

Hi M. Manna, I left a review. Take a look. Sorry for the delays. best, Colin On Mon, Jul 8, 2019, at 14:38, M. Manna wrote: > Hello, > > A few requests have been sent already. Could this please be reviewed ? Our > business implementation is holding due to this change. > > > > On Thu, 4 Ju

Re: [jira] [Created] (KAFKA-8638) Preferred Leader Blacklist (deprioritized list)

Hi,  I have created this ticket and would like to bounce this idea "Preferred Leader Blacklist" off this mailing list. I have listed a couple use-cases in my current Kafka environment that could benefit from this feature. If the community has high interests, I will start a KIP for this.  Note

[jira] [Created] (KAFKA-8639) Replace AddPartitionsToTxn request/response with automated protocol

Boyang Chen created KAFKA-8639: -- Summary: Replace AddPartitionsToTxn request/response with automated protocol Key: KAFKA-8639 URL: https://issues.apache.org/jira/browse/KAFKA-8639 Project: Kafka

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

> Now that we support multiple reassignment requests, users may add execute> > them incrementally. Suppose something goes horribly wrong and they want to> > revert as quickly as possible - they would need to run the tool with> > multiple rollback JSONs.  I think that it would be useful to ha

Build failed in Jenkins: kafka-2.0-jdk8 #282

See Changes: [cmccabe] MINOR: Split at first occurrence of '=' in kafka.py props parsing -- [...truncated 441.62 KB...] kafka.zk.ReassignPartitionsZNodeTest > testDecodeValid

Re: [DISCUSS] KIP-480 : Sticky Partitioner

Hello all, If there are no more comments or concerns, I would like to start the vote on this tomorrow afternoon. However, if there are still topics to discuss, feel free to bring them up now. Thank you, Justine On Tue, Jul 2, 2019 at 4:25 PM Justine Olshan wrote: > Hello again, > > Another up

Monitoring streams

Hello, We have multiple stream services that we're looking to monitor when they've been disconnected from the broker so that we can restart the services. I've looked at https://issues.apache.org/jira/browse/KAFKA-6520 and am wondering if anyone has suggestions on what we can do today to help ensu

Kafka - CDC SQL Server

Hi All, Would you all please to share to me step by step to configure Kafka connector to CDC SQL Server? I have Kafka with Debezium Connector to SQL Server that I don't know whether it's compatible or not if I want to connect it to CDC. I've tried to follow some use cases in the internet, but s

[jira] [Created] (KAFKA-8640) Replace OffsetFetch request/response with automated protocol

Boyang Chen created KAFKA-8640: -- Summary: Replace OffsetFetch request/response with automated protocol Key: KAFKA-8640 URL: https://issues.apache.org/jira/browse/KAFKA-8640 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk8 #3772

See Changes: [bbejeck] MINOR: improve RocksDBConfigSetter docs (#7009) [jason] MINOR: A few cleanups and compiler warning fixes (#6986) -- [...truncated 2.81 MB...] org.a

Build failed in Jenkins: kafka-trunk-jdk11 #679

See Changes: [bbejeck] MINOR: improve RocksDBConfigSetter docs (#7009) [jason] MINOR: A few cleanups and compiler warning fixes (#6986) -- [...truncated 2.56 MB...] org.a

[jira] [Resolved] (KAFKA-8591) NPE when reloading connector configuration using WorkerConfigTransformer

[ https://issues.apache.org/jira/browse/KAFKA-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8591. Resolution: Fixed Fix Version/s: 2.3.1 2.2.2 > NPE when reloading