Re: [kafka-clients] [VOTE] 2.3.0 RC1

On Tue, Jun 4, 2019, at 23:17, Colin McCabe wrote: > Hi all, > > This is the first candidate for the release of Apache Kafka 2.3.0. > > This release includes many new features, including: > * Support for incremental cooperative rebalancing > * An in-memory session store and window store for Kafka

RE: kafka connect stops consuming data when kafka broker goes down

Hello, Anyone has any information on this issue. Created a critical ticket for the same, since this is a major stability issue for connect framework. https://issues.apache.org/jira/browse/KAFKA-8485?filter=-2 Thanks. Kaushik, NOKIA From: Srinivas, Kaushik (Nokia - IN/Bangalore) Sent: Monday, Jun

Re: Contributor Mailing List

It's self-service: https://kafka.apache.org/contact On 6/4/19 11:01 AM, surya teja wrote: > Hi Team, > Could you add me to contributor mailing list? > > > Thanks, > Surya > signature.asc Description: OpenPGP digital signature

[VOTE] 2.3.0 RC1

Hi all, This is the first candidate for the release of Apache Kafka 2.3.0. This release includes many new features, including: * Support for incremental cooperative rebalancing * An in-memory session store and window store for Kafka Streams * An API for allowing users to determine what operations

[jira] [Created] (KAFKA-8485) Kafka connect worker does not respond when kafka broker goes down with data streaming in progress

kaushik srinivas created KAFKA-8485: --- Summary: Kafka connect worker does not respond when kafka broker goes down with data streaming in progress Key: KAFKA-8485 URL: https://issues.apache.org/jira/browse/KAFKA-8

Build failed in Jenkins: kafka-trunk-jdk8 #3702

See Changes: [cshapi] KAFKA-4893; Fix deletion and moving of topics with long names [github] Improve logging in the consumer for epoch updates (#6879) [github] MINOR: Update docs to say 2.3 (#6881) ---

[VOTE] KIP-475: New Metric to Measure Number of Tasks on a Connector

Hi all, Like like to start voting in the following KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-475%3A+New+Metric+to+Measure+Number+of+Tasks+on+a+Connector Discussion thread: https://lists.apache.org/thread.html/bf7c92224aa798336c14d7e96ec8f2e3406c61879ec381a50652acfe@%3Cdev.kafka.a

Re: [DISCUSS] KIP-475: New Metric to Measure Number of Tasks on a Connector

Thanks, everyone, for the feedback. It looks like there's support, so I'll open the voting thread. Cyrus On Tue, Jun 4, 2019 at 9:02 PM Randall Hauch wrote: > Sorry that I was not clear. Yes, I was suggesting the state-specific counts > were in addition to the simple task count you originally

Re: [DISCUSS] KIP-475: New Metric to Measure Number of Tasks on a Connector

Sorry that I was not clear. Yes, I was suggesting the state-specific counts were in addition to the simple task count you originally proposed. Thanks for taking my suggestion into account -- the updated KIP looks great. Thanks for contributing this improvement, Cyrus! Best regards, Randall On T

Jenkins build is back to normal : kafka-2.3-jdk8 #39

See

Re: contributor access

Hi, Balazs, Thanks for your interest. Just added you to the contributor list. Jun On Tue, Jun 4, 2019 at 5:56 PM Balazs Bence Sari wrote: > Dear Kafka Team, > > please register me as a contributor to the Kafka project. > > My github id: benyoka > My JIRA id: bsari > > Br > Bence > *Balázs Benc

contributor access

Dear Kafka Team, please register me as a contributor to the Kafka project. My github id: benyoka My JIRA id: bsari Br Bence *Balázs Bence Sári* | Staff Software Engineer t. (3670) 340-3 <(3670)3403341>341 cloudera.com [image: Cloudera] [im

Contributor Mailing List

Hi Team, Could you add me to contributor mailing list? Thanks, Surya

Re: [DISCUSS] KIP-475: New Metric to Measure Number of Tasks on a Connector

Randall, I've updated the KIP to include all of your recommendations! Cyrus On Tue, Jun 4, 2019 at 2:55 PM Cyrus Vafadari wrote: > Randall, > > I plan to update the public details section and the performance impact as > you recommended. > > Regarding state-specific counts, I do agree this is a

Build failed in Jenkins: kafka-trunk-jdk8 #3701

See Changes: [wangguoz] KAFKA 8311: better handle timeout exception on Stream thread (#6662) -- [...truncated 2.50 MB...] org.apache.kafka.streams.test.OutputVerifierTest

[jira] [Created] (KAFKA-8484) ProducerId reset can cause IllegalStateException

Jason Gustafson created KAFKA-8484: -- Summary: ProducerId reset can cause IllegalStateException Key: KAFKA-8484 URL: https://issues.apache.org/jira/browse/KAFKA-8484 Project: Kafka Issue Type

[jira] [Created] (KAFKA-8483) Possible reordering of messages by producer after UNKNOWN_PRODUCER_ID error

Jason Gustafson created KAFKA-8483: -- Summary: Possible reordering of messages by producer after UNKNOWN_PRODUCER_ID error Key: KAFKA-8483 URL: https://issues.apache.org/jira/browse/KAFKA-8483 Project

[jira] [Created] (KAFKA-8482) alterReplicaLogDirs should be better documented

Colin P. McCabe created KAFKA-8482: -- Summary: alterReplicaLogDirs should be better documented Key: KAFKA-8482 URL: https://issues.apache.org/jira/browse/KAFKA-8482 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-8449) Restart task on reconfiguration under incremental cooperative rebalancing

[ https://issues.apache.org/jira/browse/KAFKA-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe resolved KAFKA-8449. Resolution: Fixed > Restart task on reconfiguration under incremental cooperative rebalanci

Re: [VOTE] KIP-460: Admin Leader Election RPC

Hi all, During the implementation of KIP-460, we discovered that we had to make some minor changes to the design. I have updated the KIP wiki[1]. You can see the difference here[2]. At a high-level we made the following changes: 1. Added a top level ErrorCode to the response for errors that a

Re: [DISCUSS] KIP-460: Admin Leader Election RPC

Hi all, During the implementation of KIP-460, we discovered that we had to make some minor changes to the design. I have updated the KIP wiki[1]. You can see the difference here[2]. At a high-level we made the following changes: 1. Added a top level ErrorCode to the response for errors that a

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Hey Bruno, I tend to agree with Guozhang on this matter although you do bring up some good points that should be addressed. Regarding 1) I think it is probably fairly uncommon in practice for users to leverage the individual store names passed to RocksDBConfigSetter#setConfig in order to specify o

Re: [DISCUSS] KIP-475: New Metric to Measure Number of Tasks on a Connector

Randall, I plan to update the public details section and the performance impact as you recommended. Regarding state-specific counts, I do agree this is a useful addition. Before I make the change, I'd like to agree that these state-specific counts should be in addition to the already-proposed tot

Re: [VOTE] KIP-476: Add Java AdminClient interface

> The existing `AdminClient` will be marked as deprecated. What's the reasoning behind this? I'm fine with the other changes, but would prefer to keep the existing public API intact if it's not hurting anything. Also, what will AdminClient.create() return? Would it be a breaking change? Ryanne

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

Hi Guozhang, After some thoughts, I tend to be in favour of the option with metrics for each physical RocksDB instance for the following reasons: 1) A user already needs to be aware of segmented state stores when providing a custom RocksDBConfigSetter. In RocksDBConfigSetter one can specify setti

[jira] [Resolved] (KAFKA-8385) Fix leader election RPC for all partition so that only partition that had elections are returned

[ https://issues.apache.org/jira/browse/KAFKA-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio resolved KAFKA-8385. --- Resolution: Fixed We ended up implementing this on the original PR:

[jira] [Created] (KAFKA-8481) Clients may fetch incomplete set of topic partitions just after topic is created

Anna Povzner created KAFKA-8481: --- Summary: Clients may fetch incomplete set of topic partitions just after topic is created Key: KAFKA-8481 URL: https://issues.apache.org/jira/browse/KAFKA-8481 Project:

[jira] [Created] (KAFKA-8480) Clients may fetch incomplete set of topic partitions during cluster startup

Anna Povzner created KAFKA-8480: --- Summary: Clients may fetch incomplete set of topic partitions during cluster startup Key: KAFKA-8480 URL: https://issues.apache.org/jira/browse/KAFKA-8480 Project: Kafk

Re: [DISCUSS] KIP-475: New Metric to Measure Number of Tasks on a Connector

Thanks, Cyrus -- this will be quite useful. I do have a few comments/requests. Can you please be more specific about the public details about the metric? What is the MBean name on which the metric will appear? For example, the AK documentation (https://kafka.apache.org/documentation/#connect_monit

Re: [DISCUSS] KIP-333 Consider a faster form of rebalancing

Hey Matthias, I took a quick overview of this proposal. My impression is that the proposal lacks concrete use case to support it. For example, the goal here is to immediately resume processing the latest data being populated, then we could just reset application to point to latest offset. If t

Re: [DISCUSSION] KIP-418: A method-chaining way to branch KStream

Thanks for the idea, Matthias, it does seem like this would satisfy everyone. Returning the map from the terminal operations also solves the problem of merging/joining the branched streams, if we want to add support for the compliment later on. Under your suggestion, it seems that the name is requ

Re: [ANNOUNCE] Apache Kafka 2.2.1

Thanks for managing the release, Vahid! Regards, Rajini On Tue, Jun 4, 2019 at 4:45 PM Viktor Somogyi-Vass wrote: > Thanks Vahid! > > On Tue, Jun 4, 2019 at 5:20 PM Colin McCabe wrote: > > > Thanks, Vahid. > > > > best, > > Colin > > > > On Mon, Jun 3, 2019, at 07:23, Vahid Hashemian wrote: >

[jira] [Created] (KAFKA-8479) kafka-topics does not allow client config settings using "--config"

Yeva Byzek created KAFKA-8479: - Summary: kafka-topics does not allow client config settings using "--config" Key: KAFKA-8479 URL: https://issues.apache.org/jira/browse/KAFKA-8479 Project: Kafka

[VOTE] KIP-476: Add Java AdminClient interface

Hi folks As there's been no chatter on this KIP I'm assuming it's non-contentious, (or just boring), hence I'd like to call a vote for KIP-476: https://cwiki.apache.org/confluence/display/KAFKA/KIP-476%3A+Add+Java+AdminClient+Interface Thanks, Andy

Re: [ANNOUNCE] Apache Kafka 2.2.1

Thanks Vahid! On Tue, Jun 4, 2019 at 5:20 PM Colin McCabe wrote: > Thanks, Vahid. > > best, > Colin > > On Mon, Jun 3, 2019, at 07:23, Vahid Hashemian wrote: > > The Apache Kafka community is pleased to announce the release for Apache > > Kafka 2.2.1 > > > > This is a bugfix release for Kafka 2.

[jira] [Created] (KAFKA-8478) Poll for more records before forced processing

John Roesler created KAFKA-8478: --- Summary: Poll for more records before forced processing Key: KAFKA-8478 URL: https://issues.apache.org/jira/browse/KAFKA-8478 Project: Kafka Issue Type: Improv

Re: [ANNOUNCE] Apache Kafka 2.2.1

Thanks, Vahid. best, Colin On Mon, Jun 3, 2019, at 07:23, Vahid Hashemian wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.2.1 > > This is a bugfix release for Kafka 2.2.0. All of the changes in this > release can be found in the release notes: > https:

RE: Kafka Connect

Yeah, I tried it. But it works only on CDC mode. And I need connector which executes queries. -Message d'origine- De : Sagar [mailto:sagarmeansoc...@gmail.com] Envoyé : mardi 4 juin 2019 15:29 À : dev@kafka.apache.org Objet : Re: Kafka Connect Hi meirkhan, You can give debezium a shot.

Re: Kafka Connect

Hi meirkhan, You can give debezium a shot. It has a connector for mongodb On Tue, 4 Jun 2019 at 6:56 PM, wrote: > Hello Kafka! > > Here is my case. I need the Kafka Connector to Mongodb which imitates JDBC > Source Connector. > So that data is loaded to Kafka by periodically executing a query.

Kafka Connect

Hello Kafka! Here is my case. I need the Kafka Connector to Mongodb which imitates JDBC Source Connector. So that data is loaded to Kafka by periodically executing a query. I could not find any such tool. Can you give any resources or advices on it? Thank you, Meirkhan

Build failed in Jenkins: kafka-2.3-jdk8 #38

See Changes: [matthias] KAFKA-8155: Add 2.2.0 release to system tests (#6597) -- [...truncated 1.87 MB...] kafka.admin.DescribeConsumerGroupTest > testDescribeStateWithMultiP

Build failed in Jenkins: kafka-2.3-jdk8 #37

See Changes: [rhauch] KAFKA-8404: Add HttpHeader to RestClient HTTP Request and Connector REST -- [...truncated 2.91 MB...] kafka.zk.KafkaZkClientTest > testIsrChangeNotific

Build failed in Jenkins: kafka-trunk-jdk8 #3700

See Changes: [github] HOTFIX: Allow multi-batches for old format and no compression (#6871) [rhauch] KAFKA-8404: Add HttpHeader to RestClient HTTP Request and Connector REST [github] KAFKA-8155: Add 2.2.0 rele