please care and vote for Chinese people under cruel autocracy of CCP, great thanks!

Hi all, Sorry for disturbing you guys. Though I don't think here as a proper place to do this, I need your help, your vote, your holy vote, for us Chinese, for conscience and justice, for better world. In the over 70 years of ruling over China, the Chinese Communist Party has done many horrible

Re: server-side message filter

The other problem would be that kafka has no idea of the serdes you use in your messages ie it only sees the key and value as bytes so it would be difficult to implement generic filtering in the broker. for your second problem it seems that creating separate topics for respective destinations solv

Re: server-side message filter

Hi, thx for reply.we have 2 situation to use server-side filter,that also mean advantage consumer filter doen't have: 1.as Guozhang said,server filter would reduce network cost. we use aws ec2 to provide kafka, all of them and kafka clients in different aws regions to guarantee availability. ne

[jira] [Created] (KAFKA-8846) Unexpected results joining a KStream to a KTable after repartitioning

Thomas Crowley created KAFKA-8846: - Summary: Unexpected results joining a KStream to a KTable after repartitioning Key: KAFKA-8846 URL: https://issues.apache.org/jira/browse/KAFKA-8846 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #3876

See Changes: [wangguoz] MINOR: Only send delete request if there are offsets in map (#7256) -- [...truncated 2.60 MB...] kafka.controller.PartitionStateMachineTest > tes

Re: [DISCUSS] KIP-486 Support for pluggable KeyStore and TrustStore

*Hi Harsha/Maulin,I am following KIP-486 and KIP-492 and it seems https://github.com/apache/kafka/pull/7090 is the right solution when one wants to register custom factory class for KeyManager and TrustManager. User can easily configure custom implementa

Re: [DISCUSS] KIP-486 Support for pluggable KeyStore and TrustStore

Hi Harsha As we synced-up offline on this topic, we hope you don't have any more clarifications that you are seeking. If that is the case, can you please help us move this forward and discuss what changes you would expect on the KIP design in order to make it valuable contribution? Just FYI - we

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

Hi all, After some discussion with Jun and Stan, we decided that we should bump the version of the topics znode from 1 to 2. The bump is backwards compatible (older brokers can read the v2 znode). I have updated the KIP. best, Colin On Thu, Aug 8, 2019, at 11:09, Colin McCabe wrote: > Hi Ko

Re: [DISCUSS] KIP-507: Securing Internal Connect REST Endpoints

HI all, Wow, thanks for all the feedback! Happy to see this proposal getting some love :) RE Konstantine's comments: > I've read the discussions regarding why the rebalancing protocol is used here and your intention to follow the approach which was recently used in order to elegantly support up

[jira] [Created] (KAFKA-8845) Detect and abort stalled transactions

Jason Gustafson created KAFKA-8845: -- Summary: Detect and abort stalled transactions Key: KAFKA-8845 URL: https://issues.apache.org/jira/browse/KAFKA-8845 Project: Kafka Issue Type: Improveme

Build failed in Jenkins: kafka-2.3-jdk8 #97

See Changes: [wangguoz] MINOR: Only send delete request if there are offsets in map (#7256) -- [...truncated 59.58 KB...]

[jira] [Created] (KAFKA-8844) Add max lso lag metric

Jason Gustafson created KAFKA-8844: -- Summary: Add max lso lag metric Key: KAFKA-8844 URL: https://issues.apache.org/jira/browse/KAFKA-8844 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk8 #3875

See Changes: [ismael] MINOR: Initialize BrokerTopicMetrics with no topic tag greedily (#7198) [ismael] KAFKA-8837: KafkaMetricReporterClusterIdTest may not shutdown -- [.

[jira] [Created] (KAFKA-8843) Zookeeper migration tool support for TLS

Pere Urbon-Bayes created KAFKA-8843: --- Summary: Zookeeper migration tool support for TLS Key: KAFKA-8843 URL: https://issues.apache.org/jira/browse/KAFKA-8843 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-507: Securing Internal Connect REST Endpoints

Hey Chris, The KIP makes sense to me, and I think it's a very natural way to solve the issue at hand. I had two questions about the automatic rollout logic. Does this roll-out ratchet the protocol version irreversibly? What is the expected behavior when the feature has been enabled, and a worker

KIP-382: MirrorMaker 2.0 progress to delivery?

Hi, KIP-382 (MirrorMaker 2.0) has been approved for a while now but the code hasn’t yet made it into Kafka. If my memory serves me well, it looked like a candidate for 2.3 and it’s now a candidate for 2.4. For such a significant feature, I guess it’s going to take a little time to mature and th

Re: server-side message filter

The reduction on network cost is a valid point: letting the consumer to do the filtering would waste the network bandwidth as many bytes would be dropped on the floor directly afterwards. But note that letting brokers to filter on fetch response means that we cannot use nio zero-copy as we need to

Re: server-side message filter

I do not think this will be implemented in the server. Why not simply create a consumer that filters as required and outputs to a new topic? > On Aug 28, 2019, at 7:48 AM, Xiangyuan LI wrote: > > Hi, > I want to know whether kafka has any plan to filter message on > server-side.this can reduce

Jenkins build is back to normal : kafka-trunk-jdk11 #780

See

[jira] [Created] (KAFKA-8842) Reading/Writing confused in Connect QuickStart Guide

Franz van Betteraey created KAFKA-8842: -- Summary: Reading/Writing confused in Connect QuickStart Guide Key: KAFKA-8842 URL: https://issues.apache.org/jira/browse/KAFKA-8842 Project: Kafka

server-side message filter

Hi, I want to know whether kafka has any plan to filter message on server-side.this can reduce network flow obviously when many groups subscribe the same one topic and only need part of message.

Re: European Commission Hackathon - 5/6 October 2019 - registration

Dear Sayat, Thanks for your interest. I've forwarded your feedback about the registration form. It should be fixed now. Sorry for the inconvenience ! I hope to meet you at the hackathon. Kind regards, Denis On 2019/08/27 16:39:59, Sayat Satybaldiyev wrote: > Thank you, Denis, for sharing i