kafka - authenticate producers only

2018-03-30 Thread Vasily Ivanov
Hello, Is it possible to allow anyone to read from any topic over PLAINTEXT, but force SASL auth and ACLs for producers? I am using kafka 1.0.0

delivery semantics?

2018-03-30 Thread Victor L
Can someone clarify it: - "At most once": messages may be lost but are never redelivered Does it mean: "commit, when message is received by leader partition, retries disabled for producer no matter of ISR status"? - "At least once": commit only when message is ackd by all partitions in replication

Re: Kafka Mirrormaker issue

2018-03-30 Thread Siva A
Any other update on this? On Mon, Mar 26, 2018, 7:42 PM Andrew Otto wrote: > I’ve had similar problems, but I don’t have an explanation for ya :/ > > On Sun, Mar 25, 2018 at 12:19 PM, Siva A wrote: > > > Hi, > > > > We have 3 nodes Kafka cluster(0.10.0.1) and its mirroring the data from > > ano

Re: Is Restart needed after change in trust store for Kafka 1.1 ?

2018-03-30 Thread Raghav
Anyone ? On Thu, Mar 29, 2018 at 6:11 PM, Raghav wrote: > Hi > > We have a 3 node Kafka cluster running. Time to time, we have some changes > in trust store and we restart Kafka to take new changes into account. We > are on Kafka 0.10.x. > > If we move to 1.1, would we still need to restart Kafk

Re: Is Restart needed after change in trust store for Kafka 1.1 ?

2018-03-30 Thread Hans Jespersen
This is the KIP-226 for Dynamic Broker Configuration https://cwiki.apache.org/confluence/display/KAFKA/KIP-226+-+Dynamic+Broker+Configuration and this is the JIRA for what is released in Apache Kafka 1.1.

suggestion for 1.1.0 release notes

2018-03-30 Thread Gibson, Bill (ArcSight)
The release notes include this resolved issue: [KAFKA-6390] - Update ZooKeeper to 3.4.11, Gradle and other minor updates I saw 3.4.10 in the downloaded bits, not 3.4.11. It looks like the update to ZooKeeper 3.4.11 was done, but then reverted (commit 825bfe5) because of ZOOKEEPER-2960. The reve

Re: suggestion for 1.1.0 release notes

2018-03-30 Thread Ted Yu
Nice reminder. zookeeper community seems to be close to releasing 3.4.12 : http://search-hadoop.com/m/ZooKeeper/SvKKH1jwLHJq2tr22?subj=Re+VOTE+Apache+ZooKeeper+release+3+4+12+candidate+1 FYI On Fri, Mar 30, 2018 at 3:38 PM, Gibson, Bill (ArcSight) < bill.gib...@microfocus.com> wrote: > The rel

Re: Kafka Mirrormaker issue

2018-03-30 Thread Andrew Otto
I’m currently stuck on MirrorMaker version 0.9, and I’m not sure when the new consumer client became the default. Does your 0.10 version have a —new.consumer option listed in the help message? If so, then the new consumer client is not the default. I haven’t seen the problem you are describing (

Re: suggestion for 1.1.0 release notes

2018-03-30 Thread Ismael Juma
I updated the JIRA to make this clearer. Ismael On Fri, Mar 30, 2018 at 3:38 PM, Gibson, Bill (ArcSight) < bill.gib...@microfocus.com> wrote: > The release notes include this resolved issue: > > [KAFKA-6390] - Update ZooKeeper to 3.4.11, Gradle and other minor updates > > I saw 3.4.10 in the dow