Re: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-10-11 Thread Edoardo Comar
Thanks Rajini for the PR review, as agreed we have updated KIP-302 to match the code so the new config value for the entry client.dns.lookup is "use_all_dns_ips" (underscores instead of dot separators) cheers Edo ------ Edoardo Comar

Re: New release branch 2.1.0

2018-10-11 Thread Edoardo Comar
Thanks Rajini for the PR review, as agreed we have updated KIP-302 to match the code so the new config value for the entry client.dns.lookup is "use_all_dns_ips" (underscores instead of dot separators) ------ Edoardo Comar IBM Event Stre

Re: [ANNOUNCE] New Committer: Manikumar Reddy

2018-10-12 Thread Edoardo Comar
Well done Manikumar ! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: "Matthias J. Sax" To: dev Cc: users Date: 11/10/2018 23:41 Subject:Re: [ANNOUNCE] New Committer: Manik

Re: [VOTE] KIP-380: Detect outdated control requests and bounced brokers using broker generation

2018-10-31 Thread Edoardo Comar
Thanks for the KIP. +1 (non-binding) -- Edoardo Comar IBM Event Streams From: Harsha Chintalapani To: Patrick Huang , dev@kafka.apache.org Cc: "dev@kafka.apache.org" Date: 30/10/2018 19:11 Subject:Re: [VOT

[DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-21 Thread Edoardo Comar
nd Mickael ------ Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth,

Re: [ANNOUNCE] Apache Kafka 2.1.0

2018-11-21 Thread Edoardo Comar
al One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > > A big thank you for the following 100 contributors to this release! > > > > Ahmed Al Mehdi, Aleksei Izmalkin, Alex Dunayevsky, Ami

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Edoardo Comar
ffsets. The flag is needed to distinguish a batch with a desired base offset of 0, from a regular batch for which offsets need to be generated. I would not restrict a principal to only send-with-offsets (by making that mandatory via the ACL). Thanks Edo & Mickael -------

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-23 Thread Edoardo Comar
our interest ! cheers Edo ---------- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN Stanislav Kozlovski wrote on 22/11/2018 22:32:42: > From: Stanislav Kozlovski > To: dev@kafka.apache.org > Date: 22/11/2018 22:33 > Subject: Re: [D

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
a in their committed offsets) - > assumming replication takes > 0 time you'd need to handle some dups, > but every kafka consumer setup needs to know how to handle those > anyway. can you please clarify? We do not expect any cooperation from users applications. thanks! E&M

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
since this KIP seems to be designed fro active-passive > > > failover (there can be no produce traffic except the replicator) > > > wouldnt a solution based on seeking to a time offset be more generic? > > > your producers could checkpoint the last (say log append) timestamp

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
ime offset be more generic? > > your producers could checkpoint the last (say log append) timestamp of > > records theyve seen, and when restoring in the remote site seek to > > those timestamps (which will be metadata in their committed offsets) - > > assumming replicatio

Re: [DISCUSS] KIP-396: Add Commit/List Offsets Operations to AdminClient

2018-11-30 Thread Edoardo Comar
-partition field in the Kafka ListOffsets Request API so you're not exposing the full APi power with the option ------ Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Mickael Maison To: dev Date: 30/11/2018

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-10 Thread Edoardo Comar
(shameless bump) any additional feedback is welcome ... thanks! Edoardo Comar wrote on 27/11/2018 15:35:09: > From: Edoardo Comar > To: dev@kafka.apache.org > Date: 27/11/2018 15:35 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication >

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-13 Thread Edoardo Comar
Hi, as we haven't got any more feedback, we'd like to start a vote on KIP-391 on Monday https://cwiki.apache.org/confluence/display/KAFKA/KIP-391%3A+Allow+Producing+with+Offsets+for+Cluster+Replication ------ Edoardo Comar IBM Event Stre

Re: [DISCUSS] KIP-402: Improve fairness in SocketServer processors

2018-12-14 Thread Edoardo Comar
ber of client connections on a different listener. do you think it would make sense to also allow the `num.network.threads` to have an optional per-listener prefix ? ciao, Edo -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-24 Thread Edoardo Comar
+1 non-binding thanks for the KIP -- Edoardo Comar IBM Event Streams Harsha wrote on 21/12/2018 20:17:03: > From: Harsha > To: dev@kafka.apache.org > Date: 21/12/2018 20:17 > Subject: Re: [VOTE] KIP-382 MirrorMaker 2.0 >

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-07 Thread Edoardo Comar
Hi, I delayed starting the voting thread due to the festive period. I would like to start it this week. Has anyone any more feedback ? -- Edoardo Comar IBM Event Streams Edoardo Comar wrote on 13/12/2018 17:50:30: > From: Edoardo Comar &

[VOTE] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-08 Thread Edoardo Comar
P-391 ------ Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Re: [VOTE] KIP-396: Add Commit/List Offsets Operations to AdminClient

2019-01-08 Thread Edoardo Comar
+1 (non-binding) Thanks Mickael! On Tue, 8 Jan 2019 at 17:39, Patrik Kleindl wrote: > +1 (non-binding) > Thanks, sounds very helpful > Best regards > Patrik > > > Am 08.01.2019 um 18:10 schrieb Mickael Maison >: > > > > Hi all, > > > > I'd like to start the vote on KIP-396: > > > https://cwiki.

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-16 Thread Edoardo Comar
Bravo Vahid!!! Edo From: Mickael Maison To: Users Cc: dev Date: 16/01/2019 08:48 Subject:Re: [ANNOUNCE] New Committer: Vahid Hashemian Congratulations Vahid! Well done! On Wed, Jan 16, 2019 at 6:42 AM Dongjin Lee wrote: > > Congratulations, Vahid!! > > On Wed, Jan 16

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-08 Thread Edoardo Comar
: > > > +1 (non-binding) > > > > best, > > Colin > > > > > > On Wed, Apr 25, 2018, at 02:45, Edoardo Comar wrote: > > > Hi, > > > > > > The discuss thread on KIP-277 ( > > > https://www.mail-archive.com/dev@kafka.apach

Re: [VOTE] KIP-294 - Enable TLS hostname verification by default

2018-05-10 Thread Edoardo Comar
+1 (non-binding) On 10 May 2018 at 09:36, Manikumar wrote: > +1 (non-binding) > > Thanks. > > On Wed, May 9, 2018 at 10:09 PM, Mickael Maison > wrote: > > > +1, thanks for the KIP! > > > > On Wed, May 9, 2018 at 4:41 PM, Ted Yu wrote: > > > +1 > > > > > > On Wed, May 9, 2018 at 8:28 AM, Rajini

Re: [VOTE] KIP-283: Efficient Memory Usage for Down-Conversion

2018-05-10 Thread Edoardo Comar
+1 (non-binding) On 10 May 2018 at 09:56, Rajini Sivaram wrote: > Hi Dhruvil, Thanks for the KIP! > > +1 (binding) > > Regards, > > Rajini > > On Wed, May 9, 2018 at 9:28 PM, Dhruvil Shah wrote: > > > Thanks for the feedback, Jason and Ismael. I renamed the config to > > "message.downconversion

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-10 Thread Edoardo Comar
+1 (non-binding) On 10 May 2018 at 10:29, zhenya Sun wrote: > +1 non-binding > > > 在 2018年5月10日,下午5:19,Manikumar 写道: > > > > +1 (non-binding). > > Thanks. > > > > On Thu, May 10, 2018 at 2:33 PM, Mickael Maison < > mickael.mai...@gmail.com> > > wrote: > > > >> +1 (non binding) > >> Thanks > >>

[DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-14 Thread Edoardo Comar
Hi all, We just opened a KIP to add support for the client to use all IPs returned by DNS for the brokers The details are here - https://cwiki.apache.org/confluence/display/KAFKA/KIP-302+-+Enable+Kafka+clients+to+use+all+DNS+resolved+IP+addresses The JIRA and provisional PR (where the discussi

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-14 Thread Edoardo Comar
ent. > > So to me the client will try every single endpoint behind any > bootstrap.servers record. > > See > https://github.com/apache/kafka/pull/4485/commits/24757eb7b06bcf8c7d7649c85232c52b5d54f0e4#diff-89ef153462e64c250a21bd324ae1a851 > which calls getAllByName like you sug

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-14 Thread Edoardo Comar
also solve what this KIP is trying to achieve. >> >> When parsing bootstrap.servers, KIP-235 has the client add all underlying >> hostnames and IPs. >> And this happens before hitting the NetworkClient. >> >> So to me the client will try every single endpoint behind any

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-15 Thread Edoardo Comar
Hi, bumping the thread as the current vote count for this KIP is 2 binding +1 5 non-binding +1 thanks, Edo On 8 May 2018 at 16:14, Edoardo Comar wrote: > Hi, > bumping the thread as the current vote count for this KIP is > 2 binding +1 > 5 non-binding +1 > > so still miss

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-16 Thread Edoardo Comar
the load balancers. In Jonathan's case, I presume he has Kerberos > principals for the equivalent of tlp-eu-west.apache.org and > themis.apache.org. We would want to support both scenarios regardless of > the security protocol, just need to come up with configuration options that >

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-16 Thread Edoardo Comar
Skrzypek > > -----Original Message- > From: Edoardo Comar [mailto:edoco...@gmail.com] > Sent: 16 May 2018 17:03 > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved > IP addresses > > Hi Rajini, > > I

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-17 Thread Edoardo Comar
a user can decide to use cnames or > not (depending on their certificates and Kerberos principals in their > environment) and it would work. > > Jonathan Skrzypek > > -Original Message- > From: Edoardo Comar [mailto:edoco...@gmail.com] > Sent: 16 May 2018 21:59 >

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-18 Thread Edoardo Comar
bumping again as this KIP is still missing one binding vote ... voting so far : binding: Guozhang, Rajini non-binding: Ted, Stephane, Vahid, Colin, Manikumar, Matt Edo On 17 May 2018 at 03:15, Matt Farmer wrote: > +1 (non-binding) > > On Tue, May 15, 2018 at 4:26 AM, Edoardo Com

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-21 Thread Edoardo Comar
Hi, KIP freeze is tomorrow. Anyone else would like to cast their vote ? voting so far : binding: Guozhang, Rajini non-binding: Ted, Stephane, Vahid, Colin, Manikumar, Matt On 18 May 2018 at 09:38, Edoardo Comar wrote: > bumping again as this KIP is still missing one binding vote ... > &g

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-21 Thread Edoardo Comar
: > +1 (binding) > > Thanks > > On Mon, 21 May 2018 at 11:26 Edoardo Comar wrote: > >> Hi, KIP freeze is tomorrow. Anyone else would like to cast their vote ? >> >> voting so far : >> binding: Guozhang, Rajini >> non-binding: Ted, Stephane, Vahid, Coli

Re: [VOTE] KIP-306: Configuration for Delaying Response to Failed Client Authentication

2018-05-21 Thread Edoardo Comar
+1 (non-binding) Thanks ! On 21 May 2018 at 19:18, Bill Bejeck wrote: > Thanks for the KIP. > > +1 > > -Bill > > On Mon, May 21, 2018 at 1:41 PM, Ted Yu wrote: > >> +1 >> >> On Mon, May 21, 2018 at 9:02 AM, Guozhang Wang wrote: >> >> > Thanks Dhruvil for the KIP, +1 from me (binding). >> > >> >

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-05-25 Thread Edoardo Comar
ehaviour : bootstrap.servers, advertised.listeners, both > > Thoughts ? > > Jonathan Skrzypek > > > -Original Message- > From: Edoardo Comar [mailto:edoco...@gmail.com] > Sent: 17 May 2018 23:50 > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-302 - Enab

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-25 Thread Edoardo Comar
; > On Wed, Apr 25, 2018 at 2:45 AM Edoardo Comar wrote: > >> Hi, >> >> The discuss thread on KIP-277 ( >> https://www.mail-archive.com/dev@kafka.apache.org/msg86540.html ) >> seems to have been fruitful and concerns have been addressed, please allow >> me star

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-06-28 Thread Edoardo Comar
escribe' though, as one such admin should be able to know whether a topic exists. Edoardo ---------- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Guozhang Wang To: dev@kafka.apache.org Date: 27/06/2018 19:42 Sub

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-15 Thread Edoardo Comar
Congratulations Matthias ! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: UMESH CHAUDHARY To: dev@kafka.apache.org Date: 15/01/2018 11:47 Subject:Re: [ANNOUNCE] New committer: Matthias J. Sax

Re: [VOTE] KIP-229: DeleteGroups API

2018-01-16 Thread Edoardo Comar
+1 (non binding) - thanks Vahid -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Ted Yu To: dev@kafka.apache.org Date: 15/01/2018 20:33 Subject:Re: [VOTE] KIP-229: DeleteGroups API +1 On Mon, Jan

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-17 Thread Edoardo Comar
Congratulations Rajini! Bravissima! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Guozhang Wang To: dev@kafka.apache.org Date: 17/01/2018 19:29 Subject:Re: [ANNOUNCE] New Kafka PMC Member: Rajini

Re: [VOTE] KIP-257 - Configurable Quota Management

2018-03-23 Thread Edoardo Comar
Thanks for the KIP, Rajini +1 (non binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Ted Yu To: dev@kafka.apache.org Date: 22/03/2018 22:17 Subject:Re: [VOTE] KIP-257 - Configurable Quota

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-29 Thread Edoardo Comar
congratulations Dong! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Hu Xi To: "us...@kafka.apache.org" , "dev@kafka.apache.org" Date: 29/03/2018 00:04 Subject:答复: [ANNOUNCE] New

Re: [ANNOUNCE] Apache Kafka 1.1.0 Released

2018-03-29 Thread Edoardo Comar
Great to hear! thanks for driving the release process. -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Mickael Maison To: Users Cc: kafka-clients , dev Date: 29/03/2018 10:46 Subject:Re

[DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-03-29 Thread Edoardo Comar
+-+Fine+Grained+ACL+for+CreateTopics+API Feedback and suggestions are welcome, thanks. Edo & Mickael -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered in Eng

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-03-29 Thread Edoardo Comar
zations. cheers Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Stephane Maarek To: dev@kafka.apache.org Date: 29/03/2018 18:11 Subject:Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API Not against, but this needs to support regex f

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-03-29 Thread Edoardo Comar
addAcls(Set[Acl], Resource) as a regex to be matched against the actual Resource name in kafka.security.auth.Authorizer.authorize(RequestChannel.Session, Operation, Resource) Thoughts? cheers Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-04-17 Thread Edoardo Comar
r backward compatibility. Though we'd like to plan a deprecation for the Create Cluster check, if wildcard support in ACLs will be added in the future. thoughts ? ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-04-17 Thread Edoardo Comar
x27;ll revise the kip by including, not rejecting that approach. This is still much simpler than wildcard support and goes some way towards having a better fine grained topic authorization support. Edo ---------- Edoardo Comar IBM Message Hub IBM UK L

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-04-17 Thread Edoardo Comar
further thoughts, we'd like to start a vote next week. ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Edoardo Comar To: dev@kafka.apache.org Date: 17/04/2018 12:12 Subject:Re: [DISCUSS] KIP-277 -

Re: [VOTE] Kafka 2.0.0 in June 2018

2018-04-18 Thread Edoardo Comar
thanks Ismael +1 (non-binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Rajini Sivaram To: dev Date: 18/04/2018 22:05 Subject:Re: [VOTE] Kafka 2.0.0 in June 2018 Hi Ismael, Thanks for

[VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-04-25 Thread Edoardo Comar
+API I will update the small PR to the latest KIP semantics if the vote passes (as I hope :-). cheers Edo -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered

Re: [DISCUSS] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-01 Thread Edoardo Comar
, Vahid S Hashemian wrote: > Hi Edo, > > Thanks for addressing that concern in the KIP. > And I agree that in the long run the create cluster permission should be > deprecated. > > --Vahid > > > > > From: Edoardo Comar > To: dev@kafka.apache.org > Date:

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-11 Thread Edoardo Comar
i, 25 May 2018 at 12:36, Edoardo Comar wrote: > Hi Jonathan, > I'm ok with an expandable enum for the config that could be extended > in the future. > It is marginally better than multiple potentially conflicting config > entries. > > Though as I think the change for KIP-

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-18 Thread Edoardo Comar
l the brokers are up, the cluster is fully functioning even if just one of the LBs is up. HTH, Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Eno Thereska To: dev@kafka.apache.org Date: 18/09/2018 10:24 Su

[VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-18 Thread Edoardo Comar
anks!! Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-18 Thread Edoardo Comar
Yes I should, should't I ? :-) ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Rajini Sivaram To: dev Date: 18/09/2018 15:33 Subject:Re: [DISCUSS] KIP-302 - Enable Kafka clients to use all

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-18 Thread Edoardo Comar
+1 (non binding) Thanks Ron & Rajini ! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Ron Dagostino To: dev@kafka.apache.org Date: 18/09/2018 16:09 Subject:[VOTE] KIP 368: Allow SASL Connection

RE: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-20 Thread Edoardo Comar
Hi Jonathan we'll update the PR for KIP-302 soon. We do not need KIP-235 actually, they only share the name of the configuration entry. thanks Edo PS - we need votes :-) ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO2

RE: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-23 Thread Edoardo Comar
bumping the thread as the KIP needs 2 more binding votes ... pretty please ... -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: "Skrzypek, Jonathan" To: "dev@kafka.apache.org" Date: 20/0

Re: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-25 Thread Edoardo Comar
Many thanks to all that voted, This KIP has passed the vote - within the COB of 24/09/2018 - with 3 binding votes (Rajini, Damian, Gwen) and 4 non-binding votes (Eno, Jonathan and implicitly :-) Mickael and me) Edo -- Edoardo Comar IBM Event

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-25 Thread Edoardo Comar
Congratulations Colin ! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Ismael Juma To: Kafka Users , dev Date: 25/09/2018 09:40 Subject:[ANNOUNCE] New committer: Colin McCabe Hi all, The PMC

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-09-25 Thread Edoardo Comar
Hi Dong many thanks for driving the release! KIP-81 previously voted as adopted has a ready-to-review JIRA and PR. Shall we just amend the wiki ? -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Dong Lin To

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-09-26 Thread Edoardo Comar
). I'm happy if you incorporate the enhancements to create/alter that allow a check against the cluster metadata and leave out - to anther KIP, or maybe I'll rewrite 170 the changes to delete. thanks Edo ------ Edoardo Comar IBM Message

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-09-26 Thread Edoardo Comar
Edo -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Paolo Patierno To: "dev@kafka.apache.org" Date: 26/09/2017 14:10 Subject:Re: [DISCUSS] KIP-204 : adding records deletion operation to the

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-09-26 Thread Edoardo Comar
Furthermore, the deletion case could be implemented by a custom Authorizer, as discussed in the KIP-204 thread. -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Edoardo Comar To: dev@kafka.apache.org Date: 26

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-09-26 Thread Edoardo Comar
Paolo, the link you posted is to KIP-11, and I can't find the text you quoted. Our KIP-170 did indeed suggest a TopicDeletePolicy - but, as said, for our intent an Authorizer implementation will be usable instead, thanks ------ Edoardo Comar

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-09-26 Thread Edoardo Comar
Thanks Tom, what about a single method in ClusterState interface ClusterState { public Map topicsState(); } which could return a read-only snapshot of the cluster metadata ? -- Edoardo Comar IBM Message Hub IBM UK Ltd

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-09-26 Thread Edoardo Comar
r big upfront allocations. ciao, Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Tom Bentley To: dev@kafka.apache.org Date: 26/09/2017 17:39 Subject:Re: [DISCUSS] KIP-201: Rationalising Policy inter

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2017-10-04 Thread Edoardo Comar
resources already used in the cluster (eg number of partitions). thanks Edo -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Tom Bentley To: dev@kafka.apache.org Date: 02/10/2017 15:15 Subject:Re

Re: [VOTE] KIP-201: Rationalising policy interfaces

2017-10-12 Thread Edoardo Comar
Thanks Tom with the last additions (changes to the protocol) it now supersedes KIP-170 +1 non-binding -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Tom Bentley To: dev@kafka.apache.org Date: 11/10/2017 09

Re: [ANNOUNCE] New committer: Onur Karaman

2017-11-06 Thread Edoardo Comar
Congratulations Onur ! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Jun Rao To: "dev@kafka.apache.org" , "us...@kafka.apache.org" Date: 06/11/2017 17:24 Subject:[ANNOUNCE]

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-02-04 Thread Edoardo Comar
replicating the value as-is - it would edit it by stripping the epoch. As previously mentioned, the __consumer_offsets topic does not need to be replicated by producing-with-offsets to it. -- Edoardo Comar IBM Event Streams On Wed, 23 Jan 2019 at

Re: [ANNOUNCE] New Committer: Bill Bejeck

2019-02-14 Thread Edoardo Comar
Well done Bill! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Rajini Sivaram To: dev Date: 14/02/2019 09:25 Subject:Re: [ANNOUNCE] New Committer: Bill Bejeck Congratulations, Bill! On Thu, Feb

Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask is stopped

2019-04-15 Thread Edoardo Comar
Thanks Andrew. +1 (non-binding) -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Mickael Maison To: dev Date: 10/04/2019 10:14 Subject:Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask is

[DISCUSS] KIP-170: Enhanced TopicCreatePolicy and introduction of TopicDeletePolicy

2017-06-22 Thread Edoardo Comar
elcome and much needed. Thanks, Edoardo ------ Edoardo Comar IBM Message Hub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered

Re: Minimum Replication Factor

2017-06-23 Thread Edoardo Comar
Hi Stephane, we enforce the constraint in a custom create topic policy (see ' create.topic.policy.class.name') ------ Edoardo Comar IBM Message Hub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN From: Stephane Maarek To

Re: [DISCUSS] KIP-170: Enhanced TopicCreatePolicy and introduction of TopicDeletePolicy

2017-06-23 Thread Edoardo Comar
so that we have options if we need to extend > it. 3. Agree, we should have the DeletePolicy define its RequestMetadata class, too > 4. Do we want to enhance the AlterConfigs policy as well? 4. I don't see why not :-) thanks Edo -----

Re: Minimum Replication Factor

2017-06-27 Thread Edoardo Comar
ics, hence the policy applies. ciao, Edo ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: James Cheng To: dev@kafka.apache.org Date: 27/06/2017 09:15 Subject:Re: Minimum Replication Factor The create.topic

Re: Is Kafka client 0.10.2.1 backward compatible

2017-06-28 Thread Edoardo Comar
Hi Saurabh the 0.10.2.x client is backward compatible up to the 0.10.0.0 broker, not earlier. ciao Edo -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN Tom Crayford wrote on 28/06/2017 15:21:04: > From: Tom Crayford &

Re: [DISCUSS] KIP-175: Additional '--describe' views for ConsumerGroupCommand

2017-07-04 Thread Edoardo Comar
Thanks Vahid, I like the KIP. One question - could we keep the current "--describe" behavior unchanged and introduce "--only-xxx" options to filter down the full output as you proposed ? ciao, Edo ------ Edoardo Comar IBM Mes

Re: [DISCUSS] KIP-175: Additional '--describe' views for ConsumerGroupCommand

2017-07-04 Thread Edoardo Comar
Hi Vahid, no we are not relying on parsing the current output. I just thought that keeping the full output isn't necessarily that bad as it shows some sort of history of how a group was used. ciao Edo ------ Edoardo Comar IBM Message Hub IBM U

Re: [VOTE] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-24 Thread Edoardo Comar
Thanks Rajini! +1 (non-binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Rajini Sivaram To: dev Date: 24/08/2017 18:30 Subject:[VOTE] KIP-152 - Improve diagnostics for SASL authentication

Re: [DISCUSS] KIP-170: Enhanced TopicCreatePolicy and introduction of TopicDeletePolicy

2017-09-05 Thread Edoardo Comar
Hi Ismael, I was on leave for a long while. I will update the KIP. Edo On 5 September 2017 at 11:42, Ismael Juma wrote: > Hi Edoardo, > > Do you intend to update the KIP to avoid the introduction of another > interface? > > Ismael > > On Fri, Jun 23, 2017 at 5:47

Re: [VOTE] KIP-189 - Improve principal builder interface and add support for SASL

2017-09-08 Thread Edoardo Comar
day :-) cheers ------ Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Jason Gustafson To: dev@kafka.apache.org Date: 07/09/2017 17:23 Subject:Re: [VOTE] KIP-189 - Improve principal builder interface and add support for SASL I am closing the

Re: [VOTE] KIP-190: Handle client-ids consistently between clients and brokers

2017-09-14 Thread Edoardo Comar
+1 (non-binding) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Ismael Juma To: dev@kafka.apache.org Date: 14/09/2017 09:56 Subject:Re: [VOTE] KIP-190: Handle client-ids consistently between clients

Re: [DISCUSS] Client Side Auto Topic Creation

2016-06-29 Thread Edoardo Comar
necessary authorizations. Disclaimer - our deployments of Kafka as a service (IBM MessageHub) have auto creation on the broker disabled :-) cheers, Edo ------ Edoardo Comar MQ Cloud Technologies eco...@uk.ibm.com +44 (0)1962 81 5576 IBM UK Ltd, Hu

Re: [VOTE] KIP-60: Make Java client class loading more flexible

2016-07-01 Thread Edoardo Comar
+1 (non binding) -- Edoardo Comar MQ Cloud Technologies eco...@uk.ibm.com +44 (0)1962 81 5576 IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North

Re: [VOTE] KIP-84: Support SASL SCRAM mechanisms

2016-11-15 Thread Edoardo Comar
+1 (non-binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

Re: [VOTE] KIP-81: Bound Fetch memory usage in the consumer

2016-12-05 Thread Edoardo Comar
+1 (non binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2016-12-07 Thread Edoardo Comar
+1 (non-binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

Re: [VOTE]: KIP-97: The client compatibility KIP

2016-12-08 Thread Edoardo Comar
+1 (non-binding) I have some concerns on the potential for complexity and testing requirement, but in general having a client interoperable with two broker version would be great for many users. -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

2016-12-08 Thread Edoardo Comar
tion to include additional transactional resources, so that the consumption from another topic just becomes a special case of a more general "distributed" txn. Edo ---------- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO2

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

2016-12-09 Thread Edoardo Comar
ous 3 questions below, thanks. Edo -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Ports

Re: [DISCUSS] KIP-83 - Allow multiple SASL PLAIN authenticated Java clients in a single JVM process

2016-12-13 Thread Edoardo Comar
(February timeframe 0.10.2 ? 0.11 ?). so we're waiting for Rajini's https://issues.apache.org/jira/browse/KAFKA-4259 on which our changes are based. thanks Edo ------ Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park

Re: [DISCUSS] KIP-81: Max in-flight fetches

2016-12-14 Thread Edoardo Comar
e=45 APIKEY=1 FETCH * size=6 APIKEY=12 HEARTBEAT * size=45 APIKEY=1 FETCH * size=45 APIKEY=1 FETCH What do you think? ------ Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited

Re: [DISCUSS] KIP-83 - Allow multiple SASL PLAIN authenticated Java clients in a single JVM process

2016-12-14 Thread Edoardo Comar
Hi Ismael, I have retired the KIP and updated the PR. Can't wait for https://issues.apache.org/jira/browse/KAFKA-4259 to be merged :-) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Li

Re: [VOTE] KIP-90 Remove zkClient dependency from Streams

2016-12-20 Thread Edoardo Comar
+1 (non-binding) thanks! -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth

Re: [ANNOUCE] Apache Kafka 0.10.1.1 Released

2016-12-22 Thread Edoardo Comar
e.org/dist/kafka/0.10.1.1/RELEASE_NOTES.html. ------ Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, Nor

Re: [VOTE] KIP-81: Bound Fetch memory usage in the consumer

2017-03-29 Thread Edoardo Comar
Hi Mickael, as discussed we could change the priority parameter to be an int rather than a boolean. That's a bit more extensible -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Li

  1   2   3   4   >