Re: [ANNOUNCE] New committer: Damian Guy

2017-06-09 Thread Joe Stein
Congrats! ~ Joe Stein On Fri, Jun 9, 2017 at 6:49 PM, Neha Narkhede wrote: > Well deserved. Congratulations Damian! > > On Fri, Jun 9, 2017 at 1:34 PM Guozhang Wang wrote: > > > Hello all, > > > > > > The PMC of Apache Kafka is pleased to announce that w

Re: [VOTE] 0.10.0.0 RC6

2016-05-20 Thread Joe Stein
+1 ran quick start from source and binary release On Fri, May 20, 2016 at 1:07 PM, Ewen Cheslack-Postava wrote: > +1 validated connect with a couple of simple connectors and console > producer/consumer. > > -Ewen > > On Fri, May 20, 2016 at 9:53 AM, Guozhang Wang wrote: > > > +1. Validated mave

Re: [DISCUSSION] Keep docs updated per jira

2015-03-26 Thread Joe Stein
release push to the website... or something. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Thu, Mar 26, 2015 at 9:27 PM, Jun Rao wrote: > Hi, Everyone, > > Quite a few jiras these days require documentation changes (e

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations (Thread 2)

2015-04-16 Thread Joe Stein
the right error information so they know what they did wrong without much fuss. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Wed, Apr 15, 2015 at 1:23 PM, Andrii Biletskyi < andrii.bilets...@stealth.ly> wrote: > Guys, > >

Re: Can't see "KIP Template" after click Create on https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

2015-04-20 Thread Joe Stein
What is your confluence username? ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Apr 20, 2015 at 9:15 PM, Honghai Chen wrote: > Hi dear dev, > > Need create on KIP with title “Add one conf

Re: Can't see "KIP Template" after click Create on https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

2015-04-20 Thread Joe Stein
give it a try now ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Apr 20, 2015 at 9:22 PM, Honghai Chen wrote: > Username: waldenchen > Email:waldenc...@163.com > > Thanks, Honghai > > -Original Message-

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
d shy away from storing JSON in Zookeeper. Lets store bytes in Storage. - We should spend some time thinking through exceptions in the wire protocol maybe as part of this so it can keep moving forward. ~ Joe Stein On Tue, Apr 28, 2015 at 3:33 AM, Sun, Dapeng wrote: > Thank you f

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
ign which will prevent anyone from providing a > > custom implementation? > > * Did not understand the concern around wire protocol, we are adding > > AuthorizationException to indicate that an operation was not authorized. > > > > Thanks > > Parth > > > > On 4

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
Parth, Can you explain how "Mirror maker will have to start using new acl management tool") and it not affect any other client. If you aren't changing the wire protocol then how do clients use it? ~ Joe stein On Thu, Apr 30, 2015 at 3:15 PM, Parth Brahmbhatt < pbrahmbh.

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
move, weproposed that mirror > maker can just instantiate an instance of authorizer and call these apis > directly to get acls for a topic and add it to the destination cluster if > we want to add acls to be replicated as part of mirror maker. > > Thanks > Parth > > On 4/30/15,

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
be a bit more integration where the api responses were happening ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Thu, Apr 30, 2015 at 6:51 PM, Suresh Srinivas wrote: > Comment on AuthorizationException. I think the intent of excepti

Re: [VOTE] KIP-11- Authorization design for kafka security

2015-04-30 Thread Joe Stein
og above handle() than I am on the plug-in implementation options (less is more imho). If we do this approach the audit fits in nice because we are seeing more what happens in one place and decision made for access right there. ~ Joe Stein - - - - - - - - - - - - - - - - - http:/

Re: [DISCUSS] KIP-21 Configuration Management

2015-05-01 Thread Joe Stein
worried we put this change in like this and it works for quotas and maybe a few other things but nothing else gets dynamic and we don't get far enough for almost no more rolling restarts. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - -

Re: [DISCUSS] KIP-21 Configuration Management

2015-05-04 Thread Joe Stein
okers and now a new burden to understand dynamic properties. I think we need to add solutions for folks where we can to make things easier without having to add new items for them to contend with. Thanks! ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - -

Re: [VOTE] KIP-4 Admin Commands / Phase-1

2015-05-06 Thread Joe Stein
+1 (binding) ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, May 5, 2015 at 11:16 AM, Andrii Biletskyi < andrii.bilets...@stealth.ly> wrote: > Hi all, > > This is a voting thread for KIP-4 Phase-1. It will includ

Re: KAFKA-1977

2015-05-09 Thread Joe Stein
then it should be in the new java consumer, please. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Sat, May 9, 2015 at 2:52 PM, Will Funnell wrote: > Hey, > > Still waiting for some feedback on the patch for a while now, ple

Re: [DISCUSS] Add missing API to old high level consumer

2015-05-13 Thread Joe Stein
s the upgrade path we should continue on, imho. If we are going to phase out the scala clients then we need to strive to not be making changes to them on trunk. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Wed, May 13, 2015 at 6:

Re: [DISCUSS] Add missing API to old high level consumer

2015-05-14 Thread Joe Stein
trunk. ~ Joe Stein On Thu, May 14, 2015 at 8:00 PM, Jiangjie Qin wrote: > Hey Joe, > > Actually this API was asked for before, and we have several use cases in > LinkedIn as well. I thought we have added that in KAFKA-1650 but obviously > I forgot to do that. > > My underst

Re: [DISCUSS] Add missing API to old high level consumer

2015-05-15 Thread Joe Stein
every other or something. I will re-read Auth this weekend. I guess my question still is how do I test it. With SSL it is configure and it works or it doesn't. Auth is not so straightforward and more opinionated. ~ Joe Stein - - - - - - - - - - - - - - - - - h

Re: [Vote] KIP-11 Authorization design for kafka security

2015-05-18 Thread Joe Stein
+1 ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Fri, May 15, 2015 at 7:35 PM, Jun Rao wrote: > +1 > > Thanks, > > Jun > > On Fri, May 15, 2015 at 9:18 AM, Parth Brahmbhatt < > pbrahmbh...@horto

Mesos Community Networking Hangout

2015-05-28 Thread Joe Stein
e achieved with different implementations and use cases. What goes into mesos, what is a module, what is something to plugin that others can help define interfaces for, etc, etc. If you are interested let me know and I can add you to the invite, thanks! ~ Joe Stein - - - - - - - - - - - - - - - -

Re: Mesos Community Networking Hangout

2015-05-28 Thread Joe Stein
sorry, wrong email list :) ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Thu, May 28, 2015 at 11:41 AM, Joe Stein wrote: > Hi, a few folks from a few different companies (Cisco, Elodina, > Mesosphere, Moz) are going to be ha

Re: Nagging - pending review requests :)

2015-05-28 Thread Joe Stein
see below On Fri, May 29, 2015 at 2:25 AM, Jaikiran Pai wrote: > Could someone please look at these few review requests and let me know if > any changes are needed: > > https://reviews.apache.org/r/34394/ related to > https://issues.apache.org/jira/browse/KAFKA-1907 I haven't looked at all the

Re: Review Request 34394: Patch for KAFKA-1907

2015-05-29 Thread Joe Stein
tps://reviews.apache.org/r/34394/#comment137408> if we are going to add this it should be exposed as a configuration and written up in a KIP. We can't hard code values that folks won't understand without some clear information about why it is 5000 - Joe Stein On May 25, 2015, 3:49 a.m., Ja

Re: Nagging - pending review requests :)

2015-05-29 Thread Joe Stein
Hey Jai, see below On Fri, May 29, 2015 at 3:03 AM, Jaikiran Pai wrote: > Hi Joe, > > Comments inline. > > On Friday 29 May 2015 12:15 PM, Joe Stein wrote: > >> see below >> >> On Fri, May 29, 2015 at 2:25 AM, Jaikiran Pai >> wrote: >> >>

Re: Review Request 34103: Patch for KAFKA-2188

2015-05-30 Thread Joe Stein
/34103/#comment137708> is there a way to change this to not use control flow logic and still make sure we aren't killing the broker? - Joe Stein On May 12, 2015, 12:39 p.m., Andrii Biletskyi wrote: > > ---

Re: KIP Wiki

2015-06-01 Thread Joe Stein
We should probably have some release/vXYZ section so that over time we can keep track of what KIP where approved for what release, etc/ Anything not in a release folder (we could do now release/v0.8.3.0 for everything already approved) would be where it is deemed under discussion, or such. ~ Joe

Re: [DISCUSS] Compatability and KIPs

2015-01-12 Thread Joe Stein
er git or svn might also make sense also. I am not really opinionated on how we implement as long as we do implement something for these issues. Feature and/or byte changes should bump the version number, +1 /******* Joe Stein Founder, Principal Consultant

Re: Compatibility + Unknown APIs

2015-01-12 Thread Joe Stein
. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> / On Mon, Jan 12, 2015 at 8:37 PM, Jay

Re: [DISCUSS] 0.8.2-beta2 release

2015-01-12 Thread Joe Stein
? If we went with a) folks could use the artifacts staged in apache release repository so technically possible to-do. I am in favor with which ever folks would be most likely to start to push and/or finally push into production prior to final. /*** Joe Stein

Re: Heads up: KAFKA-1697 - remove code related to ack>1 on the broker

2015-01-15 Thread Joe Stein
re not going to support that then I am unclear what the use of "version" is based on our original intentions of having it because of the 0.7=>-0.8. We said no more breaking changes when we did that. - Joe Stein On Thu, Jan 15, 2015 at 12:38 PM, Ewen Cheslack-Postava wrote: > Right

Re: [DISCUSS] KIPs

2015-01-15 Thread Joe Stein
them and formalize that more if need be. /******* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> / On

Re: [DISCUSS] KIPs

2015-01-17 Thread Joe Stein
; > this is only applicable to things you absolutely will check in code > > for. > > >> We > > >> > also don't want to be making proposals before things are thought > > through, > > >> > which often requires writing the code. So

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-18 Thread Joe Stein
It works ok in gradle but fails if your using maven. taking a look at the patch you uploaded now. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.

Re: Review Request 30019: Patch for kafka-1876

2015-01-18 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30019/#review68587 --- Ship it! Ship It! - Joe Stein On Jan. 19, 2015, 1:51 a.m., Jun

Re: [kafka-clients] Re: Heads up: KAFKA-1697 - remove code related to ack>1 on the broker

2015-01-19 Thread Joe Stein
>> >>> >>> >> >>> dropping it for 0.9 is feasible, but I'll let client owners >> >>> >>> >> >>> help >> >>> >>> make >> >>> >>> >> >>> that call. >> >>> >>> >&

[DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-01-21 Thread Joe Stein
the JIRA that we should change. We should preserve --generate to be existing functionality for the next release it is in. If folks want to use --re-balance then great, it just won't break any upgrade paths, yet. /*** Joe Stein Founder, Principal Consu

[DISCUSS] KIP-8 - Decommission a broker

2015-01-21 Thread Joe Stein
. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> /

[DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-01-21 Thread Joe Stein
Hi, created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operations JIRA https://issues.apache.org/jira/browse/KAFKA-1694 /*** Joe Stein Founder, Principal Consultant Big Data Open Source

[DISCUSS] KIP-5 - Broker Configuration Management

2015-01-21 Thread Joe Stein
Created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-5+-+Broker+Configuration+Management JIRA https://issues.apache.org/jira/browse/KAFKA-1786 /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http

Re: [DISCUSS] KIP-5 - Broker Configuration Management

2015-01-22 Thread Joe Stein
ist thread links on the > KIP page. > Thanks, > Harsha > > > > On Wed, Jan 21, 2015, at 10:34 PM, Joe Stein wrote: > > Created a KIP > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-5+-+Broker+Configuration+Management &g

Re: [KIP-DISCUSSION] KIP-7 Security - IP Filtering

2015-01-22 Thread Joe Stein
. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> / On Wed, Jan 21, 2015 at 8:47 PM, Jeff Holoman wrote: > Posted a K

Re: Review Request 30199: Patch for KAFKA-1890

2015-01-22 Thread Joe Stein
apply the test cases, run test, see the failure, apply fix, verify the success. Thanks! - Joe Stein On Jan. 22, 2015, 11:25 p.m., Jiangjie Qin wrote: > > --- > This is an automatically generated e-mail. To reply, visit

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-01-22 Thread Joe Stein
ote it in java https://reviews.apache.org/r/29301/diff/7/?page=4#75 so we could do something like that, sure. > > 11. The other information that would be really useful to get would be > information about partitions--how much data is in the partition, what are > the segment offset

Re: [DISCUSS] KIP-8 - Decommission a broker

2015-01-22 Thread Joe Stein
make KIP-6 more complete. > > Thanks, > Neha > > > On Wed, Jan 21, 2015 at 10:20 PM, Joe Stein wrote: > > > Hi, created a KIP > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Decommission+a+broker > > > > JIRA related https://iss

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-01-22 Thread Joe Stein
t; > potentially be more work, but I'm not sure how much more. Has anyone > > thought about how to do it? > > > > -Jay > > > > On Wed, Jan 21, 2015 at 10:11 PM, Joe Stein > wrote: > > > > > Posted a KIP for --re-balance for partit

Re: [DISCUSS] KIP-5 - Broker Configuration Management

2015-01-22 Thread Joe Stein
files in terms of config management > and change control. And trying to support both may or may not be better. > > -Jay > > > On Wed, Jan 21, 2015 at 10:34 PM, Joe Stein wrote: > > > Created a KIP > > > > > https://cwiki.apache.org/confluence/display/KAFKA

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-23 Thread Joe Stein
I think that before we start making more changes to Mirror Maker there should be unit tests in place for it. Currently Mirror Maker is broker on trunk (there is a patch to fix it) because of a recent change. That is only going to get more unwieldily as more change happens. On Wed, Jan 21, 2015 at

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-23 Thread Joe Stein
Should value.serializer in the new java producer be defaulted to Array[Byte] ? I was working on testing some upgrade paths and got this ! return exception in callback when buffer cannot accept message ConfigException: Missing required configuration "value.serializer" which has no defau

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-24 Thread Joe Stein
hat exception will make them ask that > question right? > > -Jay > > On Fri, Jan 23, 2015 at 9:06 PM, Joe Stein wrote: > >> Should value.serializer in the new java producer be defaulted to >> Array[Byte] ? >> >> I was working on testing some upgrade paths

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-24 Thread Joe Stein
th the old clients and the > conclusion is that serialization is something you basically have to think > about to use Kafka and trying to guess just makes things worse. > > -Jay > > On Sat, Jan 24, 2015 at 2:51 PM, Joe Stein wrote: > >> Maybe. I think the StringSerialzer

Re: What to do when file.rename fails?

2015-01-25 Thread Joe Stein
This feels like another type of symptom from people using /tmp/ for their logs. Perosnally, I would rather use /mnt/data or something and if that doesn't exist on their machine we can exception, or no default and force set it. /******* Joe Stein Fo

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-26 Thread Joe Stein
topic deletion, > compaction and random testing > > On Mon, Jan 26, 2015 at 6:14 AM, Neha Narkhede wrote: > >> +1 (binding) >> Verified keys, quick start, unit tests. >> >> On Sat, Jan 24, 2015 at 4:26 PM, Joe Stein wrote: >> >> > That makes sense, tha

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 3

2015-01-30 Thread Joe Stein
+1 (binding) verified signatures, ran quick start, tests all passed. - Joe Stein On Fri, Jan 30, 2015 at 12:04 PM, Jun Rao wrote: > This is a reminder that the vote will close tomorrow night. Please test > RC3 out and vote before the deadline. > > Thanks, > > Jun > >

Re: [kafka-clients] Re: [VOTE] 0.8.2.0 Candidate 3

2015-02-02 Thread Joe Stein
Huzzah! Thanks Jun for preparing the release candidates and getting this out to the community. - Joe Stein On Mon, Feb 2, 2015 at 2:27 PM, Jun Rao wrote: > The following are the results of the votes. > > +1 binding = 3 votes > +1 non-binding = 1 votes > -1 = 0 votes > 0 = 0

[DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-02 Thread Joe Stein
also in 0.8.3 and think we should make sure it is what we want if so then: review, commit and keep going. Thoughts? /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop

Re: Review Request 30126: Patch for KAFKA-1845

2015-02-03 Thread Joe Stein
6/#comment116150> MEDIUM core/src/main/scala/kafka/server/KafkaConfig.scala <https://reviews.apache.org/r/30126/#comment116152> MEDIUM core/src/main/scala/kafka/server/KafkaConfig.scala <https://reviews.apache.org/r/30126/#comment116153> MEDIUM - Joe Stein On

Re: [DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-03 Thread Joe Stein
clude changes for a new patch. Then over the next day or two review, test and commit to trunk (or re-work if necessary). /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop

Re: Cannot stop Kafka server if zookeeper is shutdown first

2015-02-04 Thread Joe Stein
we know it works for different groups of folks. I think whoever might be interested in working on that should chime in, write up the KIP and lets start getting that discussion / release planning / work moving ahead. - Joe Stein On Wed, Feb 4, 2015 at 11:27 AM, Dana Powers wrote: > While on

Re: [DISCUSS] KIPs

2015-02-05 Thread Joe Stein
on the > > > wiki > > > >pages. It makes sense to do one or the other so all the comments > are > > > in one > > > >place and I think prior experience is that the wiki comments are > the > > > worse > > > >way. > > > >

Fwd: [jira] [Created] (AURORA-985) Move Aurora website source to subdirectory of git repo

2015-02-06 Thread Joe Stein
this looks like it might help us too with getting the release documentation content/changes along with code & test contributions in patches without the extra step with the site in the commits with svn -- Forwarded message -- From: Dave Lester (JIRA) Date: Tue, Dec 23, 2014 at 5:30

Re: [DISCUSS] ConfigDec Broker Changes on Trunk

2015-02-06 Thread Joe Stein
Tue, Feb 3, 2015 at 9:34 AM, Joe Stein wrote: > > > I updated the RB changing some of the HIGH to MEDIUM and LOW. > > > > There might be other or different opinions and they may change over time > so > > I don't really see h/m/l as a blocker to the patch going in. &g

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-02-06 Thread Joe Stein
rates on Guozhang's hot spot point. 3) anymore feedback? - Joe Stein On Fri, Jan 23, 2015 at 3:15 PM, Guozhang Wang wrote: > A centralized admin operation protocol would be very useful. > > One more general comment here is that controller is originally designed to > only talk to

Re: [DISCUSS] KIPs

2015-02-06 Thread Joe Stein
sk of things getting lost in the shuffle and missing changes, which does, will and always happen. We also need to discuss 0.8.3.0, 0.9.0.0 and such https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan it should all be KIP we think should be in where, right? - Joe Stein On Fri, Feb 6,

Re: Review Request 29893: Patch for KAFKA-1856

2015-02-08 Thread Joe Stein
e ever have a patch that has to go in 2 branches then we just then have 2 JIRA which is ok by me. - Joe Stein On Feb. 4, 2015, 11:44 p.m., Ashish Singh wrote: > > --- > This is an automatically generated e-mail. To reply,

Re: org.apache.common migration

2015-02-08 Thread Joe Stein
Jay, Can we add another package (or two) to org.apache.kafka.common for metadata and consensus. We can call them something else but the idea would be to have 1 common layer for meta data information (right now we put the json into zookeeper) and 1 common layer for asynchronous watches (which we w

Re: org.apache.common migration

2015-02-08 Thread Joe Stein
Argh, I just realized that the producer and consumer have already almost removed that so it wouldn't be in common but just something for the broker. Maybe later this year 0.9/1.0 item to crack into. On Sun, Feb 8, 2015 at 11:34 AM, Joe Stein wrote: > Jay, > > Can we add another p

Re: [DISCUSS] KIPs

2015-02-09 Thread Joe Stein
t; >> but I > > >> > > > >> don't think it is an issue of not caring to comment vs > having so > > >> many > > >> > > > >> KIPs and other code reviews in flight that people are just > > >> swamped. > > >> > &g

Re: [DISCUSS] KIPs

2015-02-09 Thread Joe Stein
they are getting built out... > > -Jay > > On Mon, Feb 9, 2015 at 6:10 PM, Joe Stein wrote: > > > I like the round-up, looks good, thanks Joel. > > > > I should be able to get KIP-5 and KIP-6 to have more detail in the coming > > days. > > > > ~

Re: [DISCUSS] KIP-8 Add a flush method to the new Java producer

2015-02-10 Thread Joe Stein
Jay, The .flush() call seems like it would be the best way if you wanted to-do a clean shutdown of the new producer? So, you could in your code "stop all incoming requests && producer.flush() && system.exit(value)" and know pretty much you won't drop anything on the floor. This can be done with

Re: Build failed in Jenkins: Kafka-trunk #389

2015-02-11 Thread Joe Stein
I ran into this issue locally too. I left it running overnight and it was stuck when I got back to it. This is where I had to kill the terminal at this morning. kafka.admin.TopicCommandTest > testConfigPreservationAcrossPartitionAlteration PASSED kafka.api.ApiUtilsTest > testShortStringASCII PASS

Re: [DISCUSS] KIP-12 - Kafka Sasl/Kerberos implementation

2015-02-11 Thread Joe Stein
Thanks Harsha, looks good so far. How were you thinking of running the KerberosTicketManager as a standalone process or like controller or is it a layer of code that does the plumbing pieces everywhere? ~ Joestein On Wed, Feb 11, 2015 at 12:18 PM, Harsha wrote: > Hi, > Here is the initial p

Re: Review Request 29647: Patch for KAFKA-1697

2015-02-11 Thread Joe Stein
tps://reviews.apache.org/r/29647/#comment118051> Could we change this to a match case? requiredAcks match { case 0 => {} case 1 => {} case -1 => {} case _ => {} } make it more concise to read through and scalish - Joe Stein On Feb. 12, 2015, 2:47 a.m.,

Re: [VOTE] KIP-8: Add a flush() method to the new producer

2015-02-18 Thread Joe Stein
+1 binding ~ Joestein On Feb 18, 2015 6:50 PM, "Jay Kreps" wrote: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Add+a+flush+method+to+the+producer+API > > +1 binding > > -Jay >

Re: [VOTE] 0.8.2.1 Candidate 1

2015-02-21 Thread Joe Stein
-1729 please. +1 (binding) ~ Joe Stein On Fri, Feb 20, 2015 at 9:08 PM, ted won wrote: > +1 > > On Friday, February 20, 2015, Guozhang Wang wrote: > > > +1 binding. > > > > Checked the md5, and quick start. > > > > Some minor comments: > > > &

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 1

2015-02-22 Thread Joe Stein
Jun, Can we also add https://issues.apache.org/jira/browse/KAFKA-1724 to the next RC please? Thanks! ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Sun, Feb 22, 2015 at 11:59 AM, Jun Rao wrote: > We identified at least one m

Re: How to get a JIRA assigned

2015-02-23 Thread Joe Stein
Jay, I thought it was the same issue like with confluence and comments and why we have to grant rights for that. Bots coming and reassigning everything to them or something in JIRA. We could ask/open a ticket with INFRA, if nothing else maybe help come up with a different way to solve it. ~ Joes

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-02-24 Thread Joe Stein
;> description > > >> > - > > >> > >> so > > >> > >> > I > > >> > >> > > > > added errorDesription field where you can at least leave > > >> > >> > > > > e

Re: Announcing the Confluent Platform built on Apache Kafka

2015-02-25 Thread Joe Stein
Awesome! The future of schema management, has arrived ~ Joestein On Wed, Feb 25, 2015 at 1:34 PM, Gwen Shapira wrote: > Congrats, Confluent team. > > This is super exciting :) > > > On Wed, Feb 25, 2015 at 10:31 AM, Neha Narkhede wrote: > > > Folks, > > > > We, at Confluent

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-03-02 Thread Joe Stein
manage better? To discuss https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals in progress and related JIRA that are interdependent and common work. ~ Joe Stein On Tue, Feb 24, 2015 at 2:59 PM, Jay Kreps wrote: > Let's stay on Google hangouts that will also re

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-03 Thread Joe Stein
l(JUnit3Suite.scala:149) at kafka.api.ProducerFailureHandlingTest.testNotEnoughReplicasAfterBrokerShutdown(ProducerFailureHandlingTest.scala:355) This happens to me all the time on a few different machines. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Mar 2, 2015 at 7:3

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-03 Thread Joe Stein
Ok, lets fix the transient test failure on trunk agreed not a blocker. +1 quick start passed, verified artifacts, updates in scala https://github.com/stealthly/scala-kafka/tree/0.8.2.1 and go https://github.com/stealthly/go_kafka_client/tree/0.8.2.1 look good ~ Joe Stein

Re: [VOTE] KIP-2 - Refactor brokers to allow listening on multiple ports and IPs

2015-03-03 Thread Joe Stein
+1 ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, Mar 3, 2015 at 3:14 PM, Gwen Shapira wrote: > Details are in the wiki: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-2+-+Refactor+brokers+to+allow+

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-03-08 Thread Joe Stein
ing, etc. > > Just by giving people a fairly clear description of the change and how it > fits into other efforts that could happen in the area really helps keep > things focused on what you want. > > -Jay > > > On Wed, Jan 21, 2015 at 10:11 PM, Joe Stein wrote: > >

Re: Can I be added as a contributor?

2015-03-09 Thread Joe Stein
Grant, I added you. Grayson and Grant, you should both also please setup Confluence accounts and we can grant perms to Confluence also too for your username. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, Mar 10, 2015 at 12:54 AM

Re: [kafka-clients] Re: [VOTE] 0.8.2.1 Candidate 2

2015-03-10 Thread Joe Stein
Thanks Jun for getting this release out the door and everyone that contributed to the work in 0.8.2.1, awesome! ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Mon, Mar 9, 2015 at 2:12 PM, Jun Rao wrote: > The following are

Re: [DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-03-11 Thread Joe Stein
make sure that we aren't running scope creep on the change but are making sure that folks understand the motivation behind a new feature. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Sun, Mar 8, 2015 at 1:21 PM, Joe Stein w

Re: Can I be added as a contributor?

2015-03-11 Thread Joe Stein
Grant, I added your perms for Confluence. Grayson, I couldn't find a confluence account for you so couldn't give you perms. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Tue, Mar 10, 2015 at 8:20 AM, Grant Henke wrote: &g

0.8.3 release plan

2015-03-11 Thread Joe Stein
re we going to try to up the version and go with 0.9.0? 0.8.2.0 ended up getting very bloated and that delayed it much longer than we had originally communicated to the community and want to make sure we take that feedback from the community and try to improve upon it. Thanks! ~ Joe

Re: [VOTE] KIP-15 add a close method with timeout to KafkaProducer

2015-03-11 Thread Joe Stein
rent than flush(time); close() and why close has its own timeout also? Lastly, what is the forceClose flag? This isn't documented in the public interface so it isn't clear how to completely use the feature just by reading the KIP. ~ Joe Stein - - - - - - - - - - - - - - - - -

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-03-12 Thread Joe Stein
discussion and stabilizing what we have before trying to introducing more new features. Perhaps a new KIP can get added for the new features you are talking about which can reference this and once this is committed that work can begin for folks that are able to contribute to work on it? ~ Joe Stein

Re: [DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-03-12 Thread Joe Stein
ng the functionality now. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Thu, Mar 12, 2015 at 11:08 AM, Guozhang Wang wrote: > The reason I want to bring it up sooner than later is that future changing > a defined request protocol takes quite

Re: [DISCUSS] KIP 16 - Replica lag tuning

2015-03-12 Thread Joe Stein
in the ISR. Also, what is the definition of "caught up" now without the number of messages? If it is === i worry about that not happening in some networks where it is always off by one or something maybe? ~ Joe Stein - - - - - - - - - - - - - - - - - h

KIP hangout next Tuesday?

2015-03-13 Thread Joe Stein
. Right now all i have for the agenda is KIP-4 - new message formats and other open discussion items I will send out invites if I miss you or you want in please let me know and i can update, np. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - -

Re: [VOTE] KIP-16: Replica Lag Tuning

2015-03-15 Thread Joe Stein
+1 one more minor nit, please update the KIP with the link to the discuss thread too. ~ Joe Stein - - - - - - - - - - - - - - - - - http://www.stealth.ly - - - - - - - - - - - - - - - - - On Sun, Mar 15, 2015 at 5:27 PM, Neha Narkhede wrote: > +1 on the KIP. Minor nit: "it is deeme

Re: KIP-4 Wiki Update

2016-03-30 Thread Joe Stein
If the meta data change for KIP-4 happens maybe we just update the KIP-4 page for the release, it would be great to have this available in 0.10 On Wed, Mar 30, 2016 at 3:36 PM, Grant Henke wrote: > Additionally feel free to review the PR (#1095 > ) to s

Re: [ANNOUNCE] New Kafka Committer Ewen Cheslack-Postava

2015-12-08 Thread Joe Stein
Ewen, Congrats! ~ Joestein On Tue, Dec 8, 2015 at 2:51 PM, Guozhang Wang wrote: > Congrats Ewen! Welcome onboard. > > Guozhang > > On Tue, Dec 8, 2015 at 11:42 AM, Liquan Pei wrote: > > > Congrats, Ewen! > > > > On Tue, Dec 8, 2015 at 11:37 AM, Neha Narkhede > wrote: > > > > > I am pleased t

Re: Unifying kafka-clients call signatures

2015-12-22 Thread Joe Stein
keep doing that until 0.9.1.0 and call it stable then. It looks like the KIP has to get written up and voted on. The discuss looks like it happened in the JIRA we should give folks at least time (via a [DISCUSS]) to see that and can comment and chat more if need be in the JIRA. ~ Joe Stein On T

Re: [VOTE] KIP-36 - Rack aware replica assignment

2016-01-10 Thread Joe Stein
work on shipping this. Left some other comments on the PR sorry if I missed the entire [discuss] thread on this. ~ Joe Stein On Sun, Jan 10, 2016 at 9:31 PM, Stevo Slavić wrote: > +1 (non-binding) > > On Tue, Jan 5, 2016 at 1:30 AM, Allen Wang wrote: > > > I would like to call

Re: [VOTE] Deprecating the old Scala producers for 0.10.0.0

2016-03-03 Thread Joe Stein
+1 ~ Joestein On Mar 3, 2016 3:01 PM, "Neha Narkhede" wrote: > +1 > > On Thu, Mar 3, 2016 at 2:36 PM, Ismael Juma wrote: > > > Hi all, > > > > The new Java producer was introduced in 0.8.2.0 (released in February > > 2015). It has become the default implementation for various tools since > > 0.

  1   2   3   4   5   6   7   8   9   10   >