[jira] [Commented] (KAFKA-713) Update Hadoop producer for Kafka 0.8 changes

2013-01-18 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557898#comment-13557898 ] Neha Narkhede commented on KAFKA-713: - Sam, thanks for the patch. I tried applying it o

Re: Abou Kafka 0.8 producer throughput test

2013-01-18 Thread Neha Narkhede
>> producer.num.acks=0 There is still a difference between the 0.7 and 0.8 Kafka behavior in the sense that in 0.7, the producer fired away requests at the broker without waiting for an ack. In 0.8, even with num.acks=0, the producer writes are going to be synchronous and it won't be able to send

[jira] [Updated] (KAFKA-713) Update Hadoop producer for Kafka 0.8 changes

2013-01-18 Thread Sam Shah (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Shah updated KAFKA-713: --- Attachment: KAFKA-713.patch > Update Hadoop producer for Kafka 0.8 changes > -

[jira] [Updated] (KAFKA-713) Update Hadoop producer for Kafka 0.8 changes

2013-01-18 Thread Sam Shah (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Shah updated KAFKA-713: --- Fix Version/s: 0.8.1 Labels: hadoop (was: ) Affects Version/s: 0.8 Statu

[jira] [Created] (KAFKA-713) Update Hadoop producer for Kafka 0.8 changes

2013-01-18 Thread Sam Shah (JIRA)
Sam Shah created KAFKA-713: -- Summary: Update Hadoop producer for Kafka 0.8 changes Key: KAFKA-713 URL: https://issues.apache.org/jira/browse/KAFKA-713 Project: Kafka Issue Type: Bug Repo

Re: default configs

2013-01-18 Thread Jay Kreps
Well, but the proposal was that topic-level configs are loaded when you run the create_topic command, so wouldn't that be what you are asking for? -Jay On Fri, Jan 18, 2013 at 1:57 PM, Joe Stein wrote: > how about a command line script (bin/kafka-config-init.sh) to load in a > file for the con

Re: default configs

2013-01-18 Thread Joe Stein
how about a command line script (bin/kafka-config-init.sh) to load in a file for the configs to initialize the config values in zookeerper but kafka reads the configs from zookeeper another script can also have options for doing updates (bin/kafka-config-update.sh) if we provide a writing mechani

[jira] [Updated] (KAFKA-705) Controlled shutdown doesn't seem to work on more than one broker in a cluster

2013-01-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-705: - Attachment: kafka-705-v1.patch Here's a simple fix. I don't really see any good reason why we shouldn't a

[jira] [Assigned] (KAFKA-711) NPE in TRUNK broker

2013-01-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps reassigned KAFKA-711: --- Assignee: Jay Kreps > NPE in TRUNK broker > --- > > Key: KAFKA-711

Re: parittioner runtime error with kafka 0.8

2013-01-18 Thread Jay Kreps
Hmmm, so I would like to turn this into a bug for us, since at the very least the error is confusing, but I am not quite sure what was going on. At least one issue is the error doesn't make it clear whether this is for the key serializer or value serializer and could be cleaned up. Let me try to re

Re: default configs

2013-01-18 Thread Jay Kreps
Yes please, any help very much appreciated. I am not sure if I understand what you are proposing, though. Are you saying support both the config file and zk for topic-level configs? I hate to do things where the answer is "do both"...I guess I feel that although everyone walks away happy it ends u

Re: Abou Kafka 0.8 producer throughput test

2013-01-18 Thread S Ahmed
I see ok, so if you wanted to compare .7 with .8 on the same footing, then you would set it to 0 right? (since 0.7 is fire and forget) producer.num.acks=0 On Thu, Jan 17, 2013 at 11:45 PM, Jun Rao wrote: > I means wait for the data reaches all replicas (that are in sync). > > Thanks, > > Jun >

[jira] [Created] (KAFKA-712) Controlled shutdown tool should provide a meaningful message if a controller failover occurs during the operation

2013-01-18 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-712: Summary: Controlled shutdown tool should provide a meaningful message if a controller failover occurs during the operation Key: KAFKA-712 URL: https://issues.apache.org/jira/browse/KAFKA-

[jira] [Updated] (KAFKA-711) NPE in TRUNK broker

2013-01-18 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-711: Affects Version/s: 0.8.1 > NPE in TRUNK broker > --- > > Key: KAFKA-711

[jira] [Commented] (KAFKA-705) Controlled shutdown doesn't seem to work on more than one broker in a cluster

2013-01-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557481#comment-13557481 ] Joel Koshy commented on KAFKA-705: -- I think this is why it happens: https://github.com/ap

[jira] [Created] (KAFKA-711) NPE in TRUNK broker

2013-01-18 Thread John Fung (JIRA)
John Fung created KAFKA-711: --- Summary: NPE in TRUNK broker Key: KAFKA-711 URL: https://issues.apache.org/jira/browse/KAFKA-711 Project: Kafka Issue Type: Bug Reporter: John Fung This

Re: parittioner runtime error with kafka 0.8

2013-01-18 Thread Jane Wang
finally, I made the partitioner working after changing the partition key to be string. and add the key.serializer.class to the config props. thanks for the help. On Thu, Jan 17, 2013 at 7:57 PM, Jane Wang wrote: > I also tried with the constructor > ExpertSearchCollectionPartitioner(VerifiableP

Re: c++ client, 0.8?

2013-01-18 Thread Neha Narkhede
Joe, We are working on a native client for 0.8 internally. I believe it is a few weeks away from completion or code review. Thanks, Neha On Fri, Jan 18, 2013 at 7:55 AM, Joe Stein wrote: > We are going to take a look at the c++ client in our adserver, has anyone > done a 0.8 version if not we

Re: default configs

2013-01-18 Thread Joe Stein
Can I help out? Also can we abstract the config call too? We have so much in chef, it's not that i don't want to call our zookeeper cluster for it but we don't have our topology yet mapped out in znodes they are in our own instances of code. It should have both a pull and push for changes, one

c++ client, 0.8?

2013-01-18 Thread Joe Stein
We are going to take a look at the c++ client in our adserver, has anyone done a 0.8 version if not we can do it. /* Joe Stein, Chief Architect http://www.medialets.com Twitter: @allthingshadoop Mobile: 917-597-9771 */