[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-07-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630874#comment-14630874 ] Guozhang Wang commented on KAFKA-1835: -- Hmm, so although partitionsFor() returns you

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

2015-07-16 Thread Ben Kirwin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630870#comment-14630870 ] Ben Kirwin commented on KAFKA-2260: --- Opened a KIP for this here: https://cwiki.apache.o

Build failed in Jenkins: KafkaPreCommit #155

2015-07-16 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2324; Update to Scala 2.11.7 -- [...truncated 1137 lines...] kafka.consumer.ZookeeperConsumerConnectorTest > testLeaderSelectionForPartition PASSED kafka.consumer.Cons

[DISCUSS] KIP-27 - Conditional Publish

2015-07-16 Thread Ben Kirwin
Hi there, I just added a KIP for a 'conditional publish' operation: a simple CAS-like mechanism for the Kafka producer. The wiki page is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-27+-+Conditional+Publish And there's some previous discussion on the ticket and the users list: ht

[jira] [Commented] (KAFKA-2345) Attempt to delete a topic already marked for deletion throws ZkNodeExistsException

2015-07-16 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630836#comment-14630836 ] Ashish K Singh commented on KAFKA-2345: --- Created reviewboard https://reviews.apache.

[jira] [Updated] (KAFKA-2345) Attempt to delete a topic already marked for deletion throws ZkNodeExistsException

2015-07-16 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2345: -- Attachment: KAFKA-2345.patch > Attempt to delete a topic already marked for deletion throws > Z

[jira] [Updated] (KAFKA-2345) Attempt to delete a topic already marked for deletion throws ZkNodeExistsException

2015-07-16 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2345: -- Status: Patch Available (was: Open) > Attempt to delete a topic already marked for deletion thr

Review Request 36565: Patch for KAFKA-2345

2015-07-16 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36565/ --- Review request for kafka. Bugs: KAFKA-2345 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-2345) Attempt to delete a topic already marked for deletion throws ZkNodeExistsException

2015-07-16 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-2345: - Summary: Attempt to delete a topic already marked for deletion throws ZkNodeExistsException Key: KAFKA-2345 URL: https://issues.apache.org/jira/browse/KAFKA-2345 Pr

[jira] [Commented] (KAFKA-2345) Attempt to delete a topic already marked for deletion throws ZkNodeExistsException

2015-07-16 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630818#comment-14630818 ] Ashish K Singh commented on KAFKA-2345: --- [~gwenshap] does this make sense? > Attemp

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

2015-07-16 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630806#comment-14630806 ] Jiangjie Qin commented on KAFKA-2260: - This is a very interesting proposal and would b

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Gwen Shapira
> On July 17, 2015, 4:26 a.m., Jiangjie Qin wrote: > > Looks good to me. > > Jiangjie Qin wrote: > Actually do we need to talk to Zookeeper every time? Can we read the data > from topic metadata cache directly? Good point, Jiangjie - looks like partitionFor is called on every ConsumerMeta

Re: Review Request 34641: Patch for KAFKA-2214

2015-07-16 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34641/#review92024 --- Just realized that verifyAssigment runs on a Map of and originally

[jira] [Created] (KAFKA-2344) Improvements for the pr-merge tool

2015-07-16 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-2344: --- Summary: Improvements for the pr-merge tool Key: KAFKA-2344 URL: https://issues.apache.org/jira/browse/KAFKA-2344 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2324: Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) >

[jira] [Commented] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630770#comment-14630770 ] Gwen Shapira commented on KAFKA-2324: - +1 and pushed to trunk. Thanks for the patch [~

[jira] [Commented] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630766#comment-14630766 ] ASF GitHub Bot commented on KAFKA-2324: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2324; Update to Scala 2.11.7

2015-07-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/82 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

Re: consumer memory footprint

2015-07-16 Thread Jiangjie Qin
I think the rough calculation of max memory footprint for each high level consumer would be: (Number Of Partitions For All Topics) * fetch.message.max.bytes * queued.max.message.chunks + (some decompression memory cost for a message) In your case, it would be 10 times above. Thanks, Jiangjie (B

Re: Review Request 34554: Patch for KAFKA-2205

2015-07-16 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34554/#review92008 --- Thanks for the latest patch. Have a few more comments below. core/

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Jiangjie Qin
> On July 17, 2015, 4:26 a.m., Jiangjie Qin wrote: > > Looks good to me. Actually do we need to talk to Zookeeper every time? Can we read the data from topic metadata cache directly? - Jiangjie --- This is an automatically generated e-

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36548/#review92020 --- Ship it! Looks good to me. - Jiangjie Qin On July 16, 2015, 6:04

[jira] [Updated] (KAFKA-2343) Clarify KafkaConsumer.poll rebalance behavior

2015-07-16 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2343: --- Description: The current javadoc for KafkaConsumer.poll says the following: {code} * The

[jira] [Created] (KAFKA-2343) Clarify KafkaConsumer.poll rebalance behavior

2015-07-16 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2343: -- Summary: Clarify KafkaConsumer.poll rebalance behavior Key: KAFKA-2343 URL: https://issues.apache.org/jira/browse/KAFKA-2343 Project: Kafka Issue Type: B

Build failed in Jenkins: KafkaPreCommit #154

2015-07-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2103; kafka.producer.AsyncProducerTest failure; patched by Ewen Cheslack-Postava; reviewed by Jun Rao -- Started by an SCM change Building remotely on ubuntu3 (Ubuntu u

Jenkins build is back to normal : Kafka-trunk #547

2015-07-16 Thread Apache Jenkins Server
See

[jira] [Updated] (KAFKA-2178) Loss of highwatermarks on incorrect cluster shutdown/restart

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2178: --- Status: In Progress (was: Patch Available) [~aozeritsky], thanks for the patch. The current logic in ReplicaM

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

2015-07-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630622#comment-14630622 ] Jay Kreps commented on KAFKA-2260: -- I like this idea a lot and the change is quite simple

Re: Build failed in Jenkins: kafka-trunk-git-pr #8

2015-07-16 Thread Ismael Juma
Thanks. Yes, it works now. :) I reported the details in the JIRA ticket. The summary is that I asked INFRA for help and Andrew Bayer fixed a few things that weren't correctly configured in the job. Ismael On 17 Jul 2015 01:52, "Jun Rao" wrote: > I deleted the email notification step. Does that

[jira] [Updated] (KAFKA-2103) kafka.producer.AsyncProducerTest failure.

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2103: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

Re: Build failed in Jenkins: kafka-trunk-git-pr #8

2015-07-16 Thread Jun Rao
I deleted the email notification step. Does that job work now? Thanks, Jun On Thu, Jul 16, 2015 at 5:41 PM, Ismael Juma wrote: > Jun, what so you think about disabling emails to the list for this job? A > comment is added to the pull request and I think that's good enough. People > can configu

[jira] [Commented] (KAFKA-2342) transient unit test failure in testConsumptionWithBrokerFailures

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630613#comment-14630613 ] Jun Rao commented on KAFKA-2342: Also, this test takes more than 40 secs, which is a bit t

[jira] [Updated] (KAFKA-2336) Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

2015-07-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2336: -- Reviewer: Joel Koshy > Changing offsets.topic.num.partitions after the offset topic is created > breaks

[jira] [Assigned] (KAFKA-2342) transient unit test failure in testConsumptionWithBrokerFailures

2015-07-16 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-2342: -- Assignee: Jason Gustafson > transient unit test failure in testConsumptionWithBrokerFai

Re: Build failed in Jenkins: kafka-trunk-git-pr #8

2015-07-16 Thread Ismael Juma
Jun, what so you think about disabling emails to the list for this job? A comment is added to the pull request and I think that's good enough. People can configure their notification settings on GitHub to match their needs. Ismael On 17 Jul 2015 01:26, "Apache Jenkins Server" wrote: > See

Build failed in Jenkins: KafkaPreCommit #153

2015-07-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2241; AbstractFetcherThread.shutdown() should not block on ReadableByteChannel.read(buffer); patched by Dong Lin; reviewed by Jun Rao [junrao] kafka-2174; Wrong TopicMetadata deserialization; patched by Alexe

[jira] [Updated] (KAFKA-2271) transient unit test failure in KafkaConfigConfigDefTest.testFromPropsToProps

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2271: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

Build failed in Jenkins: kafka-trunk-git-pr #9

2015-07-16 Thread Apache Jenkins Server
See -- GitHub pull request #42 to apache/kafka Building remotely on ubuntu3 (Ubuntu ubuntu legacy-ubuntu) in workspace > git rev-parse --is-inside-

Build failed in Jenkins: Kafka-trunk #546

2015-07-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2323; Simplify ScalaTest dependency versions; patched by Ismael Juma; reviewed by Jun Rao [junrao] kafka-2241; AbstractFetcherThread.shutdown() should not block on ReadableByteChannel.read(buffer); patched by D

Build failed in Jenkins: kafka-trunk-git-pr #8

2015-07-16 Thread Apache Jenkins Server
See -- GitHub pull request #42 to apache/kafka Building remotely on ubuntu3 (Ubuntu ubuntu legacy-ubuntu) in workspace > git rev-parse --is-inside-

Jenkins build is back to normal : kafka-trunk-git-pr #7

2015-07-16 Thread Apache Jenkins Server
See

[jira] [Updated] (KAFKA-2174) Wrong TopicMetadata deserialization

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2174: --- Status: In Progress (was: Patch Available) Thanks for the patch. +1 and committed to trunk. The patch handle

[jira] [Created] (KAFKA-2342) transient unit test failure in testConsumptionWithBrokerFailures

2015-07-16 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2342: -- Summary: transient unit test failure in testConsumptionWithBrokerFailures Key: KAFKA-2342 URL: https://issues.apache.org/jira/browse/KAFKA-2342 Project: Kafka Issue Typ

[jira] [Updated] (KAFKA-2041) Add ability to specify a KeyClass for KafkaLog4jAppender

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2041: --- Status: In Progress (was: Patch Available) [~benoyantony], thanks for the patch. We will use org.apache.kafk

[jira] [Commented] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630573#comment-14630573 ] Ismael Juma commented on KAFKA-2324: Note that Sriharsha had reviewed it in review boa

[jira] [Commented] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630569#comment-14630569 ] Ismael Juma commented on KAFKA-2324: I rebased the change as there were some conflicts

[jira] [Commented] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630567#comment-14630567 ] ASF GitHub Bot commented on KAFKA-2324: --- GitHub user ijuma opened a pull request:

[jira] [Updated] (KAFKA-2324) Update to Scala 2.11.7

2015-07-16 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2324: --- Attachment: (was: KAFKA-2324.patch) > Update to Scala 2.11.7 > -- > >

[GitHub] kafka pull request: KAFKA-2324; Update to Scala 2.11.7

2015-07-16 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/82 KAFKA-2324; Update to Scala 2.11.7 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-2324 Alternatively you can review and apply th

Build failed in Jenkins: KafkaPreCommit #152

2015-07-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2323; Simplify ScalaTest dependency versions; patched by Ismael Juma; reviewed by Jun Rao -- [...truncated 1495 lines...] kafka.server.ServerShutdownTest > testConsecut

Build failed in Jenkins: kafka-trunk-git-pr #6

2015-07-16 Thread Apache Jenkins Server
See -- GitHub pull request #42 to apache/kafka Building remotely on jenkins-ubuntu-1404-4gb-df7 (jenkins-cloud-4GB cloud-slave Ubuntu ubuntu) in workspace

[jira] [Updated] (KAFKA-2241) AbstractFetcherThread.shutdown() should not block on ReadableByteChannel.read(buffer)

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2241: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Commented] (KAFKA-2203) Get gradle build to work with Java 8

2015-07-16 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630526#comment-14630526 ] Ewen Cheslack-Postava commented on KAFKA-2203: -- [~becket_qin] I think only ce

[jira] [Updated] (KAFKA-2323) Simplify ScalaTest dependency versions

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2323: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

Build failed in Jenkins: kafka-trunk-git-pr #5

2015-07-16 Thread Apache Jenkins Server
See -- [...truncated 1916 lines...] jdk1.7.0_51/jre/lib/currency.data jdk1.7.0_51/jre/lib/javafx.properties jdk1.7.0_51/jre/THIRDPARTYLICENSEREADME.txt jdk1.7.0_51/jre/Welcome.html jdk1.7.0_51/jre/LICENSE

[jira] [Updated] (KAFKA-2188) JBOD Support

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2188: --- Status: In Progress (was: Patch Available) [~tnachen], thanks for the patch. It seems that KIP-18 is still u

Re: Review Request 35615: Patch for KAFKA-1782

2015-07-16 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35615/#review91986 --- I can consistently get 8 unit test failues with your patch, all of t

Re: Review Request 34492: Patch for KAFKA-2210

2015-07-16 Thread Edward Ribeiro
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34492/#review91980 --- core/src/main/scala/kafka/security/auth/Operation.scala (lines 43 -

[jira] [Commented] (KAFKA-2232) make MockProducer generic

2015-07-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630441#comment-14630441 ] ASF GitHub Bot commented on KAFKA-2232: --- Github user apakulov closed the pull reques

[GitHub] kafka pull request: KAFKA-2232: Make MockProducer generic

2015-07-16 Thread apakulov
Github user apakulov closed the pull request at: https://github.com/apache/kafka/pull/68 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-2210) KafkaAuthorizer: Add all public entities, config changes and changes to KafkaAPI and kafkaServer to allow pluggable authorizer implementation.

2015-07-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2210: --- Status: In Progress (was: Patch Available) > KafkaAuthorizer: Add all public entities, config changes and cha

Re: Review Request 35615: Patch for KAFKA-1782

2015-07-16 Thread Guozhang Wang
> On July 16, 2015, 4:54 p.m., Guozhang Wang wrote: > > Could you rebase? Seems some previous commits get reflected in your latest > > patch. > > Alexander Pakulov wrote: > Done. > > Also I have an update for BeforeAndAfter\BeforeAndAfterEach traits. These > traits requires any of

[jira] [Commented] (KAFKA-2203) Get gradle build to work with Java 8

2015-07-16 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630318#comment-14630318 ] Jiangjie Qin commented on KAFKA-2203: - Is it true? We have been building and run Kafka

consumer memory footprint

2015-07-16 Thread Kris K
Hi All, Is there a way to calculate the amount of memory used per thread in case of a high level consumer? I am particularly interested in calculating the memory required by a process running 10 high level consumer threads for 15 topics with max. file size set to 100 MB. Thanks, Kris

Build failed in Jenkins: KafkaPreCommit #151

2015-07-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2032: validate consumer's partition-assignment config; reviewed by Jason Rosenberg, Sriharsha Chintalapani and Guozhang Wang -- Started by an SCM change Building remo

Jenkins build is back to normal : Kafka-trunk #545

2015-07-16 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-2328) merge-kafka-pr.py script should not leave user in a detached branch

2015-07-16 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630273#comment-14630273 ] Jiangjie Qin commented on KAFKA-2328: - Same as [~gwenshap] here. > merge-kafka-pr.py

[jira] [Updated] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2032: - Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available)

Build failed in Jenkins: kafka-trunk-git-pr #4

2015-07-16 Thread Apache Jenkins Server
See -- [...truncated 1916 lines...] jdk1.7.0_51/jre/lib/currency.data jdk1.7.0_51/jre/lib/javafx.properties jdk1.7.0_51/jre/THIRDPARTYLICENSEREADME.txt jdk1.7.0_51/jre/Welcome.html jdk1.7.0_51/jre/LICENSE

[jira] [Commented] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630231#comment-14630231 ] Guozhang Wang commented on KAFKA-2032: -- Committed to trunk, thanks. > ConsumerConfig

Re: Please add me to the contributor list

2015-07-16 Thread Guozhang Wang
Added. Thanks for your interests. Guozhang On Thu, Jul 16, 2015 at 12:06 PM, David Jacot wrote: > Hi Kafka team, > > First of all, thank you for the awesome work! Kafka is really an awesome > piece of technology. I have been using it since you open sourced it and > would like to contribute to

[jira] [Work started] (KAFKA-2337) Verify that metric names will not collide when creating new topics

2015-07-16 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2337 started by Grant Henke. -- > Verify that metric names will not collide when creating new topics > --

Re: Review Request 35615: Patch for KAFKA-1782

2015-07-16 Thread Alexander Pakulov
> On July 16, 2015, 4:54 p.m., Guozhang Wang wrote: > > Could you rebase? Seems some previous commits get reflected in your latest > > patch. Done. Also I have an update for BeforeAndAfter\BeforeAndAfterEach traits. These traits requires any of Suite traits to defined for the class also. E.g.

Please add me to the contributor list

2015-07-16 Thread David Jacot
Hi Kafka team, First of all, thank you for the awesome work! Kafka is really an awesome piece of technology. I have been using it since you open sourced it and would like to contribute to it. Could you please add me to the contributor list? Thanks! David Jacot

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630179#comment-14630179 ] Alexander Pakulov commented on KAFKA-1782: -- Updated reviewboard https://reviews.a

[jira] [Updated] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pakulov updated KAFKA-1782: - Attachment: KAFKA-1782_2015-07-16_11:56:11.patch > Junit3 Misusage > --- > >

Re: Review Request 35615: Patch for KAFKA-1782

2015-07-16 Thread Alexander Pakulov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35615/ --- (Updated July 16, 2015, 6:56 p.m.) Review request for kafka. Bugs: KAFKA-1782

[jira] [Updated] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pakulov updated KAFKA-1782: - Attachment: KAFKA-1782_2015-07-16_11:50:05.patch > Junit3 Misusage > --- > >

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630163#comment-14630163 ] Alexander Pakulov commented on KAFKA-1782: -- Updated reviewboard https://reviews.a

Re: Review Request 35615: Patch for KAFKA-1782

2015-07-16 Thread Alexander Pakulov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35615/ --- (Updated July 16, 2015, 6:50 p.m.) Review request for kafka. Bugs: KAFKA-1782

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630158#comment-14630158 ] Alexander Pakulov commented on KAFKA-1782: -- Created reviewboard https://reviews.a

[jira] [Updated] (KAFKA-1782) Junit3 Misusage

2015-07-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pakulov updated KAFKA-1782: - Attachment: KAFKA-1782.patch > Junit3 Misusage > --- > > Key:

Review Request 36552: Patch for KAFKA-1782

2015-07-16 Thread Alexander Pakulov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36552/ --- Review request for kafka. Bugs: KAFKA-1782 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630153#comment-14630153 ] Guozhang Wang commented on KAFKA-2032: -- [~jkreps] I think this end goad may be not in

[jira] [Commented] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630141#comment-14630141 ] Jay Kreps commented on KAFKA-2032: -- I think the goal was to make the assignment strategie

Re: Review Request 32251: Patch for KAFKA-2032

2015-07-16 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32251/#review91936 --- Ship it! Ship It! - Sriharsha Chintalapani On March 19, 2015, 7:

[jira] [Commented] (KAFKA-2032) ConsumerConfig doesn't validate partition.assignment.strategy values

2015-07-16 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630102#comment-14630102 ] Parth Brahmbhatt commented on KAFKA-2032: - [~guozhang] The last review request was

[jira] [Updated] (KAFKA-2336) Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

2015-07-16 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-2336: --- Attachment: KAFKA-2336_2015-07-16_13:04:02.patch > Changing offsets.topic.num.partitions after the off

[jira] [Commented] (KAFKA-2336) Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

2015-07-16 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630094#comment-14630094 ] Grant Henke commented on KAFKA-2336: Updated reviewboard https://reviews.apache.org/r/

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Grant Henke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36548/ --- (Updated July 16, 2015, 6:04 p.m.) Review request for kafka. Bugs: KAFKA-2336

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Grant Henke
> On July 16, 2015, 4:53 p.m., Edward Ribeiro wrote: > > core/src/main/scala/kafka/server/OffsetManager.scala, line 454 > > > > > > It looks like there's a mix of "if(" and "if (", with the latter being > > more use

[jira] [Updated] (KAFKA-2336) Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

2015-07-16 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-2336: --- Attachment: KAFKA-2336.patch > Changing offsets.topic.num.partitions after the offset topic is created

[jira] [Commented] (KAFKA-2336) Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

2015-07-16 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630087#comment-14630087 ] Grant Henke commented on KAFKA-2336: Created reviewboard https://reviews.apache.org/r/

Review Request 36549: Patch for KAFKA-2336

2015-07-16 Thread Grant Henke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36549/ --- Review request for kafka. Bugs: KAFKA-2336 https://issues.apache.org/jira/b

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Ismael Juma
> On July 16, 2015, 4:53 p.m., Edward Ribeiro wrote: > > core/src/main/scala/kafka/server/OffsetManager.scala, line 454 > > > > > > It looks like there's a mix of "if(" and "if (", with the latter being > > more use

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Ismael Juma
> On July 16, 2015, 4:53 p.m., Edward Ribeiro wrote: > > core/src/main/scala/kafka/server/OffsetManager.scala, line 454 > > > > > > It looks like there's a mix of "if(" and "if (", with the latter being > > more use

[jira] [Commented] (KAFKA-2328) merge-kafka-pr.py script should not leave user in a detached branch

2015-07-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630033#comment-14630033 ] Gwen Shapira commented on KAFKA-2328: - 2 or 3 both seem reasonable to me > merge-kafk

[jira] [Updated] (KAFKA-2329) Consumers balance fails when multiple consumers are started simultaneously.

2015-07-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2329: - Assignee: Ze'ev Eli Klapow (was: Neha Narkhede) > Consumers balance fails when multiple consumers

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Grant Henke
> On July 16, 2015, 4:53 p.m., Edward Ribeiro wrote: > > core/src/main/scala/kafka/server/OffsetManager.scala, line 454 > > > > > > It looks like there's a mix of "if(" and "if (", with the latter being > > more use

Re: Review Request 36548: Patch for KAFKA-2336

2015-07-16 Thread Grant Henke
> On July 16, 2015, 4:53 p.m., Edward Ribeiro wrote: > > core/src/main/scala/kafka/server/OffsetManager.scala, line 454 > > > > > > It looks like there's a mix of "if(" and "if (", with the latter being > > more use

  1   2   >