New and updated producers and consumers

Hi, I'm using the latest update: 0.8.2.2 I would like to use the latest producer and consumer apis over the past few weeks, I have tried to do some performance benchmarking using the producer and consumer scripts provided in the bin directory. It was a fun activity and I have learnt a lot about ka

[jira] [Commented] (KAFKA-2749) Failure of end to end latency test during nightly run

[ https://issues.apache.org/jira/browse/KAFKA-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991447#comment-14991447 ] Rajini Sivaram commented on KAFKA-2749: --- [~geoffra] Yes, will look into it this morn

Re: New and updated producers and consumers

Adding users as well On Thu, Nov 5, 2015 at 3:37 PM, Prabhjot Bharaj wrote: > Hi, > > I'm using the latest update: 0.8.2.2 > I would like to use the latest producer and consumer apis > over the past few weeks, I have tried to do some performance benchmarking > using the producer and consumer scr

[jira] [Commented] (KAFKA-2749) Failure of end to end latency test during nightly run

[ https://issues.apache.org/jira/browse/KAFKA-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991677#comment-14991677 ] Rajini Sivaram commented on KAFKA-2749: --- [~geoffra] Had a look at the failure, and I

[jira] [Commented] (KAFKA-598) decouple fetch size from max message size

[ https://issues.apache.org/jira/browse/KAFKA-598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991703#comment-14991703 ] Stevo Slavic commented on KAFKA-598: Curious, does new consumer coming in 0.9.0.0 allow

[GitHub] kafka pull request: MINOR: Remove unnecessary println

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/429 MINOR: Remove unnecessary println Looks like this println might have been left in there by mistake. You can merge this pull request into a Git repository by running: $ git pull https://git

[GitHub] kafka pull request: MINOR: Remove copyDependantTestLibs from jar d...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/430 MINOR: Remove copyDependantTestLibs from jar dependencies _copyDependantTestLibs_ was added temporarily as a dependency of _jar_ task to enable SASL system tests to be run with MiniKdc without

[jira] [Created] (KAFKA-2751) Documentation for retention.ms is confusing

Craig W created KAFKA-2751: -- Summary: Documentation for retention.ms is confusing Key: KAFKA-2751 URL: https://issues.apache.org/jira/browse/KAFKA-2751 Project: Kafka Issue Type: Bug Affects Ver

[GitHub] kafka pull request: KAFKA-2742: Fix SourceTaskOffsetCommitter to h...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2742) SourceTaskOffsetCommitter does not properly remove commit tasks when they are already in progress

[ https://issues.apache.org/jira/browse/KAFKA-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2742. -- Resolution: Fixed Issue resolved by pull request 421 [https://github.com/apache/kafka/pull/421]

[jira] [Commented] (KAFKA-2742) SourceTaskOffsetCommitter does not properly remove commit tasks when they are already in progress

[ https://issues.apache.org/jira/browse/KAFKA-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991938#comment-14991938 ] ASF GitHub Bot commented on KAFKA-2742: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-2741) Source/SinkTaskContext should be interfaces and implementations kept in runtime jar

[ https://issues.apache.org/jira/browse/KAFKA-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991943#comment-14991943 ] ASF GitHub Bot commented on KAFKA-2741: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2741) Source/SinkTaskContext should be interfaces and implementations kept in runtime jar

[ https://issues.apache.org/jira/browse/KAFKA-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2741. -- Resolution: Fixed Issue resolved by pull request 420 [https://github.com/apache/kafka/pull/420]

[GitHub] kafka pull request: KAFKA-2741: Make SourceTaskContext and SinkTas...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/420 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk7 #761

See Changes: [wangguoz] KAFKA-2742: Fix SourceTaskOffsetCommitter to handle removal of commit -- [...truncated 123 lines...] :kafka-trunk-jdk7:clients:determineCommitId UP-TO-DATE :kafka-trunk-jd

[jira] [Resolved] (KAFKA-2743) Forwarding task reconfigurations in Copycat can deadlock with rebalances and has no backoff

[ https://issues.apache.org/jira/browse/KAFKA-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2743. -- Resolution: Fixed Issue resolved by pull request 422 [https://github.com/apache/kafka/pull/422]

[GitHub] kafka pull request: KAFKA-2743: Make forwarded task reconfiguratio...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/422 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2743) Forwarding task reconfigurations in Copycat can deadlock with rebalances and has no backoff

[ https://issues.apache.org/jira/browse/KAFKA-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991949#comment-14991949 ] ASF GitHub Bot commented on KAFKA-2743: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2738: Replica FetcherThread should conne...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2738) Can't set SSL as inter-broker-protocol by rolling restart of brokers

[ https://issues.apache.org/jira/browse/KAFKA-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2738. -- Resolution: Fixed Issue resolved by pull request 428 [https://github.com/apache/kafka/pull/428]

[jira] [Commented] (KAFKA-2738) Can't set SSL as inter-broker-protocol by rolling restart of brokers

[ https://issues.apache.org/jira/browse/KAFKA-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992000#comment-14992000 ] ASF GitHub Bot commented on KAFKA-2738: --- Github user asfgit closed the pull request

Re: New and updated producers and consumers

Hello Folks, Requesting your expertise on this. I see that under core/src/main/scala/kafka/producer/, there are many implementations - Producer.scala and SyncProducer.scala Also, going via the producerPerformance.scala, there are 2 implementations - NewShinyProducer (which points to KafkaProducer

Re: New and updated producers and consumers

Prabhjot, The answer changes slightly for the Producer and Consumer and depends on your timeline and comfort with using new APIs Today and in the future, for the Producer, you should be using the "new" producer, which isn't all that new anymore: org.apache.kafka.clients.producer.KafkaProducer;

Build failed in Jenkins: kafka-trunk-jdk8 #100

See Changes: [wangguoz] KAFKA-2742: Fix SourceTaskOffsetCommitter to handle removal of commit [wangguoz] KAFKA-2741: Make SourceTaskContext and SinkTaskContext interfaces and [wangguoz] KAFKA-2743: Make forwarded task reconfiguration

[GitHub] kafka pull request: KAFKA-2748: Ensure sink tasks commit offsets u...

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/431 KAFKA-2748: Ensure sink tasks commit offsets upon rebalance and rewind if the SinkTask flush fails. Also fix the incorrect consumer group ID setting which was giving each task its own group inste

[jira] [Commented] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992060#comment-14992060 ] ASF GitHub Bot commented on KAFKA-2748: --- GitHub user ewencp opened a pull request:

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992063#comment-14992063 ] ASF GitHub Bot commented on KAFKA-2702: --- Github user granthenke closed the pull requ

[GitHub] kafka pull request: KAFKA-2702: ConfigDef toHtmlTable() sorts in a...

GitHub user granthenke reopened a pull request: https://github.com/apache/kafka/pull/379 KAFKA-2702: ConfigDef toHtmlTable() sorts in a way that is a bit conf… …using You can merge this pull request into a Git repository by running: $ git pull https://github.com/granthenke/

[GitHub] kafka pull request: KAFKA-2702: ConfigDef toHtmlTable() sorts in a...

Github user granthenke closed the pull request at: https://github.com/apache/kafka/pull/379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992064#comment-14992064 ] ASF GitHub Bot commented on KAFKA-2702: --- GitHub user granthenke reopened a pull requ

Build failed in Jenkins: kafka-trunk-jdk7 #762

See Changes: [wangguoz] KAFKA-2741: Make SourceTaskContext and SinkTaskContext interfaces and [wangguoz] KAFKA-2743: Make forwarded task reconfiguration requests asynchronous on [wangguoz] KAFKA-2738: Replica FetcherThread should con

[jira] [Created] (KAFKA-2752) Add clean bounce system test for distributed Copycat

Ewen Cheslack-Postava created KAFKA-2752: Summary: Add clean bounce system test for distributed Copycat Key: KAFKA-2752 URL: https://issues.apache.org/jira/browse/KAFKA-2752 Project: Kafka

[GitHub] kafka pull request: KAFKA-2572: Add VerifiableSource/Sink connecto...

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/432 KAFKA-2572: Add VerifiableSource/Sink connectors and rolling bounce Copycat system tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/

[jira] [Commented] (KAFKA-2572) zk connection instability

[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992082#comment-14992082 ] ASF GitHub Bot commented on KAFKA-2572: --- GitHub user ewencp opened a pull request:

Re: New and updated producers and consumers

Hi Jeff, Is there a writeup of how to use the new consumer API (either in general or for Java)? I've seen various proposals but I don't see a recent one on the actual implementation. My team wants to start the development work to migrate to 0.9. Thanks, Cliff On Thu, Nov 5, 2015 at 11:18 AM, J

[jira] [Created] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

Jason Gustafson created KAFKA-2753: -- Summary: Improve SyncGroup error handling in AbstractCoordinator Key: KAFKA-2753 URL: https://issues.apache.org/jira/browse/KAFKA-2753 Project: Kafka Iss

Re: New and updated producers and consumers

The best thing that I know is the latest javadoc that's committed to trunk: https://github.com/apache/kafka/blob/ef5d168cc8f10ad4f0efe9df4cbe849a4b35496e/clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java Thanks Jeff On Thu, Nov 5, 2015 at 12:51 PM, Cliff Rhyne wrote:

[jira] [Commented] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992136#comment-14992136 ] ASF GitHub Bot commented on KAFKA-2753: --- GitHub user hachikuji opened a pull request

[GitHub] kafka pull request: KAFKA-2753: improve SyncGroup error handling i...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/433 KAFKA-2753: improve SyncGroup error handling in client You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-2753 Alternativel

[GitHub] kafka pull request: KAFKA-2748: Ensure sink tasks commit offsets u...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/431 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2748. -- Resolution: Fixed Issue resolved by pull request 431 [https://github.com/apache/kafka/pull/431]

[jira] [Commented] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992140#comment-14992140 ] ASF GitHub Bot commented on KAFKA-2748: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2753: improve SyncGroup error handling i...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/433 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2753. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 433 [https://gith

[jira] [Commented] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992160#comment-14992160 ] ASF GitHub Bot commented on KAFKA-2753: --- Github user asfgit closed the pull request

Build failed in Jenkins: kafka-trunk-jdk8 #101

See Changes: [wangguoz] KAFKA-2748: Ensure sink tasks commit offsets upon rebalance and rewind -- [...truncated 389 lines...] [ant:scaladoc] ^ [ant:scaladoc]

Re: New and updated producers and consumers

Hi Jeff, Thanks for your response. On scala side, is there a Producer implementation that I could use? is the java based KafkaProducer (org.apache.kafka.clients.producer.KafkaProducer;) same as Producer in Producer.scala ? Thanks, Prabhjot On Thu, Nov 5, 2015 at 11:28 PM, Jeff Holoman wrote: >

Re: Debug kafka code in intellij

Hello Folks, Requesting your expertise on this Thanks, Prabhjot On Thu, Nov 5, 2015 at 4:46 PM, Prabhjot Bharaj wrote: > Hi, > > I'm using kafka 0.8.2.1 version with IntelliJ. > Sometimes, I change the code and build it using this command: > > ./gradlew -PscalaVersion=2.11.7 releaseTarGz > > I

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992208#comment-14992208 ] Jiangjie Qin commented on KAFKA-2350: - [~hachikuji] [~guozhang] I noticed that current

Re: New and updated producers and consumers

Hi Jeff, The java doc is very nice, thank you and thanks to whoever wrote it. I do have one question about the API. For what we're doing, it's important for us to calculate the "lag" or pending message count. Today we do that using the simple consumer to ask kafka for the committed offset (beca

[jira] [Resolved] (KAFKA-1575) Topic Hierarchy

[ https://issues.apache.org/jira/browse/KAFKA-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1575. Resolution: Duplicate > Topic Hierarchy > --- > > Key: KAFKA-1575 >

Build failed in Jenkins: kafka-trunk-jdk8 #102

See Changes: [wangguoz] KAFKA-2753: improve SyncGroup error handling in client -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-5 (docker

[jira] [Resolved] (KAFKA-1520) Tools for contributors

[ https://issues.apache.org/jira/browse/KAFKA-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1520. Resolution: Fixed This is resolved by the new Github pull request process and maintaining docs in t

[jira] [Resolved] (KAFKA-1605) Producer should not require metadata.broker.list

[ https://issues.apache.org/jira/browse/KAFKA-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1605. Resolution: Won't Fix > Producer should not require metadata.broker.list > -

[jira] [Created] (KAFKA-2754) Support defining ACLs at topic creation time

Thomas Graves created KAFKA-2754: Summary: Support defining ACLs at topic creation time Key: KAFKA-2754 URL: https://issues.apache.org/jira/browse/KAFKA-2754 Project: Kafka Issue Type: Improv

[jira] [Updated] (KAFKA-2754) Support defining ACLs at topic creation time

[ https://issues.apache.org/jira/browse/KAFKA-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated KAFKA-2754: - Description: With a secured kafka cluster we want to be able have certain users create topics and

[jira] [Assigned] (KAFKA-2754) Support defining ACLs at topic creation time

[ https://issues.apache.org/jira/browse/KAFKA-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Brahmbhatt reassigned KAFKA-2754: --- Assignee: Parth Brahmbhatt > Support defining ACLs at topic creation time > -

[jira] [Resolved] (KAFKA-1404) Close unused log file

[ https://issues.apache.org/jira/browse/KAFKA-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1404. Resolution: Duplicate > Close unused log file > - > > Key: KAFKA

[jira] [Commented] (KAFKA-2423) Introduce Scalastyle

[ https://issues.apache.org/jira/browse/KAFKA-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992334#comment-14992334 ] Grant Henke commented on KAFKA-2423: Are we sill thinking of applying something like t

Jenkins build is back to normal : kafka-trunk-jdk7 #763

See

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992357#comment-14992357 ] Guozhang Wang commented on KAFKA-2350: -- Could this be resolved by calling {code} con

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992363#comment-14992363 ] Ashish K Singh commented on KAFKA-2077: --- Hey guys, this seems to be interesting. Is

[jira] [Resolved] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2424. Resolution: Duplicate > Consider introducing lint-like tool for Scala >

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992386#comment-14992386 ] Ismael Juma commented on KAFKA-2424: I'm not sure this is a duplicate. Can you please

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992387#comment-14992387 ] Grant Henke commented on KAFKA-2702: I have updated the pull request based on all disc

Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

Hello Kafka Devs, I've been testing the upgrade procedure between Kafka 0.8.2.1 and Kafka 0.9.0.0 and have been having Replication issues between the two version, and I was wondering if anyone was aware of this issue (I just searched and this seems to be related to KAFKA-2750 raised yesterday )

[jira] [Commented] (KAFKA-2423) Introduce Scalastyle

[ https://issues.apache.org/jira/browse/KAFKA-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992390#comment-14992390 ] Ismael Juma commented on KAFKA-2423: My understanding is that this is something we wan

[GitHub] kafka pull request: MINOR: follow-up KAFKA-2730 to use two tags fo...

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/434 MINOR: follow-up KAFKA-2730 to use two tags for broker id and fetcher id combination You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozha

[jira] [Created] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

Ashish K Singh created KAFKA-2755: - Summary: NPE thrown while handling DescribeGroup request for non-existent consumer group Key: KAFKA-2755 URL: https://issues.apache.org/jira/browse/KAFKA-2755 Proje

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992391#comment-14992391 ] Grant Henke commented on KAFKA-2424: It was on the basis that both are static code/sty

[jira] [Commented] (KAFKA-2730) partition-reassignment tool stops working due to error in registerMetric

[ https://issues.apache.org/jira/browse/KAFKA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992392#comment-14992392 ] ASF GitHub Bot commented on KAFKA-2730: --- GitHub user guozhangwang opened a pull requ

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992398#comment-14992398 ] Ismael Juma commented on KAFKA-2424: I think there's some overlap, but they tend to ca

Re: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

Hi Matthew, I have not read into the details of your issues but have done similar "rolling" upgrade testing myself. The reason replication breaks is due to some wire protocol changes. Just checking some preliminary things before digging in - Have you followed the upgrade steps outlined here?

[jira] [Commented] (KAFKA-2423) Introduce Scalastyle

[ https://issues.apache.org/jira/browse/KAFKA-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992404#comment-14992404 ] Grant Henke commented on KAFKA-2423: Thanks [~ijuma]. That makes sense. I will share w

[GitHub] kafka pull request: KAFKA-2755: NPE thrown while handling Describe...

GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/435 KAFKA-2755: NPE thrown while handling DescribeGroup request for non-e… …xistent consumer group You can merge this pull request into a Git repository by running: $ git pull https://github.

[jira] [Commented] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992408#comment-14992408 ] ASF GitHub Bot commented on KAFKA-2755: --- GitHub user SinghAsDev opened a pull reques

[jira] [Commented] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992411#comment-14992411 ] Ashish K Singh commented on KAFKA-2755: --- [~hachikuji], [~guozhang] mind taking a loo

RE: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

Hi Grant, Yes, I have read and followed the Upgrade documentation and I have set inter.broker.protocol.version=0.8.2.X and it does not resolve the issue - based on the part of the code it's occurring in, it uses the 'latest' version for any API Key, and not the one specified by 'inter.broker.p

Re: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

Hi Matt, Great. Just wanted to be sure of the background. Are you interested in opening a jira and contributing a patch? If not would you be interested in testing a patch if I provided one? Thank you, Grant On Thu, Nov 5, 2015 at 2:31 PM, Matthew Bruce wrote: > Hi Grant, > > Yes, I have read a

RE: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

I don’t mind opening a JIRA and testing a patch, I'm not sure how quickly I'd be able to contribute one on my own though. Thanks, Matt -Original Message- From: Grant Henke [mailto:ghe...@cloudera.com] Sent: Thursday, November 5, 2015 3:37 PM To: dev@kafka.apache.org Subject: Re: Replica

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992436#comment-14992436 ] Grant Henke commented on KAFKA-2424: Cool, makes sense to me. I will re-open. Apologie

[jira] [Reopened] (KAFKA-2424) Consider introducing lint-like tool for Scala

[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reopened KAFKA-2424: > Consider introducing lint-like tool for Scala > - > >

RE: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

https://issues.apache.org/jira/browse/KAFKA-2756 -Original Message- From: Grant Henke [mailto:ghe...@cloudera.com] Sent: Thursday, November 5, 2015 3:37 PM To: dev@kafka.apache.org Subject: Re: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk) Hi Matt, Great. Just wanted to be su

[jira] [Created] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocl version

Matthew Bruce created KAFKA-2756: Summary: Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocl version Key: KAFKA-2756 URL: https://issues.apache.org/jira/browse/KAFKA-2756

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Bruce updated KAFKA-2756: - Summary: Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992452#comment-14992452 ] Jiangjie Qin commented on KAFKA-2350: - Ah, right. That would work. It still a bit weir

[jira] [Updated] (KAFKA-2750) Sender.java: handleProduceResponse does not check protocol version

[ https://issues.apache.org/jira/browse/KAFKA-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2750: - Affects Version/s: 0.10.0.0 > Sender.java: handleProduceResponse does not check protocol version >

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992466#comment-14992466 ] Guozhang Wang commented on KAFKA-2350: -- I think this can be fixed by filtering out th

[jira] [Resolved] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2755. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 435 [https://gith

[GitHub] kafka pull request: KAFKA-2755: NPE thrown while handling Describe...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992480#comment-14992480 ] ASF GitHub Bot commented on KAFKA-2755: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2735 BrokerEndPoint should support upper...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/415 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2735) BrokerEndPoint should support uppercase hostnames

[ https://issues.apache.org/jira/browse/KAFKA-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2735. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 415 [https://gith

[jira] [Commented] (KAFKA-2735) BrokerEndPoint should support uppercase hostnames

[ https://issues.apache.org/jira/browse/KAFKA-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992507#comment-14992507 ] ASF GitHub Bot commented on KAFKA-2735: --- Github user asfgit closed the pull request

[jira] [Created] (KAFKA-2757) Consoliate BrokerEndPoint and EndPoint

Guozhang Wang created KAFKA-2757: Summary: Consoliate BrokerEndPoint and EndPoint Key: KAFKA-2757 URL: https://issues.apache.org/jira/browse/KAFKA-2757 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request: KAFKA-2721; Avoid handling duplicate LeaderAnd...

GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/436 KAFKA-2721; Avoid handling duplicate LeaderAndISR requests You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-2721 Alternat

[jira] [Commented] (KAFKA-2721) Avoid handling duplicate LeaderAndISR requests

[ https://issues.apache.org/jira/browse/KAFKA-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992520#comment-14992520 ] ASF GitHub Bot commented on KAFKA-2721: --- GitHub user lindong28 opened a pull request

Build failed in Jenkins: kafka-trunk-jdk8 #103

See Changes: [wangguoz] KAFKA-2755: Suspicious reference forwarding cause NPE on [wangguoz] KAFKA-2735: BrokerEndPoint should support uppercase hostnames. -- Started by an SCM change [EnvInject]

[jira] [Assigned] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-2756: Assignee: Guozhang Wang > Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2756: - Fix Version/s: 0.9.0.0 > Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java use

  1   2   >