[GitHub] kafka pull request #1508: MINOR: Fix quota violation exception message

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1508 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1512: KAFKA-3838 zkClient and Zookeeper version bump

GitHub user mangas opened a pull request: https://github.com/apache/kafka/pull/1512 KAFKA-3838 zkClient and Zookeeper version bump You can merge this pull request into a Git repository by running: $ git pull https://github.com/mangas/kafka trunk Alternatively you can review a

[jira] [Commented] (KAFKA-3838) Bump zkclient and Zookeeper versions

[ https://issues.apache.org/jira/browse/KAFKA-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1511#comment-1511 ] ASF GitHub Bot commented on KAFKA-3838: --- GitHub user mangas opened a pull request:

[GitHub] kafka pull request #1504: KAFKA-3838 zkClient and Zookeeper version bump

Github user mangas closed the pull request at: https://github.com/apache/kafka/pull/1504 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3838) Bump zkclient and Zookeeper versions

[ https://issues.apache.org/jira/browse/KAFKA-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1513#comment-1513 ] ASF GitHub Bot commented on KAFKA-3838: --- Github user mangas closed the pull request

Re: FYI - Apache ZooKeeper Backup, a Treatise

Great write-up, Jordan, thanks! Whether to backup zk data or not is possibly an open topic for this community, even though we have discussed it at times. My sense has been that precisely because of the issues you mention in your post, it is typically best to have a way to recreate its data upon

Build failed in Jenkins: kafka-trunk-jdk8 #700

See Changes: [ismael] MINOR: Fix quota violation exception message -- [...truncated 1883 lines...] kafka.api.PlaintextProducerSendTest > testSendCompressedMessageWithCreateTime STARTED kafka.ap

Re: Embedding zookeeper and kafka in java process.

Hi Subhash, This would happen if `null` is passed as the `threadNamePrefix` argument when instantiating `KafkaServer`: class KafkaServer(val config: KafkaConfig, time: Time = SystemTime, threadNamePrefix: Option[String] = None) extends Logging with KafkaMetricsGroup How are you starting Kafka in

Re: [VOTE] KIP-55: Secure quotas for authenticated users

Jun, Thank you for the review. I have updated the KIP: 1. Added an overview section. Slightly reworded since it is better to treat user and client-id as different levels rather than the same level. 2. Yes, it is neater to store quota for each entity in a different path in Zookeeper.

Re: [VOTE] KIP-55: Secure quotas for authenticated users

Jun, Actually, with quotas stored in different nodes in ZK, it is better to store remainder quota rather than total quota under /users/ so that quota calculations are not dependent on the order of notifications. I have updated the KIP to reflect that. So the quotas in ZK now always reflect the quo

[GitHub] kafka pull request #1507: KAFKA-3840; Allow clients default OS buffer sizes

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1507 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3840) OS auto tuning for socket buffer size in clients not allowed through configuration

[ https://issues.apache.org/jira/browse/KAFKA-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333684#comment-15333684 ] ASF GitHub Bot commented on KAFKA-3840: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3840) OS auto tuning for socket buffer size in clients not allowed through configuration

[ https://issues.apache.org/jira/browse/KAFKA-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3840. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1507 [https://github

[jira] [Commented] (KAFKA-3370) Add options to auto.offset.reset to reset offsets upon initialization only

[ https://issues.apache.org/jira/browse/KAFKA-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333736#comment-15333736 ] James Clarke commented on KAFKA-3370: - I think those options make sense. Without thes

Re: Memory consumption of Kafka-examples Kafka-streams around 1.5 GB

Phil, I think what you're seeing w.r.t. memory consumption is that the packaging step (`mvn package`) for the Kafka Streams examples under https://github.com/confluentinc/examples also runs the full test suite, and this test suite launches embedded Kafka brokers, ZooKeeper, and Confluent schema re

Re: Complexe Event Processing on top of KafkaStreams

Thanks for sharing, Florian! -Michael On Thu, Jun 16, 2016 at 12:32 AM, Guozhang Wang wrote: > Hello Florian, > > Thanks for your interests! As mentioned in our release notes we are > considering to add the SQL support (e.g. using Calcite) on top of Kafka > Streams as a near-term future work. >

Build failed in Jenkins: kafka-trunk-jdk8 #701

See Changes: [ismael] KAFKA-3840; Allow clients default OS buffer sizes -- [...truncated 8122 lines...] org.apache.kafka.common.metrics.JmxReporterTest > testJmxRegistration PASSED org.apache.k

Re: [DISCUSS] KIP-4 Create Topic Schema

I have updated the wiki and pull request based on the feedback. If there are no objections I will start a vote at the end of the day. Details for this implementation can be read here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operations#K

[jira] [Created] (KAFKA-3851) Add references to important installation/upgrade notes to release notes

Ewen Cheslack-Postava created KAFKA-3851: Summary: Add references to important installation/upgrade notes to release notes Key: KAFKA-3851 URL: https://issues.apache.org/jira/browse/KAFKA-3851

[jira] [Created] (KAFKA-3852) Clarify how to handle message format upgrade without killing performance

Ewen Cheslack-Postava created KAFKA-3852: Summary: Clarify how to handle message format upgrade without killing performance Key: KAFKA-3852 URL: https://issues.apache.org/jira/browse/KAFKA-3852

[jira] [Updated] (KAFKA-3851) Add references to important installation/upgrade notes to release notes

[ https://issues.apache.org/jira/browse/KAFKA-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3851: - Affects Version/s: 0.10.0.0 > Add references to important installation/upgrade not

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334161#comment-15334161 ] Vahid Hashemian commented on KAFKA-3144: [~hachikuji] Isn't what you are suggestin

[GitHub] kafka pull request #1513: MINOR: Follow-up from KAFKA-2720 with comment/styl...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1513 MINOR: Follow-up from KAFKA-2720 with comment/style fixes You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka followup-for-kafka-2

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334164#comment-15334164 ] ASF GitHub Bot commented on KAFKA-2720: --- GitHub user hachikuji opened a pull request

[jira] [Comment Edited] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334161#comment-15334161 ] Vahid Hashemian edited comment on KAFKA-3144 at 6/16/16 5:05 PM: ---

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334175#comment-15334175 ] Jason Gustafson commented on KAFKA-3144: Haha, yeah. Should have known that Jun wo

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334201#comment-15334201 ] Jason Gustafson commented on KAFKA-3144: [~vahid] I created KAFKA-3853. Feel free

[jira] [Assigned] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-3853: -- Assignee: Vahid Hashemian > Report offsets for empty groups in ConsumerGroupCommand > -

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334216#comment-15334216 ] Vahid Hashemian commented on KAFKA-3144: Thanks [~hachikuji]. > report members wi

[jira] [Created] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

Jason Gustafson created KAFKA-3853: -- Summary: Report offsets for empty groups in ConsumerGroupCommand Key: KAFKA-3853 URL: https://issues.apache.org/jira/browse/KAFKA-3853 Project: Kafka Iss

RE: Embedding zookeeper and kafka in java process.

Thanks Ismael. I am instantiating kafkaserver instance like this. new KafkaServer(kafkaConfig,null,null); I tried to use new KafkaServer(kafkaConfig); but it does not compile with kafka 0.10.0. All the example I see uses new KafkaServer(kafkaConfig); Do we support new KafkaServer(kafkaConfig

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334223#comment-15334223 ] Vahid Hashemian commented on KAFKA-3144: This improvement request was moved to its

[jira] [Created] (KAFKA-3854) Consecutive regex subscription calls fail

Vahid Hashemian created KAFKA-3854: -- Summary: Consecutive regex subscription calls fail Key: KAFKA-3854 URL: https://issues.apache.org/jira/browse/KAFKA-3854 Project: Kafka Issue Type: Bug

avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

I am able to produce Avro from producer for pageview.avsc but not for userprofile.avsc. Here are two samples below, first one leaves out Avro optional experience, second one specifies it. Note: I do not register using REST curl calls schemas to schema-registry as I assume that kafka-avro-console-p

[VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

Hi All, I'd like to open the vote for KIP-62. This proposal attempts to address one of the recurring usability problems that users of the new consumer have faced with as little impact as possible. You can read the full details here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-62%3A+Allow

[jira] [Created] (KAFKA-3855) Guard race conditions in TopologyBuilder

Guozhang Wang created KAFKA-3855: Summary: Guard race conditions in TopologyBuilder Key: KAFKA-3855 URL: https://issues.apache.org/jira/browse/KAFKA-3855 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-3856) Move inner classes accessible only functions in TopologyBuilder out of public APIs

Guozhang Wang created KAFKA-3856: Summary: Move inner classes accessible only functions in TopologyBuilder out of public APIs Key: KAFKA-3856 URL: https://issues.apache.org/jira/browse/KAFKA-3856 Proj

[jira] [Resolved] (KAFKA-3561) Auto create through topic for KStream aggregation and join

[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3561. -- Resolution: Fixed Issue resolved by pull request 1472 [https://github.com/apache/kafka/pull/1472

[GitHub] kafka pull request #1472: KAFKA-3561: Auto create through topic for KStream ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1472 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3561) Auto create through topic for KStream aggregation and join

[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334446#comment-15334446 ] ASF GitHub Bot commented on KAFKA-3561: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1514: MINOR: Mention `log.message.format.version=0.10.0`...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1514 MINOR: Mention `log.message.format.version=0.10.0` in rolling upgrade section We had mentioned this step in the performance impact section in the middle of a long paragraph, which made it easy to mis

[jira] [Created] (KAFKA-3857) Additional log cleaner metrics

Kiran Pillarisetty created KAFKA-3857: - Summary: Additional log cleaner metrics Key: KAFKA-3857 URL: https://issues.apache.org/jira/browse/KAFKA-3857 Project: Kafka Issue Type: Improvemen

Re: FYI - Apache ZooKeeper Backup, a Treatise

Yes, thank you to Jordan for the article! Like Flavio, I personally have never come across the requirement for ZooKeeper backups. I've generally followed the pattern that data stored in ZooKeeper is truly transient, and applications are built either to tolerate loss of that data or reconstruct it

[jira] [Commented] (KAFKA-789) Producer-side persistence for delivery guarantee

[ https://issues.apache.org/jira/browse/KAFKA-789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334523#comment-15334523 ] radha commented on KAFKA-789: - This says resolved but does not mention anything about how this

[GitHub] kafka pull request #1515: KAFKA-3849: Make consumer poll time in MirrorMaker...

GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/1515 KAFKA-3849: Make consumer poll time in MirrorMaker configurable You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-3849

[jira] [Commented] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

[ https://issues.apache.org/jira/browse/KAFKA-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334531#comment-15334531 ] ASF GitHub Bot commented on KAFKA-3849: --- GitHub user SinghAsDev opened a pull reques

[jira] [Updated] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

[ https://issues.apache.org/jira/browse/KAFKA-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3849: -- Status: Patch Available (was: Open) > Make consumer poll time in MirrorMaker configurable. > --

Build failed in Jenkins: kafka-trunk-jdk8 #702

See Changes: [wangguoz] KAFKA-3561: Auto create through topic for KStream aggregation and join -- [...truncated 6592 lines...] kafka.utils.ByteBoundedBlockingQueueTest > testByteBoundedBlocking

[DISCUSS] Java 8 as a minimum requirement

Hi all, I would like to start a discussion on making Java 8 a minimum requirement for Kafka's next feature release (let's say Kafka 0.10.1.0 for now). This is the first discussion on the topic so the idea is to understand how people feel about it. If people feel it's too soon, then we can pick up

Re: Embedding zookeeper and kafka in java process.

Try using kafka.server.KafkaServerStartable instead. It should do the right thing. Ismael On Thu, Jun 16, 2016 at 7:18 PM, Subhash Agrawal wrote: > Thanks Ismael. > I am instantiating kafkaserver instance like this. > new KafkaServer(kafkaConfig,null,null); > > I tried to use > new KafkaServer(

Re: [DISCUSS] Java 8 as a minimum requirement

+1 for Lambda expression. On Thu, Jun 16, 2016 at 1:48 PM, Rajiv Kurian wrote: > +1 > > On Thu, Jun 16, 2016 at 1:45 PM, Ismael Juma wrote: > > > Hi all, > > > > I would like to start a discussion on making Java 8 a minimum requirement > > for Kafka's next feature release (let's say Kafka 0.10.

Re: [DISCUSS] Java 8 as a minimum requirement

+ 1 On Thursday, 16 June 2016, Craig Swift wrote: > +1 > > Craig J. Swift > Principal Software Engineer - Data Pipeline > ReturnPath Inc. > Work: 303-999-3220 Cell: 720-560-7038 > > On Thu, Jun 16, 2016 at 2:50 PM, Henry Cai > wrote: > > > +1 for Lambda expression. > > > > On Thu, Jun 16, 2016

Re: [DISCUSS] Java 8 as a minimum requirement

+1 Adam Kunicki StreamSets | Field Engineer mobile: 415.890.DATA (3282) | linkedin On Thu, Jun 16, 2016 at 1:56 PM, Craig Swift < craig.sw...@returnpath.com.i

Re: [DISCUSS] Java 8 as a minimum requirement

+1 Craig J. Swift Principal Software Engineer - Data Pipeline ReturnPath Inc. Work: 303-999-3220 Cell: 720-560-7038 On Thu, Jun 16, 2016 at 2:50 PM, Henry Cai wrote: > +1 for Lambda expression. > > On Thu, Jun 16, 2016 at 1:48 PM, Rajiv Kurian wrote: > > > +1 > > > > On Thu, Jun 16, 2016 at 1:

Re: [DISCUSS] Java 8 as a minimum requirement

+1 On Thu, Jun 16, 2016 at 1:45 PM, Ismael Juma wrote: > Hi all, > > I would like to start a discussion on making Java 8 a minimum requirement > for Kafka's next feature release (let's say Kafka 0.10.1.0 for now). This > is the first discussion on the topic so the idea is to understand how > peo

Re: [DISCUSS] Java 8 as a minimum requirement

I strongly support motion having difficulty running (Apache Kafka as opposed to Confluent) Stream examples with JDK 8 today. On 16 Jun 2016 4:46 p.m., "Ismael Juma" wrote: > Hi all, > > I would like to start a discussion on making Java 8 a minimum requirement > for Kafka's next feature release (l

[jira] [Created] (KAFKA-3858) Add functions to print stream topologies

Roger Hoover created KAFKA-3858: --- Summary: Add functions to print stream topologies Key: KAFKA-3858 URL: https://issues.apache.org/jira/browse/KAFKA-3858 Project: Kafka Issue Type: New Feature

Re: avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

Sorry, this thread belongs to confluent not Kafka.apache.org as it pertains to Confluent's examples. On Thu, Jun 16, 2016 at 2:33 PM, Philippe Derome wrote: > I am able to produce Avro from producer for pageview.avsc but not for > userprofile.avsc. Here are two samples below, first one leaves ou

Re: [DISCUSS] Java 8 as a minimum requirement

Would the move to Java 8 be for all modules? I'd have some concern about removing Java 7 compatibility for kafka-clients and for kafka streams (though less so since it's still so new). I don't know how hard it will be to transition a Scala 2.11 application to Scala 2.12. Are we comfortable with the

Re: [DISCUSS] Java 8 as a minimum requirement

I definitely think its time, but I am not sure if 0.10.1.0 is the release version to drop support in. Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 to maintain upgrade compatibility throughout the 0.10.x series? As a side note, I personally like the pattern of always s

Re: [DISCUSS] Java 8 as a minimum requirement

+1 for lambda expressions On Thu, Jun 16, 2016 at 5:13 PM, Grant Henke wrote: > I definitely think its time, but I am not sure if 0.10.1.0 is the release > version to drop support in. > > Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 > to maintain upgrade compatibilit

[jira] [Updated] (KAFKA-3858) Add functions to print stream topologies

[ https://issues.apache.org/jira/browse/KAFKA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-3858: Affects Version/s: (was: 0.10.0.0) 0.10.1.0 > Add functions to print stre

[jira] [Assigned] (KAFKA-3858) Add functions to print stream topologies

[ https://issues.apache.org/jira/browse/KAFKA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-3858: --- Assignee: Eno Thereska (was: Guozhang Wang) > Add functions to print stream topologies > ---

Re: [DISCUSS] Java 8 as a minimum requirement

On Thu, Jun 16, 2016 at 11:13 PM, Stephen Boesch wrote: > @Jeff Klukas What is the concern about scala 2.11 vs 2.12? 2.11 runs on > both java7 and java8 > Scala 2.10.5 and 2.10.6 also support Java 8 for what it's worth. Ismael

Build failed in Jenkins: kafka-trunk-jdk7 #1369

See Changes: [wangguoz] KAFKA-3561: Auto create through topic for KStream aggregation and join -- [...truncated 10553 lines...] org.apache.kafka.common.config.ConfigDefTest > testValidate PASSE

[jira] [Updated] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3837: -- Status: Patch Available (was: In Progress) > Report the name of the blocking thread whe

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Grant, Comments below. On Thu, Jun 16, 2016 at 11:13 PM, Grant Henke wrote: > Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 > to maintain upgrade compatibility throughout the 0.10.x series? > The issue is that we don't know when Kafka 0.11 will be released. Also,

Re: [DISCUSS] Java 8 as a minimum requirement

@Jeff Klukas What is the concern about scala 2.11 vs 2.12? 2.11 runs on both java7 and java8 2016-06-16 14:12 GMT-07:00 Jeff Klukas : > Would the move to Java 8 be for all modules? I'd have some concern about > removing Java 7 compatibility for kafka-clients and for kafka streams > (though less

Re: [DISCUSS] Java 8 as a minimum requirement

+1 On Thu, Jun 16, 2016 at 5:05 PM, Philippe Derome wrote: > I strongly support motion having difficulty running (Apache Kafka as > opposed to Confluent) Stream examples with JDK 8 today. > On 16 Jun 2016 4:46 p.m., "Ismael Juma" wrote: > > > Hi all, > > > > I would like to start a discussion o

Re: FYI - Apache ZooKeeper Backup, a Treatise

Contrary to recommendations everywhere, my experience is that almost everyone is storing source of truth data in ZooKeeper. It’s just too tempting. You have a distributed file system just sitting there and it’s too easy to use. You get a lot of great features like watches, etc. People are using

Re: FYI - Apache ZooKeeper Backup, a Treatise

Hi Jordan, Kafka stores ACLs as well as client and topic configs in ZooKeeper so that lends credence to your argument, I think. Ismael On Thu, Jun 16, 2016 at 11:41 PM, Jordan Zimmerman < jor...@jordanzimmerman.com> wrote: > Contrary to recommendations everywhere, my experience is that almost >

[VOTE] KIP-4 Create Topics Schema

I would like to initiate the voting process for the "KIP-4 Create Topics Schema changes". This is not a vote for all of KIP-4, but specifically for the create topics changes. I have included the exact changes below for clarity: > > Create Topics Request (KAFKA-2945 >

[GitHub] kafka pull request #1516: KAFKA-3837: Report the thread name of the blocking...

GitHub user bharatviswa504 opened a pull request: https://github.com/apache/kafka/pull/1516 KAFKA-3837: Report the thread name of the blocking thread when throwing ConcurrentModificationException You can merge this pull request into a Git repository by running: $ git pull htt

[jira] [Commented] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334768#comment-15334768 ] ASF GitHub Bot commented on KAFKA-3837: --- GitHub user bharatviswa504 opened a pull re

Reg: Build Validation Jenkins

Hi, I have opened pull request for one of the JIRA. My build has been marked has failed due to time out exception. I think configuration setup is like that after 2 hours mark it as build fail. I have seen other builds on jenkins they also has same issue. Is this jenkins server executing machines

[GitHub] kafka pull request #1513: MINOR: Follow-up from KAFKA-2720 with comment/styl...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1513 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334787#comment-15334787 ] ASF GitHub Bot commented on KAFKA-2720: --- Github user asfgit closed the pull request

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Jan, That's interesting. Do you have some references you can share on this? It would be good to know which Java 8 versions have been tested and whether it is something that is being worked on. Ismael On Fri, Jun 17, 2016 at 12:02 AM, wrote: > > Hi Ismael, > > Unfortunately Java 8 doesn't pl

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Ismael, Unfortunately Java 8 doesn't play nice with FreeBSD. We have seen a lot of JVM crashes running our 0.9 brokers on Java 8... Java 7 on the other hand is totally stable. Until these issues have been addressed, this would cause some serious issues for us. Regards Jan

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334812#comment-15334812 ] Roger Hoover commented on KAFKA-3740: - [~h...@pinterest.com], any update on this? I'm

[GitHub] kafka pull request #1509: KAFKA-3691: Confusing logging during metadata upda...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1509 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3691) Confusing logging during metadata update timeout

[ https://issues.apache.org/jira/browse/KAFKA-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334834#comment-15334834 ] ASF GitHub Bot commented on KAFKA-3691: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3691) Confusing logging during metadata update timeout

[ https://issues.apache.org/jira/browse/KAFKA-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3691: --- Resolution: Fixed Fix Version/s: (was: 0.10.0.1) Status: Resolved (was: Patch Av

Re: [VOTE] KIP-55: Secure quotas for authenticated users

Rajini, Thanks for the update. A few more questions/comments. 10. For the quota value stored in ZK, since we are adding an optional user_principal field in the json, we should bump the version from 1 to 2. Also, user_principal is not really part of the config values. So, perhaps we should represe

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334860#comment-15334860 ] Ishita Mandhan commented on KAFKA-3185: --- [~guozhang] Do you think this is a bug a ne

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

＋1. On Thu, Jun 16, 2016 at 11:44 AM, Jason Gustafson wrote: > Hi All, > > I'd like to open the vote for KIP-62. This proposal attempts to address one > of the recurring usability problems that users of the new consumer have > faced with as little impact as possible. You can read the full detail

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 (binding) On Fri, Jun 17, 2016 at 12:44 AM, Guozhang Wang wrote: > ＋1. > > On Thu, Jun 16, 2016 at 11:44 AM, Jason Gustafson > wrote: > > > Hi All, > > > > I'd like to open the vote for KIP-62. This proposal attempts to address > one > > of the recurring usability problems that users of the

Re: [VOTE] KIP-4 Create Topics Schema

+1 (binding) On Thu, Jun 16, 2016 at 11:50 PM, Grant Henke wrote: > I would like to initiate the voting process for the "KIP-4 Create Topics > Schema changes". This is not a vote for all of KIP-4, but specifically for > the create topics changes. I have included the exact changes below for > cla

[jira] [Resolved] (KAFKA-3755) tightening the offset check in ReplicaFetcherThread

[ https://issues.apache.org/jira/browse/KAFKA-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3755. Resolution: Not A Problem As notes in the PR, looks like Log.append() already has that check. See https://g

[GitHub] kafka pull request #1506: KAFKA-3755 Tightening the offset check in ReplicaF...

Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1506 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-3755) tightening the offset check in ReplicaFetcherThread

[ https://issues.apache.org/jira/browse/KAFKA-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334892#comment-15334892 ] ASF GitHub Bot commented on KAFKA-3755: --- Github user imandhan closed the pull reques

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

Harsha, Another question. 9. How would the delegation token be configured in the client? The standard way is to do this through JAAS. However, we will need to think through if this is convenient in a shared environment. For example, when a new task is added to a Storm worker node, do we need to d

Re: avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

Here is my understanding about Avro "union type (or optional field if one of its union value is null)": 1. Even for such fields, you need to specify them as "null" in your data, such as {"region" : "US", "experience" : null}. 2. And if you do have a value for these union fields, you need to speci

Re: [DISCUSS] Java 8 as a minimum requirement

I think moving from Java 7 to 8 for Kafka Streams won't be of a big issue. What specific concerns do you have Jeff? On Thu, Jun 16, 2016 at 2:12 PM, Jeff Klukas wrote: > Would the move to Java 8 be for all modules? I'd have some concern about > removing Java 7 compatibility for kafka-clients and

Re: [VOTE] KIP-4 Create Topics Schema

+1. On Thu, Jun 16, 2016 at 3:47 PM, Ismael Juma wrote: > +1 (binding) > > On Thu, Jun 16, 2016 at 11:50 PM, Grant Henke wrote: > > > I would like to initiate the voting process for the "KIP-4 Create Topics > > Schema changes". This is not a vote for all of KIP-4, but specifically > for > > the

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334926#comment-15334926 ] Guozhang Wang commented on KAFKA-3185: -- I think [~mjsax] has already started working

[GitHub] kafka pull request #1485: KAFKA-3805: Check if DB is null.

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1485 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3805) Running multiple instances of a Streams app on the same machine results in Java_org_rocksdb_RocksDB_write error

[ https://issues.apache.org/jira/browse/KAFKA-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334935#comment-15334935 ] ASF GitHub Bot commented on KAFKA-3805: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3805) Running multiple instances of a Streams app on the same machine results in Java_org_rocksdb_RocksDB_write error

[ https://issues.apache.org/jira/browse/KAFKA-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3805. -- Resolution: Fixed Fix Version/s: 0.10.0.1 Issue resolved by pull request 1485 [https://gi

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334945#comment-15334945 ] Ishita Mandhan commented on KAFKA-3185: --- Ah okay, sounds good- I'll look for somethi

  1   2   >