[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090458#comment-15090458 ] Nitin Padalia commented on KAFKA-2120: -- Is this resolution backported to older versio

[GitHub] kafka-site pull request: MINOR: Simple updates to api, design, sec...

Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/7 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] kafka-site pull request: Minor updates to api, design, security an...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka-site/pull/7 Minor updates to api, design, security and upgrade pages Changes copied from 0.9.0 branch of the kafka repo. You can merge this pull request into a Git repository by running: $ git pull https:/

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

Anna - Good suggestion. Sounds good to me as well On Fri, Jan 8, 2016 at 2:32 PM, Aditya Auradkar < aaurad...@linkedin.com.invalid> wrote: > Anna, > > That sounds good to me as well. > > Aditya > > On Fri, Jan 8, 2016 at 2:11 PM, Gwen Shapira wrote: > > > Sounds good to me too. Seems pretty easy

Jenkins build is back to normal : kafka_0.9.0_jdk7 #83

See

Build failed in Jenkins: kafka-trunk-jdk7 #949

See Changes: [me] MINOR: Security doc fixes -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (Ubuntu ubuntu) in workspace

Build failed in Jenkins: kafka-trunk-jdk7 #948

See Changes: [me] MINOR: speed up connect startup when full connector class name is [me] MINOR: Add property to configure showing of standard streams in Gradle -- [...truncated 3714 lines...] ka

Re: KIP-41: KafkaConsumer Max Records

Hi Jason, +1 on the idea of adding max.poll.bytes as an optional configuration (default set to -1, would mean that the setting does not come into play) The pre-fetching optimization, (pre fetch again only those partitions with no retained data), seems slightly better(same as what we have in produ

[GitHub] kafka pull request: MINOR: Security doc fixes

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/745 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: Kafka 3078

GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/747 Kafka 3078 You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-3078 Alternatively you can review and apply these changes a

[GitHub] kafka pull request: MINOR: Add property to configure showing of st...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/739 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: MINOR: speed up connect startup when full conn...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

Anna, That sounds good to me as well. Aditya On Fri, Jan 8, 2016 at 2:11 PM, Gwen Shapira wrote: > Sounds good to me too. Seems pretty easy to add and can be useful for > producers. > > On Fri, Jan 8, 2016 at 1:22 PM, Joel Koshy wrote: > > > Hi Anna, > > > > That sounds good to me - Becket/ot

Re: Consider increasing the default reserved.broker.max.id

I agree that many people id their brokers differently and increasing the default will only handle a subset of those schemes. Though I think increasing it to some reasonable value may help decrease issues drastically regardless. I also think some longer term fix that avoids collisions all together

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

Sounds good to me too. Seems pretty easy to add and can be useful for producers. On Fri, Jan 8, 2016 at 1:22 PM, Joel Koshy wrote: > Hi Anna, > > That sounds good to me - Becket/others any thoughts? > > Thanks, > > Joel > > On Fri, Jan 8, 2016 at 12:41 PM, Anna Povzner wrote: > > > Hi Becket an

[GitHub] kafka pull request: MINOR: speed up connect startup when full conn...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/746 MINOR: speed up connect startup when full connector class name is provided You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka work

[jira] [Created] (KAFKA-3086) unused handle method in MirrorMakerMessageHandler

Jun Rao created KAFKA-3086: -- Summary: unused handle method in MirrorMakerMessageHandler Key: KAFKA-3086 URL: https://issues.apache.org/jira/browse/KAFKA-3086 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089993#comment-15089993 ] Cosmin Marginean commented on KAFKA-2985: - I have't yet, no, as I'm struggling to

[jira] [Assigned] (KAFKA-3076) BrokerChangeListener should log the brokers in order

[ https://issues.apache.org/jira/browse/KAFKA-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konrad Kalita reassigned KAFKA-3076: Assignee: Konrad Kalita > BrokerChangeListener should log the brokers in order > --

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089983#comment-15089983 ] Jason Gustafson commented on KAFKA-2985: [~cosmin.marginean] Have you tested with

[GitHub] kafka pull request: MINOR: Security doc fixes

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/745 MINOR: Security doc fixes Simple fixes that have tripped users. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka security-doc-improvement

[jira] [Created] (KAFKA-3085) BrokerChangeListener computes inconsistent live/dead broker list

Jun Rao created KAFKA-3085: -- Summary: BrokerChangeListener computes inconsistent live/dead broker list Key: KAFKA-3085 URL: https://issues.apache.org/jira/browse/KAFKA-3085 Project: Kafka Issue Typ

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

Hi Anna, That sounds good to me - Becket/others any thoughts? Thanks, Joel On Fri, Jan 8, 2016 at 12:41 PM, Anna Povzner wrote: > Hi Becket and everyone, > > Could we please add the following functionality to this KIP. I think it > would be very useful for the broker to return the timestamp i

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089962#comment-15089962 ] Cosmin Marginean commented on KAFKA-2985: - I can confirm that I can also reproduce

Jenkins build is back to normal : kafka-trunk-jdk7 #947

See

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

Hi Becket and everyone, Could we please add the following functionality to this KIP. I think it would be very useful for the broker to return the timestamp in the ack to the producer (in response: timestamp per partition) and propagate it back to client in RecordMetadata. This way, if timestamp ty

[jira] [Updated] (KAFKA-3084) Topic existence checks in topic commands (create, alter, delete)

[ https://issues.apache.org/jira/browse/KAFKA-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-3084: --- Status: Patch Available (was: Open) > Topic existence checks in topic commands (create, alter, delete

[jira] [Commented] (KAFKA-3084) Topic existence checks in topic commands (create, alter, delete)

[ https://issues.apache.org/jira/browse/KAFKA-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089874#comment-15089874 ] ASF GitHub Bot commented on KAFKA-3084: --- GitHub user granthenke opened a pull reques

[GitHub] kafka pull request: KAFKA-3084: Topic existence checks in topic co...

GitHub user granthenke opened a pull request: https://github.com/apache/kafka/pull/744 KAFKA-3084: Topic existence checks in topic commands (create, alter, … …delete) You can merge this pull request into a Git repository by running: $ git pull https://github.com/granthenke/

[jira] [Created] (KAFKA-3084) Topic existence checks in topic commands (create, alter, delete)

Grant Henke created KAFKA-3084: -- Summary: Topic existence checks in topic commands (create, alter, delete) Key: KAFKA-3084 URL: https://issues.apache.org/jira/browse/KAFKA-3084 Project: Kafka I

Re: [VOTE] KIP-32 Add CreateTime and LogAppendTime to Kafka message.

+1 from me Looking through this thread it seems there was some confusion on the migration discussion. This discussion in fact happened in the KIP-31 discuss thread, not so much in the KIP hangout. There is considerable overlap in discussions between KIP-3[1,2,3] so it makes sense to cross-referenc

Re: KIP-41: KafkaConsumer Max Records

Thanks Jens for all of your work as well! Unless there are any more concerns, perhaps we can open the vote early next week. As a quick summary for newcomers to this thread, the problem we're trying to solve in this KIP is how to give users more predictable control over the message processing loop.

[jira] [Comment Edited] (KAFKA-2410) Implement "Auto Topic Creation" client side and remove support from Broker side

[ https://issues.apache.org/jira/browse/KAFKA-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089686#comment-15089686 ] Mayuresh Gharat edited comment on KAFKA-2410 at 1/8/16 6:48 PM:

[jira] [Commented] (KAFKA-2410) Implement "Auto Topic Creation" client side and remove support from Broker side

[ https://issues.apache.org/jira/browse/KAFKA-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089686#comment-15089686 ] Mayuresh Gharat commented on KAFKA-2410: I would like to bump up discussion on thi

[GitHub] kafka pull request: MINOR: Fix typos in Kafka website page

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/742 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-3079) org.apache.kafka.common.KafkaException: java.lang.SecurityException: Configuration Error:

[ https://issues.apache.org/jira/browse/KAFKA-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit Anchlia updated KAFKA-3079: - Attachment: kafka_server_jaas.conf Jass file attached > org.apache.kafka.common.KafkaException: j

[jira] [Issue Comment Deleted] (KAFKA-3079) org.apache.kafka.common.KafkaException: java.lang.SecurityException: Configuration Error:

[ https://issues.apache.org/jira/browse/KAFKA-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit Anchlia updated KAFKA-3079: - Comment: was deleted (was: KafkaServer { com.sun.security.auth.module.Krb5LoginModule required

[jira] [Commented] (KAFKA-3079) org.apache.kafka.common.KafkaException: java.lang.SecurityException: Configuration Error:

[ https://issues.apache.org/jira/browse/KAFKA-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089625#comment-15089625 ] Mohit Anchlia commented on KAFKA-3079: -- KafkaServer { com.sun.security.auth.modul

Re: TMR should nopt create topic if not existing.

Hi Mayuresh, Your understand aligns with my understanding. Thanks, Grant On Fri, Jan 8, 2016 at 11:38 AM, Mayuresh Gharat wrote: > Hi Grant, > > Thanks a lot for the explanation.This is great. > It was little confusing with KIP-4 and KAFKA-1507 both talking about the > somewhat same thing and

[GitHub] kafka pull request: MINOR: Fix bug in `waitUntilLeaderIsElectedOrC...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/743 MINOR: Fix bug in `waitUntilLeaderIsElectedOrChanged` and simplify result type The bug was for the following case: `leader.isDefined && oldLeaderOpt.isEmpty && newLeaderOpt.isDefined && newLe

Re: KIP-41: KafkaConsumer Max Records

Hi Aarti, Thanks for the feedback. I think the concern about memory overhead is valid. As Guozhang mentioned, the problem already exists in the current consumer, so this probably deserves consideration outside of this KIP. That said, it's a good question whether our prefetching strategy makes it m

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leader a topic partition in an inconsistent state

[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089586#comment-15089586 ] Mayuresh Gharat commented on KAFKA-3083: [~fpj] can you shed some light on what yo

Re: ScalaStyle Feedback

One more thing: once we apply this PR, backporting to 0.9.0 will become much harder. This is one of the reasons (the other being that I'd like to see the impact of the rules on the existing codebase and haven't had the time to check) that I haven't commented on your PR in more detail. We are still

Re: TMR should nopt create topic if not existing.

Hi Grant, Thanks a lot for the explanation.This is great. It was little confusing with KIP-4 and KAFKA-1507 both talking about the somewhat same thing and KAFKA-1507 has been lying around since last August and not checked in or iterated on. Here is what I understand is : 1) KAFKA-2945 will implem

Re: ScalaStyle Feedback

Hey Grant, As you know I think this is definitely valuable. My take: 1. The choice of rules is really important and it's a good plan to be conservative initially (as you suggested) 2. We should only use errors, not warnings 3. To make the previous one feasible, the rules we enable must not have f

ScalaStyle Feedback

A while back I did a some preliminary work on KAFKA-2423: Introduce ScalaStyle. There is a pull request here: https://github.com/apache/kafka/pull/560. The important content for review is the rule set defined in scalastyle_config.xml. I know complete consensus on something like this may not be fea

Re: TMR should nopt create topic if not existing.

Hi Mayuresh, I am working on KIP-4 and the create topic wire protocol is a part of that. I have a patch but it needs to be changed to be synchronous on the server side yet. You can see the discussion on the pull request. That work can be tracked here: https://issues.apache.org/jira/browse/KAFKA-29

[jira] [Commented] (KAFKA-3064) Improve resync method to waste less time and data transfer

[ https://issues.apache.org/jira/browse/KAFKA-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089449#comment-15089449 ] Michael Graff commented on KAFKA-3064: -- Example log messages indicating this issue is

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leader a topic partition in an inconsistent state

[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089422#comment-15089422 ] Jun Rao commented on KAFKA-3083: [~fpj] suggested that reason that this could happen is th

[jira] [Updated] (KAFKA-3083) a soft failure in controller may leader a topic partition in an inconsistent state

[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-3083: --- Description: The following sequence can happen. 1. Broker A is the controller and is in the middle of process

[jira] [Created] (KAFKA-3083) a soft failure in controller may leader a topic partition in an inconsistent state

Jun Rao created KAFKA-3083: -- Summary: a soft failure in controller may leader a topic partition in an inconsistent state Key: KAFKA-3083 URL: https://issues.apache.org/jira/browse/KAFKA-3083 Project: Kafka

Status of multi-tenancy

Hello Luciano, We have started a KIP to make progress along this direction. [KIP-37| https://cwiki.apache.org/confluence/display/KAFKA/KIP-37+-+Add+Namespaces+to+Kafka] covers the details. It will be nice if you can go over the KIP, its associated discussion thread and provide your thoughts. Hones

Status of multi-tenancy

Hi there We are interested in adding support for multiple tenants into Kafka and I reached to this thread http://grokbase.com/t/kafka/dev/154wsscrsk/adding-multi-tenancy-capabilities-to-kafka Could you please let me know the status of this proposal? Is this something we can move forward? Regar

[jira] [Commented] (KAFKA-1382) Update zkVersion on partition state update failures

[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089248#comment-15089248 ] dude commented on KAFKA-1382: - we hit this bug in kafka0.8.2.1, three nodes. zookeeper version

[GitHub] kafka pull request: MINOR: Fix typos in Kafka website page

GitHub user smalldirector opened a pull request: https://github.com/apache/kafka/pull/742 MINOR: Fix typos in Kafka website page Fix two minor typos in Kafka official website page. You can merge this pull request into a Git repository by running: $ git pull https://github.com/s

KIP process

Hi, I just read through the KIP process[1] and have three specific questions: 1. I notice that the voting is executed using "Lazy Majority"[2]. However, I was surprised that "Lazy Majority" doesn't stipulate a time for how long a voting process will go on. I assume I can't vote "No" to i

Re: KIP-41: KafkaConsumer Max Records

Hi, I just publicly wanted to thank Jason for the work he's done with the KIP and say that I've been in touch with him privately back and forth to work out of some of its details. Thanks! Since it feels like I initiated this KIP a bit I also want to say that I'm happy with it and that its proposa

[jira] [Commented] (KAFKA-3007) new Consumer should expose mechanism to fetch single message, consumer.poll(timeout, maxMessageLimit)

[ https://issues.apache.org/jira/browse/KAFKA-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088919#comment-15088919 ] Jens Rantil commented on KAFKA-3007: Seems like I don't have access to change the titl