[jira] [Commented] (KAFKA-4277) creating ephemeral node already exist

2017-03-13 Thread Wrikken (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906972#comment-15906972 ] Wrikken commented on KAFKA-4277: [~junrao]: it was not there several hours later, but I ha

[jira] [Comment Edited] (KAFKA-4277) creating ephemeral node already exist

2017-03-13 Thread Wrikken (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906972#comment-15906972 ] Wrikken edited comment on KAFKA-4277 at 3/13/17 7:53 AM: - [~junrao

[jira] [Resolved] (KAFKA-4884) __consumer_offsets topic processing consuming all resources

2017-03-13 Thread Tom Coupland (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Coupland resolved KAFKA-4884. - Resolution: Invalid > __consumer_offsets topic processing consuming all resources > --

[jira] [Commented] (KAFKA-4829) Improve logging of StreamTask commits

2017-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907078#comment-15907078 ] Nicolas Fouché commented on KAFKA-4829: --- Some comments on how we felt that some logs

Doubts regarding KafkaProducer implemetation

2017-03-13 Thread Madhukar Bharti
Hi, We have three brokers in a cluster with replication factor is 3. We are using Kafka-0.10.0.1. We see some failures on metadata timeout exceptions while producing. We have configured retries=3 and max in flight request=1. After comparing with the old scala Producer code found that in new Produc

[jira] [Created] (KAFKA-4889) 2G8lc

2017-03-13 Thread Vamsi Jakkula (JIRA)
Vamsi Jakkula created KAFKA-4889: Summary: 2G8lc Key: KAFKA-4889 URL: https://issues.apache.org/jira/browse/KAFKA-4889 Project: Kafka Issue Type: Task Reporter: Vamsi Jakkula Cr

Re: Doubts regarding KafkaProducer implemetation

2017-03-13 Thread Manikumar
Hi, java producer waits for the metadata of the given topic to be available. We will get TimeoutException if we didn't get metadata within max.block.ms. As observed by you, this behavior is different from old producer. "retries" config is not applicable to metadata fetch. We can adjust max.block.

Re: Add to contributor list

2017-03-13 Thread Raja Guru Thirumavalavan
Thank you Raja Guru T On Mon, Mar 13, 2017 at 3:24 AM, Guozhang Wang wrote: > Done. > > Guozhang > > On Sun, Mar 12, 2017 at 11:19 AM, Raja Guru Thirumavalavan < > geeky.rajag...@gmail.com> wrote: > > > Hi,,Can you please add me to contributor list. > > or is there any other way to request. > >

[jira] [Commented] (KAFKA-4835) Allow users control over repartitioning

2017-03-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907523#comment-15907523 ] Michal Borowiecki commented on KAFKA-4835: -- My point above was that if the custom

[DISCUSS] KIP-132: Augment KStream.print to allow extra parameters in the printed string

2017-03-13 Thread Marc Juchli
Dear all, The following describes KIP-132, which I just created. See: https://cwiki.apache.org/confluence/display/KAFKA/KIP-132+-+Augment+KStream.print+to+allow+extra+parameters+in+the+printed+string Motivation As for now, KStream#print leads to a predefined output where key and value are printe

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2017-03-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4128: --- Labels: reliability (was: ) > Kafka broker losses messages when zookeeper session times out > ---

[jira] [Created] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-4890: - Summary: State directory being deleted when another thread holds the lock Key: KAFKA-4890 URL: https://issues.apache.org/jira/browse/KAFKA-4890 Project: Kafka Iss

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

2017-03-13 Thread Jun Rao
Hi, Dong, Thanks for the updated KIP. Some more comments below. 10. For the .move log, do we perform any segment deletion (based on retention) or log cleaning (if a compacted topic)? Or do we only enable that after the swap? 11. kafka-reassign-partitions.sh 11.1 If all reassigned replicas are in

[jira] [Updated] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4890: -- Description: Looks like a state directory is being cleaned up when another thread already has the lock:

[jira] [Created] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread Onur Karaman (JIRA)
Onur Karaman created KAFKA-4891: --- Summary: kafka.request.logger TRACE regression Key: KAFKA-4891 URL: https://issues.apache.org/jira/browse/KAFKA-4891 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #2677: MINOR: set trace logging for zookeeper upgrade tes...

2017-03-13 Thread apurvam
GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/2677 MINOR: set trace logging for zookeeper upgrade test This adds logging which will hopefully help root cause https://issues.apache.org/jira/browse/KAFKA-4574. You can merge this pull request into a G

[jira] [Commented] (KAFKA-4574) Transient failure in ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade with security_protocol = SASL_PLAINTEXT, SSL

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907916#comment-15907916 ] ASF GitHub Bot commented on KAFKA-4574: --- GitHub user apurvam opened a pull request:

[GitHub] kafka pull request #2678: KAFKA-4891 kafka.request.logger TRACE regression

2017-03-13 Thread onurkaraman
GitHub user onurkaraman opened a pull request: https://github.com/apache/kafka/pull/2678 KAFKA-4891 kafka.request.logger TRACE regression Both the headers and requests have regressed to just show object ids instead of their contents from their underlying structs. I'm guessing this

[jira] [Commented] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15911762#comment-15911762 ] ASF GitHub Bot commented on KAFKA-4891: --- GitHub user onurkaraman opened a pull reque

Re: [DISCUSS] KIP-82 - Add Record Headers

2017-03-13 Thread radai
the common "stack" we envision at linkedin would consist of (at least) the following components that add headers to every outgoing request: 1. auditing/"lineage" - appends a header containing "node" (hostname etc), time (UTC time) and destination (cluster/topic). these accumulate as requests get m

[GitHub] kafka pull request #2554: KAFKA-4769: Add Float serializer, deserializer, se...

2017-03-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2554 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4769) Add Float serializer, deserializer, serde

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4769: - Resolution: Fixed Fix Version/s: 0.11.0.0 Status: Resolved (was: Patch Available

[jira] [Commented] (KAFKA-4769) Add Float serializer, deserializer, serde

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922722#comment-15922722 ] ASF GitHub Bot commented on KAFKA-4769: --- Github user asfgit closed the pull request

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Jay Kreps
Two things: 1. This is a minor thing but the proposed new name for KStreamBuilder is StreamsTopologyBuilder. I actually think we should not put topology in the name as topology is not a concept you need to understand at the kstreams layer right now. I'd think of three categories of con

[GitHub] kafka pull request #2672: KAFKA-4657: Improve test coverage of CompositeRead...

2017-03-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4848) Stream thread getting into deadlock state while trying to get rocksdb lock in retryWithBackoff

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922762#comment-15922762 ] Guozhang Wang commented on KAFKA-4848: -- [~sjmittal] BTW I have added you to the contr

[jira] [Assigned] (KAFKA-4848) Stream thread getting into deadlock state while trying to get rocksdb lock in retryWithBackoff

2017-03-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-4848: -- Assignee: Sachin Mittal > Stream thread getting into deadlock state while trying to get

[jira] [Commented] (KAFKA-4657) Improve test coverage of CompositeReadOnlyWindowStore

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922752#comment-15922752 ] ASF GitHub Bot commented on KAFKA-4657: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4657) Improve test coverage of CompositeReadOnlyWindowStore

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4657. -- Resolution: Fixed Issue resolved by pull request 2672 [https://github.com/apache/kafka/pull/2672

[jira] [Commented] (KAFKA-4859) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion (again)

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922772#comment-15922772 ] Guozhang Wang commented on KAFKA-4859: -- [~original-brownbear] Thanks a lot for pickin

[jira] [Commented] (KAFKA-4887) Enabling caching on a persistent window store breaks support for duplicate insertion

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922789#comment-15922789 ] Guozhang Wang commented on KAFKA-4887: -- Thanks Elias, this does sound a bug to me. J

Re: [DISCUSS] KIP-117: Add a public AdministrativeClient API for Kafka admin operations

2017-03-13 Thread radai
looking at the KIP as it is now, looks like all *Options objects have a common timeout property. could it be extracted to a common AdminRequestOptions or something? On Thu, Mar 9, 2017 at 2:14 PM, Colin McCabe wrote: > Hi all, > > We've been discussing this for a while (about a month) and I thin

[jira] [Commented] (KAFKA-4887) Enabling caching on a persistent window store breaks support for duplicate insertion

2017-03-13 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922826#comment-15922826 ] Elias Levy commented on KAFKA-4887: --- It is a bit complicated. I am abusing the {{RocksD

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Steven Schlansker
> On Mar 13, 2017, at 12:30 PM, Matthias J. Sax wrote: > > Jay, > > thanks for your feedback > >> What if instead we called it KStreamsBuilder? > > That's the current name and I personally think it's not the best one. > The main reason why I don't like KStreamsBuilder is, that we have the > c

[GitHub] kafka pull request #2678: KAFKA-4891 kafka.request.logger TRACE regression

2017-03-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2678 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922844#comment-15922844 ] ASF GitHub Bot commented on KAFKA-4891: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4891: Fix Version/s: 0.10.2.1 > kafka.request.logger TRACE regression > --

[GitHub] kafka pull request #2679: HOTFIX: Fix apache headers in float serde class fi...

2017-03-13 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/2679 HOTFIX: Fix apache headers in float serde class files @hachikuji You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KHotfix

[jira] [Updated] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4891: Fix Version/s: (was: 0.10.2.1) 0.11.0.0 > kafka.request.logger TRACE regressi

Build failed in Jenkins: kafka-trunk-jdk8 #1346

2017-03-13 Thread Apache Jenkins Server
See -- Failed to access build log java.io.IOException: remote file operation failed: /home/jenkins/jenkins-slave/workspace/kafka-trunk-jdk8 at hudson.remoting.Channel@7b7d2d3b:ubuntu-u

[jira] [Resolved] (KAFKA-4891) kafka.request.logger TRACE regression

2017-03-13 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-4891. - Resolution: Fixed > kafka.request.logger TRACE regression > -

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Matthias J. Sax
Steven, thanks for your feedback. I am not sure about KafkaStreamsBuilder (even if agree that it is better than KStreamBuilder), because it sounds like a builder that creates a KafkaStreams instance. But that's of course not the case. It builds a Topology -- that was the reason to consider callin

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Matthias J. Sax
Guozhang, 1) I updated the KIP to option (b). 3) Agreed. So we leave this part out, and tackle it within KIP-130 -Matthias On 3/12/17 3:48 PM, Guozhang Wang wrote: > Thanks Matthias. > > 1) Given that TopologyDescription is for debugging purposes before > `KafkaStreams.start()`. I think the

Re: [DISCUSS] KIP-132: Augment KStream.print to allow extra parameters in the printed string

2017-03-13 Thread Matthias J. Sax
Marc, Thanks for the KIP. Can you please update the KIP in a way such that it is self contained. Right now, you link to all kind of other places making it hard to read the KIP. The KIP should be the "center of truth" -- if there is important information elsewhere, please c&p it into the KIP. T

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Matthias J. Sax
Jay, thanks for your feedback > What if instead we called it KStreamsBuilder? That's the current name and I personally think it's not the best one. The main reason why I don't like KStreamsBuilder is, that we have the concepts of KStreams and KTables, and the builder creates both. However, the n

[jira] [Updated] (KAFKA-4840) There are are still cases where producer buffer pool will not remove waiters.

2017-03-13 Thread Sean McCauliff (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean McCauliff updated KAFKA-4840: -- Description: There are several problems dealing with errors in BufferPool.allocate(int size, l

[GitHub] kafka pull request #2679: HOTFIX: Fix apache headers in float serde class fi...

2017-03-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2679 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4835) Allow users control over repartitioning

2017-03-13 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922911#comment-15922911 ] Matthias J. Sax commented on KAFKA-4835: Agreed. I just wanted to point out, that

Re: [DISCUSS] KIP-131 : Add access to OffsetStorageReader from SourceConnector

2017-03-13 Thread Matthias J. Sax
Can you please add the KIP to this table: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-KIPsunderdiscussion Thanks, Matthias On 3/7/17 1:24 PM, Florian Hussonnois wrote: > Hi all, > > I've created a new KIP to add access to OffsetStor

Build failed in Jenkins: kafka-trunk-jdk7 #2011

2017-03-13 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4769: Add Float serializer, deserializer, serde [wangguoz] KAFKA-4657: Improve test coverage of CompositeReadOnlyWindowStore -- [...truncate

[jira] [Commented] (KAFKA-4643) Improve test coverage of StreamsKafkaClient

2017-03-13 Thread Andrey Dyachkov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922945#comment-15922945 ] Andrey Dyachkov commented on KAFKA-4643: I would like to grab this one, could you

[jira] [Commented] (KAFKA-4859) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion (again)

2017-03-13 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922979#comment-15922979 ] Armin Braun commented on KAFKA-4859: [~guozhang] zeroing in on it :) Should have a PR

Re: [DISCUSS] KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback

2017-03-13 Thread Jason Gustafson
Hey Onur, > Regarding 1: I've been considering something like this for a while now. > KIP-122 has a similar issue and I brought up some hacks in that discussion > to work around it (http://markmail.org/message/kk4ng74riejidify). While > solving this problem would help loosen the requirements for

Re: [DISCUSS] KIP-132: Augment KStream.print to allow extra parameters in the printed string

2017-03-13 Thread Matthias J. Sax
Can you please add the KIP to this table: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-KIPsunderdiscussion Thanks, Matthias On 3/13/17 8:08 AM, Marc Juchli wrote: > Dear all, > > The following describes KIP-132, which I just created.

Re: [DISCUSS] KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback

2017-03-13 Thread Jason Gustafson
Oh, seems I missed your comment saying the default would be "auto." Hmm... If that's safe, then it sounds good to me. -Jason On Mon, Mar 13, 2017 at 2:32 PM, Jason Gustafson wrote: > Hey Onur, > > >> Regarding 1: I've been considering something like this for a while now. >> KIP-122 has a simila

Jenkins build is back to normal : kafka-trunk-jdk7 #2012

2017-03-13 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-117: Add a public AdministrativeClient API for Kafka admin operations

2017-03-13 Thread Colin McCabe
Hi Radai, Thanks for looking at the KIP again. On Mon, Mar 13, 2017, at 12:33, radai wrote: > looking at the KIP as it is now, looks like all *Options objects have a > common timeout property. could it be extracted to a common > AdminRequestOptions or something? Perhaps I'm missing something, bu

Build failed in Jenkins: kafka-trunk-jdk8 #1347

2017-03-13 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4769: Add Float serializer, deserializer, serde [wangguoz] KAFKA-4657: Improve test coverage of CompositeReadOnlyWindowStore [becket.qin] KAFKA-4891; kafka.request.logger TRACE reg

[jira] [Commented] (KAFKA-4859) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion (again)

2017-03-13 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923095#comment-15923095 ] Armin Braun commented on KAFKA-4859: [~guozhang] so basically this can just be resolve

Re: [DISCUSS] KIP-113: Support replicas movement between log directories

2017-03-13 Thread Dong Lin
Hey Jun, Thanks much for your detailed comments. Please see my reply below. On Mon, Mar 13, 2017 at 9:09 AM, Jun Rao wrote: > Hi, Dong, > > Thanks for the updated KIP. Some more comments below. > > 10. For the .move log, do we perform any segment deletion (based on > retention) or log cleaning

Build failed in Jenkins: kafka-trunk-jdk8 #1348

2017-03-13 Thread Apache Jenkins Server
See Changes: [jason] HOTFIX: Fix apache headers in float serde class files -- [...truncated 21.52 KB...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[8] PAS

[GitHub] kafka pull request #2680: KAFKA-4859: Raised Timeout

2017-03-13 Thread original-brownbear
GitHub user original-brownbear opened a pull request: https://github.com/apache/kafka/pull/2680 KAFKA-4859: Raised Timeout This fixes https://issues.apache.org/jira/browse/KAFKA-4859 for me over hundreds of iterations while I could easily reproduce it with less than ~30-40 iteratio

[jira] [Commented] (KAFKA-4859) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion (again)

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923105#comment-15923105 ] ASF GitHub Bot commented on KAFKA-4859: --- GitHub user original-brownbear opened a pul

[jira] [Created] (KAFKA-4892) kafka 0.8.2.1 getOffsetsBefore API returning correct offset given timestamp in unix epoch format

2017-03-13 Thread Chris Bedford (JIRA)
Chris Bedford created KAFKA-4892: Summary: kafka 0.8.2.1 getOffsetsBefore API returning correct offset given timestamp in unix epoch format Key: KAFKA-4892 URL: https://issues.apache.org/jira/browse/KAFKA-4892

[jira] [Commented] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923322#comment-15923322 ] Guozhang Wang commented on KAFKA-4890: -- [~damianguy] I looked at the logs (actually o

[jira] [Comment Edited] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923322#comment-15923322 ] Guozhang Wang edited comment on KAFKA-4890 at 3/14/17 12:41 AM:

[jira] [Commented] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923328#comment-15923328 ] Guozhang Wang commented on KAFKA-4890: -- Since I do not have the code sketch it is har

[jira] [Commented] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923361#comment-15923361 ] Guozhang Wang commented on KAFKA-4890: -- I have uploaded a small PR to improve the log

[GitHub] kafka pull request #2681: KAFKA-4890: Improve log4j for debugging [WIP]

2017-03-13 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/2681 KAFKA-4890: Improve log4j for debugging [WIP] You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka K4890-state-lock-cleanup

[jira] [Commented] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923367#comment-15923367 ] ASF GitHub Bot commented on KAFKA-4890: --- GitHub user guozhangwang opened a pull requ

Re: [DISCUSS] KIP-126 - Allow KafkaProducer to batch based on uncompressed size

2017-03-13 Thread Becket Qin
Bump up the thread for further comments. If there is no more comments on the KIP I will start the voting thread on Wed. Thanks, Jiangjie (Becket) Qin On Tue, Mar 7, 2017 at 9:48 AM, Becket Qin wrote: > Hi Dong, > > Thanks for the comments. > > The patch is mostly for proof of concept in case t

[jira] [Commented] (KAFKA-4277) creating ephemeral node already exist

2017-03-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923516#comment-15923516 ] Jun Rao commented on KAFKA-4277: [~Wrikken], the only case when we need to re-register the

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Jay Kreps
Hey Matthias, Make sense, I'm more advocating for removing the word topology than any particular new replacement. -Jay On Mon, Mar 13, 2017 at 12:30 PM, Matthias J. Sax wrote: > Jay, > > thanks for your feedback > > > What if instead we called it KStreamsBuilder? > > That's the current name an

Re: [DISCUSS] KIP-120: Cleanup Kafka Streams builder API

2017-03-13 Thread Sriram Subramanian
StreamsBuilder would be my vote. > On Mar 13, 2017, at 9:42 PM, Jay Kreps wrote: > > Hey Matthias, > > Make sense, I'm more advocating for removing the word topology than any > particular new replacement. > > -Jay > > On Mon, Mar 13, 2017 at 12:30 PM, Matthias J. Sax > wrote: > >> Jay, >>

[jira] [Comment Edited] (KAFKA-4878) Kafka Connect does not log connector configuration errors

2017-03-13 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923586#comment-15923586 ] Gwen Shapira edited comment on KAFKA-4878 at 3/14/17 5:07 AM: --

[jira] [Commented] (KAFKA-4878) Kafka Connect does not log connector configuration errors

2017-03-13 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923586#comment-15923586 ] Gwen Shapira commented on KAFKA-4878: - This is even worse in stand-alone mode because

[jira] [Updated] (KAFKA-4878) Kafka Connect does not log connector configuration errors

2017-03-13 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-4878: Fix Version/s: 0.10.2.1 > Kafka Connect does not log connector configuration errors > --

[jira] [Updated] (KAFKA-4878) Kafka Connect does not log connector configuration errors

2017-03-13 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-4878: Priority: Blocker (was: Major) > Kafka Connect does not log connector configuration errors > --

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-03-13 Thread Gwen Shapira
+1 (binding) Nice job - this is going to be super useful. On Thu, Feb 23, 2017 at 4:46 PM, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi All, > > It seems that there is no further concern with the KIP-122. > At this point we would like to start the voting process. > > The

[jira] [Created] (KAFKA-4893) async topic deletion conflicts with max topic length

2017-03-13 Thread Onur Karaman (JIRA)
Onur Karaman created KAFKA-4893: --- Summary: async topic deletion conflicts with max topic length Key: KAFKA-4893 URL: https://issues.apache.org/jira/browse/KAFKA-4893 Project: Kafka Issue Type:

Re: [VOTE] KIP-117: Add a public AdminClient API for Kafka admin operations

2017-03-13 Thread Gwen Shapira
+1 (binding) I expressed few concerns in the discussion thread, but in general this is super important to get done. On Fri, Mar 10, 2017 at 10:38 AM, Colin McCabe wrote: > Hi all, > > I'd like to start voting on KIP-117 > (https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 117%3A+Add+a+pu

Re: [DISCUSS] KIP-117: Add a public AdministrativeClient API for Kafka admin operations

2017-03-13 Thread Gwen Shapira
I'm torn between my desire to get this in already and the fact that parts of the API feel a bit alien to Kafka. I will resolve my difficulties by giving my feedback here and then going to vote +1 on the vote thread. Colin can choose whether to address my concerns now or use his "unstable" option t

[jira] [Assigned] (KAFKA-4893) async topic deletion conflicts with max topic length

2017-03-13 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-4893: -- Assignee: Vahid Hashemian > async topic deletion conflicts with max topic length >

[jira] [Commented] (KAFKA-4859) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion (again)

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923614#comment-15923614 ] ASF GitHub Bot commented on KAFKA-4859: --- GitHub user guozhangwang opened a pull requ

[GitHub] kafka pull request #2682: KAFKA-4859: Set shorter commit interval for integr...

2017-03-13 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/2682 KAFKA-4859: Set shorter commit interval for integration tests with caching You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kaf

[jira] [Commented] (KAFKA-4893) async topic deletion conflicts with max topic length

2017-03-13 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923636#comment-15923636 ] Onur Karaman commented on KAFKA-4893: - Maybe the right move is to just add more layers