[jira] [Resolved] (KAFKA-7210) Add system test for log compaction

2018-08-20 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7210. Resolution: Fixed > Add system test for log compaction > -- > >

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-08-20 Thread Jan Filipiak
On 20.08.2018 00:19, Matthias J. Sax wrote: @Nick: A KIP is only accepted if it got 3 binding votes, ie, votes from committers. If you close the vote before that, the KIP would not be accepted. Note that committers need to pay attention to a lot of KIPs and it can take a while until people can

[ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Ismael Juma
Hi everyone, Dong Lin became a committer in March 2018. Since then, he has remained active in the community and contributed a number of patches, reviewed several pull requests and participated in numerous KIP discussions. I am happy to announce that Dong is now a member of the Apache Kafka PMC. C

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Manikumar
Congrats, Dong Lin! On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerous KIP discu

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Mickael Maison
Congratulations Dong! On Mon, Aug 20, 2018 at 12:46 PM Manikumar wrote: > > Congrats, Dong Lin! > > On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and contributed a n

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Dongjin Lee
Congratulations!! On Mon, Aug 20, 2018 at 9:22 PM Mickael Maison wrote: > Congratulations Dong! > On Mon, Aug 20, 2018 at 12:46 PM Manikumar > wrote: > > > > Congrats, Dong Lin! > > > > On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > > > > > Hi everyone, > > > > > > Dong Lin became a com

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-08-20 Thread Thomas Becker
I agree with Jan. A strategy interface for choosing processing order is nice, and would hopefully be a step towards getting this in streams. -Tommy On Mon, 2018-08-20 at 12:52 +0200, Jan Filipiak wrote: On 20.08.2018 00:19, Matthias J. Sax wrote: @Nick: A KIP is only accepted if it got 3 bindi

Build failed in Jenkins: kafka-trunk-jdk10 #416

2018-08-20 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-7210: Add system test to verify log compaction (#5226) -- [...truncated 1.54 MB...] kafka.coordinator.transaction.TransactionCoordinatorTest >

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Paolo Patierno
Congratulations Dong! Paolo Patierno Principal Software Engineer (IoT) @ Red Hat Microsoft MVP on Azure & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin : paolopatierno Blog : DevExperience

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-08-20 Thread Becket Qin
Hi Lucas, In KIP-103, we introduced a convention to define and look up the listeners. So it would be good if the later KIPs can follow the same convention. >From what I understand, the advertised.listeners is actually designed for our purpose, i.e. providing a list of listeners that can be used i

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Attila Sasvári
Congratulations Dong! Well deserved. Regards, Attila Paolo Patierno ezt írta (időpont: 2018. aug. 20., H 15:09): > Congratulations Dong! > > Paolo Patierno > Principal Software Engineer (IoT) @ Red Hat > Microsoft MVP on Azure & IoT > Microsoft Azure Advisor > > Twitter : @ppatierno

Build failed in Jenkins: kafka-trunk-jdk8 #2908

2018-08-20 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-7210: Add system test to verify log compaction (#5226) -- [...truncated 2.48 MB...] org.apache.kafka.streams.processor.internals.InternalTopolo

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-08-20 Thread Eno Thereska
Hi folks, I looked at the previous numbers that Lucas provided (thanks!) but it's still not clear to me whether the performance benefits justify the added complexity. I'm looking for some intuition here (a graph would be great but not required): for a small/medium/large cluster, what are the expec

[jira] [Resolved] (KAFKA-7298) Concurrent DeleteRecords can lead to fatal OutOfSequence error in producer

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7298. Resolution: Fixed Fix Version/s: 2.0.1 > Concurrent DeleteRecords can lead to fatal

[jira] [Resolved] (KAFKA-6835) Enable topic unclean leader election to be enabled without controller change

2018-08-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-6835. Resolution: Fixed Merged the PR to trunk. > Enable topic unclean leader election to be enabled without con

[jira] [Resolved] (KAFKA-7303) Kafka client is stuck when specifying wrong brokers

2018-08-20 Thread Chun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Zhang resolved KAFKA-7303. --- Resolution: Duplicate > Kafka client is stuck when specifying wrong brokers > ---

Re: [DISCUSS] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-20 Thread Nikolay Izhikov
Hello, Ted. Thanks for the comment. I've edit KIP and change proposal to `windowSize`. Guys, any other comments? В Вс, 19/08/2018 в 14:57 -0700, Ted Yu пишет: > bq. // or just Duration windowSize(); > > +1 to the above choice. > The duration is obvious from the return type. For getter methods

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Matthias J. Sax
Congrats Dong! -Matthias On 8/20/18 3:54 AM, Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerous KIP discussions.

[jira] [Resolved] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7278. Resolution: Fixed Fix Version/s: 2.0.1 > replaceSegments() should not call asyncDele

[jira] [Created] (KAFKA-7314) MirrorMaker example in documentation does not work

2018-08-20 Thread John Wilkinson (JIRA)
John Wilkinson created KAFKA-7314: - Summary: MirrorMaker example in documentation does not work Key: KAFKA-7314 URL: https://issues.apache.org/jira/browse/KAFKA-7314 Project: Kafka Issue Type

Jenkins build is back to normal : kafka-trunk-jdk10 #417

2018-08-20 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-7311) Sender should reset next batch expiry time between poll loops

2018-08-20 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7311. -- Resolution: Fixed > Sender should reset next batch expiry time between poll loops > ---

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Guozhang Wang
Congratulations Dong! On Mon, Aug 20, 2018 at 10:59 AM, Matthias J. Sax wrote: > Congrats Dong! > > -Matthias > > On 8/20/18 3:54 AM, Ismael Juma wrote: > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and contributed a n

[jira] [Created] (KAFKA-7315) Streams serialization docs contain a broken link for Avro

2018-08-20 Thread John Roesler (JIRA)
John Roesler created KAFKA-7315: --- Summary: Streams serialization docs contain a broken link for Avro Key: KAFKA-7315 URL: https://issues.apache.org/jira/browse/KAFKA-7315 Project: Kafka Issue T

Jenkins build is back to normal : kafka-trunk-jdk8 #2909

2018-08-20 Thread Apache Jenkins Server
See

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Vahid Hashemian
Congratulations Dong! --Vahid On Mon, Aug 20, 2018 at 1:08 PM Guozhang Wang wrote: > Congratulations Dong! > > On Mon, Aug 20, 2018 at 10:59 AM, Matthias J. Sax > wrote: > > > Congrats Dong! > > > > -Matthias > > > > On 8/20/18 3:54 AM, Ismael Juma wrote: > > > Hi everyone, > > > > > > Dong Li

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Gwen Shapira
Congrats Dong Lin! Well deserved! On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerou

Build failed in Jenkins: kafka-trunk-jdk8 #2910

2018-08-20 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-6835: Enable topic unclean leader election to be enabled without [jason] KAFKA-7278; replaceSegments() should not call asyncDeleteSegment() for [wangguoz] KAFKA-7311: Reset next batc

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Mayuresh Gharat
Congrats Dong !!! Thanks, Mayuresh On Mon, Aug 20, 2018 at 1:36 PM Gwen Shapira wrote: > Congrats Dong Lin! Well deserved! > > On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the c

Build failed in Jenkins: kafka-trunk-jdk10 #419

2018-08-20 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7311: Reset next batch expiry time on each poll loop [jason] KAFKA-6312; Document --reset-offsets option for consumer group tool -- [...trun

[jira] [Resolved] (KAFKA-5891) Cast transformation fails if record schema contains timestamp field

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5891. Resolution: Fixed Fix Version/s: 2.0.1 1.1.2 1.

[jira] [Created] (KAFKA-7317) Use collections subscription for main consumer to reduce metadata

2018-08-20 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7317: -- Summary: Use collections subscription for main consumer to reduce metadata Key: KAFKA-7317 URL: https://issues.apache.org/jira/browse/KAFKA-7317 Project: Kafka

[jira] [Created] (KAFKA-7316) Use of filter method in KTable.scala may result in StackOverflowError

2018-08-20 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7316: - Summary: Use of filter method in KTable.scala may result in StackOverflowError Key: KAFKA-7316 URL: https://issues.apache.org/jira/browse/KAFKA-7316 Project: Kafka Issue

Build failed in Jenkins: kafka-1.1-jdk7 #184

2018-08-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5891; Proper handling of LogicalTypes in Cast (#4633) -- [...truncated 1.93 MB...] org.apache.kafka.streams.integration.StreamStreamJoinIntegratio

Build failed in Jenkins: kafka-trunk-jdk10 #420

2018-08-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5891; Proper handling of LogicalTypes in Cast (#4633) -- [...truncated 1.54 MB...] kafka.coordinator.transaction.TransactionCoordinatorTest >

Jenkins build is back to normal : kafka-trunk-jdk8 #2911

2018-08-20 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-08-20 Thread Boyang Chen
Thanks Matthias for the input. Sorry I was busy recently and haven't got time to update this thread. To summarize what we come up so far, here is a draft updated plan: Introduce a new config called `member.name` which is supposed to be provided uniquely by the consumer client. The broker will

[jira] [Created] (KAFKA-7318) Should introduce a offset reset policy to consume only the messages after subscribing

2018-08-20 Thread joechen8...@gmail.com (JIRA)
joechen8...@gmail.com created KAFKA-7318: Summary: Should introduce a offset reset policy to consume only the messages after subscribing Key: KAFKA-7318 URL: https://issues.apache.org/jira/browse/KAFKA-731