Re: Request to be a contributor

2019-07-30 Thread Matthias J. Sax
Done. On 7/30/19 4:30 PM, Michael Carter wrote: > Hi dev, > > Can I please be added to the contributor list? > My JIRA username is michael_carter > > Cheers, > Michael > signature.asc Description: OpenPGP digital signature

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Levani Kokhreidze
Hello Guozhang, Thanks for the feedback. That’s an interesting point. To be honest, I totally missed it. I wasn’t aware that there’s `groupBy` possibility on KTable. I don’t see any reasons why not to add same functionality to KTable interface. I’ve updated the KIP: https://cwiki.apache.org/co

Re: [DISCUSS] KIP-499 - Unify connection name flag for command line tool

2019-07-30 Thread Jason Gustafson
Hey Mitch, thanks for the KIP! This command line inconsistency frustrates me almost every day. I'm definitely +1 on this. One minor nitpick. The compatibility section mentions there will be no deprecations, but it sounds like we are planning on deprecating the old arguments? Thanks, Jason On Tue

Build failed in Jenkins: kafka-trunk-jdk11 #722

2019-07-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Refactor abstractConfig#configuredInstance (#7129) -- [...truncated 2.57 MB...] org.apache.kafka.streams.StreamsConfigTest > shouldOverrideS

Jenkins build is back to normal : kafka-trunk-jdk8 #3819

2019-07-30 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-8738) Cleaning thread blocked when more than one ALTER_REPLICA_LOG_DIRS requests sent

2019-07-30 Thread dingsainan (JIRA)
dingsainan created KAFKA-8738: - Summary: Cleaning thread blocked when more than one ALTER_REPLICA_LOG_DIRS requests sent Key: KAFKA-8738 URL: https://issues.apache.org/jira/browse/KAFKA-8738 Project: Kaf

[jira] [Created] (KAFKA-8737) TaskMigrated Exception while rebalancing kafka streams

2019-07-30 Thread KUMAR (JIRA)
KUMAR created KAFKA-8737: Summary: TaskMigrated Exception while rebalancing kafka streams Key: KAFKA-8737 URL: https://issues.apache.org/jira/browse/KAFKA-8737 Project: Kafka Issue Type: Bug

[DISCUSS] KIP-499 - Unify connection name flag for command line tool

2019-07-30 Thread Mitchell
Hello, I have written a proposal to add the command line argument `--bootstrap-server` to 5 of the existing command line tools that do not currently use `--broker-list` for passing cluster connection information. https://cwiki.apache.org/confluence/display/KAFKA/KIP-499+-+Unify+connection+name+fla

Request to be a contributor

2019-07-30 Thread Michael Carter
Hi dev, Can I please be added to the contributor list? My JIRA username is michael_carter Cheers, Michael

[jira] [Created] (KAFKA-8736) Performance: ThreadCache uses size() for empty cache check

2019-07-30 Thread Matthew Jarvie (JIRA)
Matthew Jarvie created KAFKA-8736: - Summary: Performance: ThreadCache uses size() for empty cache check Key: KAFKA-8736 URL: https://issues.apache.org/jira/browse/KAFKA-8736 Project: Kafka Is

Build failed in Jenkins: kafka-trunk-jdk11 #721

2019-07-30 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8640; Use generated classes in OffsetFetch request and response [jason] KAFKA-8442; Include ISR in Metadata response even if there is no leader [github] KAFKA-8717; Reuse cached offse

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Guozhang Wang
Hello Levani, Thanks for the KIP! Just got a quick question here about the scope: why do we only want this for `KStream`, not `KTable#groupBy` for example? Guozhang On Tue, Jul 30, 2019 at 1:27 PM Bill Bejeck wrote: > Thanks for the KIP Levani. > > +1 (binding) > > -Bill > > On Tue, Jul 30,

Re: [DISCUSS] KIP-490: log when consumer groups lose a message because offset has been deleted

2019-07-30 Thread Jose M
Hello Stanislav, Thanks again for your comments. I understand, and Im happy to hear that my usecase is rare. The reason is that before going to real production, we are forced to build a prototype, with limited resources, but still resilient enough to pass acceptance tests. I agree the whitelist

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

2019-07-30 Thread Jun Rao
Hi, Colin, Thanks for the KIP. Sorry for the late reply. LGTM overall. A few detailed comments below. 10. The KIP adds two new fields (AddingReplicas and RemovingReplicas) to LeaderAndIsr request. Could you explain how these 2 fields will be used? Should we include those two fields in UpdateMetad

Re: [DISCUSS] KIP-447: Producer scalability for exactly once semantics

2019-07-30 Thread Boyang Chen
Thank you Guozhang for the reply. We will consider the interface change from 429 as a backup plan for 447. And bumping this thread for more discussion. On Mon, Jul 22, 2019 at 6:28 PM Guozhang Wang wrote: > On Sat, Jul 20, 2019 at 9:50 AM Boyang Chen > wrote: > > > Thank you Guozhang for the s

[jira] [Created] (KAFKA-8735) BrokerMetadataCheckPoint should check metadata.properties existence itself

2019-07-30 Thread Qinghui Xu (JIRA)
Qinghui Xu created KAFKA-8735: - Summary: BrokerMetadataCheckPoint should check metadata.properties existence itself Key: KAFKA-8735 URL: https://issues.apache.org/jira/browse/KAFKA-8735 Project: Kafka

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Bill Bejeck
Thanks for the KIP Levani. +1 (binding) -Bill On Tue, Jul 30, 2019 at 3:37 PM Levani Kokhreidze wrote: > Hello, > > Still waiting for feedback on this KIP. > Please let me know if you have any concerns and/or questions. > > Regards, > Levani > > > > On Jul 24, 2019, at 8:20 PM, Sophie Blee-Gol

[jira] [Created] (KAFKA-8734) Remove PartitionAssignorAdapter and deprecated PartitionAssignor interface

2019-07-30 Thread Sophie Blee-Goldman (JIRA)
Sophie Blee-Goldman created KAFKA-8734: -- Summary: Remove PartitionAssignorAdapter and deprecated PartitionAssignor interface Key: KAFKA-8734 URL: https://issues.apache.org/jira/browse/KAFKA-8734

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

2019-07-30 Thread John Roesler
Thanks, everyone, for the really good discussion. The vote has been open for 6 days, and has three binding votes (Guozhang, Bill, Matthias), in addition to my own non-binding +1, so the KIP vote passes! Next, I'll close my POC PR and put together an actual change set for review. Thanks again, al

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

2019-07-30 Thread John Roesler
Thanks, Matthias, and thanks again for raising the concern. -John On Mon, Jul 29, 2019 at 4:58 PM Matthias J. Sax wrote: > Thanks for the details! > > Also talked to Guozhang about a potential upgrade path. This KIP seems > not to put us into an bad position to provide a clean upgrade path if we

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Levani Kokhreidze
Hello, Still waiting for feedback on this KIP. Please let me know if you have any concerns and/or questions. Regards, Levani > On Jul 24, 2019, at 8:20 PM, Sophie Blee-Goldman wrote: > > Looks good! Thanks Levani, > > +1 (non-binding) > > Sophie > > On Tue, Jul 23, 2019 at 2:16 PM Levani K

Re: JIRA and KIP contributor permissions

2019-07-30 Thread Bill Bejeck
Thanks for your interest in Apache Kafka. You should be set now. Thanks, Bill On Tue, Jul 30, 2019 at 9:40 AM Gokul Ramanan Subramanian < gokul24...@gmail.com> wrote: > Hello Community, > > In order to start contributing to Apache Kafka project, could I please > request contributor access to JI

Re: [VOTE] KIP-492 Add java security providers in Kafka Security config

2019-07-30 Thread Manikumar
+1 (binding) Thanks for the KIP. LGTM. Thanks. Manikumar On Tue, Jul 30, 2019 at 1:42 PM Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP, Sandeep! > > Regards, > > Rajini > > On Tue, Jul 30, 2019 at 4:40 AM Satish Duggana > wrote: > > > +1 (non-binding) > > > > Thanks, > > Satish.

[jira] [Created] (KAFKA-8733) Offline partitions occur when leader's disk is slow in reads while responding to follower fetch requests.

2019-07-30 Thread Satish Duggana (JIRA)
Satish Duggana created KAFKA-8733: - Summary: Offline partitions occur when leader's disk is slow in reads while responding to follower fetch requests. Key: KAFKA-8733 URL: https://issues.apache.org/jira/browse/KAF

Configuration for custom authorizer

2019-07-30 Thread Jeff Zemerick
Hi all, I'm implementing a custom authorizer using the Authorizer interface. In it there is a configure function that takes a map of properties. When using kafka-acl.sh those properties are passed via --authorizer-properties. How do I pass those properties to Kafka when the server starts in order

[jira] [Resolved] (KAFKA-8717) Use cached hw/lso offset metadata when reading from log

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8717. Resolution: Fixed Fix Version/s: 2.4.0 > Use cached hw/lso offset metadata when read

[jira] [Resolved] (KAFKA-8442) Inconsistent ISR output in topic command when using --bootstrap-server

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8442. Resolution: Fixed Fix Version/s: 2.4.0 > Inconsistent ISR output in topic command wh

[jira] [Resolved] (KAFKA-8640) Replace OffsetFetch request/response with automated protocol

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8640. Resolution: Fixed > Replace OffsetFetch request/response with automated protocol >

Build failed in Jenkins: kafka-trunk-jdk8 #3818

2019-07-30 Thread Apache Jenkins Server
See -- [...truncated 6.46 MB...] org.apache.kafka.connect.json.JsonConverterTest > structToConnect PASSED org.apache.kafka.connect.json.JsonConverterTest > stringToJson STARTED org.apa

JIRA and KIP contributor permissions

2019-07-30 Thread Gokul Ramanan Subramanian
Hello Community, In order to start contributing to Apache Kafka project, could I please request contributor access to JIRA and be granted write permissions to the Kafka wiki? My name: Gokul Ramanan Subramanian JIRA username: gokul2411s Confluence username: gokul2411s (https://cwiki.apache.org/c

Re: [DISCUSS] KIP-470: TopologyTestDriver test input and output usability improvements

2019-07-30 Thread John Roesler
Hey Jukka, Sorry for the delay. For what it's worth, I think 3, 4, and 5 are all good options. I guess my own preference is 5. It seems like the migration pain is a one-time concern vs. having more maintainable code for years thereafter. Thanks, -John On Tue, Jul 2, 2019 at 4:03 AM Jukka Kar

[jira] [Created] (KAFKA-8732) specifying a non-existent broker to ./bin/kafka-reassign-partitions.sh leads to reassignment never getting completed.

2019-07-30 Thread Raunak (JIRA)
Raunak created KAFKA-8732: - Summary: specifying a non-existent broker to ./bin/kafka-reassign-partitions.sh leads to reassignment never getting completed. Key: KAFKA-8732 URL: https://issues.apache.org/jira/browse/KAFKA-

Re: [VOTE] KIP-492 Add java security providers in Kafka Security config

2019-07-30 Thread Rajini Sivaram
+1 (binding) Thanks for the KIP, Sandeep! Regards, Rajini On Tue, Jul 30, 2019 at 4:40 AM Satish Duggana wrote: > +1 (non-binding) > > Thanks, > Satish. > > On Tue, Jul 30, 2019 at 5:18 AM Harsha Chintalapani > wrote: > > > > Thanks for the KIP Sandeep. > > > > +1 (binding) > > > > Thanks, >

[jira] [Resolved] (KAFKA-1111) Broker prematurely accepts TopicMetadataRequests on startup

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-. - Resolution: Abandoned Closing as abandoned after no objections on dev list. If this is indeed sti

[jira] [Resolved] (KAFKA-1099) StopReplicaRequest and StopReplicaResponse should also carry the replica ids

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-1099. - Resolution: Abandoned Closing this as abandoned after asking for feedback on the dev list and re

[jira] [Resolved] (KAFKA-1016) Broker should limit purgatory size

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-1016. - Resolution: Not A Problem Closing this as "not a problem", I believe the Purgatory redesign shoul

[jira] [Resolved] (KAFKA-822) Reassignment of partitions needs a cleanup

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-822. Resolution: Abandoned Closing this as abandoned after asking for feedback on the dev list. Its prob

Build failed in Jenkins: kafka-trunk-jdk11 #720

2019-07-30 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-8345: KIP-455 Protocol changes (part 1) (#7114) -- [...truncated 6.29 MB...] kafka.api.SslProducerSendTest > testCloseWithZeroTimeoutFromCalle