Build failed in Jenkins: kafka-trunk-jdk11 #720

2019-07-30 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-8345: KIP-455 Protocol changes (part 1) (#7114) -- [...truncated 6.29 MB...] kafka.api.SslProducerSendTest > testCloseWithZeroTimeoutFromCalle

[jira] [Resolved] (KAFKA-822) Reassignment of partitions needs a cleanup

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-822. Resolution: Abandoned Closing this as abandoned after asking for feedback on the dev list. Its prob

[jira] [Resolved] (KAFKA-1016) Broker should limit purgatory size

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-1016. - Resolution: Not A Problem Closing this as "not a problem", I believe the Purgatory redesign shoul

[jira] [Resolved] (KAFKA-1099) StopReplicaRequest and StopReplicaResponse should also carry the replica ids

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-1099. - Resolution: Abandoned Closing this as abandoned after asking for feedback on the dev list and re

[jira] [Resolved] (KAFKA-1111) Broker prematurely accepts TopicMetadataRequests on startup

2019-07-30 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-. - Resolution: Abandoned Closing as abandoned after no objections on dev list. If this is indeed sti

Re: [VOTE] KIP-492 Add java security providers in Kafka Security config

2019-07-30 Thread Rajini Sivaram
+1 (binding) Thanks for the KIP, Sandeep! Regards, Rajini On Tue, Jul 30, 2019 at 4:40 AM Satish Duggana wrote: > +1 (non-binding) > > Thanks, > Satish. > > On Tue, Jul 30, 2019 at 5:18 AM Harsha Chintalapani > wrote: > > > > Thanks for the KIP Sandeep. > > > > +1 (binding) > > > > Thanks, >

[jira] [Created] (KAFKA-8732) specifying a non-existent broker to ./bin/kafka-reassign-partitions.sh leads to reassignment never getting completed.

2019-07-30 Thread Raunak (JIRA)
Raunak created KAFKA-8732: - Summary: specifying a non-existent broker to ./bin/kafka-reassign-partitions.sh leads to reassignment never getting completed. Key: KAFKA-8732 URL: https://issues.apache.org/jira/browse/KAFKA-

Re: [DISCUSS] KIP-470: TopologyTestDriver test input and output usability improvements

2019-07-30 Thread John Roesler
Hey Jukka, Sorry for the delay. For what it's worth, I think 3, 4, and 5 are all good options. I guess my own preference is 5. It seems like the migration pain is a one-time concern vs. having more maintainable code for years thereafter. Thanks, -John On Tue, Jul 2, 2019 at 4:03 AM Jukka Kar

JIRA and KIP contributor permissions

2019-07-30 Thread Gokul Ramanan Subramanian
Hello Community, In order to start contributing to Apache Kafka project, could I please request contributor access to JIRA and be granted write permissions to the Kafka wiki? My name: Gokul Ramanan Subramanian JIRA username: gokul2411s Confluence username: gokul2411s (https://cwiki.apache.org/c

Build failed in Jenkins: kafka-trunk-jdk8 #3818

2019-07-30 Thread Apache Jenkins Server
See -- [...truncated 6.46 MB...] org.apache.kafka.connect.json.JsonConverterTest > structToConnect PASSED org.apache.kafka.connect.json.JsonConverterTest > stringToJson STARTED org.apa

[jira] [Resolved] (KAFKA-8640) Replace OffsetFetch request/response with automated protocol

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8640. Resolution: Fixed > Replace OffsetFetch request/response with automated protocol >

[jira] [Resolved] (KAFKA-8442) Inconsistent ISR output in topic command when using --bootstrap-server

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8442. Resolution: Fixed Fix Version/s: 2.4.0 > Inconsistent ISR output in topic command wh

[jira] [Resolved] (KAFKA-8717) Use cached hw/lso offset metadata when reading from log

2019-07-30 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8717. Resolution: Fixed Fix Version/s: 2.4.0 > Use cached hw/lso offset metadata when read

Configuration for custom authorizer

2019-07-30 Thread Jeff Zemerick
Hi all, I'm implementing a custom authorizer using the Authorizer interface. In it there is a configure function that takes a map of properties. When using kafka-acl.sh those properties are passed via --authorizer-properties. How do I pass those properties to Kafka when the server starts in order

[jira] [Created] (KAFKA-8733) Offline partitions occur when leader's disk is slow in reads while responding to follower fetch requests.

2019-07-30 Thread Satish Duggana (JIRA)
Satish Duggana created KAFKA-8733: - Summary: Offline partitions occur when leader's disk is slow in reads while responding to follower fetch requests. Key: KAFKA-8733 URL: https://issues.apache.org/jira/browse/KAF

Re: [VOTE] KIP-492 Add java security providers in Kafka Security config

2019-07-30 Thread Manikumar
+1 (binding) Thanks for the KIP. LGTM. Thanks. Manikumar On Tue, Jul 30, 2019 at 1:42 PM Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP, Sandeep! > > Regards, > > Rajini > > On Tue, Jul 30, 2019 at 4:40 AM Satish Duggana > wrote: > > > +1 (non-binding) > > > > Thanks, > > Satish.

Re: JIRA and KIP contributor permissions

2019-07-30 Thread Bill Bejeck
Thanks for your interest in Apache Kafka. You should be set now. Thanks, Bill On Tue, Jul 30, 2019 at 9:40 AM Gokul Ramanan Subramanian < gokul24...@gmail.com> wrote: > Hello Community, > > In order to start contributing to Apache Kafka project, could I please > request contributor access to JI

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Levani Kokhreidze
Hello, Still waiting for feedback on this KIP. Please let me know if you have any concerns and/or questions. Regards, Levani > On Jul 24, 2019, at 8:20 PM, Sophie Blee-Goldman wrote: > > Looks good! Thanks Levani, > > +1 (non-binding) > > Sophie > > On Tue, Jul 23, 2019 at 2:16 PM Levani K

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

2019-07-30 Thread John Roesler
Thanks, Matthias, and thanks again for raising the concern. -John On Mon, Jul 29, 2019 at 4:58 PM Matthias J. Sax wrote: > Thanks for the details! > > Also talked to Guozhang about a potential upgrade path. This KIP seems > not to put us into an bad position to provide a clean upgrade path if we

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

2019-07-30 Thread John Roesler
Thanks, everyone, for the really good discussion. The vote has been open for 6 days, and has three binding votes (Guozhang, Bill, Matthias), in addition to my own non-binding +1, so the KIP vote passes! Next, I'll close my POC PR and put together an actual change set for review. Thanks again, al

[jira] [Created] (KAFKA-8734) Remove PartitionAssignorAdapter and deprecated PartitionAssignor interface

2019-07-30 Thread Sophie Blee-Goldman (JIRA)
Sophie Blee-Goldman created KAFKA-8734: -- Summary: Remove PartitionAssignorAdapter and deprecated PartitionAssignor interface Key: KAFKA-8734 URL: https://issues.apache.org/jira/browse/KAFKA-8734

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Bill Bejeck
Thanks for the KIP Levani. +1 (binding) -Bill On Tue, Jul 30, 2019 at 3:37 PM Levani Kokhreidze wrote: > Hello, > > Still waiting for feedback on this KIP. > Please let me know if you have any concerns and/or questions. > > Regards, > Levani > > > > On Jul 24, 2019, at 8:20 PM, Sophie Blee-Gol

[jira] [Created] (KAFKA-8735) BrokerMetadataCheckPoint should check metadata.properties existence itself

2019-07-30 Thread Qinghui Xu (JIRA)
Qinghui Xu created KAFKA-8735: - Summary: BrokerMetadataCheckPoint should check metadata.properties existence itself Key: KAFKA-8735 URL: https://issues.apache.org/jira/browse/KAFKA-8735 Project: Kafka

Re: [DISCUSS] KIP-447: Producer scalability for exactly once semantics

2019-07-30 Thread Boyang Chen
Thank you Guozhang for the reply. We will consider the interface change from 429 as a backup plan for 447. And bumping this thread for more discussion. On Mon, Jul 22, 2019 at 6:28 PM Guozhang Wang wrote: > On Sat, Jul 20, 2019 at 9:50 AM Boyang Chen > wrote: > > > Thank you Guozhang for the s

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

2019-07-30 Thread Jun Rao
Hi, Colin, Thanks for the KIP. Sorry for the late reply. LGTM overall. A few detailed comments below. 10. The KIP adds two new fields (AddingReplicas and RemovingReplicas) to LeaderAndIsr request. Could you explain how these 2 fields will be used? Should we include those two fields in UpdateMetad

Re: [DISCUSS] KIP-490: log when consumer groups lose a message because offset has been deleted

2019-07-30 Thread Jose M
Hello Stanislav, Thanks again for your comments. I understand, and Im happy to hear that my usecase is rare. The reason is that before going to real production, we are forced to build a prototype, with limited resources, but still resilient enough to pass acceptance tests. I agree the whitelist

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Guozhang Wang
Hello Levani, Thanks for the KIP! Just got a quick question here about the scope: why do we only want this for `KStream`, not `KTable#groupBy` for example? Guozhang On Tue, Jul 30, 2019 at 1:27 PM Bill Bejeck wrote: > Thanks for the KIP Levani. > > +1 (binding) > > -Bill > > On Tue, Jul 30,

Build failed in Jenkins: kafka-trunk-jdk11 #721

2019-07-30 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-8640; Use generated classes in OffsetFetch request and response [jason] KAFKA-8442; Include ISR in Metadata response even if there is no leader [github] KAFKA-8717; Reuse cached offse

[jira] [Created] (KAFKA-8736) Performance: ThreadCache uses size() for empty cache check

2019-07-30 Thread Matthew Jarvie (JIRA)
Matthew Jarvie created KAFKA-8736: - Summary: Performance: ThreadCache uses size() for empty cache check Key: KAFKA-8736 URL: https://issues.apache.org/jira/browse/KAFKA-8736 Project: Kafka Is

Request to be a contributor

2019-07-30 Thread Michael Carter
Hi dev, Can I please be added to the contributor list? My JIRA username is michael_carter Cheers, Michael

[DISCUSS] KIP-499 - Unify connection name flag for command line tool

2019-07-30 Thread Mitchell
Hello, I have written a proposal to add the command line argument `--bootstrap-server` to 5 of the existing command line tools that do not currently use `--broker-list` for passing cluster connection information. https://cwiki.apache.org/confluence/display/KAFKA/KIP-499+-+Unify+connection+name+fla

[jira] [Created] (KAFKA-8737) TaskMigrated Exception while rebalancing kafka streams

2019-07-30 Thread KUMAR (JIRA)
KUMAR created KAFKA-8737: Summary: TaskMigrated Exception while rebalancing kafka streams Key: KAFKA-8737 URL: https://issues.apache.org/jira/browse/KAFKA-8737 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-8738) Cleaning thread blocked when more than one ALTER_REPLICA_LOG_DIRS requests sent

2019-07-30 Thread dingsainan (JIRA)
dingsainan created KAFKA-8738: - Summary: Cleaning thread blocked when more than one ALTER_REPLICA_LOG_DIRS requests sent Key: KAFKA-8738 URL: https://issues.apache.org/jira/browse/KAFKA-8738 Project: Kaf

Jenkins build is back to normal : kafka-trunk-jdk8 #3819

2019-07-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk11 #722

2019-07-30 Thread Apache Jenkins Server
See Changes: [github] MINOR: Refactor abstractConfig#configuredInstance (#7129) -- [...truncated 2.57 MB...] org.apache.kafka.streams.StreamsConfigTest > shouldOverrideS

Re: [DISCUSS] KIP-499 - Unify connection name flag for command line tool

2019-07-30 Thread Jason Gustafson
Hey Mitch, thanks for the KIP! This command line inconsistency frustrates me almost every day. I'm definitely +1 on this. One minor nitpick. The compatibility section mentions there will be no deprecations, but it sounds like we are planning on deprecating the old arguments? Thanks, Jason On Tue

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-07-30 Thread Levani Kokhreidze
Hello Guozhang, Thanks for the feedback. That’s an interesting point. To be honest, I totally missed it. I wasn’t aware that there’s `groupBy` possibility on KTable. I don’t see any reasons why not to add same functionality to KTable interface. I’ve updated the KIP: https://cwiki.apache.org/co

Re: Request to be a contributor

2019-07-30 Thread Matthias J. Sax
Done. On 7/30/19 4:30 PM, Michael Carter wrote: > Hi dev, > > Can I please be added to the contributor list? > My JIRA username is michael_carter > > Cheers, > Michael > signature.asc Description: OpenPGP digital signature