Re: Fail-fast builds?

2018-12-20 Thread Manikumar
+1 fo the suggestion. On Fri, Dec 21, 2018 at 2:38 AM David Arthur wrote: > In the jenkins.sh file, we have the following comment: > > "In order to provide faster feedback, the tasks are ordered so that faster > tasks are executed in every module before slower tasks (if possible)" > > > but then

Build failed in Jenkins: kafka-2.1-jdk8 #88

2018-12-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7759; Disable WADL output in the Connect REST API (#6051) -- [...truncated 2.78 MB...] org.apache.kafka.streams.TopologyTest > shouldNotAllowNullPr

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Srinivas Reddy
+1 (non binding) Thank you Ryan for the KIP, let me know if you need support in implementing it. - Srinivas - Typed on tiny keys. pls ignore typos.{mobile app} On Fri, 21 Dec, 2018, 08:26 Ryanne Dolan Thanks for the votes so far! > > Due to recent discussions, I've removed the high-level REST

[jira] [Created] (KAFKA-7764) Authentication exceptions during consumer metadata updates may not get propagated

2018-12-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7764: -- Summary: Authentication exceptions during consumer metadata updates may not get propagated Key: KAFKA-7764 URL: https://issues.apache.org/jira/browse/KAFKA-7764 P

[DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

2018-12-20 Thread Paul Davidson
Hi everyone, I would like to start a discussion around the following KIP: *https://cwiki.apache.org/confluence/display/KAFKA/KIP-411%3A+Add+option+to+make+Kafka+Connect+task+client+ID+values+unique

Build failed in Jenkins: kafka-2.0-jdk8 #205

2018-12-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7759; Disable WADL output in the Connect REST API (#6051) -- [...truncated 438.36 KB...] kafka.zk.ReassignPartitionsZNodeTest > testDecodeValidJso

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-20 Thread Ryanne Dolan
Jun, let's leave the REST API out of the KIP then. I have been arguing that Connect wouldn't benefit from the multi-cluster/herder/worker features we need in MM2, and that the effort would result in a needlessly complex Connect REST API. But certainly two separate APIs is inherently more complex t

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Ryanne Dolan
Thanks for the votes so far! Due to recent discussions, I've removed the high-level REST API from the KIP. On Thu, Dec 20, 2018 at 12:42 PM Paul Davidson wrote: > +1 > > Would be great to see the community build on the basic approach we took > with Mirus. Thanks Ryanne. > > On Thu, Dec 20, 2018

Re: Request permission to create KIP

2018-12-20 Thread Guozhang Wang
Hello Paul, It's done. Cheers, Guozhang On Thu, Dec 20, 2018 at 11:50 AM Paul Davidson wrote: > Hi. I would like to create a new KIP, but I currently don't have > permission. > > Wiki ID: pdavidson > > Thanks! > > Paul > -- -- Guozhang

[jira] [Resolved] (KAFKA-7759) Disable WADL output on OPTIONS method in Connect REST

2018-12-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7759. Resolution: Fixed Fix Version/s: 2.0.2 2.1.1 > Disable WADL outpu

Fail-fast builds?

2018-12-20 Thread David Arthur
In the jenkins.sh file, we have the following comment: "In order to provide faster feedback, the tasks are ordered so that faster tasks are executed in every module before slower tasks (if possible)" but then we proceed to use the Gradle --continue flag. This means PRs won't get notified of prob

[DISCUSS] : KIP-410: Add metric for request handler thread pool utilization by request type

2018-12-20 Thread Mayuresh Gharat
I would like to get feedback on the proposal to add a metric for request handler thread pool utilization by request type. Please find the KIP here : KIP-410: Add metric for request handler thread pool utilization by request type

Request permission to create KIP

2018-12-20 Thread Paul Davidson
Hi. I would like to create a new KIP, but I currently don't have permission. Wiki ID: pdavidson Thanks! Paul

Re: [VOTE] [REMINDER] KIP-383 Pluggable interface for SSL Factory

2018-12-20 Thread Harsha
Damian, This is the VOTE thread. There is a DISCUSS thread which concluded in it. -Harsha On Wed, Dec 19, 2018, at 5:04 AM, Pellerin, Clement wrote: > I did that and nobody came. > https://lists.apache.org/list.html?dev@kafka.apache.org:lte=1M:kip-383 > I don't understand why thi

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Paul Davidson
+1 Would be great to see the community build on the basic approach we took with Mirus. Thanks Ryanne. On Thu, Dec 20, 2018 at 9:01 AM Andrew Psaltis wrote: > +1 > > Really looking forward to this and to helping in any way I can. Thanks for > kicking this off Ryanne. > > On Thu, Dec 20, 2018 at

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-20 Thread Jun Rao
Hi, Ryanne, Hmm, there are still quite a few MM2 specific rest apis. Overall, I am still not sure that having a separate dedicated MM2 cluster is better. From an operational perspective, if someone is already running a connect cluster for other connectors, it seems that it's better to just run MM2

[jira] [Resolved] (KAFKA-7762) KafkaConsumer uses old API in the javadocs

2018-12-20 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7762. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 6052 [https://github.com/a

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Andrew Psaltis
+1 Really looking forward to this and to helping in any way I can. Thanks for kicking this off Ryanne. On Thu, Dec 20, 2018 at 10:18 PM Andrew Otto wrote: > +1 > > This looks like a huge project! Wikimedia would be very excited to have > this. Thanks! > > On Thu, Dec 20, 2018 at 9:52 AM Ryanne

[jira] [Resolved] (KAFKA-7753) ValueTransformerWithKey should not require producing one value every message

2018-12-20 Thread Mateusz Owczarek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Owczarek resolved KAFKA-7753. - Resolution: Feedback Received > ValueTransformerWithKey should not require producing one

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Andrew Otto
+1 This looks like a huge project! Wikimedia would be very excited to have this. Thanks! On Thu, Dec 20, 2018 at 9:52 AM Ryanne Dolan wrote: > Hey y'all, please vote to adopt KIP-382 by replying +1 to this thread. > > For your reference, here are the highlights of the proposal: > > - Leverages

[VOTE] KIP-382 MirrorMaker 2.0

2018-12-20 Thread Ryanne Dolan
Hey y'all, please vote to adopt KIP-382 by replying +1 to this thread. For your reference, here are the highlights of the proposal: - Leverages the Kafka Connect framework and ecosystem. - Includes both source and sink connectors. - Includes a high-level driver that manages connectors in a dedica

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-20 Thread Ryanne Dolan
> KAFKA-7707 was just created which proposes enabling connectors to override consumer properties Thanks Sönke, I think something along those lines will be super useful for Connect. To some extent, enabling connectors to override some worker properties obviates the need for multiple worker configs,

Jenkins build is back to normal : kafka-trunk-jdk8 #3268

2018-12-20 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7763) KafkaProducer with transactionId endless waits when network is disconnection

2018-12-20 Thread weasker (JIRA)
weasker created KAFKA-7763: -- Summary: KafkaProducer with transactionId endless waits when network is disconnection Key: KAFKA-7763 URL: https://issues.apache.org/jira/browse/KAFKA-7763 Project: Kafka

[jira] [Created] (KAFKA-7762) KafkaConsumer uses old API in the javadocs

2018-12-20 Thread JIRA
Matthias Weßendorf created KAFKA-7762: - Summary: KafkaConsumer uses old API in the javadocs Key: KAFKA-7762 URL: https://issues.apache.org/jira/browse/KAFKA-7762 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-7742) DelegationTokenCache#hmacIdCache entry is not cleared when a token is removed using removeToken(String tokenId) API.

2018-12-20 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7742. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 6037 [https://github.com/a

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-20 Thread Sönke Liebau
Hi, just to briefly mention this, as it is somewhat related to the discussion we had: KAFKA-7707 was just created which proposes enabling connectors to override consumer properties. It would currently appear to be a bit narrow in scope, but that can probably be expanded upon. Not sure if that has