Re: [DISCUSS] KIP-303: Add Dynamic Routing in Streams Sink

2018-05-15 Thread Matthias J. Sax
Thanks for the KIP. +1 @John: compare https://cwiki.apache.org/confluence/display/KAFKA/KIP-100+-+Relax+Type+constraints+in+Kafka+Streams+API about the generics -Matthias On 5/15/18 11:19 AM, John Roesler wrote: > Thanks for the KIP, Guozhang. > > It looks good overall to me; I just have one

Re: [DISCUSS] KIP-303: Add Dynamic Routing in Streams Sink

2018-05-15 Thread Matthias J. Sax
Just my 2 cents: I am fine with `KeyValueMapper` (+1 for code reusage) -- the JavaDocs will explain what the `KeyValueMapper` is supposed to do, ie, extract and return the sink topic name from the key-value pair. A side remark though: do we think that accessing key/value is sufficient? Or should

Re: Permission request to open a KIP

2018-05-16 Thread Matthias J. Sax
Done. On 5/16/18 7:55 AM, Saulius Valatka wrote: > Hi, > > could someone please grant me permission to open a KIP? My wiki id is > saulius.vl > > Thanks > signature.asc Description: OpenPGP digital signature

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

2018-05-17 Thread Matthias J. Sax
+1 (binding) On 5/17/18 12:18 PM, Ted Yu wrote: > +1 > Original message From: Gwen Shapira > Date: 5/17/18 11:53 AM (GMT-08:00) To: dev Subject: > Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology > Sink > Yay, its about time :) > > +1 > > On Th

Re: Merge order for commits to older versions?

2018-05-19 Thread Matthias J. Sax
Hi, not sure if this is documented in the wiki on not (feel free to add it to the wiki :)). It works as follows: Older version branches are only used for bug fix releases and are never merged into trunk. All PRs are opened against trunk by default and if we want to get a commit into an older bran

Re: [VOTE] KIP-298: Error Handling in Connect kafka

2018-05-21 Thread Matthias J. Sax
+1 (binding) On 5/21/18 9:30 AM, Randall Hauch wrote: > Thanks, Arjun. +1 (non-binding) > > Regards, > Randall > > On Mon, May 21, 2018 at 11:14 AM, Guozhang Wang wrote: > >> Thanks for the KIP. +1 (binding) >> >> >> Guozhang >> >> On Fri, May 18, 2018 at 3:36 PM, Gwen Shapira wrote: >> >>>

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

2018-05-21 Thread Matthias J. Sax
hat requires users who have customized > StreamPartitioner implementations. > > I've updated the wiki page of KIP-303, please recast your vote on this > thread. Thanks!!! > > > Guozhang > > > On Thu, May 17, 2018 at 3:15 PM, John Roesler wrote: > >> +1 non-b

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

2018-05-21 Thread Matthias J. Sax
> StreamPartitioner itself, since even without dynamic routing, allowing the > topic name could let users to give one partitioner implementation that > branch on the topic names other than having one partitioner per topic. > > > Guozhang > > > On Mon, May 21, 2018 a

Re: [VOTE] KIP-305: Add Connect primitive number converters

2018-05-22 Thread Matthias J. Sax
+1 (binding) On 5/22/18 1:49 PM, Gwen Shapira wrote: > +1 (I can't believe we didn't have it until now...) > > On Tue, May 22, 2018 at 1:26 PM, Ewen Cheslack-Postava > wrote: > >> +1 (binding) >> >> -Ewen >> >> On Tue, May 22, 2018 at 9:29 AM Ted Yu wrote: >> >>> +1 >>> >>> On Tue, May 22, 201

Re: subscribe mail list

2018-05-25 Thread Matthias J. Sax
To subscribe, please follow instructions here: https://kafka.apache.org/contact On 5/24/18 8:16 PM, wrote: > subscribe mail list > signature.asc Description: OpenPGP digital signature

Re: Contributing to Apache Kafka

2018-05-25 Thread Matthias J. Sax
Done. On 5/25/18 9:12 AM, Nikolay Izhikov wrote: > Hello, guys! > > I want to contribute to Apache Kafka. > Please, give me permission to assign jira ticket to myself. > > My Jira ID - NIzhikov > signature.asc Description: OpenPGP digital signature

Re: Contributor Access to Kafka Project

2018-05-25 Thread Matthias J. Sax
What is your Jira user name ? -Matthias On 5/25/18 8:20 AM, vrspraveen atluri wrote: > Hi Team, > > > I am trying assign few bugs in Jira to but not able to do so. Could you > help me granting the required permissions. > > Thanks, > Praveen. > signature.asc Description: OpenPGP digital s

Re: New contributor, Jira KAFKA-6616

2018-05-25 Thread Matthias J. Sax
Added you to the list on contributors. You can know assign Jiras to yourself. -Matthias On 5/25/18 10:59 AM, Victor Popov wrote: > Hi, > > I'm new to contributing and I want to start working on this issue. > I see it's not being worked by anybody, so if someone can assign it to > me or may be gi

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-05-28 Thread Matthias J. Sax
.s. practical concerns >>> about storage convenience to its impact on compaction effectiveness. >>> >>> The different between timestamp and the header key-value pairs is that for >>> the latter, as I mentioned before, "it is arguably out of Kafka's

Re: Avro to JSON

2018-05-28 Thread Matthias J. Sax
Just revert the `VALUE_FORMAT` types... On 5/28/18 10:59 PM, madhu.kar...@dell.com wrote: > Dell - Internal Use - Confidential > > Thanks.. The link has JSON to Avro. > I was looking for the other way. > > Regards > Madhu > > -Original Message- > From: Gwen Shapira [mailto:g...@confl

Re: Contributing to Apache Kafka

2018-05-29 Thread Matthias J. Sax
Done. On 5/29/18 6:59 AM, Atluri, Praveen wrote: > > > Hi, > > I am trying to contribute to Apache Kafka but not able to assign Jira Issue > to me. Could you grant me appropriate Jira permissions. My Jira username is > "patl" > > > > Thanks, > > Praveen Atluri. > > > > > _

Re: Please, give me permission to create a KIP in Kafka

2018-05-29 Thread Matthias J. Sax
What is your wiki ID? -Matthias On 5/29/18 9:55 AM, Flávio Stutz wrote: > Can I send a proposal? > Thanks. > > -Flávio Stutz > > Sent from my iPhone > > > >> On 27 May 2018, at 14:48, Flávio Stutz wrote: >> >> Hi. >> I want to propose a KIP and need access to do it. >> Please give me acce

Re: Permission to create KIP

2018-05-29 Thread Matthias J. Sax
Done. On 5/28/18 1:16 PM, Arseniy Tashoyan wrote: > Hi, > > Please give me permission to create KIP. > id: tashoyan > > Arseniy Tashoyan > signature.asc Description: OpenPGP digital signature

Re: [jira] [Created] (KAFKA-6989) Support Async Processing in Streams

2018-06-04 Thread Matthias J. Sax
Soumya, thanks a lot for your interest in contributing to Kafka! If you are new to the project, I would recommend to pick a JIRA that is labeled as "newbie" or "beginner". Adding a complex feature like KAFKA-6989 might be a second step. Of course, if you feel confident enough to tackle this from

Re: Request Access to Create KIP

2018-06-06 Thread Matthias J. Sax
Done. On 6/6/18 11:35 AM, Adam Bellemare wrote: > Hello > > As per: > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > > I request access to be able to create a KIP for > https://issues.apache.org/jira/browse/KAFKA-4628. > > Wiki username: adam.bellemare > > Tha

[DISCUSS] 0.11.0.3 bug fix release

2018-06-07 Thread Matthias J. Sax
Dear all, I want to propose a 0.11.0.3 bug fix release. 0.11.0.2 is 6 months old and a couple of critical fixes are available for 0.11.0.3. Please find a list of all 16 resolved tickets here: https://issues.apache.org/jira/browse/KAFKA-6925?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Resolv

[DISCUSS] 1.0.2 bug fix release

2018-06-07 Thread Matthias J. Sax
Dear all, I want to propose a 1.0.2 bug fix release. 1.0.1 is 3 months old and a couple of critical fixes are available for 1.0.2. Please find a list of all 14 resolved tickets here: https://issues.apache.org/jira/browse/KAFKA-6937?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Resolved%2C%20C

[DISCUSS] 0.10.2.2 bug fix release

2018-06-07 Thread Matthias J. Sax
Dear all, I want to propose a 0.10.2.2 bug fix release. 0.10.2.1 is over a year old and a couple of critical fixes are available for 0.10.2.2. Please find a list of all 24 resolved tickets here: https://issues.apache.org/jira/browse/KAFKA-6566?jql=project%20%3D%20KAFKA%20AND%20fixVersion%20%3D%2

Re: Need Access to Create KIP - Second Time Requesting

2018-06-08 Thread Matthias J. Sax
Your request was already granted. Same day when you sent the first email. Did you not see my reply on the dev list? (cc'ed you this time to make sure you get the email). -Matthias On 6/8/18 5:05 AM, Adam Bellemare wrote: > Hello > > Sending a second request to get access to make a KIP. > > A

Re: The purpose of ProducerRecord Headers

2018-06-10 Thread Matthias J. Sax
Check out the KIP that added headers: https://cwiki.apache.org/confluence/display/KAFKA/KIP-82+-+Add+Record+Headers -Matthias On 6/8/18 8:23 PM, wrote: > Hi team: > When I reading KafkaProducer doSend() and I found each record have a > Header[] headers . > But I don't know

Re: [VOTE] KIP-228 Negative record timestamp support

2018-06-10 Thread Matthias J. Sax
+1 (binding) Thanks for the KIP. -Matthias On 5/29/18 9:14 AM, Konstantin Chukhlomin wrote: > Thanks, updated the KIP. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-228+Negative+record+timestamp+support > >

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-10 Thread Matthias J. Sax
+1 (binding) -Matthias On 6/9/18 12:39 AM, Luís Cabral wrote: > Hi all, > > Any takers on having a look at this KIP and voting on it? > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-280%3A+Enhanced+log+compaction > > Cheers, > Luis > signature.asc Description: OpenPGP digital sig

Re: [DISCUSSION] KIP-300: Add Windowed KTable API in StreamsBuilder

2018-06-10 Thread Matthias J. Sax
Thanks lot for the KIP. The general idea to allow reading windowed-KTables is very useful! Couple of initial comments/question: About only adding a single `windowedTable()` with no overloads: - retention time is no mandatory parameter and we can always use the default of 1 day - instead of e

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-06-10 Thread Matthias J. Sax
Just catching up on this thread. I like the general idea. Couple of comments: - I think that adding `Processed` (or maybe a different name?) is a valid proposal for stateless operators that only have a single overload atm. It would align with the overall API design. - for all methods with mult

Re: [DISCUSS] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-10 Thread Matthias J. Sax
Thanks for the KIP. I don't have any comments at this pint. Overall I am +1 on the KIP. -Matthias On 6/8/18 2:56 PM, Bruno Cadonna wrote: > Hi list, > > I created KIP-313 [1] for JIRA issue KAFKA-4217 [2] and I would like to > put the KIP up for discussion. > > Best regards, > Bruno > > > [

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-06-10 Thread Matthias J. Sax
ined exceptions extend >>>> InvalidStateStoreException to ensure backward compatibility. Since we >>> want >>>> to encourage callers to catch the more specific exceptions, and we >> don't >>>> expect to ever throw a raw InvalidStateStoreException

Re: [DISCUSS] KIP-262 Metadata should include the number of state stores for task

2018-06-10 Thread Matthias J. Sax
only discussed that the information should be added, but this is only half of the story from my point of view. -Matthias On 3/22/18 9:15 PM, Matthias J. Sax wrote: > Hi Richard, > > with KIP-268 in place (should be accepted soon) the upgrade path is > covered. Thus, you can upd

Re: [DISCUSS]: KIP-230: Name Windowing Joins

2018-06-10 Thread Matthias J. Sax
e if this is a common case?) > then we probably need to consider something new? > > > > Guozhang > > > > > > On Tue, Feb 13, 2018 at 7:02 PM, Matthias Margush < > matthias.marg...@gmail.com> wrote: > >> Thanks for the reminder! I need

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2018-06-10 Thread Matthias J. Sax
What is the status of this KIP? -Matthias On 2/13/18 1:43 PM, Matthias J. Sax wrote: > Is there any update for this KIP? > > > -Matthias > > On 12/4/17 2:08 PM, Matthias J. Sax wrote: >> Jeyhun, >> >> thanks for updating the KIP. >> >>

Re: [VOTE] KIP-206: Add support for UUID serialization and deserialization

2018-06-10 Thread Matthias J. Sax
Jakub, it seems that you got enough votes. I am closing the KIP as accepted with - 3 binding votes (Ewen, Rajini, Damian) - 4 non-binding (Ted, Colin, Manikumar, Mickael - one non-binding -1 (Jan) Feel free to update the PR -- it might need a rebase. -Matthias On 5/11/18 3:31 PM, Damia

Re: [DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-11 Thread Matthias J. Sax
@John: I don't think this is a good idea. `KafkaStreams` executes a `Topology` and should be agnostic if the topology was build manually or via `StreamsBuilder` (at least from my point of view). -Matthias On 6/11/18 9:53 AM, Guozhang Wang wrote: > Another implementation detail that we can conside

Re: access to create KIP

2018-06-12 Thread Matthias J. Sax
Done. On 6/12/18 12:37 AM, Chia-Ping Tsai wrote: > dear Kafka, > > Please give me the permission to create KIP. the email is > "chia7...@gmail.com" and the account is "chia7712" > > Best Regards, > chia-ping > signature.asc Description: OpenPGP digital signature

Re: Wiki Access

2018-06-13 Thread Matthias J. Sax
Done. On 6/12/18 6:51 PM, Nishanth Pradeep wrote: > Hello, > > Could you give me access so I can create a KIP. I have been tasked with an > issue that needs a KIP. > > WIKI ID: nprad > > Let me know if you need more information. > > Thank You!

Re: Are defaults serde in Kafka streams doing more harm then good ?

2018-06-13 Thread Matthias J. Sax
The idea of default Serde is to support generic format like Avro or Json throughout the whole topology. If everything is in Avro/Json (or similar) users don't nee to overwrite any operator level Serde. -Matthias On 6/12/18 6:32 PM, Stephane Maarek wrote: > Hi > > Coming from a user perspective,

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-16 Thread Matthias J. Sax
Ted, I am also not sure what you mean by "Shouldn't the selection in header have higher precedence over the configuration"? What selection do you mean? And want configuration? About the first point, I think this is actually a valid concern: To address this issue, it seems that we would need to c

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-17 Thread Matthias J. Sax
ould > take precedence over the value of the configuration. > I understand that such interpretation may have slight performance cost. > > Cheers > > On Sat, Jun 16, 2018 at 6:29 PM, Matthias J. Sax > wrote: > >> Ted, >> >> I am also not sure what you me

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-17 Thread Matthias J. Sax
ent approach ? > > I wonder how user B gets to know the intention of user A. Meaning, if user > B doesn't follow the norm set by user A, there still would be issue, right ? > > > On Sun, Jun 17, 2018 at 4:58 PM, Matthias J. Sax > wrote: > >> Let me rephr

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-18 Thread Matthias J. Sax
keep in mind that I would like to keep this as >> backwards >>> compatible as possible, so a lot of decisions are inferred from that >> intent. >>> >>> @Guozhang: IMHO, adding expression evaluation to configuration is an >>> incorrect approach. If you

Re: [DISCUSS] - KIP-314: KTable to GlobalKTable Bi-directional Join

2018-06-18 Thread Matthias J. Sax
Adam, thanks a lot for the KIP. I agree that this would be a valuable feature to add. It's a very complex one though. You correctly pointed out, that the GlobalKTable (or global stores in general) cannot be the "driver" atm and are passively updated only. This is by design. Are you familiar with t

Re: cwiki access for KIP

2018-06-20 Thread Matthias J. Sax
Done. On 6/20/18 11:15 AM, Matthias Wessendorf wrote: > Hi, > > I'd like to request permission to the kafka space in our ASF cwiki, to be > able to create KIPs. > > Username: matzew > email: mat...@apache.org > > Thanks! > Matthias > signature.asc Description: OpenPGP digital signature

Re: [DISCUSS] KIP-315: Stream Join Sticky Assignor

2018-06-20 Thread Matthias J. Sax
Mike, thanks a lot for the KIP. I am wondering, why Streams API cannot be used for perform the join? Would be good to understand the advantage of adding a `StickyStreamJoinAssignor` compared to using Streams API? Atm, it seems to be a redundant feature to me. -Matthias On 6/20/18 1:07 PM, Mike

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2018-06-20 Thread Matthias J. Sax
ot able to complete this KIP. Please accept my > apologies for that.  > > > Cheers, > Jeyhun > > On Mon, Jun 11, 2018 at 2:25 AM Matthias J. Sax <mailto:matth...@confluent.io>> wrote: > > What is the status of this KIP? > > -Matthias > >

Re: access for KIP

2018-06-20 Thread Matthias J. Sax
You are added already. On 6/20/18 5:18 PM, Lei Chen wrote: > Hi, there, > > I'd like to request permission to the kafka space in our ASF cwiki, to be able > to create KIPs. > > Username: leyncl > email: ley...@gmail.com > > Thanks! > signature.asc Description: OpenPGP digital signature

[VOTE] 1.0.2 RC0

2018-06-22 Thread Matthias J. Sax
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 1.0.2. This is a bug fix release closing 26 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2 Release notes for the 1.0.2 release: http://home.apache.org/~mjsa

[VOTE] 0.11.0.3 RC0

2018-06-22 Thread Matthias J. Sax
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.11.0.3. This is a bug fix release closing 27 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.11.0.3 Release notes for the 0.11.0.3 release: http://home.apache.

[VOTE] 0.10.2.2 RC1

2018-06-22 Thread Matthias J. Sax
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 0.10.2.2. Note, that RC0 was created before the upgrade to Gradle 4.8.1 and thus, we discarded it in favor of RC1 (without sending out a email for RC0). This is a bug fix release closing

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-06-24 Thread Matthias J. Sax
Thanks for the KIP! I am don't have any further comments. For Guozhang's comment: if we mention anything about `toString()`, we should make explicit that `toString()` output is still not public contract and users should not rely on the output. Furhtermore, for the actual uses output, I would rep

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-24 Thread Matthias J. Sax
Thanks for the KIP. Overall, I think it makes sense to clean up the API. Couple of comments: > Sadly there's no way to "deprecate" this > exposure I disagree. We can just mark the variable as deprecated and I advocate to do this. When the deprecation period passed, we can make it private (or act

Re: [VOTE] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-24 Thread Matthias J. Sax
+1 (binding) -Matthias On 6/22/18 10:25 AM, Bill Bejeck wrote: > Thanks for the KIP, +1. > > -Bill > > On Fri, Jun 22, 2018 at 1:08 PM Ted Yu wrote: > >> +1 >> >> On Fri, Jun 22, 2018 at 2:50 AM, Bruno Cadonna wrote: >> >>> Hi list, >>> >>> I would like to voting on this KIP. >>> >>> I crea

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-06-24 Thread Matthias J. Sax
NING. The > user can retry until KafkaStream state is RUNNING. > > >> When would we throw an `StateStoreEmptyException`? The semantics is > unclear to me atm. > >> When the state is RUNNING, is `StateStoreClosedException` a retryable > error? > > These two comm

Re: [VOTE] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-25 Thread Matthias J. Sax
+1 (binding) On 6/25/18 6:11 AM, Bill Bejeck wrote: > All, > I'd like to start a vote for this KIP now. > > Thanks, > Bill > signature.asc Description: OpenPGP digital signature

Re: [VOTE] KIP-280: Enhanced log compaction

2018-06-25 Thread Matthias J. Sax
ue that we are effectively > assigning the whole sub-space of "header=*" of Strings for headers, and > what if users want to use preserved value falling into that sub-space > (again, should not really happen in practice, just being paranoid here). > > It seems that two config

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-06-25 Thread Matthias J. Sax
reamThreadNotRunning, because I think users' handling logic for the third > case would be likely the same as the second. Do you have some scenarios > where users may want to handle them differently? > > Guozhang > > On Sun, Jun 24, 2018 at 5:25 PM, Matthias J. Sax > wrote:

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-25 Thread Matthias J. Sax
gt;> Materialized >>> object yet, only the Windows spec. So I think in this KIP we probably >>> cannot move it immediately. >>> >>> But in future KIPs if we decide to expose the stream-stream join's store >> / >>> changelog / repartition top

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-06-25 Thread Matthias J. Sax
ly. I think we should still not claiming it is part of the >>> public APIs that would not be changed anyhow in the future, but just >>> mentioning it in the wiki for people to be aware is fine. >>> >>> >>> Guozhang >>> >>> On Sun, Jun 24,

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-25 Thread Matthias J. Sax
> https://issues.apache.org/jira/browse/KAFKA-7080 > > -John > > On Mon, Jun 25, 2018 at 4:44 PM John Roesler wrote: > >> Matthias, >> >> That's a good idea. I'm not sure why I didn't... >> >> Thanks, >> -John >> >> On Mon, Jun

Re: [VOTE] KIP-319: Replace numSegments to segmentInterval in Streams window configurations

2018-06-25 Thread Matthias J. Sax
+1 (binding) On 6/25/18 3:00 PM, Guozhang Wang wrote: > +1 > > On Mon, Jun 25, 2018 at 2:58 PM, Ted Yu wrote: > >> +1 >> >> On Mon, Jun 25, 2018 at 2:56 PM, John Roesler wrote: >> >>> Hello All, >>> >>> Thanks for the discussion on KIP-319. I'd now like to start the voting. >>> >>> As a remind

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-26 Thread Matthias J. Sax
On Mon, Jun 25, 2018 at 10:06 PM Matthias J. Sax > wrote: > >> KAFKA-7080 is for this KIP. >> >> I meant to create a JIRA to add `segmentInterval` to `Materialized` and >> a JIRA to add `Materialized` to `KStream#join(KStream)`. >> >> Thx. >> >>

Re: [VOTE] KIP-324: Add method to get metrics() in AdminClient

2018-06-27 Thread Matthias J. Sax
+1 (binding) On 6/26/18 2:33 PM, Guozhang Wang wrote: > +1. Thanks. > > On Tue, Jun 26, 2018 at 2:31 PM, Yishun Guan wrote: > >> Hi All, >> >> I am starting a vote on this KIP: >> >> https://cwiki.apache.org/confluence/x/lQg0BQ >> >> Thanks, >> Yishun >> > > > signature.asc Description: O

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-27 Thread Matthias J. Sax
Thanks for the KIP John. One initial comments about the last example "Bounded lateness": For a non-windowed KTable bounding the lateness does not really make sense, does it? Thus, I am wondering if we should allow `suppressLateEvents()` for this case? It seems to be better to only allow it for wi

Re: Help with first contribution

2018-06-28 Thread Matthias J. Sax
Nikolay, thanks for your interest in contribution to Kafka! Did you filter for JIRAs with label "newbie" or "beginner"? What component of Kafka do you want to work on/interests you most? -Matthias On 6/28/18 3:20 AM, Nikolay Izhikov wrote: > Hello, guys. > > I'm experienced java/scala enginee

Re: Please, add me to the committers!

2018-06-29 Thread Matthias J. Sax
Daniele, thanks for your interest in working on Kafka! Being a committer has a very special meaning in the Apache world: - https://www.apache.org/dev/committers.html - https://cwiki.apache.org/confluence/display/KAFKA/Bylaws Thus, when you start to work on Kafka, you are a contributor. You sho

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

2018-06-29 Thread Matthias J. Sax
The KIP says: > In WindowBytesStoreSupplier, we will add: Should it be `SessionBytesStoreSupplier` ? What do you mean by > Users customizing the SessionBytesStoreSupplier should not implement this function. From my understanding, this is a breaking change for all users implementing a custom `

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-06-29 Thread Matthias J. Sax
ore the partial aggregations on >> local stores and, from time to time, query those states and aggregate them >> as a single value, avoiding bottlenecks. This is a way to create a "timed >> aggregation barrier”. >> >> If we leverage this kind of built-in feature we c

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

2018-06-29 Thread Matthias J. Sax
the latter case, they are not impacted. > > Does that make sense to you? > > Guozhang > > > On Fri, Jun 29, 2018 at 10:44 AM Matthias J. Sax > wrote: > >> The KIP says: >> >>> In WindowBytesStoreSupplier, we will add: >> >> Should it b

Re: [VOTE] 1.0.2 RC0

2018-06-29 Thread Matthias J. Sax
t; >>>> Checked signatures. >>>> >>>> On Fri, Jun 22, 2018 at 11:42 AM, Vahid S Hashemian < >>>> vahidhashem...@us.ibm.com> wrote: >>>> >>>>> +1 (non-binding) >>>>> >>>>> Built from

[VOTE] 1.0.2 RC1

2018-06-29 Thread Matthias J. Sax
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.0.2. This is a bug fix release addressing 27 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2 Release notes for the 1.0.2 release: http://home.apache.org/~

Re: [kafka-clients] [VOTE] 1.1.1 RC2

2018-06-29 Thread Matthias J. Sax
Hi Dong, it seems that the kafka-streams-quickstart artifacts are missing. Is it just me or is the RC incomplete? -Matthias On 6/29/18 4:07 PM, Rajini Sivaram wrote: > Hi Dong, > > +1 (binding) > > Verified binary using quick start, ran tests from source, checked > release notes. > > Thanks

Re: Help with first contribution

2018-07-01 Thread Matthias J. Sax
w to contribute" guide. > Seems, many of them already discussed or assigned. > > Can you, please, suggest one? > >> What component of Kafka do you want to work on/interests you most? > > Actually, I don't have any specific wishes so any good-to-start issue will

Re: [kafka-clients] [VOTE] 0.10.2.2 RC1

2018-07-02 Thread Matthias J. Sax
+1 -Matthias On 6/29/18 2:46 PM, Jun Rao wrote: > Hi, Matthias, > > Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 > > Jun > > On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax <mailto:matth...@confluent.io>> wrote: > >

[RESULTS] [VOTE] Release Kafka version 0.10.2.2

2018-07-02 Thread Matthias J. Sax
This vote passes with 5 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jason * Guozhang * Jun Committers: * Matthias Community: * Ted 0 votes * No votes -1 votes * No votes Vote thread: http://search-hadoop.com/m/Kafka/uyzND1Wt6721GMzOE1?subj=+VOTE+0+10+2+2+RC1 I'll cont

Re: [kafka-clients] Re: [VOTE] 0.11.0.3 RC0

2018-07-02 Thread Matthias J. Sax
se! > > Ismael > > On Fri, Jun 22, 2018 at 3:14 PM Matthias J. Sax > mailto:matth...@confluent.io>> wrote: > > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka

[RESULTS] [VOTE] Release Kafka version 0.11.0.3

2018-07-02 Thread Matthias J. Sax
This vote passes with 8 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jun * Rajini * Ismael Committers: * Matthias Community: * Vahid * Manikumar * Ted * Harash 0 votes * No votes -1 votes * No votes Vote thread: http://search-hadoop.com/m/Kafka/uyzND1yVsGqxIVN5?subj=+VO

Re: Contribute : assign JIRAs and create KIP permissions

2018-07-02 Thread Matthias J. Sax
Done. On 7/2/18 9:35 AM, Saïd Bouras wrote: > Hi everyone, > > I am looking for a while now to contribute to Apache Kafka. I would like to > have permissions to create KIP and assign JIRAs to myself. > > My jira id is : sbouras > > Thanks in advance :-) > signature.asc Description: OpenPGP

Re: [RESULTS] [VOTE] Release Kafka version 0.11.0.3

2018-07-02 Thread Matthias J. Sax
votes -1 votes * No votes -Matthias On 7/2/18 9:54 AM, Matthias J. Sax wrote: > This vote passes with 8 +1 votes (3 bindings) and no 0 or -1 votes. > > +1 votes PMC Members: > * Jun > * Rajini > * Ismael > > Committers: > * Matthias > > Community: > * Va

[ANNOUNCE] Apache Kafka 0.11.0.3 Released

2018-07-03 Thread Matthias J. Sax
, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others. A big thank you for the following 26 contributors to this release! Matthias J. Sax, Ewen Cheslack-Postava, Konstantine Karantasis, Guozhang Wang, Rajini Sivaram, Randall Hauch, tedyu, Jagadesh Adireddi, Jarek Rudzinski

[ANNOUNCE] Apache Kafka 0.10.2.2 Released

2018-07-03 Thread Matthias J. Sax
, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others. A big thank you for the following 30 contributors to this release! Ewen Cheslack-Postava, Matthias J. Sax, Randall Hauch, Eno Thereska, Damian Guy, Rajini Sivaram, Colin P. Mccabe, Kelvin Rutt, Kyle Winkelman, Max Zheng

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-03 Thread Matthias J. Sax
>> The exception just means there is no uniform extractor for all the sinks. >> >> On Mon, Jun 25, 2018 at 8:02 PM, Matthias J. Sax >> wrote: >> >>> Ted, >>> >>> Why? Each sink can have a different TopicNameExtractor. >>> >>

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-03 Thread Matthias J. Sax
. -Matthias On 7/3/18 11:09 PM, Matthias J. Sax wrote: > John, > > I am a little bit on the fence. In retrospective, it might have been > better to add `topic()` and `topicPattern()` to source node and return a > proper `Pattern` object instead of the pattern as a String. > > All ot

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-04 Thread Matthias J. Sax
pl > since even if users do not override this function, the default value > `className@hashcode` still looks fine to me. > > > Guozhang > > > > On Tue, Jul 3, 2018 at 11:22 PM, Matthias J. Sax > wrote: > >> I just double checked the discussion thread of KIP-12

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-07-04 Thread Matthias J. Sax
;>>>>>> >>>>>>> [ KTable caching with commit interval = 2 ] >>>>>>> >>>>>>> <(k:2)-----(k:4)-(k:6)-> >>>>>>> >>>>>>> [ suppre

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-07-05 Thread Matthias J. Sax
Thanks for the KIP! +1 (binding) -Matthias On 7/5/18 7:45 AM, Chia-Ping Tsai wrote: > hi all, > > I would like to start voting on "KIP-331 Add default implementation to > close() and configure() for Serializer, Deserializer and Serde" > > https://cwiki.apache.org/confluence/display/KAFKA/KIP

Re: [kafka-clients] [VOTE] 1.0.2 RC1

2018-07-08 Thread Matthias J. Sax
>> wrote: > > > > > > > > > Hi, Matthias, > > > > Thanks for the running the release. Verified quickstart on scala 2.12 > > binary. +1 > > > > Jun > > > > On Fri, Jun 29, 2018 at 10:

Re: [kafka-clients] [VOTE] 1.0.2 RC1

2018-07-08 Thread Matthias J. Sax
gt; Harsha > > On Mon, Jul 2nd, 2018 at 11:57 AM, Jun Rao <mailto:j...@confluent.io>> wrote: > > > > > > > > > Hi, Matthias, > > > > Thanks for the running the release. Verified quickstart on scala 2.12

Re: Requesting Permission To Create KIP And Assign JIRAs

2018-07-14 Thread Matthias J. Sax
What is your wiki ID? Note, that the wiki and JIRA system are two independent accounts. -Matthias On 7/10/18 11:24 PM, Kevin Lu wrote: > Hi, > > I received access to assign JIRAs now, but I still cannot create KIPs. > > When I hover over the "Create KIP" button, it says I do not have permissio

Re: Requesting Permission To Create KIP And Assign JIRAs

2018-07-14 Thread Matthias J. Sax
Ah. Just saw that you included the info in the original email. I just double checked your wiki credentials are set correctly. You should be able to create a new wiki page. Maybe you need to re-login? -Matthias On 7/14/18 5:27 PM, Matthias J. Sax wrote: > What is your wiki ID? Note, that

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-15 Thread Matthias J. Sax
t's beyond the scope of the > original KIP? I am happy to do either. > > On Wed, Jul 4, 2018 at 1:48 PM Matthias J. Sax > wrote: > >> Sounds good to me. >> >> -Matthias >> >> On 7/4/18 10:53 AM, Guozhang Wang wrote: >>> After looked through the

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-07-15 Thread Matthias J. Sax
a "final results" or >> "emission" >>>>>> option >>>>>>>> to the windowed aggregation. >>>>>>>> >>>>>>>> What do you think about an API more like this: >>>>>&

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-07-15 Thread Matthias J. Sax
t;> - Tasks from Application A will have something like: >>>>>> .stream(/site-events) >>>>>> .count() >>>>>> .publish(/single-partitioned-topic-with-count-partials) >>>>>> - The published mess

[ANNOUCE] Apache Kafka 1.0.2 Released

2018-07-15 Thread Matthias J. Sax
York Times, Uber, Yelp, and Zalando, among others. A big thank you for the following 32 contributors to this release! Matthias J. Sax, Rajini Sivaram, Anna Povzner, Jason Gustafson, Ewen Cheslack-Postava, Guozhang Wang, Dong Lin, huxi, John Roesler, Ismael Juma, Jun Rao, Manikumar Reddy O, Max

Re: [kafka-clients] Re: [VOTE] 1.1.1 RC3

2018-07-18 Thread Matthias J. Sax
Thanks Dong. I am a little late, but +1, too. - verified signatures - build from sources - run unit test suite - run streams quickstart Thanks for running the release! -Matthias On 7/18/18 10:24 AM, Dong Lin wrote: > Thank you all for taking time to certify and vote for the release! > >

Re: Contribution request

2018-07-19 Thread Matthias J. Sax
Done On 7/19/18 8:49 AM, András Katona wrote: > Hello Team, > > Could you add me to the contributors on Apache Kafka project in JIRA, > please? > Username: akatona > > Thank you, > Andras Katona > signature.asc Description: OpenPGP digital signature

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-19 Thread Matthias J. Sax
create the JIRA for the second step so that >> others can pick it up. >> >> >> Guozhang >> >> On Sun, Jul 15, 2018 at 6:14 PM, Matthias J. Sax >> wrote: >> >>> There is no general protocol. We can include the changes in the current >>&

Re: [DISCUSS] KIP-335 Consider configurations for Kafka Streams

2018-07-19 Thread Matthias J. Sax
Thanks for the KIP. I just double checked the code. It seems that `retries` and `retries.backoff.ms` is only used in `GlobalStateManagerImpl` any longer to catch a timeout exception and retry. Thus, it seems reasonable to me to deprecate those configs and rewrite `GlobalStateManager` accordingly.

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-07-20 Thread Matthias J. Sax
sary >>>>> since it's only a name change. >>>>> >>>>> I have made the change to the KIP to only add, not change, >> preexisting >>>>> APIs. But where do we stand on deprecating topics()? >>>>> >>>>>

<    1   2   3   4   5   6   7   8   9   10   >