Experiencing trouble with KafkaCSVMetricsReporter

2016-12-27 Thread Dongjin Lee
In short: the resulting csv files from the brokers are filled with 0 only, although the broker cluster is running correctly. Hello. I am trying some benchmarks with KAFKA-4514[^1]. However, My KafkaCSVMetricsReporter is not working properly. I would like to ask if someone on this mailing list h

Re: [VOTE] KIP-119: Drop Support for Scala 2.10 in Kafka 0.11

2017-02-28 Thread Dongjin Lee
+1. Best, Dongjin -- Dongjin Lee Software developer in Line+. So interested in massive-scale machine learning. facebook: www.facebook.com/dongjin.lee.kr (http://www.facebook.com/dongjin.lee.kr) linkedin: kr.linkedin.com/in/dongjinleekr (http

Re: [VOTE] KIP-128: Add ByteArrayConverter for Kafka Connect

2017-03-08 Thread Dongjin Lee
Me too. +1. -- Dongjin Lee Software developer in Line+. So interested in massive-scale machine learning. facebook: www.facebook.com/dongjin.lee.kr (http://www.facebook.com/dongjin.lee.kr) linkedin: kr.linkedin.com/in/dongjinleekr (http

Wiki permissions

2017-01-04 Thread Dongjin Lee
Hello. I just completed a KIP for KAFKA-4514[^1] but can not create any page on the wiki. Could anyone can give me the permission? Regards, Dongjin [^1]: https://issues.apache.org/jira/browse/KAFKA-4514 -- *Dongjin Lee* *Software developer in Line+.So interested in massive-scale machine

[DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-05 Thread Dongjin Lee
Hi all, I've just posted a new KIP "KIP-110: Add Codec for ZStandard Compression" for discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-110%3A+Add+Codec+for+ZStandard+Compression Please have a look when you are free. Best, Dongjin -- *Dongjin Lee* *Softwa

Re: Wiki permissions

2017-01-05 Thread Dongjin Lee
Thanks Wang, I completed to submit my KIP because of you. Regards, Dongjin On Fri, Jan 6, 2017 at 2:52 AM, Guozhang Wang wrote: > Dongjin > > I have granted you the permission under apache id dongjin > > > Guozhang > > > On Wed, Jan 4, 2017 at 11:51 PM, Dongjin Lee

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-08 Thread Dongjin Lee
It seems like no one needs any update on this KIP. If then, May I start the vote? Regards, Dongjin On Fri, Jan 6, 2017 at 11:40 AM, Dongjin Lee wrote: > Hi all, > > I've just posted a new KIP "KIP-110: Add Codec for ZStandard Compression" > for > discussion

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-09 Thread Dongjin Lee
ider: are there other projects using it, does it have good test > coverage, are there performance tests, does it track upstream closely? > > Thanks, > Ismael > > On Fri, Jan 6, 2017 at 2:40 AM, Dongjin Lee wrote: > > > Hi all, > > > > I've just posted

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-10 Thread Dongjin Lee
Ismael, I see. Then, I will share the benchmark code I used by tomorrow. Thanks for your guidance. Best,Dongjin - Dongjin Lee Software developer in Line+. So interested in massive-scale machine learning. facebook: www.facebook.com/dongjin.lee.kr linkedin: kr.linkedin.com/in/dongjinleekr

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-11 Thread Dongjin Lee
:03 PM, Dongjin Lee wrote: > Ismael, > > I see. Then, I will share the benchmark code I used by tomorrow. Thanks > for your guidance. > > Best, > Dongjin > > - > > Dongjin Lee > > Software developer in Line+. > So interested in massive-scale mac

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-11 Thread Dongjin Lee
problems that could result in unreliable results. Also, it's a bit surprising that LZ4 is producing smaller output than gzip. Is that right? Ismael On Wed, Jan 11, 2017 at 10:20 AM, Dongjin Lee wrote: > Ismael, > > I pushed the benchmark code I used, with some updates (iteration: 20 ->

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-11 Thread Dongjin Lee
d don't really know JMH well anyway) but it might be worth getting > that > > landed so we can use it for this as well. > > > > -Ewen > > > > On Wed, Jan 11, 2017 at 6:35 AM, Dongjin Lee wrote: > > > > > Hi Ismael, > > > > > > 1.

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-15 Thread Dongjin Lee
I updated KIP-110 with JMH-measured benchmark results. Please have a review when you are free. (The overall result is not different yet.) Regards, Dongjin +1. Could anyone assign KAFKA-4514 to me? On Thu, Jan 12, 2017 at 11:39 AM, Dongjin Lee wrote: > Okay, I will have a try. > Thank

[Suggestion] Issues on StreamConfig Builder

2017-01-18 Thread Dongjin Lee
apache.org/jira/browse/KAFKA-4531 -- *Dongjin Lee* *Software developer in Line+.So interested in massive-scale machine learning.facebook: www.facebook.com/dongjin.lee.kr <http://www.facebook.com/dongjin.lee.kr>linkedin: kr.linkedin.com/in/dongjinleekr <http://kr.linkedin.com/in/dongjin

Re: [Suggestion] Issues on StreamConfig Builder

2017-01-19 Thread Dongjin Lee
bit > orthogonal to other two. > > 3. We prefer to work on smaller tasks, which generates smaller patches to > review etc. > > > So how about start picking on 2898 first, which I think can be done in > parallel with 4531? > > Guozhang > > > > > On Wed, Ja

Re: [Suggestion] Issues on StreamConfig Builder

2017-01-19 Thread Dongjin Lee
wrote: > 1. I think it would need a KIP discussion, yes. > 2. What sub-tasks are you considering to break KAFKA-4436? > > > Guozhang > > On Thu, Jan 19, 2017 at 5:52 PM, Dongjin Lee wrote: > > > Guozhang and all, > > > > No problem. I just took K

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-31 Thread Dongjin Lee
22 PM, Ben Stopford wrote: > > > Is there more discussion to be had on this KIP, or should it be taken to > a > > vote? > > > > On Mon, Jan 16, 2017 at 6:37 AM Dongjin Lee wrote: > > > > > I updated KIP-110 with JMH-measured benchmark results. Pl

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-31 Thread Dongjin Lee
P with the relevant details. I suggest describing each flow > and the error that the user would see in each case. > > Also, you mentioned an attached screenshot, but it seems like there was > nothing attached to the email. > > Ismael > > On Tue, Jan 31, 2017 at 9:28 AM, Dong

Re: [DISCUSS] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-02-04 Thread Dongjin Lee
ould hopefully be > enough > > time for Java 8 to be even more established. We haven't decided when the > > next major release will happen, but we know that it won't happen before > > June 2017. > > > > Please take a look at the proposal and share your feed

[DISCUSS] KIP-508: Make Suppression State Queriable

2019-08-16 Thread Dongjin Lee
Hi all, I would like to start a discussion of KIP-508, making suppression state queriable. Please give it a read when you are free and give some feedbacks. https://cwiki.apache.org/confluence/display/KAFKA/KIP-508%3A+Make+Suppression+State+Queriable Thanks, Dongjin -- *Dongjin Lee* *A

Re: [VOTE] KIP-499 - Unify connection name flag for command line tool

2019-08-21 Thread Dongjin Lee
inding) > > > > > > > > > > cheers, > > > > > Colin > > > > > > > > > > On Fri, Aug 9, 2019, at 09:56, Ron Dagostino wrote: > > > > > > +1 (non-binding) > > > > > > > > > > > &

[DISCUSS] KIP-638: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-07 Thread Dongjin Lee
appreciated. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinleekr <https://keybase.io/dongjinleekr>linkedin: kr.linkedin.c

Re: [DISCUSS] KIP-638: Deprecate DescribeLogDirsResponse.[LogDirInfo, ReplicaInfo]

2020-07-08 Thread Dongjin Lee
/confluence/pages/viewpage.action?pageId=158862109 > > On Tue, Jul 7, 2020 at 2:29 PM Dongjin Lee wrote: > > > > Hi devs, > > > > I hope to start the discussion of KIP-638, which aims to fix a glitch in > > Admin#describeLogDirs method. > > > > - KIP: >

Re: [DISCUSS] KIP-621: Deprecate and replace DescribeLogDirsResult.all() and .values()

2020-07-08 Thread Dongjin Lee
Hi Tom, Thanks for taking this issue. I opened a PR for this issue earlier, but your KIP was submitted first. So I closed my one . I have a question: for consistency with other methods, how about maintaining the signatur

Re: [DISCUSS] KIP-621: Deprecate and replace DescribeLogDirsResult.all() and .values()

2020-07-09 Thread Dongjin Lee
tself, since we'll continue to use it internally. > > best, > Colin > > > On Wed, Jul 8, 2020, at 07:41, Dongjin Lee wrote: > > Hi Tom, > > > > Thanks for taking this issue. I opened a PR for this issue earlier, but > > your KIP was submitted first. So I cl

Re: [DISCUSS] KIP-621: Deprecate and replace DescribeLogDirsResult.all() and .values()

2020-07-10 Thread Dongjin Lee
nternal classes at all, even via > > > inheritance. > > > * Using static member classes is inconsistent with other Admin APIs > such as > > > TopicDescription (though I think this is trivially fixed in your > proposal). > > > > > > The loss o

Re: [VOTE] KIP-621: Deprecate and replace DescribeLogDirsResult.all() and .values()

2020-07-10 Thread Dongjin Lee
on, Jul 6, 2020, at 01:14, Tom Bentley wrote: > > > > > Hi, > > > > > > > > > > I'd like to start a vote on KIP-621 which is about deprecating > methods > > > in > > > > > DescribeLogDirsResult which leak internal classes

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-08-05 Thread Dongjin Lee
u > > > want to enable IQ, why do we need all those new interfaces? The > > > result of a suppress() is a KTable that is the same as any other > > > key-value/windowed/sessions store? > > > > > > We should also have corresponding Jira tickets for different

[DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-08-05 Thread Dongjin Lee
Hi, Kafka dev, I hope to initiate the discussion of KIP-653, upgrading log4j to log4j2. https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+Upgrade+log4j+to+log4j2 All kinds of feedbacks are greatly appreciated! Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world

Re: [DISCUSS] Apache Kafka 2.7.0 release

2020-09-09 Thread Dongjin Lee
; wrote: > > > > > > > >> Thanks, Bill! > > > >> -John > > > >> > > > >> On Thu, 2020-08-13 at 15:19 -0700, Ismael Juma wrote: > > > >>> Thanks for volunteering Bill. :) > > > >>> > > > &g

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-11 Thread Dongjin Lee
gt; > I just took another look at the KIP, and it looks good to > me! > > I think this is ready for a vote. > > Thanks, > -John > > On Wed, 2020-08-05 at 22:04 +0900, Dongjin Lee wrote: > > Hi All, > > > > I updated the KIP > > < > https://cwi

[VOTE] KIP-508: Make Suppression State Queriable

2020-09-11 Thread Dongjin Lee
Hi devs, I hope to start the vote for KIP-508: Make Suppression State Queriable - it makes suppression state queriable by introducing KTable#suppress(Suppressed, Materialized) to the public API. Thanks, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <h

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-11 Thread Dongjin Lee
Hi All, Here is the voting thread: https://lists.apache.org/thread.html/r5653bf2dafbb27b247bf20dbe6f070c151b3823d96c9c9ca94183e20%40%3Cdev.kafka.apache.org%3E Thanks, Dongjin On Fri, Sep 11, 2020 at 4:23 PM Dongjin Lee wrote: > Hi John, > > Thanks for the feedback. I will open the Vo

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-15 Thread Dongjin Lee
ry to guard)? > - Can we actually implement it? We had issues with regard to KIP-300 to > materialize windowed-KTables? > > Would be worth to clarify upfront. Maybe, we even need a POC > implementation to verify that it works? > > > -Matthias > > > On 9/11/20 12:26 AM

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-16 Thread Dongjin Lee
cial snowflakes" in the > API, Choice B does seem safer in the short term. We would > basically be proposing a temporary API to make the > suppressed view queriable without a Materialized argument. > Then, once we fix the main KIP-300 problem, we would look at > converging Su

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-16 Thread Dongjin Lee
Is there anyone who has suggestions or comments on this feature? Thanks, Dongjin On Wed, Aug 5, 2020 at 11:37 PM Dongjin Lee wrote: > Hi, Kafka dev, > > I hope to initiate the discussion of KIP-653, upgrading log4j to log4j2. > > > https://cwiki.apache.org/confluence/displa

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-16 Thread Dongjin Lee
s `withName(String)`, it seems > like all we need to add is a boolean flag. > > Does that seem sensible to you? > > Thanks, > -John > > On Wed, 2020-09-16 at 21:50 +0900, Dongjin Lee wrote: > > Hi John, > > > > > Although it's not great to have "

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-16 Thread Dongjin Lee
ld provide a good opportunity to move on from the legacy config > format. The other option is to stick with the old format for 3.0 and > migrate to the new format in 4.0. > > Ismael > > On Wed, Aug 5, 2020 at 7:45 AM Dongjin Lee wrote: > > > Hi, Kafka dev, > > &g

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-17 Thread Dongjin Lee
ate names for the operation and the view? > > Thanks, > John > > On Wed, Sep 16, 2020, at 11:43, Dongjin Lee wrote: > > Hi John, > > > > It seems like the available alternatives in this point is clear: > > > > 1. Pass queriable name as a separate parameter

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-21 Thread Dongjin Lee
e. But we do have a choice with Suppress. > > Thanks! > -John > > On Thu, Sep 17, 2020, at 13:14, Dongjin Lee wrote: > > Hi John, > > > > I just reviewed KIP-307. As far as I understood, ... > > > > 1. There was Materialized name initially. > > 2. Wi

[VOTE] KIP-653: Upgrade log4j to log4j2

2020-09-22 Thread Dongjin Lee
Hi devs, Here I open the vote for KIP-653: Upgrade log4j to log4j2. It replaces the obsolete log4j logging library into the current standard, log4j2, with maintaining backward-compatibility. Thanks, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <h

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-22 Thread Dongjin Lee
. Thanks, Dongjin On Thu, Sep 17, 2020 at 2:29 AM Dongjin Lee wrote: > Hi Ismael, > > > Have we considered switching to the log4j2 logging config format by > default and providing a mechanism to use the old format? > > As of present, the proposal leaves the default confi

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-23 Thread Dongjin Lee
en the > project's compatibility requirements & semantic versioning. > > If these API compatibility issues are easily fixed I think it would be > great to have this in 2.7, but if not it might be easier to target this for > Kafka 3.0. That would also allow you to change the logg

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-28 Thread Dongjin Lee
are free. And please note that the KIP freeze for 2.7.0 is imminent. Thanks, Dongjin On Mon, Sep 21, 2020 at 11:35 PM Dongjin Lee wrote: > Hi John, > > I updated the PR applying the API changes we discussed above. I am now > updating the KIP document. > > Thanks, > Dongjin

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2020-09-28 Thread Dongjin Lee
> > Kind regards, > > Tom > > [1]: > > https://github.com/tombentley/kafka/blob/KAFKA-1368-log4j2/core/src/main/scala/kafka/utils/Log4j2Controller.scala > > > > > > On Wed, Sep 23, 2020 at 1:50 PM Dongjin Lee wrote: > > > Hi Tom, > > > >

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-03 Thread Dongjin Lee
gt; it in years. > > > > Ismael > > > > On Wed, Jun 9, 2021 at 9:51 PM Dongjin Lee wrote: > > > > > Hi Ismael, > > > > > > Before I submit this KIP, I reviewed some history. When KIP-499 > > > < > > > > https://cwiki.

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-03 Thread Dongjin Lee
gt; >> It will be removed in 4.0 if we are able to deprecate it in 3.9. > Hence, it > > >> seems to me enhancing it is a bit weird since the feature is active > only > > >> for one release … > > >> > > >>> > > >>>>

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-06 Thread Dongjin Lee
) > > On 2024/07/04 05:38:42 Dongjin Lee wrote: > > Okay, Ismael's opinion seems reasonable, so I will follow it. > > > > Then, could you please assign me the deprecation issue & KIP? Since I > > opened this KIP in the past, I hope to wrap it up. If you are oka

[DISCUSS] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-07 Thread Dongjin Lee
pache.org/confluence/display/KAFKA/KIP-752%3A+Support+--bootstrap-server+in+ReplicaVerificationTool> . Thanks in advance for all discussions, feedbacks, etc. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/d

Re: [VOTE] KIP-752: Support --bootstrap-server in ReplicaVerificationTool

2024-07-07 Thread Dongjin Lee
2024 at 9:05 PM Dongjin Lee wrote: > Hi Tsai, > > Great. I will close the old KIP & PR and file new ones by this weekend. > > Thanks, > Dongjin > > On Thu, Jul 4, 2024 at 8:48 PM Chia-Ping Tsai wrote: > >> hi Dongjin >> >> I have assigned https://iss

[VOTE] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-07 Thread Dongjin Lee
Hi all, I'd like to call for a vote on KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9): https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=311627623 Thanks, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_9

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-07-08 Thread Dongjin Lee
tps://www.linkedin.com/company/aiven/> < > https://twitter.com/aiven_io> > *Aiven Deutschland GmbH* > Alexanderufer 3-7, 10117 Berlin > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > Amtsgericht Charlottenburg, HRB 209739 B > -- *Dongjin Lee* *A hitchhike

Re: [DISCUSS] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-10 Thread Dongjin Lee
t; > > 1) "we usually have a deprecation period of at least 1 year" this > > was > > > > > what > > > > > > I believed before. > > > > > > 2) However, it seems another rule is "we don't introduce breaking > >

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-07-10 Thread Dongjin Lee
is not accurate (as you were the one bringing the KIP to > completion). > > Best, > > On Mon, Jul 8, 2024 at 5:38 PM Dongjin Lee wrote: > > > Hi Josep, > > > > Thanks for managing the 3.8 release. I have a request: could you please > > move the KIP-390 into the 3.9

Re: [VOTE] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

2024-07-15 Thread Dongjin Lee
cations, but > I'm > > > > fine to have a dedicated one for this tool (maybe we can link them). > > > > > > > > https://issues.apache.org/jira/browse/KAFKA-14705. > > > > > > > > On Sun, Jul 7, 2024

Re: [VOTE] KIP-518: Allow listing consumer groups per state

2020-01-13 Thread Dongjin Lee
gt; > > > > wrote: > > > > > > > > > Hi all, > > > > > > > > > > I'd like to start the vote on KIP-518: > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-

Re: [DISCUSS] KIP-390: Add producer option to adjust compression level

2020-01-28 Thread Dongjin Lee
a > and Snappy compression. > > Setting the buffer from 32kb to 128kb brings a rough 10% decrease in > storage which is a big deal. > > I could offer working on this as well. > > Best regards, > > Miklos > > > -- *Dongjin Lee* *A hitchhiker in the mathematical

Re: [DISCUSS] KIP-390: Allow fine-grained configuration for compression (Rebooted)

2020-01-28 Thread Dongjin Lee
s not benefit that much. > > It seems to me that for different types the buffer used quite differently. > Also, aside from ZSTD, are there any other types that have levels? > > > Guozhang > > > On Mon, Jun 24, 2019 at 4:30 PM Dongjin Lee wrote: > > > Hello.

[DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-02-14 Thread Dongjin Lee
iable - Jira: https://issues.apache.org/jira/browse/KAFKA-8403 All kinds of feedback will be greatly appreciated. Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjin

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-02-19 Thread Dongjin Lee
re actually fetching from the > internal buffers. > > Thanks, > John > > > On Fri, Feb 14, 2020, at 07:55, Dongjin Lee wrote: > > Hi devs, > > > > I'd like to reboot the discussion on KIP-508, which aims to support a > > Materialized variant of KTable#s

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-02-20 Thread Dongjin Lee
t what value there is in querying the > internal suppression buffer, since it only contains exactly the same value > as > the upstream table, for each key that is still buffered. But it feels like > you're saying you're trying to do something different than just query the >

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-02-26 Thread Dongjin Lee
the impression that you wanted to expand the scope of the KIP > to additionally allow querying the internal buffer, not just the result. > Can you clarify whether you are proposing to allow querying the state of > the internal buffer, the result, or both? > > Thanks, > John >

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Dongjin Lee
t; > > > > > > > > >>> meetups and at Kafka Summit and answering questions > on > > > > > > > > > > >>> stackoverflow. He consistently shows good judgement > in > > > design > > > > > > > > > > >>> and a c

Re: log4j-2.x

2022-01-17 Thread Dongjin Lee
On Sat, Jan 15, 2022 at 5:14 PM Berthold Reinwald > wrote: > > > Hi Everyone, > > > > > > > > kafka_2.13-3.0.0 is using log4j-1.2.17. Is there a plan to upgrade from > > log4j-1.x to log4j 2.x, and what would be the time line? > > > > Regards, >

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-17 Thread Dongjin Lee
logback or log4j2 > or > > any other logging framework, so I think the safest approach is to allow > > users to choose their implementation, while in tests I think we're free > to > > use whatever we want as that shouldn't be constrained by vulnerabilities. > >

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-19 Thread Dongjin Lee
und in either logback or log4j2 > > or > > > any other logging framework, so I think the safest approach is to allow > > > users to choose their implementation, while in tests I think we're free > > to > > > use whatever we want as that shouldn't be constrained by > vulnerab

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-21 Thread Dongjin Lee
st > the use of 1.x configuration that's deprecated (which it is), but it's also > the use of the appender itself which is deprecated. > > Kind regards, > > Tom > > On Thu, 20 Jan 2022 at 05:01, Dongjin Lee wrote: > > > Hi all, > > > > I just fil

Re: [VOTE] KIP-719: Deprecate Log4J Appender

2022-01-24 Thread Dongjin Lee
> Luke > > On Mon, Jan 24, 2022 at 5:30 PM Tom Bentley wrote: > > > Thanks Dongjin, +1 (binding). > > > > Kind regards, > > > > Tom > > > > > > On Thu, 20 Jan 2022 at 17:20, Ismael Juma wrote: > > > > > Thanks for the

[DISCUSS] KIP-817: Fix inconsistency in dynamic application log levels

2022-01-28 Thread Dongjin Lee
KIP-653: Upgrade log4j to log4j2 (Accepted). https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+Upgrade+log4j+to+log4j2 All kinds of feedbacks are greatly appreciated! Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2022-01-29 Thread Dongjin Lee
> So I don't think it's a problem but I think we probably want to > > mention it in the KIP or in the upgrade/release notes at least. > > > > Thanks, > > Mickael > > > > On Thu, Oct 22, 2020 at 4:27 AM Dongjin Lee wrote: > > > > > >

Re: [DISCUSS] KIP-817: Fix inconsistency in dynamic application log levels

2022-02-07 Thread Dongjin Lee
't feel strong either way so let's see what others > have to say. > > Cheers, > David > > > > > On Fri, Jan 28, 2022 at 11:04 AM Dongjin Lee wrote: > > > > Hi Kafka dev, > > > > I would like to start the discussion of KIP-817: Fix inconsi

Re: [ANNOUNCE] New committer: Luke Chen

2022-02-09 Thread Dongjin Lee
e community. > > > Thanks for all of your contributions Luke. Congratulations! > > -- Guozhang, on behalf of the Apache Kafka PMC > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongj

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks for the KIP! Thanks, Dongjin On Fri, Feb 11, 2022, 10:16 PM Julien Chanaud wrote: > Bumping this vote. > > We have 2 binding votes so far. > > The associated PR is already implemented: > https://github.com/apache/kafka/pull/11575 > Let me know if you have any feedback.

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-11 Thread Dongjin Lee
+1 (non-binding) Thanks, Dongjin On Wed, Feb 9, 2022, 2:07 AM Mickael Maison wrote: > Bumping this vote. > > We have 1 binding and 4 non-binding votes so far. > Let me know if you have any feedback. > > Thanks, > Mickael > > On Wed, Feb 2, 2022 at 10:13 AM Julien Chanaud > wrote: > > > > Hi Mi

Re: [VOTE] KIP-653: Upgrade log4j to log4j2

2022-03-23 Thread Dongjin Lee
HTH > > > > Edo > > > > -- > > > > Edoardo Comar > > > > Event Streams for IBM Cloud > > > > > > > > > > > > > > > > From:

Re: [VOTE] KIP-653: Upgrade log4j to log4j2

2022-03-23 Thread Dongjin Lee
omers don't use custom filters/layouts? > > Ismael > > On Wed, Mar 23, 2022 at 7:53 AM Dongjin Lee wrote: > > > Hi Mikael, Edoardo and Ismael, > > > > Sorry for being late. Frankly, I thought KIP-653 is not a breaking change > > since (as Edoardo stated) unl

Re: Kafka Log4J vulnerabilities - Urgent

2022-06-30 Thread Dongjin Lee
ssemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and > from Cognizant e-mail

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2021-01-17 Thread Dongjin Lee
t; > I agree, a POC implementation would help us to see if this is a good > choice for the kip. > > Thanks! > John > > On Tue, Oct 6, 2020, at 10:21, Dongjin Lee wrote: > > You mean, the performance issue related to `#all` or `#range` query. > Right? > > I reviewe

[DISCUSS] KIP-719: Add Log4J2 Appender

2021-03-02 Thread Dongjin Lee
Hi Kafka dev, I would like to start the discussion of KIP-719: Add Log4J2 Appender. https://cwiki.apache.org/confluence/display/KAFKA/KIP-719%3A+Add+Log4J2+Appender All kinds of feedbacks are greatly appreciated! Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world

Re: [ANNOUNCE] New committer: Tom Bentley

2021-03-16 Thread Dongjin Lee
wrote: > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > > > > > > > The PMC for Apache Kafka has invited Tom Bentley as a > > > > > committer, > > > > > > > and > > > > > > > > > &g

Re: [ANNOUNCE] New Kafka PMC Member: Chia-Ping Tsai

2021-03-16 Thread Dongjin Lee
; >>>> > > > >>>>> Congratulations Chia-Ping! Well deserved. > > > >>>>> > > > >>>>> Ismael > > > >>>>> > > > >>>>> On Fri, Mar 12, 2021, 11:14 AM Jun Rao > > &g

Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Dongjin Lee
like to start the discussion on KIP-720, which > proposes > > to > > > > deprecate the original MirrorMaker in the upcoming 3.0 major release. > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-720%3A+

Re: [VOTE] KIP-717: Deprecate batch-size config from console producer

2021-03-17 Thread Dongjin Lee
.@gmail.com> wrote: > > > Hi, > > > > I'd like to start a vote on KIP-717 to remove batch-size config from the > > console producer. > > > > https://cwiki.apache.org/confluence/x/DB1RCg > > > > Thanks, > > Kamal > > > --

Re: Inquiry about usage of Kafka Compression

2021-03-17 Thread Dongjin Lee
oducer and consumer:* > > Producer Kafka Client Version (using ZStandard compression): 2.5.1 > Consumer Kafka Client Version: 2.1.0 > > Could you help us identify what caused this error? Do we need to upgrade > the version on the consumer side? > > > Best Regards,

Re: [DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-03-17 Thread Dongjin Lee
proved and implemented in AK 2.3.0) is here: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-449%3A+Add+connector+contexts+to+Connect+worker+logs > > I look forward to your feedback! > > Best regards, > > Randall > -- *Dongjin Lee* *A hitchhiker in the mathema

Re: [DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-03-18 Thread Dongjin Lee
the KIP-653 PR to be merged > first. I’ll just have to update my PR when this KIP passes. > > On Thu, Mar 18, 2021 at 1:30 AM Dongjin Lee wrote: > > > Hi Randall, > > > > I am +1 for this proposal. Sure, changing this setting manually is so > > annoying. I

Re: [ANNOUNCE] New Kafka PMC Member: Bill Bejeck

2021-04-12 Thread Dongjin Lee
Matthias J. Sax > wrote: > >>> > >>>> Hi, > >>>> > >>>> It's my pleasure to announce that Bill Bejeck in now a member of the > >>>> Kafka PMC. > >>>> > >>>> Bill has been a Kafka committ

Re: [ANNOUNCE] New Committer: Bruno Cadonna

2021-04-12 Thread Dongjin Lee
uthored a paper on Kafka's stream processing > > semantics in this year's SIGMOD conference ( > > https://en.wikipedia.org/wiki/SIGMOD). Bruno has also been quite active > on > > SO channels and AK mailings. > > > > Please join me to congratulate Bruno fo

Re: [VOTE] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-05-07 Thread Dongjin Lee
m myself. > > Thanks, and best regards! > > Randall > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinleekr <https://ke

Re: [VOTE] KIP-731: Record Rate Limiting for Kafka Connect

2021-05-08 Thread Dongjin Lee
/confluence/display/KAFKA/KIP-731%3A+Record+Rate+Limiting+for+Kafka+Connect > > Thanks for your votes! > > Ryanne > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleek

Re: [VOTE] KIP-741: Change default serde to be null

2021-05-25 Thread Dongjin Lee
t; > > > < > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-741%3A+Change+default+serde+to+be+null > > > > > > > > > The > > > > discussion is linked on the KIP for context. > > > > > &

Re: [VOTE] KIP-741: Change default serde to be null

2021-05-25 Thread Dongjin Lee
e date and time of the first message to this thread 72 > > hours havn't passed, yet. Theoretically, there could still be -1 votes > > coming in. > > > > Best, > > Bruno > > > > [1] > > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improve

Re: [DISCUSS] Apache Kafka 3.0.0 release

2021-05-25 Thread Dongjin Lee
t; > >> wrote: > >> > Hi all, > >> > > >> > Given that we seem to reach an agreement that the feature release > after > >> the > >> > upcoming 2.8.0 will be 3.0.0, I'd like to volunteer to be the release > >> >

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-05-25 Thread Dongjin Lee
y will have a good grasp on why both KIPs are best if released altogether. I will open the voting thread now, and please leave a vote if you are interested in this issue. Best, Dongjin On Tue, Mar 2, 2021 at 5:00 PM Dongjin Lee wrote: > Hi Kafka dev, > > I would like to start the

[VOTE] KIP-719: Add Log4J2 Appender

2021-05-25 Thread Dongjin Lee
Hi Kafka dev, I'd like to kick-off the voting for KIP-719: Add Log4J2 Appender. https://cwiki.apache.org/confluence/display/KAFKA/KIP-719%3A+Add+Log4J2+Appender Best, Dongjin -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-05-26 Thread Dongjin Lee
I hope you will check this proposal out. Best, Dongjin On Tue, May 25, 2021 at 10:43 PM Dongjin Lee wrote: > Bumping up the discussion thread. > > Recently, I updated the document of KIP-653: Upgrade log4j to log4j2 > <https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+

Re: [DISCUSS] Apache Kafka 3.0.0 release

2021-05-26 Thread Dongjin Lee
tracking when adding adopted KIPs > tentatively into the release plan. > > Not including KIP-719 to the release plan just yet because it's still under > discussion. Happy to add it once we conclude voting on it. > > Regards, > Konstantine > > > On Tue, May 25, 2021 at

Re: Kafka Serialzer for zOS Unix

2021-05-29 Thread Dongjin Lee
error. Even when the JKS files have been updated with the proper > certificates. > -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/>github.com/dongjinleekr <https://github.com/dongjinleekr>keybase: https://keybase.io/dongjinle

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-04-28 Thread Dongjin Lee
+1 On 29 Apr 2017, 9:51 AM +0900, Michael Pearce , wrote: > +1 > > From: Colin McCabe Sent: Saturday, April 29, 2017 1:09:25 AM > To: dev@kafka.apache.org > Subject: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and > listing ACLs > > Hi a

Re: [VOTE] KIP-144: Exponential backoff for broker reconnect attempts

2017-05-08 Thread Dongjin Lee
process for KIP-144: Exponential backoff for > > broker > > > > > > > reconnect attempts: > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > > > > > 144%3A+Exponential+ > > > > >

<    1   2   3   4   >