Permission to create a KIP

2020-04-12 Thread
Hi, I am working on a ticket which requires modifying public APIs that are visible to users. Could somebody grant the KIP permission to me ? Thanks.

MessagesOutPerSec JMX metric

2020-04-12 Thread
Hi, I am wondering why there isn't a metric called MessagesOutPerSec in Kafka JMX metrics to describe how many messages are consumed by clients and fetched by followers per second since there are already metrics like MessagesInPerSec, BytesInPerSec and BytesOutPerSec. Thanks.

Re: Permission to create a KIP

2020-04-12 Thread
I am not sure that I have one, how can I find out this and how can I create one ? Thanks. Guozhang Wang 于2020年4月13日周一 下午1:42写道: > Hello Xiang, > > What's your apache ID? > > > Guozhang > > On Sun, Apr 12, 2020 at 6:08 PM 张祥 wrote: > > > Hi, I am workin

Re: Permission to create a KIP

2020-04-12 Thread
before, that will work; if not you can create one > under that space. > > > Guozhang > > On Sun, Apr 12, 2020 at 10:49 PM 张祥 wrote: > > > I am not sure that I have one, how can I find out this and how can I > create > > one ? Thanks. > > >

Re: Permission to create a KIP

2020-04-13 Thread
Thanks Guozhang. Guozhang Wang 于2020年4月14日周二 上午12:52写道: > I've added your id to the apache wiki space. You should be able to create > new pages now. > > On Sun, Apr 12, 2020 at 10:55 PM 张祥 wrote: > > > I just registered a new account with xiangzhang1...@gmail.

[DISCUSS] KIP-594 Safely abort Producer transactions during application shutdown

2020-04-15 Thread
Hi everyone, I have opened a small KIP about safely aborting transaction during shutdown. I'd like to use this thread to discuss about it and any feedback is appreciated. Here is a link to KIP-594 : https://cwiki.apache.org/confluence/display/KAFKA/KIP-594%3A+Safely+abort+Producer+transactions+dur

Re: [DISCUSS] KIP-594 Safely abort Producer transactions during application shutdown

2020-04-15 Thread
> > Once you are done, I'd suggest that you please start a separate discussion > thread with the new KIP number. > > > Cheers, > Kowshik > > > On Wed, Apr 15, 2020 at 6:42 PM 张祥 wrote: > > > Hi everyone, > > > > I have opened a small KIP about

[DISCUSS] KIP-596 Safely abort Producer transactions during application shutdown

2020-04-15 Thread
Hi everyone, I have opened a small KIP about safely aborting transaction during shutdown. I'd like to use this thread to discuss about it and any feedback is appreciated (sorry for earlier KIP number mistake). Here is a link to KIP-596 : https://cwiki.apache.org/confluence/display/KAFKA/KIP-596%3A

Re: [DISCUSS] KIP-596 Safely abort Producer transactions during application shutdown

2020-04-16 Thread
I think the KIP is in pretty good shape. > > Boyang > > On Wed, Apr 15, 2020 at 7:07 PM 张祥 wrote: > > > Hi everyone, > > > > I have opened a small KIP about safely aborting transaction during > > shutdown. I'd like to use this thread to discuss abo

endless authorizer log

2020-04-16 Thread
I am using Ambari to manage Kafka, info listed below: Ambari version: 2.7.4.0 Kafka version: 2.0.0 broker number: 10 On every broker, authorizer logger keeps outputting following logs: [2020-04-14 07:56:40,214] INFO Principal = User:xxx is Denied Operation = Describe from host = 10.90.1.213 on

Restart without shutdown log

2020-04-16 Thread
Hi, I am using Ambari to manage Kafka, info as listed below: Ambari version: 2.7.4.0 Kafka version: 2.0.0 The problem I ran into is that one broker restarts without shutdown log, which makes it difficult to track down the reason. The related logs are as follows, in which I cannot find "shut down

Re: [DISCUSS] KIP-596 Safely abort Producer transactions during application shutdown

2020-04-16 Thread
need to depend on the exception to decide whether to `close` the > producer, so the above recommendation could look like: > > try { > > } catch {Exception e} { > > producer.abortTxn; > > if (e instanceof /*fatal exceptions*/) { > producer.close(); > } > }

Re: [DISCUSS] KIP-596 Safely abort Producer transactions during application shutdown

2020-04-25 Thread
Sorry, but this KIP is still open to discussion, any comments and ideas would be appreciated, Thanks. 张祥 于2020年4月17日周五 下午1:04写道: > Guozhang, thanks for the valuable suggestion. > > A new part called "suggested coding pattern" has been added and I copy the > c

Re: [DISCUSS] KIP-596 Safely abort Producer transactions during application shutdown

2020-05-05 Thread
to be miss-leading? > > > -Matthias > > On 4/25/20 6:08 PM, 张祥 wrote: > > Sorry, but this KIP is still open to discussion, any comments and ideas > > would be appreciated, Thanks. > > > > 张祥 于2020年4月17日周五 下午1:04写道: > > > >> Guozhang, thanks for the va

[VOTE] KIP-596 Safely abort Producer transactions during application shutdown

2020-05-15 Thread
Hi all, I'd like to start a vote for KIP-586. You can find the link for this KIP here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-596%3A+Safely+abort+Producer+transactions+during+application+shutdown Thanks.

JIRA access request

2020-02-19 Thread
Hi, I am a newbie, could somebody please open JIRA access for me ? Thanks.

Regarding segment size config

2020-03-18 Thread
Hi community, I understand that there are two configs regarding segment file size, log.segment.bytes for broker and segment.bytes for topic. The default values are both 1G and they are required to be an integer so they cannot be larger than 2G. My question is, assuming I am not making any mistakes

Kafka JMX monitoring

2020-03-18 Thread
Hi, I want to know what the best practice to collect Kafka JMX metrics is. I haven't found a decent way to collect and parse JMX in Java (because it is too much) and I learn that there are tools like tools like jmxtrans to do this. I wonder if there is more. Thanks. Regards.

Re: Regarding segment size config

2020-03-19 Thread
panel#comment-14161185 > > > On Wed, Mar 18, 2020 at 2:10 AM 张祥 wrote: > > > Hi community, > > > > I understand that there are two configs regarding segment file size, > > log.segment.bytes for broker and segment.bytes for topic. The default > > values are

JMX expired topic metircs

2020-03-19 Thread
Hi, I notice that there are jmx metrics for deleted topics when using java code and jmxterm. Has anyone also run into this ? If yes, what is the reason behind this and how can I filter expired metrics ? Thanks.