Fwd: [DISCUSS] Make org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable

2018-10-25 Thread Pavel Moukhataev
Hello I'd like to introduce new feature for kafka client: Making org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable Here is KPI https://cwiki.apache.org/confluence/display/KAFKA/KIP-375%3A+Make+org.apache.kafka.clients.Metadata%23TOPIC_EXPIRY_MS+configurable The problem is: if applica

[DISCUSS] KIP-375 Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable

2018-11-20 Thread Pavel Moukhataev
Hello https://cwiki.apache.org/confluence/display/KAFKA/KIP-375%3A+Kafka+Clients+-+make+Metadata%23TOPIC_EXPIRY_MS+configurable I'd like to introduce new feature for kafka client: Making org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable Here is KPI https://cwiki.apache.org/confluence

[DISCUSS] Make org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable

2018-09-24 Thread Pavel Moukhataev
I'd like to introduce new feature for kafka client: Making org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable Here is KPI https://cwiki.apache.org/confluence/display/KAFKA/KIP-375%3A+Make+org.apache.kafka.clients.Metadata%23TOPIC_EXPIRY_MS+configurable The problem is: if application se

[DISCUSS] KIP-375 Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable

2018-09-26 Thread Pavel Moukhataev
https://cwiki.apache.org/confluence/display/KAFKA/KIP-375%3A+Kafka+Clients+-+make+Metadata%23TOPIC_EXPIRY_MS+configurable I'd like to introduce new feature for kafka client: Making org.apache.kafka.clients.Metadata#TOPIC_EXPIRY_MS configurable The problem is: if application sends records to some

Using Java Kafka Producer API for nearly Real Time Applications

2017-08-11 Thread Pavel Moukhataev
Hi Sometimes kafka is used in nearly real-time java applications that has low latency requirements. In that case it is very important to minify latency. In kafka producer API there are two things that are done synchronously and can be optimized: - cluster metadata fetch - wait for free memory in

Re: Using Java Kafka Producer API for nearly Real Time Applications

2017-08-11 Thread Pavel Moukhataev
bsolute bound on the amount of time the application is > willing to wait for messages to be acknowledged. By setting this low > enough, you can always favor fresh messages over older ones. And when the > brokers are unavailable or simply overloaded, that's the best you can do > IMO. >

Re: Using Java Kafka Producer API for nearly Real Time Applications

2017-08-17 Thread Pavel Moukhataev
with > other use cases. If it is deemed like a worthy improvement by the > community, your KIP and subsequent PR are likely to be accepted. > > Thanks, > Apurva > > > > On Fri, Aug 11, 2017 at 4:23 PM, Pavel Moukhataev > > wrote: > > > Imagine I have applicati

[DISCUSS] KIP-190 Asynchronous Java Kafka Producer

2017-08-17 Thread Pavel Moukhataev
with > other use cases. If it is deemed like a worthy improvement by the > community, your KIP and subsequent PR are likely to be accepted. > > Thanks, > Apurva > > > > On Fri, Aug 11, 2017 at 4:23 PM, Pavel Moukhataev > > wrote: > > > Imagine I have applicati

[DISCUSS] KIP-190 Asynchronous Java Kafka Producer

2017-08-18 Thread Pavel Moukhataev
This KIP is to make java kafka producer client 100% async. This is very important for applications with low latency requirements. https://cwiki.apache.org/confluence/display/ARIES/KIP-190+-+ Make+java+kafka+producer+asynchronous But I put it into ARIES space because I don't have access rights for