--
This message, and any attachments, is for the intended recipient(s) only, may
contain information that is privileged, confidential and/or proprietary and
subject to important terms and conditions available at
http://www.ban
s requests back up.
We'll get the docs for this in with the final 0.8.2 release.
-Jay
On Thu, Dec 18, 2014 at 1:38 PM, Orelowitz, David
wrote:
>
> I notice that there is parameter max.in.flight.requests.per.connection
> in the ProducerConfig.java code that can be set. It is default
I notice that there is parameter max.in.flight.requests.per.connection in the
ProducerConfig.java code that can be set. It is defaulted to 5.
This is not documented in the 0.8.2 documentation.
http://kafka.apache.org/082/documentation.html#newproducerconfigs
Is it something we should play with?
, kafka.api.OffsetRequest.CurrentVersion(), clientName);
OffsetResponse response = consumer.getOffsetsBefore(request);
if(readOffset != 0)
readOffset--;
else
handle this case…
From: Neha Narkhede [mailto:n...@confluent.io]
Sent: Monday, December 08, 2014 12:43 PM
To: Orelowitz, David
Cc: users
]
Sent: Monday, December 08, 2014 12:43 PM
To: Orelowitz, David
Cc: users@kafka.apache.org
Subject: Re: Reading only the latest message
The returned latest offset - 1 will be the offset of the last message. Sorry,
should've made it clear in my last email. Let me know if that helps.
On Mon,
last committed message (at the time of the request) for that partition.
On Fri, Dec 5, 2014 at 12:42 PM, Orelowitz, David
wrote:
> What is the best mechanism to retrieve the latest message from a kafka
> partition.
>
> We intend for our producer, on startup or recovery, to read the
What is the best mechanism to retrieve the latest message from a kafka
partition.
We intend for our producer, on startup or recovery, to read the upstream
sequence number in the last message in the partition and request for the
upstream system to start sending from that sequence number++.
Curr
com/allthingshadoop>
/
On Fri, Dec 5, 2014 at 9:57 AM, Orelowitz, David
wrote:
> We are upgrading to 0.8.2 and have rewritten our producer using the
> new org.apache.kafka.clients.producer.KafkaProducer which works great.
>
> Should we also con
We are upgrading to 0.8.2 and have rewritten our producer using the new
org.apache.kafka.clients.producer.KafkaProducer which works great.
Should we also convert the consumers to use
org.apache.kafka.clients.consumer.KafkaConsumer.java or wait for 0.9.3 for the
new consumer client.
Thanks,
Dav
