Does that count get frozen on a fixed number or any random number? -Zakee
On Mon, Feb 23, 2015 at 9:48 AM, Stuart Reynolds <s...@stureynolds.com> wrote: > See SimpleConsumer. getOffsetsBefore > and the .... getLastOffset example here: > > https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example > whichTime=-1 or -2 (depending whether you want the latest or earliest > offset. > > However, I've been banging my head against the wall with this API -- > it seems that, even with a single broker and a single host, sometimes > the latest offset gets frozen as new data comes in. :-/ > > > > public static long getLastOffset(SimpleConsumer consumer, String > topic, int partition, > long whichTime, String clientName) { > TopicAndPartition topicAndPartition = new > TopicAndPartition(topic, partition); > Map<TopicAndPartition, PartitionOffsetRequestInfo> requestInfo > = new HashMap<TopicAndPartition, PartitionOffsetRequestInfo>(); > requestInfo.put(topicAndPartition, new > PartitionOffsetRequestInfo(whichTime, 1)); > kafka.javaapi.OffsetRequest request = new > kafka.javaapi.OffsetRequest(requestInfo, > kafka.api.OffsetRequest.CurrentVersion(),clientName); > OffsetResponse response = consumer.getOffsetsBefore(request); > > if (response.hasError()) { > System.out.println("Error fetching data Offset Data the > Broker. Reason: " + response.errorCode(topic, partition) ); > return 0; > } > long[] offsets = response.offsets(topic, partition); > return offsets[0]; > } > > On Sun, Feb 22, 2015 at 9:05 PM, Bhuvana Baskar > <bhuvana.baska...@gmail.com> wrote: > > Hi, > > > > Please let me know how to find the total number of messages in a > particular > > topic. > > > > Regards, > > Bhuvana > ____________________________________________________________ > Heavy rains mean flooding > Anywhere it rains it can flood. Learn your risk. Get flood insurance. > http://thirdpartyoffers.netzero.net/TGL3255/54eb6db072a8f6db07624mp13duc > >
