Thanks a lot Hans.. By using KafkaConsumer API
https://gist.github.com/senthilec566/16e8e28b32834666fea132afc3a4e2f9 i can
query the data using timestamp ..
It worked !
Now another question to achieve Parallelism on reading data ..
Example : topic : test
partitions : 4
Kafk
The timeindex was added in 0.10 so I think you need to use the new Consumer API
to access this functionality. Specifically you should call offsetsForTimes()
https://kafka.apache.org/0102/javadoc/org/apache/kafka/clients/consumer/Consumer.html#offsetsForTimes(java.util.Map)
-hans
> On May 25, 20
I did an experiment on searching messages using timestamps ..
Step 1: Used Producer with Create Time ( CT )
Step 2 : Verify whether it reflects in Kafka or not
.index .log
.timeindex
These three files in disk
Hi All , We have been using Kafka for our Use Case which helps in
delivering real time raw logs.. I have a requirement to fetch data from
Kafka by using offset ..
DataSet Example :
{"access_date":"2017-05-24
13:57:45.044","format":"json","start":"1490296463.031"}
{"access_date":"2017-05-24
13:57:
