Re: offsetsForTimes API performance

2018-01-24 Thread srimugunthan dhandapani
Does the performance of kafka APIs ( https://kafka.apache.org/0110/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html ) depend on how geographically apart the caller of the API is from the kafka cluster? Do all APIs perform faster if the calls are made from a machine co-located in the ka

Re: offsetsForTimes API performance

2018-01-22 Thread Andrew Otto
Speaking of, has there been any talk of combining those two requests into a single API call? I’d assume that offsetForTimes + consumer seek is probably the most common use case of offsetForTimes. Maybe a round trip could be avoided if the broker could just auto-assign the consumer to the offset f

offsetsForTimes API performance

2018-01-22 Thread srimugunthan dhandapani
Hi all, We use kafka as our store and every one of our record is associated with a timeStamp. We pull data from kafka by seeking to a timeStamp offset everytime and then get the records by polling. We use KafkaConsumer's offsetsForTimes ( https://kafka.apache.org/0110/javadoc/org/apache/kafka/cl