Hello All, Requirement :- Process/Read (Consumer) data only if kafka message size greater then specified size (configured).
I am using SimpleConsumer and trying to pull size wise (GB) message using spark(kafka RDD).I am able to get earliest and latest offset using metadata request, but not able to get any size related metadata information. Is there way to get size of a message without fetchrequest in Kafka through SimpleConsumer/highlevel api ? Is there any API/method to get size related information in metadata request/response in kafka api. Thanks, Hutashan Chandrakar
