According to https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-OffsetCommitRequest, we can store custom metadata with our checkpoints. It looks like the high level consumer does not support committing offsets with metadata, and that in order to checkpoint with custom metadata, we have to issue the OffsetCommitRequest ourselves. Is that correct?
Thanks, -James
