nsivabalan commented on a change in pull request #4930:
URL: https://github.com/apache/hudi/pull/4930#discussion_r818242568
##########
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
##########
@@ -189,6 +189,11 @@ public static long totalNewMessages(OffsetRange[] ranges) {
.defaultValue(KafkaResetOffsetStrategies.LATEST)
.withDocumentation("Kafka consumer strategy for reading data.");
+ public static final ConfigProperty<String> JSON_KAFKA_PROCESSOR_CLASS_OPT
= ConfigProperty
+ .key("hoodie.deltastreamer.source.kafka.json.processor.class")
+ .noDefaultValue()
+ .withDocumentation("Json kafka source pre-processor class name, used
to do pre-process on kafka data.");
Review comment:
lets not use "pre-process" as it might be confusing. we can just say
post process data after consuming from source and before giving it to
deltastreamer.
##########
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java
##########
@@ -189,6 +189,11 @@ public static long totalNewMessages(OffsetRange[] ranges) {
.defaultValue(KafkaResetOffsetStrategies.LATEST)
.withDocumentation("Kafka consumer strategy for reading data.");
+ public static final ConfigProperty<String> JSON_KAFKA_PROCESSOR_CLASS_OPT
= ConfigProperty
+ .key("hoodie.deltastreamer.source.kafka.json.processor.class")
Review comment:
hoodie.deltastreamer.source.json.kafka.post.processor.class
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
