cwtrex edited a comment on pull request #7965: URL: https://github.com/apache/kafka/pull/7965#issuecomment-991932149
>You said you're consuming strings While I am consuming strings initially, it is the intention to have it as proper JSON before it arrives in Kafka. The full solution is: app (generate sha1 for indexId as part of the json object generated to prevent duplicate ingests) -> kafka connector (use transform to pull indexId into a header) and (use this SMT or your serializer/converter suggestion to get it to be a proper JSON object) -> kafka -> camel k elastic sink solution (works with ES7 without issues) that pushes it into Elastic which needs JSON and indexId Again, I am no developer. Just looking for a solution. The above is completely existing except the solution to take out the timestamp or assign it to a JSON object and process proper json objects. The initial thought was an SMT for a transform operation rather than HoistField (this one). But a custom `value.converter` may work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
