cwtrex edited a comment on pull request #7965: URL: https://github.com/apache/kafka/pull/7965#issuecomment-991932149
>You said you're consuming strings While I am consuming strings initially, it is the intention to have it as proper JSON before it arrives in Kafka. The full solution is: app (generate sha1 for indexId as part of the json object generated to prevent duplicate ingests) -> kafka connector (use transform to pull indexId into a header) -> kafka -> camel k elastic sink solution (works with ES7 without issues) that pushes it into Elastic which needs JSON and indexId Again, I am no developer. Just looking for an easy solution. The above is completely existing except the solution to take out the timestamp or assign it to a JSON object and process proper json objects. The initial thought was an SMT for a transform operation rather than HoistField (this one). But a `value.converter` may work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
