[ https://issues.apache.org/jira/browse/KAFKA-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17220283#comment-17220283 ]
Joshua Grisham commented on KAFKA-10640: ---------------------------------------- Created PR: https://github.com/apache/kafka/pull/9493 > Connect Cast and ReplaceField transforms only support top-level fields and > Cast does not support complex types. > --------------------------------------------------------------------------------------------------------------- > > Key: KAFKA-10640 > URL: https://issues.apache.org/jira/browse/KAFKA-10640 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect > Reporter: Joshua Grisham > Priority: Major > > When working with anything but the most simple of messages, you will > inevitably run into nested structures and nested fields within other > structures. These two transforms are very important when working with data > and if we want to use Connect for anything except the most simple scenarios > then they should support working with more complicated structures. > Also, in case the messages have more complicated types such as Arrays or Maps > that are not supported by the Flatten transform, it is not possible to do > many "standard" feeling things with the messages such as using a > JdbcSinkConnector to put the data into a database and use it in a > database-driven system. > So it would be good if at a minimum we can Cast complex types as a string so > that they can at least be sent along and stored in the database and then > parsed later. This is opposed to them just being completely blocked like is > the current state. -- This message was sent by Atlassian Jira (v8.3.4#803005)