MOBIN-F opened a new pull request, #3791:
URL: https://github.com/apache/flink-cdc/pull/3791
Currently, the output of Kafka sink in debezium format looks like this:
```
{
"before": {
"id": 4,
"name": "John",
"address": "New York",
"phone_number": "2222",
"age": 12
},
"after": {
"id": 4,
"name": "John",
"address": "New York",
"phone_number": "1234",
"age": 12
},
"op": "u",
"source": {
"db": null,
"table": "customers"
}
}
```
It contains record data with full before/after and db info, but schema info
wasn't included.
However, In some scenarios, we need this information to determine the type
of data. For example, Paimon's Kafka CDC source requires this type information,
otherwise all types are considered String, refer to
https://paimon.apache.org/docs/0.9/flink/cdc-ingestion/kafka-cdc/#supported-formats.
Considering that this will increase the data load, I suggest adding a
parameter to configure whether to enable it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
