Re: Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-10 Thread Ran Tao
Hi, Илья. Thanks for your opinions! Your are right, and in fact, in addition to the different fields numbers, the names may also be different. Currently, we can also support inconsistent schema, which was discussed in the previous design, for example, we can provide a `schema.fields.mappings` para

RE: Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-10 Thread Илья Соин
Hi devs, I think for this approach to work, the internal record schema generated by Flink must be exactly the same for batch and stream records, because at runtime Flink will use the same serializer to send them downstream. However, it’s not always the case, because in batch mode Flink’s optimi