Re: SupportsReadingMetadata flow between table transformations

2023-05-30 Thread Hang Ruan
Hi, Yuval. `SupportsReadingMetadata` make connectors be able to append metadata columns to the schema of table sources. But one operator does not know the columns map to which column in the source. We could try to generate this information when parsing Flink sql. But it is hard for DataStream API

SupportsReadingMetadata flow between table transformations

2023-05-29 Thread Yuval Itzchakov
Hi, I am looking for a way to propagate a column all the way from the source to the sink, without the knowledge of whoever is applying transformations on the tables. I looked into SupportsReadingMetadata, and saw that it is able to "tag" tables with metadata. I was wondering, does this tag flow be