Re: Extract column and table lineage from flink sql

2020-10-22 Thread Danny Chan
Hi, dawangli ~ Usually people build the lineage of tables through a self-built platform, there was a DB to persist the relationship between the tables, for each job, you may need to analyze each SQL which are source tables and which are sink. E.G. The INSERT target table is a sink and table after

Extract column and table lineage from flink sql

2020-10-20 Thread dawangli
I want to build a lineage system for a real-time data warehouse,how can I extract table and column lineage from flink sql?