You can check out https://github.com/hortonworks-spark/spark-atlas-connector/
On Wed, 15 May 2019 at 19:44, lk_spark <lk_sp...@163.com> wrote: > hi,all: > When I use spark , if I run some SQL to do ETL how can I get > lineage info. I found that , CDH spark have some config about lineage : > spark.lineage.enabled=true > spark.lineage.log.dir=/var/log/spark2/lineage > Are they also work for apache spark ? > > 2019-05-16 > ------------------------------ > lk_spark >
