[
https://issues.apache.org/jira/browse/FLINK-16774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068345#comment-17068345
]
jackylau commented on FLINK-16774:
----------------------------------
hi [~kkl0u] [~jark]
we want to develop a flink atas hook refering to Atlas stom hook. And it will
need define model, which is to describe information we want to store to atlas.
So we should do such things
1) find flink hooks and there is JobListener , we can trigger
so i just implement a JobListener loader from config.
https://issues.apache.org/jira/browse/FLINK-16692 and the PR is merged.
2) expose jobclient's Pipeline, and the community thinks it will not be added
to flink, which you can see here
https://issues.apache.org/jira/browse/FLINK-16777. but it don't matter. we will
modify ourself flink
3) and we also need extract source/sink function metadata to build atlas
entity. But the source/sink function's method is not public .
https://issues.apache.org/jira/browse/FLINK-16774
https://issues.apache.org/jira/browse/FLINK-16775
and if the conmmunity think 1) 3) is not problem and merged, our flink version
upgrades will be simple. so we want to expose them
> expose HBaseUpsertSinkFunction hTableName and schema for other system
> ---------------------------------------------------------------------
>
> Key: FLINK-16774
> URL: https://issues.apache.org/jira/browse/FLINK-16774
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / HBase
> Affects Versions: 1.10.0
> Reporter: jackylau
> Priority: Major
> Fix For: 1.11.0
>
>
> i want to expose hTableName and schema of HBaseUpsertSinkFunction such as
> getTableName, getTableScheme for other system such as atlas and i think it is
> needed
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
