Hi, Samrat. I have seen some users are asking for GlueCatalog support[1], it's really exciting that you're driving it. After a quick look of this Flip, I have some comments:
1: I noticed there's a YAML part in the section of "Using the Catalog", what do you mean by that? Do you mean how to use glue catalog in sql client? If so, just for your information, it's not supported to use yaml envrioment file in sql client[2]. 2: Seems there's a typo in "Design#views" part, it contains "listTables" which I think shouldn't be contained. Also, I'm curious about how to list views using Glue API. Is there an on-hand api to list views directly or we need to list the tables and then filter the views using the table-kind? 3: In "Flink Glue DataType Mapping" part, CharType is mapped to String. It seems the char's size will lose, is it possible to have a better mapping which won't loss the size of char type? 4: About the "Flink CatalogFunction mapping with Glue Function" part, how do we map the function language in Flink's CatalogFunction. [1] https://lists.apache.org/thread/pdd780wl4f26p447fohvm9osky2r9fhh [2] https://issues.apache.org/jira/browse/FLINK-22540 Best regards, Yuxia ----- 原始邮件 ----- 发件人: "Samrat Deb" <decordea...@gmail.com> 收件人: "dev" <dev@flink.apache.org> 抄送: "prabhujose gates" <prabhujose.ga...@gmail.com> 发送时间: 星期六, 2022年 12 月 03日 下午 12:29:16 主题: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink Hi everyone, I would like to open a discussion[1] on providing GlueCatalog support in Flink. Currently, Flink offers 3 major types of catalog[2]. Out of which only HiveCatalog is a persistent catalog backed by Hive Metastore. We would like to introduce GlueCatalog in Flink offering another option for users which will be persistent in nature. Aws Glue data catalog is a centralized data catalog in AWS cloud that provides integrations with many different connectors[3]. Flink GlueCatalog can use the features provided by glue and create strong integration with other services in the cloud. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-277%3A+Native+GlueCatalog+Support+in+Flink [2] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/catalogs/ [3] https://docs.aws.amazon.com/glue/latest/dg/components-overview.html#data-catalog-intro [4] https://issues.apache.org/jira/browse/FLINK-29549 Bests Samrat
