Hi Chen, Thanks for bringing this up! I think it would be great if the Hive connector is externalized. We've already previously established [1] that it should be externalized. I believe the only reason why this hasn't been done yet is because it's blocked by https://issues.apache.org/jira/browse/FLINK-26603. Is that still the case?
Best regards, Martijn [1] https://lists.apache.org/thread/bk9f91o6wk66zdh353j1n7sfshh262tr On Mon, Jan 9, 2023 at 4:22 PM Chen Qin <qinnc...@gmail.com> wrote: > Hi there, > > Following community guidance Externalized+Connector+development > <https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development>, > We > would like to initiate discussion on moving connector/hive to > apache/flink-connector-hive > <https://github.com/apache/flink-connector-hive>. > > Currently proposed changes includes > > - cleanup dependencies introduced from hive/yarn dependencies with > latest package version stated in properties section in POM file > - add FlinkPlannerCalciteShim to handle PlannerCalcite API signature > changes from 1.16 v.s 1.17-SNAPSHOT > - add PackageITTests and ProductionArchitectureTests > - [bonus] adding docker e2e tests with list of supported Hive/HMS > versions > > Risk associated with this change includes not being able to release until > 1.17 release, so we would have to keep cherry-pick changes from > flink/connectors/hive for a period of time. > > Looking forward to hearing community feedback. > > Chen >
