Hi Minge, Chris, Hao, Thanks for proposing this interesting idea. I think this is a nice step towards the AI world for Apache Flink. I don't know much about AI/ML, so I may have some stupid questions.
1. Could you tell more about why polymorphism table function (PTF) doesn't work and do we have plan to use PTF as model functions? 2. What kind of object does the model map to in SQL? A relation or a data type? It looks like a data type because we use it as a parameter of the table function. If it is a data type, how does it cooperate with type inference[1]? 3. What built-in model functions will we support? How to define a user-defined model function? 4. What built-in model types will we support? How to define a user-defined model type? 5. Regarding the remote model, what providers will we support? Can users implement 3rd-party providers except OpenAI? Best, Jark [1]: https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/functions/udfs/#type-inference On Wed, 13 Mar 2024 at 05:55, Hao Li <h...@confluent.io.invalid> wrote: > Hi, Dev > > > Mingge, Chris and I would like to start a discussion about FLIP-437: > Support ML Models in Flink SQL. > > This FLIP is proposing to support machine learning models in Flink SQL > syntax so that users can CRUD models with Flink SQL and use models on Flink > to do prediction with Flink data. The FLIP also proposes new model entities > and changes to catalog interface to support model CRUD operations in > catalog. > > For more details, see FLIP-437 [1]. Looking forward to your feedback. > > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-437%3A+Support+ML+Models+in+Flink+SQL > > Thanks, > Minge, Chris & Hao >
