Hi, Dev
Mingge, Chris and I would like to start a discussion about FLIP-437:
Support ML Models in Flink SQL.
This FLIP is proposing to support machine learning models in Flink SQL
syntax so that users can CRUD models with Flink SQL and use models on Flink
to do prediction with Flink data. The FL
will we support? How to define a user-defined
> model type?
>
> 5. Regarding the remote model, what providers will we support? Can users
> implement
> 3rd-party providers except OpenAI?
>
> Best,
> Jark
>
> [1]:
>
> https://nightlies.apache.org/flink/flink-docs-master
%3A+Support+SQL+windowing+table-valued+function#FLIP145:SupportSQLwindowingtablevaluedfunction-CumulatingWindows
> [3]:
>
> https://github.com/aws-samples/amazon-redshift-ml-getting-started/blob/main/use-cases/bring-your-own-model-remote-inference/README.md#create-model
>
>
>
>
>
defining
> the function with the model, users can directly invoke the function without
> reference to the model name.
>
> Best,
> Jark
>
> [1]:
>
> https://github.com/apache/flink/blob/d6c7eee8243b4fe3e593698f250643534dc79cb5/flink-table/flink-table-planner/src/main/ja
.
> >> >> The specific checking logic of cumulate window happens in
> >> >> SqlCumulateTableFunction.OperandMetadataImpl#checkOperandTypes.
> >> >> The return type of SqlCumulateTableFunction is defined in
> >> >> #getRowTypeInference() me
rameters similar to `DESCRIBE
> TABLE` only shows the columns (not the WITH clause).
>
> Regards,
> Timo
>
>
> On 23.03.24 13:17, Ahmed Hamdy wrote:
> > Hi everyone,
> > +1 for this proposal, I believe it is very useful to the minimum, It
> would
> >
be deduced from the options.
2). Sure. We can add temporary model
3). Make sense. We can use `show create model ` to display all
information and `describe model ` to show input/output schema
Thanks,
Hao
On Mon, Mar 25, 2024 at 3:21 PM Hao Li wrote:
> Hi Ahmed,
>
> Looks like the feature fr
e.
>
> Let me know when you updated the FLIP for a final review before voting.
>
> Do others have additional objections?
>
> Regards,
> Timo
>
> [1]
>
> https://livesql.oracle.com/apex/livesql/file/content_HQK7TYEO0NHSJCDY3LN2ERDV6.html
>
>
>
> On 25.03.2
> important
> because it relates to what use cases can run with the new Flink version out
> of the box.
>
> Best,
> Jark
>
> On Wed, 27 Mar 2024 at 01:10, Hao Li wrote:
>
> > Hi Timo,
> >
> > Yeah. For `primary key` and `from table(...)` those are expl
Thanks Timo. I'll start a vote tomorrow if no further discussion.
Thanks,
Hao
On Thu, Mar 28, 2024 at 9:33 AM Timo Walther wrote:
> Hi everyone,
>
> I updated the FLIP according to this discussion.
>
> @Hao Li: Let me know if I made a mistake somewhere. I added some
&g
Hi devs,
I'd like to start a vote on the FLIP-437: Support ML Models in Flink
SQL [1]. The discussion thread is here [2].
The vote will be open for at least 72 hours unless there is an objection or
insufficient votes.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-437%3A+Support+ML+M
does the model have an owner? I assume that Flink model resource is the
> > master of the model? I imagine in the future that a model that comes in
> via
> > a new connector could be kept up to date with the external model and
> would
> > not be allowed to be changed by
rent catalog interface extend it. As model support
will be built-in in Flink, the current catalog interface will need to
support model CRUD operations. For my own education, can you elaborate more
on how separate interface will allow us to begin with lower stability
guarantees?
Thanks,
Hao
On Thu, M
Hi Dev,
Thanks all for voting. I'm closing the vote and the result will be posted
in a separate email.
Thanks,
Hao
On Wed, Apr 3, 2024 at 10:24 AM Hao Li wrote:
> Thanks David Radley and David Moravek for the comments. I'll reply in the
> discussion thread.
>
> Hao
>
Hi Dev,
I'm happy to announce that FLIP-437: Support ML Models in Flink SQL [1] has
been accepted with 7 approving votes (6 binding) [2]
Timo Walther (binding)
Jark Wu (binding)
Yu Chen (non-binding)
Piotr Nowojski (binding)
Leonard Xu (binding)
Martijn Visser (binding)
David Moravek (binding)
T
Hi Yash,
+1 for the proposal.
Thanks,
Hao
On Mon, Feb 10, 2025 at 12:31 AM Yanquan Lv wrote:
> Hi, Yash. Thanks for driving it.
> +1 for this.
>
> > 2025年2月7日 05:28，Yash Anand 写道：
> >
> > Hi all! I would like to open up for discussion a new FLIP-507[1].
> > Motivation This proposal aims to ex
+1 (non-binding)
Thanks Yash,
Hao
On Tue, Feb 18, 2025 at 10:46 AM Yash Anand
wrote:
> Hi Everyone,
>
> I'd like to start a vote on FLIP-507: Add Model DDL methods in TABLE API
> [1] which has been discussed in this thread [2].
>
> The vote will be open for at least 72 hours unless there is an
Thanks Timo for the FLIP! This is a great improvement to the FLINK sql
syntax around tables. I have two clarification questions:
1. For SEARCH_KEY
```
SELECT *
FROM
t_other,
LATERAL SEARCH_KEY(
input => t,
on_key => DESCRIPTOR(k),
lookup => t_other.name,
options => MAP[
'
Hao Li created FLINK-34992:
--
Summary: FLIP-437: Support ML Models in Flink SQL
Key: FLINK-34992
URL: https://issues.apache.org/jira/browse/FLINK-34992
Project: Flink
Issue Type: New Feature
Hao Li created FLINK-34993:
--
Summary: Support Model CRUD in parser
Key: FLINK-34993
URL: https://issues.apache.org/jira/browse/FLINK-34993
Project: Flink
Issue Type: Sub-task
Reporter
Hao Li created FLINK-35013:
--
Summary: Support temporary model
Key: FLINK-35013
URL: https://issues.apache.org/jira/browse/FLINK-35013
Project: Flink
Issue Type: Sub-task
Reporter: Hao
Hao Li created FLINK-35014:
--
Summary: SqlNode to operation conversion for models
Key: FLINK-35014
URL: https://issues.apache.org/jira/browse/FLINK-35014
Project: Flink
Issue Type: Sub-task
Hao Li created FLINK-35016:
--
Summary: Catalog changes for model CRUD
Key: FLINK-35016
URL: https://issues.apache.org/jira/browse/FLINK-35016
Project: Flink
Issue Type: Sub-task
Reporter
Hao Li created FLINK-35018:
--
Summary: ML_EVALUATE function
Key: FLINK-35018
URL: https://issues.apache.org/jira/browse/FLINK-35018
Project: Flink
Issue Type: Sub-task
Reporter: Hao Li
Hao Li created FLINK-35017:
--
Summary: ML_PREDICT function
Key: FLINK-35017
URL: https://issues.apache.org/jira/browse/FLINK-35017
Project: Flink
Issue Type: Sub-task
Reporter: Hao Li
Hao Li created FLINK-35019:
--
Summary: Support show create model syntax
Key: FLINK-35019
URL: https://issues.apache.org/jira/browse/FLINK-35019
Project: Flink
Issue Type: Sub-task
Hao Li created FLINK-35020:
--
Summary: Model Catalog implementation in Hive etc
Key: FLINK-35020
URL: https://issues.apache.org/jira/browse/FLINK-35020
Project: Flink
Issue Type: Sub-task
27 matches
Mail list logo
