alamb closed issue #6518: Async User Defined Functions (UDF)
URL: https://github.com/apache/datafusion/issues/6518
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscrib
goldmedal commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2676875774
I have created a draft PR for this issue.
- https://github.com/apache/datafusion/pull/14837
It still has some remaining work, but feel free to share your opinion.
--
goldmedal commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2671902644
> I think the biggest piece of work needed a if we ported
https://github.com/goldmedal/datafusion-llm-function/pull/1 to the core would
be tests and support for other plan nodes
alamb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2595210435
> I just came across this use case today and am very interested, it would be
amazing if DataFusion just had
https://github.com/apache/datafusion/issues/6518#issuecomment-2585270509
adriangb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2593297771
I just came across this use case today and am very interested, it would be
amazing if DataFusion just had
https://github.com/apache/datafusion/issues/6518#issuecomment-2585270509
alamb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2585694146
> ```rust
> let sql = r#"
> CREATE FUNCTION an_llm_function(STRING)
> RETURNS STRING
> LANGUAGE MODEL
> AS 'microsoft/phi-4'
> "#;
>
> ctx.sql(sql).await?.sho
alamb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2585692537
BTW @Omega359 pointed out in Discord that there is something seemingly
similar looking in Arroyo (I think thanks to @
https://github.com/ArroyoSystems/arroyo/blob/4014db4824
milenkovicm commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2585390129
```rust
let sql = r#"
CREATE FUNCTION an_llm_function(STRING)
RETURNS STRING
LANGUAGE MODEL
AS 'microsoft/phi-4'
"#;
ctx.sql(sql).await?.show().await?;
edmondop commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2585357745
I read the code in the PR it totally makes sense: there is an optimizer that
intercepts async udf and create a separate physical node for their execution.
In the past I br
alamb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2585270509
I have been working with @goldmedal on a POC of this, and I am quite
pleased with how it has come out. See:
- https://github.com/goldmedal/datafusion-llm-function/pull/1
B
alamb commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2263943152
Sure -- sounds good to me @edmondop
What I would personally suggest doing is make an example showing what you
are trying to do -- and then with that example modify the DataFu
edmondop commented on issue #6518:
URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2261704543
@alamb this is very useful for me now but it is blocking, any chance I can
resume the existing work?
--
This is an automated message from the Apache Git Service.
To respond to
12 matches
Mail list logo
