timsaucer opened a new pull request, #15646:
URL: https://github.com/apache/datafusion/pull/15646

   ## Which issue does this PR close?
   
   - Closes #14247 but it is a different solution than requested
   
   ## Rationale for this change
   
   We have many users who wish to use extension data or other metadata when 
writing user defined functions. This PR enables two features for Scalar UDFs
   
   - When invoking the UDF, the metadata of each input column will be 
available, if it exists
   - The UDF can also specify output metadata that is attached to the schema of 
the record batch
   
   ## What changes are included in this PR?
   
   This is a fairly large change, but at a high level we add in a vector of 
argument metadata to the `ScalarFunctionArgs` that gets passed when invoked. 
Additionally all Physical Expressions are now required to implement a new 
function to output their metadata. The rest of the work included is around 
plumbing these changes through the system, extracting the metadata from the 
input schema, and setting it as output.
   
   ## Are these changes tested?
   
   - All existing unit tests pass.
   - Additional unit test exercising this feature is added.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to