adriangb commented on issue #6518: URL: https://github.com/apache/datafusion/issues/6518#issuecomment-2593297771
I just came across this use case today and am very interested, it would be amazing if DataFusion just had https://github.com/apache/datafusion/issues/6518#issuecomment-2585270509 built in. My use case is essentially storing a link to an asset in a column and materializing that so that I can search it e.g. `select * from chat_history where unblob(prompt) like 'You are an expert in%'`. I don't want to store `prompt` inline with the rest of the data for several reasons the only easy one of which to explain is that I don't want to push the data around when I do compaction and other optimization of files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
