alamb commented on issue #13692: URL: https://github.com/apache/datafusion/issues/13692#issuecomment-2528696445
> Ultimately moving the CPU bound work off tokio isn't that complex, and the DF community has successfully pulled off far more complex initiatives (e.g. StringView). This is the core challenge in my mind. I would love to believe this project isn't that complex, but I have yet to see someone show how this would work practically with DataFusion (as well as trying myself). I am more than willing to coordinate this work once we have a pattern to apply. > Doing so would simplify integrating DF into existing codebases, eliminate whole classes of footgun, and allow for greater parallelism than is currently possible. I agree with the first two points (more parallelism I am not sure). I would very much like this to happen and am willing to invest a significant amount of effort to to do. I just don't know how to do it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
