alamb commented on issue #16365: URL: https://github.com/apache/datafusion/issues/16365#issuecomment-3189798794
I have been thinking about this @BlakeOrth -- and when I was trying to write up this plan, I realized it wasn't actually clear to me what was happening and thus I didn't know what to write up. One thing I was thinking is that we could make it easier to see what datafusion-cli was doing so we could better diagnose why this command takes so long (and thus how we can make it better0 ``` > CREATE EXTERNAL TABLE overture_maps STORED AS PARQUET LOCATION 's3://overturemaps-us-west-2/release/2025-07-23.0/'; 0 row(s) fetched. Elapsed 10.107 seconds. ``` Perhaps we can take inspiration from @kosiew and https://github.com/apache/datafusion/pull/17021 and add some way to monitor what is happening I/O wise from datafusion-cli. I will try and spec out a ticket for this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
