westonpace opened a new issue, #1146:
URL: https://github.com/apache/datafusion-python/issues/1146

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   
   In the table provider for `lance` in the `scan` method I sometimes have to 
do a small amount of I/O to load dataset metadata if the metadata is not 
already in the cache.  The `scan` method is async so I assume this is ok.  
However, I use `spawn_blocking` to trigger this I/O and it fails because the 
runtime is not active.
   
   **Describe the solution you'd like**
   
   The runtime should be attached before calling `scan`.
   
   **Describe alternatives you've considered**
   
   Currently I work around this by forcing the metadata to be cached before 
creating the table provider but this is inconvenient.
   
   **Additional context**
   
   Can provide additional details (stack traces, lance reproducers, etc.) on 
request.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to