Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2025-01-09 Thread via GitHub
kylebarron commented on PR #975: URL: https://github.com/apache/datafusion-python/pull/975#issuecomment-2580599804 Thanks for making that update! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2025-01-09 Thread via GitHub
timsaucer merged PR #975: URL: https://github.com/apache/datafusion-python/pull/975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@d

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2025-01-08 Thread via GitHub
timsaucer commented on code in PR #975: URL: https://github.com/apache/datafusion-python/pull/975#discussion_r1907919652 ## python/datafusion/record_batch.py: ## @@ -59,18 +59,22 @@ def __init__(self, record_batch_stream: df_internal.RecordBatchStream) -> None: def next(

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2025-01-07 Thread via GitHub
timsaucer commented on code in PR #975: URL: https://github.com/apache/datafusion-python/pull/975#discussion_r1905447211 ## python/datafusion/record_batch.py: ## @@ -59,18 +59,22 @@ def __init__(self, record_batch_stream: df_internal.RecordBatchStream) -> None: def next(

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2024-12-17 Thread via GitHub
kylebarron commented on PR #975: URL: https://github.com/apache/datafusion-python/pull/975#issuecomment-2549262305 I'd like to add a test with pytest-asyncio, but I don't know how to add the dependency, ref #977 -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2024-12-17 Thread via GitHub
kylebarron commented on PR #975: URL: https://github.com/apache/datafusion-python/pull/975#issuecomment-2549231264 This PR changes the behavior of `stream.next()` to raise `StopIteration` when there are no more batches available in the stream. This matches default iterator behavior:

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2024-12-17 Thread via GitHub
timsaucer commented on PR #975: URL: https://github.com/apache/datafusion-python/pull/975#issuecomment-2548366767 At first glance, this looks like a very nice add. Do you need help resolving the test failures? -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Support async iteration of RecordBatchStream [datafusion-python]

2024-12-16 Thread via GitHub
kylebarron commented on PR #975: URL: https://github.com/apache/datafusion-python/pull/975#issuecomment-2546768589 If this looks good, we can add a test using pytest-asyncio -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Support async iteration of RecordBatchStream [datafusion-python]

2024-12-16 Thread via GitHub
kylebarron opened a new pull request, #975: URL: https://github.com/apache/datafusion-python/pull/975 # Which issue does this PR close? Closes #974 . # Rationale for this change Support async iteration of RecordBatchStream. # What changes are included in this PR?