Re: [PR] feat: Add option to adjust writer buffer size for query output [datafusion]

2025-04-30 Thread via GitHub
alamb merged PR #15747: URL: https://github.com/apache/datafusion/pull/15747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusi

Re: [PR] feat: Add option to adjust writer buffer size for query output [datafusion]

2025-04-23 Thread via GitHub
m09526 commented on code in PR #15747: URL: https://github.com/apache/datafusion/pull/15747#discussion_r2055434583 ## datafusion/datasource/src/write/mod.rs: ## @@ -88,6 +91,21 @@ pub async fn create_writer( file_compression_type.convert_async_writer(buf_writer) } +/// R

Re: [PR] feat: Add option to adjust writer buffer size for query output [datafusion]

2025-04-22 Thread via GitHub
m09526 commented on code in PR #15747: URL: https://github.com/apache/datafusion/pull/15747#discussion_r2054291448 ## datafusion/datasource/src/write/mod.rs: ## @@ -88,6 +91,21 @@ pub async fn create_writer( file_compression_type.convert_async_writer(buf_writer) } +/// R

Re: [PR] feat: Add option to adjust writer buffer size for query output [datafusion]

2025-04-17 Thread via GitHub
alamb commented on code in PR #15747: URL: https://github.com/apache/datafusion/pull/15747#discussion_r2049392845 ## datafusion/datasource/src/write/mod.rs: ## @@ -88,6 +91,21 @@ pub async fn create_writer( file_compression_type.convert_async_writer(buf_writer) } +/// Re

[PR] feat: Add option to adjust writer buffer size for query output [datafusion]

2025-04-17 Thread via GitHub
m09526 opened a new pull request, #15747: URL: https://github.com/apache/datafusion/pull/15747 ## Which issue does this PR close? - Closes #15656. ## Rationale for this change DataFusion uses `object_store`'s `BufWriter` to write query results to remote o