andygrove opened a new issue, #1453:
URL: https://github.com/apache/datafusion-comet/issues/1453
### What is the problem the feature request solves?
When native shuffle has a single output partition, we append the rows from
the input batch into array builders and then create a new batch, which is
identical to the input batch. We could skip all of this processing and just
pass the batch though unmodified.
```rust
Partitioning::UnknownPartitioning(n) if *n == 1 => {
let buffered_partitions = &mut self.buffered_partitions;
assert!(
buffered_partitions.len() == 1,
"Expected 1 partition but got {}",
buffered_partitions.len()
);
let indices = (0..input.num_rows()).collect::<Vec<usize>>();
self.append_rows_to_partition(input.columns(), &indices, 0)
.await?;
```
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
