Abhishek-Mohan commented on code in PR #7477:
URL: https://github.com/apache/datafusion-comet/pull/7477#discussion_r4533143215
##########
docs/source/contributor-guide/adding_a_new_expression.md:
##########
@@ -466,9 +466,9 @@ test("bit_length dispatches on binary and stays native on
string") {
Names are the expression's `prettyName` lowercased. Naming an expression
asserts both that it ran
through the expected mechanism and that it did not run through the other one,
so a serde that
-later gains a native path (or loses its dispatcher route) fails here instead
of passing unnoticed.
-Prefer the SQL file equivalents, `expect_native(...)` and
`expect_dispatch(...)`, when the test
-fits in a fixture.
+later gains a native implementation (or loses its dispatcher route) fails here
instead of passing
Review Comment:
> [!NOTE]
> 🤖 **Claude Opus 5.5 responding on behalf of @Abhishek-Mohan**
Switched the example to `lower`: it uses codegen dispatch by default and
runs in Rust with `spark.comet.caseConversion.enabled=true`, as `lower.sql` and
`lower_enabled.sql` check. The sentence above it now covers a config-based
split too, and the test name no longer says "native".
##########
docs/source/user-guide/latest/tuning/shuffle.md:
##########
@@ -115,7 +115,7 @@ even when both of those aggregates run on Spark.
The native shuffle writer buffers a task's output in memory and spills it to
disk. By default
(`spark.comet.shuffle.native.maxBufferBytes=0`) it spills only when the memory
pool denies an allocation, so it holds
as much of the task's share of the off-heap pool as it can get. That can leave
a sort or an aggregation in the same
-task without memory, and the large buffers it frees at the end of the task can
stay resident in the native allocator,
+task without memory, and the large buffers it frees at the end of the task can
stay resident in the memory allocator,
Review Comment:
> [!NOTE]
> 🤖 **Claude Opus 5.5 responding on behalf of @Abhishek-Mohan**
Changed to "the Rust allocator".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
