alamb commented on code in PR #16196:
URL: https://github.com/apache/datafusion/pull/16196#discussion_r2135631720
##########
datafusion/common/src/config.rs:
##########
@@ -722,6 +722,15 @@ config_namespace! {
/// then the output will be coerced to a non-view.
/// Coerces `Utf8View` to `LargeUtf8`, and `BinaryView` to
`LargeBinary`.
pub expand_views_at_output: bool, default = false
+
+ /// When DataFusion detects that a plan might not be promply
cancellable
+ /// due to the presence of tight-looping operators, it will attempt to
+ /// mitigate this by inserting explicit yielding (in as few places as
+ /// possible to avoid performance degradation). This value represents
the
+ /// yielding period (in batches) at such explicit yielding points. The
+ /// default value is 64. If set to 0, no DataFusion will not perform
Review Comment:
I like that this has a "escape valve" too -- if this mechanism isn't working
we can disable the new yields via config
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
