Re: [I] `array_contains` falls back to Spark in case of empty Array [datafusion-comet]

2025-06-25 Thread via GitHub
andygrove commented on issue #1929: URL: https://github.com/apache/datafusion-comet/issues/1929#issuecomment-3006195157 @comphead Hmm, do you see a fallback reason? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] `array_contains` falls back to Spark in case of empty Array [datafusion-comet]

2025-06-25 Thread via GitHub
comphead commented on issue #1929: URL: https://github.com/apache/datafusion-comet/issues/1929#issuecomment-3006128645 > I don't think this is a bug. Spark likely optimizes the array_contains expression during planning time and replaces it with a boolean literal? > > ``` > checkSp

Re: [I] `array_contains` falls back to Spark in case of empty Array [datafusion-comet]

2025-06-25 Thread via GitHub
andygrove commented on issue #1929: URL: https://github.com/apache/datafusion-comet/issues/1929#issuecomment-3006004580 I don't think this is a bug. Spark likely optimizes the array_contains expression during planning time and replaces it with a boolean literal? ``` checkSparkAnsw

[I] `array_contains` falls back to Spark in case of empty Array [datafusion-comet]

2025-06-24 Thread via GitHub
comphead opened a new issue, #1929: URL: https://github.com/apache/datafusion-comet/issues/1929 ### Describe the bug After reviewing https://github.com/apache/datafusion/pull/16529 I added empty array test to Comet ``` test("array_contains") { withSQLConf(CometC