aoyuEra opened a new issue, #282: URL: https://github.com/apache/doris-spark-connector/issues/282
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version doris-3.0.4 spark-3.0.5 spark-doris-connector-spark-3.5：25.0.0 ### What's Wrong? ### 原始代码： spark.sql( """ | select ryid, | (case when bcxmbh = 'DACSRQ' then bcxmz else null end) as cac001, | (case when bcxmbh = 'HKDJRQ' then bcxmz else null end) as cae457, | (case when bcxmbh = 'SFGBSF' then bcxmz else null end) as cac221, | (case when bcxmbh = 'NMGBZ' then bcxmz else null end) as aac028, | (case when bcxmbh = 'SCDJ' then bcxmz else null end) as ala040, | (case when bcxmbh = 'HLYLDJ' then bcxmz else null end) as alc060 | from test_table | where bcxmbh in ('DACSRQ','HKDJRQ','SFGBSF','NMGBZ','SCDJ','HLYLDJ') |""".stripMargin).where("!(cac001 is null and cae457 is null and cac221 is null and aac028 is null and ala040 is null and alc060 is null)").show ### spark日志输出 Pushing operators to test_table Pushed Filters: BCXMBH IN ('DACSRQ', 'HKDJRQ', 'SFGBSF', 'NMGBZ', 'SCDJ', 'HLYLDJ'), (((NOT (CASE WHEN BCXMBH = 'DACSRQ' THEN BCXMZ IS NULL ELSE TRUE END)) OR (NOT (CASE WHEN BCXMBH = 'HKDJRQ' THEN BCXMZ IS NULL ELSE TRUE END))) OR (NOT (CASE WHEN BCXMBH = 'SFGBSF' THEN BCXMZ IS NULL ELSE TRUE END))) OR (((NOT (CASE WHEN BCXMBH = 'NMGBZ' THEN BCXMZ IS NULL ELSE TRUE END)) OR (NOT (CASE WHEN BCXMBH = 'SCDJ' THEN BCXMZ IS NULL ELSE TRUE END))) OR (NOT (CASE WHEN BCXMBH = 'HLYLDJ' THEN BCXMZ IS NULL ELSE TRUE END))) Post-Scan Filters: 2025-03-10 13:50:52.406 [main] INFO o.a.s.s.e.d.v.V2ScanRelationPushDown - Output: RYID#8, BCXMBH#9, BCXMZ#10, JBR#11, JBSJ#12 ### 发送到doris接口的参数 {"sql":"SELECT `RYID`,`BCXMBH`,`BCXMZ`,`JBR`,`JBSJ` FROM `hrss_load`.`sbhc_si3u3752_per_natl_cmpl` WHERE `BCXMBH` IN ('DACSRQ','HKDJRQ','SFGBSF','NMGBZ','SCDJ','HLYLDJ') AND (((NOT (null) OR NOT (null)) OR NOT (null)) OR ((NOT (null) OR NOT (null)) OR NOT (null)))"} 缺失转换的类：org.apache.doris.spark.read.expression.V2ExpressionBuilder ### What You Expected? 能正常转为类似这样（这里可能还有其他没有找到的可能性需要处理）， ( ( (NOT (CASE WHEN BCXMBH = 'DACSRQ' THEN BCXMZ IS NULL ELSE TRUE END)) OR (NOT (CASE WHEN BCXMBH = 'HKDJRQ' THEN BCXMZ IS NULL ELSE TRUE END)) ) OR (NOT (CASE WHEN BCXMBH = 'SFGBSF' THEN BCXMZ IS NULL ELSE TRUE END)) ) OR ( ( (NOT (CASE WHEN BCXMBH = 'NMGBZ' THEN BCXMZ IS NULL ELSE TRUE END)) OR (NOT (CASE WHEN BCXMBH = 'SCDJ' THEN BCXMZ IS NULL ELSE TRUE END)) ) OR (NOT (CASE WHEN BCXMBH = 'HLYLDJ' THEN BCXMZ IS NULL ELSE TRUE END)) ) ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
