Hi All, I kind of understand why https://github.com/apache/spark/pull/49971 was reverted on the branch-4.0 to allow testing of 4.0 release. Why was it also reverted on the master branch? I don’t see any JIRA being open for the failure. AFAIK, the proper way to handle the issue in Apache project:
- revert https://github.com/apache/spark/pull/49971 on the branch-4.0 (note that PR targeted master branch and SPARK-51229 targets 4.1 as affected version) - open JIRA and provide details of how to reproduce the error on the master branch - wait for the author of https://github.com/apache/spark/pull/49971 (in this case it was me) to reply in a timely manner and only then revert the commit If you agree with the approach, please undo the revert and file JIRA. There is an easy fix to the issue. Thank you, Vlad