This does not make any sense. 1. There are no broken tests introduced by https://github.com/apache/spark/pull/49971 2. There are no JIRA filed for “the main entry point” 3. “The main entry point” that does not have any unit test suggests that it is not the main entry point. 4. It is not practical to revert every commit that introduced some functional issue or regression. If regression can’t be fixed, it is reverted, if it can be reasonably fixed, the fix is applied to the regression. Just as an example, https://github.com/apache/spark/pull/42823 introduced a regression. It was fixed by https://github.com/apache/spark/pull/50348. Nobody asked for the revert. 5. The way how revert was handled is not "Apache way”.
It may be easier for you to handle it in a single PR, but it is easier for me to provide PR on top of existing changes and it will also provide JIRA and a commit that documents why there is an issue. Otherwise it will be easier to introduce the error back again. Thank you, Vlad On Mar 25, 2025, at 4:58 PM, Hyukjin Kwon <gurwls...@apache.org> wrote: Rozov, this broke the main entry points of release, Spark shells. Even in the mast branch, you build a Spark, and cannot use Spark shells. Why don't you submit a PR that contains the proper fix? It is easier to have one PR that has no issue, e.g., reverting backporting etc. On Wed, 26 Mar 2025 at 00:17, Rozov, Vlad <vro...@amazon.com.invalid> wrote: Hi All, I kind of understand why https://github.com/apache/spark/pull/49971 was reverted on the branch-4.0 to allow testing of 4.0 release. Why was it also reverted on the master branch? I don’t see any JIRA being open for the failure. AFAIK, the proper way to handle the issue in Apache project: - revert https://github.com/apache/spark/pull/49971 on the branch-4.0 (note that PR targeted master branch and SPARK-51229 targets 4.1 as affected version) - open JIRA and provide details of how to reproduce the error on the master branch - wait for the author of https://github.com/apache/spark/pull/49971 (in this case it was me) to reply in a timely manner and only then revert the commit If you agree with the approach, please undo the revert and file JIRA. There is an easy fix to the issue. Thank you, Vlad
