[jira] [Updated] (SPARK-51460) Shuffle read and write are inconsistent when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-51460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] imarch1 zhang updated SPARK-51460: -- Description: When push-based shuffle enabled, some spark applications in our cluster experien

[jira] [Updated] (SPARK-51460) Shuffle read and write are inconsistent when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-51460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] imarch1 zhang updated SPARK-51460: -- Description: When push-based shuffle enabled, some spark applications in our cluster experien

[jira] [Created] (SPARK-51460) Shuffle read and write are inconsistent when push-based shuffle is enabled

imarch1 zhang created SPARK-51460: - Summary: Shuffle read and write are inconsistent when push-based shuffle is enabled Key: SPARK-51460 URL: https://issues.apache.org/jira/browse/SPARK-51460 Project:

[jira] [Updated] (SPARK-51465) Use `Apache Arrow Swift` 19.0.1

[ https://issues.apache.org/jira/browse/SPARK-51465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51465: --- Labels: pull-request-available (was: ) > Use `Apache Arrow Swift` 19.0.1 >

[jira] [Resolved] (SPARK-51463) Add `Spark Connect`-generated `Swift` code

[ https://issues.apache.org/jira/browse/SPARK-51463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51463. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 5 [https://gith

[jira] [Resolved] (SPARK-51409) Add error classification for changelog writer related errors

[ https://issues.apache.org/jira/browse/SPARK-51409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51409. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50176 [https://gi

[jira] [Updated] (SPARK-51459) Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE`

[ https://issues.apache.org/jira/browse/SPARK-51459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51459: --- Labels: pull-request-available (was: ) > Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE

[jira] [Closed] (SPARK-50966) Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3)

[ https://issues.apache.org/jira/browse/SPARK-50966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niall Pemberton closed SPARK-50966. --- > Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3) > ---

[jira] [Resolved] (SPARK-51461) Setup `SparkConnect` package structure and CI to test `build`

[ https://issues.apache.org/jira/browse/SPARK-51461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51461. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 4 [https://gith

[jira] [Updated] (SPARK-51461) Setup `SparkConnect` package structure and CI to test `build`

[ https://issues.apache.org/jira/browse/SPARK-51461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51461: --- Labels: pull-request-available (was: ) > Setup `SparkConnect` package structure and CI to t

[jira] [Updated] (SPARK-51463) Add `Spark Connect`-generated `Swift` code

[ https://issues.apache.org/jira/browse/SPARK-51463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51463: --- Labels: pull-request-available (was: ) > Add `Spark Connect`-generated `Swift` code >

[jira] [Updated] (SPARK-51464) Unable-to-stop-spark-application-after-enabling-authentication

[ https://issues.apache.org/jira/browse/SPARK-51464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prikshit updated SPARK-51464: - Description: I have enabled authentication in my Spark standalone cluster by setting  {{spark.authentica

[jira] [Created] (SPARK-51462) Support typed literals of the TIME data type

Max Gekk created SPARK-51462: Summary: Support typed literals of the TIME data type Key: SPARK-51462 URL: https://issues.apache.org/jira/browse/SPARK-51462 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-51458) Add GitHub Action job to check ASF license

[ https://issues.apache.org/jira/browse/SPARK-51458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51458. --- Fix Version/s: 4.1.0 Assignee: Dongjoon Hyun Resolution: Fixed This is resol

[jira] [Updated] (SPARK-51431) Support full table scanning of partitioned table is prohibited

[ https://issues.apache.org/jira/browse/SPARK-51431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-51431: -- Description: Many cloud customers expect spark sql to disable full table scanning by default, prompting users

[jira] [Assigned] (SPARK-51453) Fix AssertTrue constructor so it uses toPrettySQL instead of simpleString

[ https://issues.apache.org/jira/browse/SPARK-51453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51453: --- Assignee: Mihailo Aleksic > Fix AssertTrue constructor so it uses toPrettySQL instead of si

[jira] [Created] (SPARK-51459) Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE`

Dongjoon Hyun created SPARK-51459: - Summary: Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE` Key: SPARK-51459 URL: https://issues.apache.org/jira/browse/SPARK-51459 Project: Spark Issue T

[jira] [Resolved] (SPARK-51457) Use R 4.4.3 in `windows` R GitHub Action Windows job

[ https://issues.apache.org/jira/browse/SPARK-51457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51457. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50229 [https://

[jira] [Resolved] (SPARK-51459) Add `merge_spark_pr.py` and `PULL_REQUEST_TEMPLATE`

[ https://issues.apache.org/jira/browse/SPARK-51459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51459. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 3 [https://gith

[jira] [Updated] (SPARK-51451) [UNSUPPORTED_GENERATOR.NESTED_IN_EXPRESSIONS] The generator is not supported: nested in expressions "unresolvedstarwithcolumns(explode(array(0, 1, 2, 3, 4, 5, 6, 7, 8, 9

[ https://issues.apache.org/jira/browse/SPARK-51451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-51451: --- Affects Version/s: 4.0.0 > [UNSUPPORTED_GENERATOR.NESTED_IN_EXPRESSIONS] The generator is not suppor

[jira] [Updated] (SPARK-51451) Regression: [UNSUPPORTED_GENERATOR.NESTED_IN_EXPRESSIONS] The generator is not supported: nested in expressions "unresolvedstarwithcolumns(explode(array(0, 1, 2, 3, 4, 5

[ https://issues.apache.org/jira/browse/SPARK-51451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-51451: --- Summary: Regression: [UNSUPPORTED_GENERATOR.NESTED_IN_EXPRESSIONS] The generator is not supported: n

[jira] [Commented] (SPARK-51431) Support full table scanning of partitioned table is prohibited

[ https://issues.apache.org/jira/browse/SPARK-51431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934103#comment-17934103 ] melin commented on SPARK-51431: --- [~gurwls223]  > Support full table scanning of partition

[jira] [Created] (SPARK-51463) Add `Spark Connect`-generated `Swift` code

Dongjoon Hyun created SPARK-51463: - Summary: Add `Spark Connect`-generated `Swift` code Key: SPARK-51463 URL: https://issues.apache.org/jira/browse/SPARK-51463 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-51464) unable-to-stop-spark-application-after-enabling-authentication

prikshit created SPARK-51464: Summary: unable-to-stop-spark-application-after-enabling-authentication Key: SPARK-51464 URL: https://issues.apache.org/jira/browse/SPARK-51464 Project: Spark Issue

[jira] [Updated] (SPARK-51464) unable-to-stop-spark-application-after-enabling-authentication

[ https://issues.apache.org/jira/browse/SPARK-51464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prikshit updated SPARK-51464: - Description: I have enabled authentication in my Spark standalone cluster by setting  {{spark.authentica

[jira] [Resolved] (SPARK-51445) Change the never changed 'var' to 'val'

[ https://issues.apache.org/jira/browse/SPARK-51445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51445. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50219 [https://github.com

[jira] [Resolved] (SPARK-51447) Add stringToTime and stringToTimeAnsi

[ https://issues.apache.org/jira/browse/SPARK-51447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51447. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50220 [https://github.com

[jira] [Assigned] (SPARK-51365) OOM occurred during macOS daily tests

[ https://issues.apache.org/jira/browse/SPARK-51365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51365: - Assignee: Yang Jie > OOM occurred during macOS daily tests > --

[jira] [Updated] (SPARK-51457) Use R 4.4.3 in `windows` R GitHub Action Windows job

[ https://issues.apache.org/jira/browse/SPARK-51457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51457: --- Labels: pull-request-available (was: ) > Use R 4.4.3 in `windows` R GitHub Action Windows j

[jira] [Assigned] (SPARK-51452) Improve Thread dump table search

[ https://issues.apache.org/jira/browse/SPARK-51452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51452: - Assignee: Kent Yao > Improve Thread dump table search > ---

[jira] [Updated] (SPARK-51450) BarrierCoordinator thread not exiting in Spark standalone mode

[ https://issues.apache.org/jira/browse/SPARK-51450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jayadeep Jayaraman updated SPARK-51450: --- Description: When `xgboost` or any framework that relies on `Barrier` stage runs in

[jira] [Updated] (SPARK-51318) Remove `jar` files from Apache Spark repository and disable affected tests

[ https://issues.apache.org/jira/browse/SPARK-51318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51318: --- Labels: pull-request-available (was: ) > Remove `jar` files from Apache Spark repository an

[jira] [Updated] (SPARK-51454) Support cast from time to string

[ https://issues.apache.org/jira/browse/SPARK-51454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51454: --- Labels: pull-request-available (was: ) > Support cast from time to string > ---

[jira] [Updated] (SPARK-51269) Simplify AvroCompressionCodec by removing defaultCompressionLevel

[ https://issues.apache.org/jira/browse/SPARK-51269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-51269: --- Summary: Simplify AvroCompressionCodec by removing defaultCompressionLevel (was: SQLConf should man

[jira] [Updated] (SPARK-51457) Use R 4.4.3 in `windows` R GitHub Action Windows job

[ https://issues.apache.org/jira/browse/SPARK-51457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51457: -- Summary: Use R 4.4.3 in `windows` R GitHub Action Windows job (was: Use R 4.4.2 in `windows`