[jira] [Resolved] (SPARK-43502) DataFrame.drop should support empty column

[ https://issues.apache.org/jira/browse/SPARK-43502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43502. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41180 [https://

[jira] [Updated] (SPARK-43504) [K8S] Mounts the hadoop config map on the executor pod

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-43504: - Summary: [K8S] Mounts the hadoop config map on the executor pod (was: [K8S] Mount hadoop config map in

[jira] [Updated] (SPARK-43504) [K8S] Mounts the hadoop config map on the executor pod

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-43504: - Description: Since SPARK-25815 [,|https://github.com/apache/spark/pull/22911,] the hadoop config map wi

[jira] [Created] (SPARK-43520) Upgrade mysql-connector-java from 8.0.32 to 8.0.33

BingKun Pan created SPARK-43520: --- Summary: Upgrade mysql-connector-java from 8.0.32 to 8.0.33 Key: SPARK-43520 URL: https://issues.apache.org/jira/browse/SPARK-43520 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43488) bitmap function

[ https://issues.apache.org/jira/browse/SPARK-43488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43488: - Labels: (was: patch) > bitmap function > --- > > Key: SPARK-43488

[jira] [Commented] (SPARK-43501) `test_ops_on_diff_frames_*` are much slower on Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722969#comment-17722969 ] Hyukjin Kwon commented on SPARK-43501: -- cc [~itholic] > `test_ops_on_diff_frames_*

[jira] [Resolved] (SPARK-43483) Adds SQL references for OFFSET clause.

[ https://issues.apache.org/jira/browse/SPARK-43483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43483. -- Fix Version/s: 3.5.0 Assignee: jiaan.geng Resolution: Fixed > Adds SQL referen

[jira] [Commented] (SPARK-43483) Adds SQL references for OFFSET clause.

[ https://issues.apache.org/jira/browse/SPARK-43483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722968#comment-17722968 ] Hyukjin Kwon commented on SPARK-43483: -- Fixed in https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-43482) Expand QueryTerminatedEvent to contain error class if it exists in exception

[ https://issues.apache.org/jira/browse/SPARK-43482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43482. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41150 [https://gi

[jira] [Assigned] (SPARK-43482) Expand QueryTerminatedEvent to contain error class if it exists in exception

[ https://issues.apache.org/jira/browse/SPARK-43482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43482: Assignee: Jungtaek Lim > Expand QueryTerminatedEvent to contain error class if it exists

[jira] [Created] (SPARK-43519) Bump Parquet 1.13.1

Cheng Pan created SPARK-43519: - Summary: Bump Parquet 1.13.1 Key: SPARK-43519 URL: https://issues.apache.org/jira/browse/SPARK-43519 Project: Spark Issue Type: Improvement Components: B

[jira] [Resolved] (SPARK-43517) Add a migration guide for namedtuple monkey patch

[ https://issues.apache.org/jira/browse/SPARK-43517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43517. -- Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-43517) Add a migration guide for namedtuple monkey patch

[ https://issues.apache.org/jira/browse/SPARK-43517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43517: Assignee: Hyukjin Kwon > Add a migration guide for namedtuple monkey patch >

[jira] [Assigned] (SPARK-43473) Support struct type in createDataFrame from pandas DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43473: Assignee: Takuya Ueshin > Support struct type in createDataFrame from pandas DataFrame >

[jira] [Resolved] (SPARK-43473) Support struct type in createDataFrame from pandas DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43473. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41149 [https://gi

[jira] [Created] (SPARK-43518) Convert `_LEGACY_ERROR_TEMP_2029` to INTERNAL_ERROR

BingKun Pan created SPARK-43518: --- Summary: Convert `_LEGACY_ERROR_TEMP_2029` to INTERNAL_ERROR Key: SPARK-43518 URL: https://issues.apache.org/jira/browse/SPARK-43518 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Description: We designed a function that joins two DFs on common column with some

[jira] [Resolved] (SPARK-43300) Cascade failure in Guava cache due to fate-sharing

[ https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-43300. Fix Version/s: 3.5.0 Resolution: Fixed > Cascade failure in Guava cache due to fate-sharing

[jira] [Commented] (SPARK-43300) Cascade failure in Guava cache due to fate-sharing

[ https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722959#comment-17722959 ] Josh Rosen commented on SPARK-43300: Fixed in https://github.com/apache/spark/pull/4

[jira] [Assigned] (SPARK-43300) Cascade failure in Guava cache due to fate-sharing

[ https://issues.apache.org/jira/browse/SPARK-43300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-43300: -- Assignee: Ziqi Liu > Cascade failure in Guava cache due to fate-sharing > ---

[jira] [Resolved] (SPARK-43281) Fix concurrent writer does not update file metrics

[ https://issues.apache.org/jira/browse/SPARK-43281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43281. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-43281) Fix concurrent writer does not update file metrics

[ https://issues.apache.org/jira/browse/SPARK-43281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43281: --- Assignee: XiDuo You > Fix concurrent writer does not update file metrics >

[jira] [Assigned] (SPARK-43413) IN subquery ListQuery has wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43413: --- Assignee: Jack Chen > IN subquery ListQuery has wrong nullability > ---

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Summary: Unexpected NullPointerException or IllegalArgumentException inside UDFs o

[jira] [Resolved] (SPARK-43413) IN subquery ListQuery has wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43413. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41094 [https://gith

[jira] [Updated] (SPARK-43517) Add a migration guide for namedtuple monkey patch

[ https://issues.apache.org/jira/browse/SPARK-43517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43517: - Priority: Minor (was: Major) > Add a migration guide for namedtuple monkey patch >

[jira] [Created] (SPARK-43517) Add a migration guide for namedtuple monkey patch

Hyukjin Kwon created SPARK-43517: Summary: Add a migration guide for namedtuple monkey patch Key: SPARK-43517 URL: https://issues.apache.org/jira/browse/SPARK-43517 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-43516) Basic estimator / transformer / model / evaluator interfaces

[ https://issues.apache.org/jira/browse/SPARK-43516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43516: -- Assignee: Weichen Xu > Basic estimator / transformer / model / evaluator interfaces > ---

[jira] [Created] (SPARK-43516) Basic estimator / transformer / model / evaluator interfaces

Weichen Xu created SPARK-43516: -- Summary: Basic estimator / transformer / model / evaluator interfaces Key: SPARK-43516 URL: https://issues.apache.org/jira/browse/SPARK-43516 Project: Spark Iss

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features on empty data frames caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Environment: Scala version: 2.12.17 Test examples was executed inside Zeppelin 0.

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features on empty data frames caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Environment: Scala version: 2.12.17 Test examples were executed inside Zeppelin 0

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features on empty data frames caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Environment: Scala version: 2.12.17 Test examples was executed inside Zeppelin 0.

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features on empty data frames caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Summary: Unexpected NullPointerException or IllegalArgumentException inside UDFs o

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Description: We designed a function that joins two DFs on common column with some

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Description: We designed a function that joins two DFs on common column with some

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Description: We designed a function that joins two DFs on common column with some

[jira] [Created] (SPARK-43515) Add a benchmark to evaluate the performance of migrating a large number of tiny blocks during decommission

Xingbo Jiang created SPARK-43515: Summary: Add a benchmark to evaluate the performance of migrating a large number of tiny blocks during decommission Key: SPARK-43515 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Svyatoslav Semenyuk updated SPARK-43514: Description: We designed a function that joins two DFs on common column with some

[jira] [Created] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

Svyatoslav Semenyuk created SPARK-43514: --- Summary: Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions Key: SPARK-43514 URL: https://issues

[jira] [Updated] (SPARK-43513) withColumnRenamed duplicates columns if new column already exists

[ https://issues.apache.org/jira/browse/SPARK-43513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederik Paradis updated SPARK-43513: - Summary: withColumnRenamed duplicates columns if new column already exists (was: withCo

[jira] [Created] (SPARK-43513) withColumnRenamed duplicate columns if new column already exist

Frederik Paradis created SPARK-43513: Summary: withColumnRenamed duplicate columns if new column already exist Key: SPARK-43513 URL: https://issues.apache.org/jira/browse/SPARK-43513 Project: Spar

[jira] [Updated] (SPARK-43513) withColumnRenamed duplicates columns if new column already exist

[ https://issues.apache.org/jira/browse/SPARK-43513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederik Paradis updated SPARK-43513: - Summary: withColumnRenamed duplicates columns if new column already exist (was: withCol

[jira] [Created] (SPARK-43512) Update stateStoreOperationsBenchmark to allow rocksdb jni upgrade

Anish Shrigondekar created SPARK-43512: -- Summary: Update stateStoreOperationsBenchmark to allow rocksdb jni upgrade Key: SPARK-43512 URL: https://issues.apache.org/jira/browse/SPARK-43512 Project

[jira] [Commented] (SPARK-43205) Add an IDENTIFIER(stringLiteral) clause that maps a string to an identifier

[ https://issues.apache.org/jira/browse/SPARK-43205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722894#comment-17722894 ] Hudson commented on SPARK-43205: User 'srielau' has created a pull request for this issu

[jira] [Commented] (SPARK-43511) Implemented State APIs for Spark Connect Scala

[ https://issues.apache.org/jira/browse/SPARK-43511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722891#comment-17722891 ] Bo Gao commented on SPARK-43511: Created PR https://github.com/apache/spark/pull/40959

[jira] [Created] (SPARK-43511) Implemented State APIs for Spark Connect Scala

Bo Gao created SPARK-43511: -- Summary: Implemented State APIs for Spark Connect Scala Key: SPARK-43511 URL: https://issues.apache.org/jira/browse/SPARK-43511 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-43442) Split test module `pyspark_pandas_connect`

[ https://issues.apache.org/jira/browse/SPARK-43442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43442. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41127 [https://

[jira] [Assigned] (SPARK-43442) Split test module `pyspark_pandas_connect`

[ https://issues.apache.org/jira/browse/SPARK-43442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43442: - Assignee: Ruifeng Zheng > Split test module `pyspark_pandas_connect` >

[jira] [Updated] (SPARK-43510) Spark application hangs when YarnAllocator adds running executors after processing completed containers

[ https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-43510: --- Summary: Spark application hangs when YarnAllocator adds running executors after processing complete

[jira] [Updated] (SPARK-43510) Spark application hangs when YarnAllocator adding running executors after processing completed containers

[ https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-43510: --- Description: I see application hangs when containers are preempted immediately after allocation as

[jira] [Updated] (SPARK-43510) Spark application hangs when YarnAllocator adding running executors after processing completed containers

[ https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-43510: --- Summary: Spark application hangs when YarnAllocator adding running executors after processing comple

[jira] [Updated] (SPARK-43510) Spark application hangs when YarnAllocator processing completed containers before updating internal state

[ https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-43510: --- Description: I see application hangs when containers are preempted immediately after allocation as

[jira] [Assigned] (SPARK-43494) Directly call `replicate()` instead of reflection in `SparkHadoopUtil#createFile`

[ https://issues.apache.org/jira/browse/SPARK-43494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43494: Assignee: Yang Jie > Directly call `replicate()` instead of reflection in > `SparkHadoopUtil#cre

[jira] [Resolved] (SPARK-43494) Directly call `replicate()` instead of reflection in `SparkHadoopUtil#createFile`

[ https://issues.apache.org/jira/browse/SPARK-43494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43494. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41164 [https://github.com

[jira] [Created] (SPARK-43510) Spark application hangs when YarnAllocator processing completed containers before updating internal state

Manu Zhang created SPARK-43510: -- Summary: Spark application hangs when YarnAllocator processing completed containers before updating internal state Key: SPARK-43510 URL: https://issues.apache.org/jira/browse/SPARK-43

[jira] [Resolved] (SPARK-43223) KeyValueGroupedDataset#agg

[ https://issues.apache.org/jira/browse/SPARK-43223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43223. --- Fix Version/s: 3.5.0 Assignee: Zhen Li Resolution: Fixed > KeyValueG

[jira] [Updated] (SPARK-43461) Skip compiling useless files when making distribution

[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Summary: Skip compiling useless files when making distribution (was: Skip compiling javadoc.jar a

[jira] [Assigned] (SPARK-43508) Replace the link related to hadoop version 2 with hadoop version 3

[ https://issues.apache.org/jira/browse/SPARK-43508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-43508: Assignee: BingKun Pan > Replace the link related to hadoop version 2 with hadoop version

[jira] [Updated] (SPARK-43508) Replace the link related to hadoop version 2 with hadoop version 3

[ https://issues.apache.org/jira/browse/SPARK-43508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43508: - Priority: Trivial (was: Minor) > Replace the link related to hadoop version 2 with hadoop versi

[jira] [Resolved] (SPARK-43508) Replace the link related to hadoop version 2 with hadoop version 3

[ https://issues.apache.org/jira/browse/SPARK-43508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43508. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41171 [https://gi

[jira] [Created] (SPARK-43509) Support creating multiple sessions for Spark Connect in PySpark

Martin Grund created SPARK-43509: Summary: Support creating multiple sessions for Spark Connect in PySpark Key: SPARK-43509 URL: https://issues.apache.org/jira/browse/SPARK-43509 Project: Spark

[jira] [Updated] (SPARK-43495) Upgrade RoaringBitmap to 0.9.44

[ https://issues.apache.org/jira/browse/SPARK-43495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43495: - Priority: Minor (was: Major) > Upgrade RoaringBitmap to 0.9.44 > --

[jira] [Resolved] (SPARK-43495) Upgrade RoaringBitmap to 0.9.44

[ https://issues.apache.org/jira/browse/SPARK-43495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43495. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41165 [https://gi

[jira] [Assigned] (SPARK-43495) Upgrade RoaringBitmap to 0.9.44

[ https://issues.apache.org/jira/browse/SPARK-43495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-43495: Assignee: Yang Jie > Upgrade RoaringBitmap to 0.9.44 > --- >

[jira] [Commented] (SPARK-43359) DELETE from Hive table result in INTERNAL error

[ https://issues.apache.org/jira/browse/SPARK-43359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722759#comment-17722759 ] BingKun Pan commented on SPARK-43359: - Let me fix it. > DELETE from Hive table resu

[jira] [Updated] (SPARK-43508) Replace the link related to hadoop version 2 with hadoop version 3

[ https://issues.apache.org/jira/browse/SPARK-43508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43508: Summary: Replace the link related to hadoop version 2 with hadoop version 3 (was: Replace the lin

[jira] [Updated] (SPARK-43508) Replace the link related to hadoop version 2 with Hadoop version 3

[ https://issues.apache.org/jira/browse/SPARK-43508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43508: Summary: Replace the link related to hadoop version 2 with Hadoop version 3 (was: Replace the lin

[jira] [Created] (SPARK-43508) Replace the link related to Hadoop version 2 with Hadoop version 3

BingKun Pan created SPARK-43508: --- Summary: Replace the link related to Hadoop version 2 with Hadoop version 3 Key: SPARK-43508 URL: https://issues.apache.org/jira/browse/SPARK-43508 Project: Spark

[jira] [Commented] (SPARK-43485) Confused errors from the DATEADD function

[ https://issues.apache.org/jira/browse/SPARK-43485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722749#comment-17722749 ] Nikita Awasthi commented on SPARK-43485: User 'MaxGekk' has created a pull reque

[jira] [Resolved] (SPARK-43485) Confused errors from the DATEADD function

[ https://issues.apache.org/jira/browse/SPARK-43485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43485. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41143 [https://github.com

[jira] [Comment Edited] (SPARK-43493) Add a max distance argument to the levenshtein() function

[ https://issues.apache.org/jira/browse/SPARK-43493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722720#comment-17722720 ] BingKun Pan edited comment on SPARK-43493 at 5/15/23 9:46 AM:

[jira] [Commented] (SPARK-43493) Add a max distance argument to the levenshtein() function

[ https://issues.apache.org/jira/browse/SPARK-43493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722720#comment-17722720 ] BingKun Pan commented on SPARK-43493: - Let me implements it at `sql` first, I will i

[jira] [Commented] (SPARK-43493) Add a max distance argument to the levenshtein() function

[ https://issues.apache.org/jira/browse/SPARK-43493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722713#comment-17722713 ] ASF GitHub Bot commented on SPARK-43493: User 'panbingkun' has created a pull re

[jira] [Resolved] (SPARK-43500) Test `DataFrame.drop` with empty column list and names containing dot

[ https://issues.apache.org/jira/browse/SPARK-43500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43500. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41167 [https://

[jira] [Assigned] (SPARK-43500) Test `DataFrame.drop` with empty column list and names containing dot

[ https://issues.apache.org/jira/browse/SPARK-43500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43500: - Assignee: Ruifeng Zheng > Test `DataFrame.drop` with empty column list and names contai

[jira] [Created] (SPARK-43507) The status of free pages in allocatedPages mismatch with pageTable after invoking TaskMemoryManager::cleanUpAllAllocatedMemory

qian heng created SPARK-43507: - Summary: The status of free pages in allocatedPages mismatch with pageTable after invoking TaskMemoryManager::cleanUpAllAllocatedMemory Key: SPARK-43507 URL: https://issues.apache.org/j

[jira] [Updated] (SPARK-43507) The status of free pages in allocatedPages mismatch with pageTable after invoking TaskMemoryManager::cleanUpAllAllocatedMemory

[ https://issues.apache.org/jira/browse/SPARK-43507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian heng updated SPARK-43507: -- External issue URL: (was: https://github.com/apache/spark/pull/40974) > The status of free pages in

[jira] [Created] (SPARK-43506) Enable ArrowTests.test_toPandas_empty_columns for pandas 2.0.0.

Haejoon Lee created SPARK-43506: --- Summary: Enable ArrowTests.test_toPandas_empty_columns for pandas 2.0.0. Key: SPARK-43506 URL: https://issues.apache.org/jira/browse/SPARK-43506 Project: Spark

[jira] [Created] (SPARK-43505) spark on k8s supports spark.executor.extraLibraryPath

YE created SPARK-43505: -- Summary: spark on k8s supports spark.executor.extraLibraryPath Key: SPARK-43505 URL: https://issues.apache.org/jira/browse/SPARK-43505 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-43504) [K8S] Mount hadoop config map in executor side

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-43504: - Description: Since SPARK-25815 [,|https://github.com/apache/spark/pull/22911,] the hadoop config map is

[jira] [Updated] (SPARK-43504) [K8S] Mount hadoop config map in executor side

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-43504: - Description: Since SPARK-25815 [,|https://github.com/apache/spark/pull/22911,] the hadoop config map is

[jira] [Commented] (SPARK-43504) [K8S] Mount hadoop config map in executor side

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722674#comment-17722674 ] Fei Wang commented on SPARK-43504: -- gentle ping [~vanzin]  [~dongjoon] [~ifilonenko] 

[jira] [Updated] (SPARK-43504) [K8S] Mount hadoop config map in executor side

[ https://issues.apache.org/jira/browse/SPARK-43504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-43504: - Description: Since SPARK-25815 [,|https://github.com/apache/spark/pull/22911,] the hadoop config map is

[jira] [Created] (SPARK-43504) [K8S] Mount hadoop config map in executor side

Fei Wang created SPARK-43504: Summary: [K8S] Mount hadoop config map in executor side Key: SPARK-43504 URL: https://issues.apache.org/jira/browse/SPARK-43504 Project: Spark Issue Type: Improvemen