[jira] [Created] (SPARK-53134) Clean up unused ANSI imports in tests

2025-08-05 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-53134: Summary: Clean up unused ANSI imports in tests Key: SPARK-53134 URL: https://issues.apache.org/jira/browse/SPARK-53134 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-52922) Avoid CAST_INVALID_INPUT of "astype" in ANSI mode

2025-08-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52922. -- Assignee: Xinrong Meng Resolution: Won't Fix > Avoid CAST_INVALID_INPUT of "astype" in A

[jira] [Updated] (SPARK-51982) Prepare and Configure Pandas API on Spark for ANSI Mode

2025-08-04 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-51982: - Summary: Prepare and Configure Pandas API on Spark for ANSI Mode (was: Pandas API on Spark supp

[jira] [Updated] (SPARK-52593) Avoid CAST_INVALID_INPUT of `MultiIndex.to_series`, `Series.dot` and `DataFrame.dot` in ANSI mode

2025-07-31 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52593: - Summary: Avoid CAST_INVALID_INPUT of `MultiIndex.to_series`, `Series.dot` and `DataFrame.dot` in

[jira] [Created] (SPARK-53050) MultiIndex.to_series() should return tuples for each entry

2025-07-31 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-53050: Summary: MultiIndex.to_series() should return tuples for each entry Key: SPARK-53050 URL: https://issues.apache.org/jira/browse/SPARK-53050 Project: Spark Is

[jira] [Resolved] (SPARK-52580) Avoid CAST_INVALID_INPUT of `replace` in ANSI mode

2025-07-31 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52580. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Resolved] (SPARK-52622) Avoid CAST_INVALID_INPUT of `DataFrame.melt` in ANSI mode

2025-07-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52622. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Deleted] (SPARK-52986) Exclude pandas numpy operand in comparison operators

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng deleted SPARK-52986: - > Exclude pandas numpy operand in comparison operators > --

[jira] [Resolved] (SPARK-52985) Raise TypeError for pandas numpy operand in comparison operators

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52985. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Assigned] (SPARK-52285) INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-52285: Assignee: Xinrong Meng > INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled >

[jira] [Resolved] (SPARK-52700) Dtype difference for Pandas on Spark in ANSI mode

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52700. -- Assignee: Xinrong Meng Resolution: Resolved > Dtype difference for Pandas on Spark in AN

[jira] [Resolved] (SPARK-52285) INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52285. -- Resolution: Resolved > INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled > ---

[jira] [Updated] (SPARK-52266) Arrow fails to infer the schema with string and int column when creating a DataFrame

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52266: - Parent Issue: SPARK-52984 (was: SPARK-52169) > Arrow fails to infer the schema with string and

[jira] [Updated] (SPARK-52332) Fix promotion from float32 to float64 during division

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52332: - Parent Issue: SPARK-52984 (was: SPARK-52169) > Fix promotion from float32 to float64 during div

[jira] [Deleted] (SPARK-52284) Enable divide-by-zero tests

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng deleted SPARK-52284: - > Enable divide-by-zero tests > --- > > Key: SPARK-52284 >

[jira] [Created] (SPARK-53005) Add ANSI Compliance to Pandas API on Spark

2025-07-29 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-53005: Summary: Add ANSI Compliance to Pandas API on Spark Key: SPARK-53005 URL: https://issues.apache.org/jira/browse/SPARK-53005 Project: Spark Issue Type: Umbrel

[jira] [Updated] (SPARK-52644) Return False for int and str comparison for __eq__ in non-ANSI mode

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52644: - Parent Issue: SPARK-52984 (was: SPARK-52556) > Return False for int and str comparison for __eq

[jira] [Resolved] (SPARK-52646) Avoid CAST_INVALID_INPUT of `__eq__` in ANSI mode

2025-07-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52646. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Updated] (SPARK-52985) Raise TypeError for pandas numpy operand in comparison operators

2025-07-28 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52985: - Summary: Raise TypeError for pandas numpy operand in comparison operators (was: Exclude pandas

[jira] [Created] (SPARK-52986) Exclude pandas numpy operand in comparison operators

2025-07-28 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52986: Summary: Exclude pandas numpy operand in comparison operators Key: SPARK-52986 URL: https://issues.apache.org/jira/browse/SPARK-52986 Project: Spark Issue Ty

[jira] [Created] (SPARK-52985) Exclude pandas numpy operand in comparison operators

2025-07-28 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52985: Summary: Exclude pandas numpy operand in comparison operators Key: SPARK-52985 URL: https://issues.apache.org/jira/browse/SPARK-52985 Project: Spark Issue Ty

[jira] [Created] (SPARK-52984) Pandas on Spark ANSI Off Improvement

2025-07-28 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52984: Summary: Pandas on Spark ANSI Off Improvement Key: SPARK-52984 URL: https://issues.apache.org/jira/browse/SPARK-52984 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-52948) Enable test_np_spark_compat_frame under ANSI

2025-07-24 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52948. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Created] (SPARK-52948) Enable test_np_spark_compat_frame under ANSI

2025-07-24 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52948: Summary: Enable test_np_spark_compat_frame under ANSI Key: SPARK-52948 URL: https://issues.apache.org/jira/browse/SPARK-52948 Project: Spark Issue Type: Sub-

[jira] [Resolved] (SPARK-52570) Enable divide-by-zero for numeric rmod with ANSI enabled

2025-07-24 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52570. -- Assignee: Xinrong Meng Resolution: Fixed > Enable divide-by-zero for numeric rmod with

[jira] [Created] (SPARK-52922) Avoid CAST_INVALID_INPUT of "astype" in ANSI mode

2025-07-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52922: Summary: Avoid CAST_INVALID_INPUT of "astype" in ANSI mode Key: SPARK-52922 URL: https://issues.apache.org/jira/browse/SPARK-52922 Project: Spark Issue Type:

[jira] [Updated] (SPARK-52920) Improve memory profiler doc to clarify generator UDFs are unsupported

2025-07-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52920: - Summary: Improve memory profiler doc to clarify generator UDFs are unsupported (was: Improve do

[jira] [Created] (SPARK-52920) Improve doc of memory profiler

2025-07-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52920: Summary: Improve doc of memory profiler Key: SPARK-52920 URL: https://issues.apache.org/jira/browse/SPARK-52920 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52644) Return False for int and str comparison for __eq__ in non-ANSI mode

2025-07-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52644: - Summary: Return False for int and str comparison for __eq__ in non-ANSI mode (was: astype("obje

[jira] [Updated] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv`

2025-07-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52771: - Summary: Fix float32 type widening in `truediv`/`floordiv` (was: Fix float32 type widening in `

[jira] [Resolved] (SPARK-52711) Fix float32 type widening in `mul`/`rmul` under ANSI

2025-07-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52711. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Created] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv` under ANSI

2025-07-11 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52771: Summary: Fix float32 type widening in `truediv`/`floordiv` under ANSI Key: SPARK-52771 URL: https://issues.apache.org/jira/browse/SPARK-52771 Project: Spark

[jira] [Resolved] (SPARK-52760) Fix float32 type widening in `sub`/`rsub` under ANSI

2025-07-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52760. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Updated] (SPARK-52711) Fix float32 type widening in `mul`/`rmul` under ANSI

2025-07-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52711: - Component/s: (was: Tests) > Fix float32 type widening in `mul`/`rmul` under ANSI > -

[jira] [Resolved] (SPARK-52720) Fix float32 type widening in `add`/`radd` under ANSI

2025-07-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52720. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Updated] (SPARK-52711) Fix float32 type widening in `mul`/`rmul` under ANSI

2025-07-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52711: - Summary: Fix float32 type widening in `mul`/`rmul` under ANSI (was: Enable test_extension_float

[jira] [Created] (SPARK-52760) Fix float32 type widening in `sub`/`rsub` under ANSI

2025-07-10 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52760: Summary: Fix float32 type widening in `sub`/`rsub` under ANSI Key: SPARK-52760 URL: https://issues.apache.org/jira/browse/SPARK-52760 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-52718) Fix float32 type widening in `rmod`/`mod` under ANSI

2025-07-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52718. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Created] (SPARK-52720) Fix float32 type widening in `add`/`radd` under ANSI

2025-07-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52720: Summary: Fix float32 type widening in `add`/`radd` under ANSI Key: SPARK-52720 URL: https://issues.apache.org/jira/browse/SPARK-52720 Project: Spark Issue Ty

[jira] [Created] (SPARK-52718) Fix float32 type widening in `rmod` under ANSI

2025-07-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52718: Summary: Fix float32 type widening in `rmod` under ANSI Key: SPARK-52718 URL: https://issues.apache.org/jira/browse/SPARK-52718 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-52718) Fix float32 type widening in `rmod`/`mod` under ANSI

2025-07-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52718: - Summary: Fix float32 type widening in `rmod`/`mod` under ANSI (was: Fix float32 type widening i

[jira] [Resolved] (SPARK-52701) Fix float32 type widening in `mod` with bool under ANSI

2025-07-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52701. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Created] (SPARK-52711) Enable test_extension_float_dtypes with ANSI

2025-07-08 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52711: Summary: Enable test_extension_float_dtypes with ANSI Key: SPARK-52711 URL: https://issues.apache.org/jira/browse/SPARK-52711 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-52701) Fix float32 type widening in `mod` with bool under ANSI

2025-07-07 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52701: Summary: Fix float32 type widening in `mod` with bool under ANSI Key: SPARK-52701 URL: https://issues.apache.org/jira/browse/SPARK-52701 Project: Spark Issue

[jira] [Updated] (SPARK-52700) Dtype difference for Pandas on Spark

2025-07-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52700: - Summary: Dtype difference for Pandas on Spark (was: Dtype difference) > Dtype difference for P

[jira] [Updated] (SPARK-52700) Dtype difference for Pandas on Spark in ANSI mode

2025-07-07 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52700: - Summary: Dtype difference for Pandas on Spark in ANSI mode (was: Dtype difference for Pandas on

[jira] [Created] (SPARK-52700) Dtype difference

2025-07-07 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52700: Summary: Dtype difference Key: SPARK-52700 URL: https://issues.apache.org/jira/browse/SPARK-52700 Project: Spark Issue Type: Umbrella Components: P

[jira] [Created] (SPARK-52646) Avoid CAST_INVALID_INPUT of `__eq__` in ANSI mode

2025-07-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52646: Summary: Avoid CAST_INVALID_INPUT of `__eq__` in ANSI mode Key: SPARK-52646 URL: https://issues.apache.org/jira/browse/SPARK-52646 Project: Spark Issue Type:

[jira] [Created] (SPARK-52644) astype("object") is unsupported

2025-07-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52644: Summary: astype("object") is unsupported Key: SPARK-52644 URL: https://issues.apache.org/jira/browse/SPARK-52644 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52593) Avoid CAST_INVALID_INPUT of `Series.dot` and `DataFrame.dot` in ANSI mode

2025-06-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52593: - Summary: Avoid CAST_INVALID_INPUT of `Series.dot` and `DataFrame.dot` in ANSI mode (was: Avoid

[jira] [Updated] (SPARK-52622) Avoid CAST_INVALID_INPUT of `DataFrame.melt` in ANSI mode

2025-06-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52622: - Summary: Avoid CAST_INVALID_INPUT of `DataFrame.melt` in ANSI mode (was: Avoid CAST_INVALID_INP

[jira] [Updated] (SPARK-52593) Avoid CAST_INVALID_INPUT of `Series.dot` and "DataFrame.dot" in ANSI mode

2025-06-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52593: - Summary: Avoid CAST_INVALID_INPUT of `Series.dot` and "DataFrame.dot" in ANSI mode (was: Avoid

[jira] [Created] (SPARK-52622) Avoid CAST_INVALID_INPUT of `DataFrame.dot` in ANSI mode

2025-06-30 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52622: Summary: Avoid CAST_INVALID_INPUT of `DataFrame.dot` in ANSI mode Key: SPARK-52622 URL: https://issues.apache.org/jira/browse/SPARK-52622 Project: Spark Issu

[jira] [Resolved] (SPARK-52570) Enable divide-by-zero for numeric rmod with ANSI enabled

2025-06-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52570. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Created] (SPARK-52593) Avoid CAST_INVALID_INPUT of `Series.dot` in ANSI mode

2025-06-26 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52593: Summary: Avoid CAST_INVALID_INPUT of `Series.dot` in ANSI mode Key: SPARK-52593 URL: https://issues.apache.org/jira/browse/SPARK-52593 Project: Spark Issue T

[jira] [Created] (SPARK-52580) Avoid CAST_INVALID_INPUT of `replace` in ANSI mode

2025-06-25 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52580: Summary: Avoid CAST_INVALID_INPUT of `replace` in ANSI mode Key: SPARK-52580 URL: https://issues.apache.org/jira/browse/SPARK-52580 Project: Spark Issue Type

[jira] [Resolved] (SPARK-52572) Avoid CAST_INVALID_INPUT of DataFrame.isin in ANSI mode

2025-06-25 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52572. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Created] (SPARK-52570) Enable divide-by-zero for numeric rmod with ANSI enabled

2025-06-24 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52570: Summary: Enable divide-by-zero for numeric rmod with ANSI enabled Key: SPARK-52570 URL: https://issues.apache.org/jira/browse/SPARK-52570 Project: Spark Iss

[jira] [Updated] (SPARK-52572) Avoid CAST_INVALID_INPUT of DataFrame.isin in ANSI mode

2025-06-24 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52572: - Summary: Avoid CAST_INVALID_INPUT of DataFrame.isin in ANSI mode (was: Avoid CAST_INVALID_INPUT

[jira] [Resolved] (SPARK-52557) Avoid CAST_INVALID_INPUT of to_numeric(errors='coerce') in ANSI mode

2025-06-24 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52557. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Created] (SPARK-52572) Avoid CAST_INVALID_INPUT of DataFrame.isin

2025-06-24 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52572: Summary: Avoid CAST_INVALID_INPUT of DataFrame.isin Key: SPARK-52572 URL: https://issues.apache.org/jira/browse/SPARK-52572 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-52249) Enable divide-by-zero for numeric truediv with ANSI enabled

2025-06-24 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52249: - Summary: Enable divide-by-zero for numeric truediv with ANSI enabled (was: Enable divide-by-zer

[jira] [Created] (SPARK-52557) Avoid CAST_INVALID_INPUT of to_numeric(errors='coerce') in ANSI mode

2025-06-23 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52557: Summary: Avoid CAST_INVALID_INPUT of to_numeric(errors='coerce') in ANSI mode Key: SPARK-52557 URL: https://issues.apache.org/jira/browse/SPARK-52557 Project: Spark

[jira] [Created] (SPARK-52556) CAST_INVALID_INPUT for Pandas on Spark in ANSI mode

2025-06-23 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52556: Summary: CAST_INVALID_INPUT for Pandas on Spark in ANSI mode Key: SPARK-52556 URL: https://issues.apache.org/jira/browse/SPARK-52556 Project: Spark Issue Typ

[jira] [Updated] (SPARK-52349) Enable divide-by-zero for boolean division with ANSI enabled

2025-06-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52349: - Summary: Enable divide-by-zero for boolean division with ANSI enabled (was: Enable divide-by-ze

[jira] [Updated] (SPARK-52349) Enable boolean division tests with ANSI enabled

2025-06-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52349: - Summary: Enable boolean division tests with ANSI enabled (was: Enable divide-by-zero for boolea

[jira] [Resolved] (SPARK-52519) Enable divide-by-zero for numeric floordiv with ANSI enabled

2025-06-20 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52519. -- Assignee: Xinrong Meng Resolution: Fixed Resolved by https://github.com/apache/spark/pul

[jira] [Created] (SPARK-52528) Enable divide-by-zero for numeric mod with ANSI enabled

2025-06-18 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52528: Summary: Enable divide-by-zero for numeric mod with ANSI enabled Key: SPARK-52528 URL: https://issues.apache.org/jira/browse/SPARK-52528 Project: Spark Issu

[jira] [Resolved] (SPARK-52402) Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode

2025-06-17 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52402. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Updated] (SPARK-52169) Enable divide-by-zero with ANSI enabled

2025-06-17 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52169: - Summary: Enable divide-by-zero with ANSI enabled (was: Enable divide-by-zero for numeric truedi

[jira] [Created] (SPARK-52519) Enable divide-by-zero for numeric floordiv with ANSI enabled

2025-06-17 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52519: Summary: Enable divide-by-zero for numeric floordiv with ANSI enabled Key: SPARK-52519 URL: https://issues.apache.org/jira/browse/SPARK-52519 Project: Spark

[jira] [Updated] (SPARK-52394) Enable DIVIDE_BY_ZERO for autocorrelation

2025-06-16 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52394: - Summary: Enable DIVIDE_BY_ZERO for autocorrelation (was: Enable DIVIDE_BY_ZERO for correlation)

[jira] [Updated] (SPARK-52394) Fix autocorr divide-by-zero error under ANSI mode

2025-06-16 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52394: - Summary: Fix autocorr divide-by-zero error under ANSI mode (was: Enable DIVIDE_BY_ZERO for auto

[jira] [Updated] (SPARK-52402) Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode

2025-06-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52402: - Summary: Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode (was: Fix

[jira] [Created] (SPARK-52402) Fix divide-by-zero error in groupby().corr('kendall') with ANSI mode enabled

2025-06-04 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52402: Summary: Fix divide-by-zero error in groupby().corr('kendall') with ANSI mode enabled Key: SPARK-52402 URL: https://issues.apache.org/jira/browse/SPARK-52402 Project:

[jira] [Created] (SPARK-52394) Enable DIVIDE_BY_ZERO for correlation

2025-06-03 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52394: Summary: Enable DIVIDE_BY_ZERO for correlation Key: SPARK-52394 URL: https://issues.apache.org/jira/browse/SPARK-52394 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52169) Enable divide-by-zero for numeric truediv with ANSI enabled

2025-05-30 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52169: - Summary: Enable divide-by-zero for numeric truediv with ANSI enabled (was: Enable divide-by-zer

[jira] [Created] (SPARK-52356) Enable divide-by-zero for boolean mod/rmod with ANSI enabled

2025-05-30 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52356: Summary: Enable divide-by-zero for boolean mod/rmod with ANSI enabled Key: SPARK-52356 URL: https://issues.apache.org/jira/browse/SPARK-52356 Project: Spark

[jira] [Created] (SPARK-52349) Enable divide-by-zero test cases

2025-05-29 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52349: Summary: Enable divide-by-zero test cases Key: SPARK-52349 URL: https://issues.apache.org/jira/browse/SPARK-52349 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-52331) Adjust test for promotion from float32 to float64 during division

2025-05-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52331. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Updated] (SPARK-52332) Fix promotion from float32 to float64 during division

2025-05-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52332: - Description: {{>>> ps.set_option("compute.fail_on_ansi_mode", False)}} {{>>> spark.conf.set("spa

[jira] [Created] (SPARK-52332) Fix promotion from float32 to float64 during division

2025-05-27 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52332: Summary: Fix promotion from float32 to float64 during division Key: SPARK-52332 URL: https://issues.apache.org/jira/browse/SPARK-52332 Project: Spark Issue T

[jira] [Created] (SPARK-52331) Adjust test for promotion from float32 to float64 during division

2025-05-27 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52331: Summary: Adjust test for promotion from float32 to float64 during division Key: SPARK-52331 URL: https://issues.apache.org/jira/browse/SPARK-52331 Project: Spark

[jira] [Resolved] (SPARK-52270) User guide for native plotting

2025-05-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52270. -- Resolution: Resolved Resolved by https://github.com/apache/spark/pull/50992 > User guide for

[jira] [Resolved] (SPARK-52264) Test divide-by-zero behavior with more numeric data types

2025-05-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52264. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Assigned] (SPARK-52270) User guide for native plotting

2025-05-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-52270: Assignee: Xinrong Meng > User guide for native plotting > --

[jira] [Created] (SPARK-52288) Avoid INVALID_ARRAY_INDEX in split when ANSI mode is on

2025-05-23 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52288: Summary: Avoid INVALID_ARRAY_INDEX in split when ANSI mode is on Key: SPARK-52288 URL: https://issues.apache.org/jira/browse/SPARK-52288 Project: Spark Issu

[jira] [Updated] (SPARK-52285) INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled

2025-05-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52285: - Summary: INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled (was: Resolve INVALID_ARRAY_

[jira] [Updated] (SPARK-52285) Resolve INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled

2025-05-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52285: - Summary: Resolve INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled (was: Fix INVALID_AR

[jira] [Created] (SPARK-52285) Fix INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled

2025-05-23 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52285: Summary: Fix INVALID_ARRAY_INDEX for Pandas on Spark with ANSI enabled Key: SPARK-52285 URL: https://issues.apache.org/jira/browse/SPARK-52285 Project: Spark

[jira] [Updated] (SPARK-52284) Enable divide-by-zero tests

2025-05-23 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52284: - Summary: Enable divide-by-zero tests (was: Fix divide-by-zero tests) > Enable divide-by-zero te

[jira] [Created] (SPARK-52284) Fix divide-by-zero tests

2025-05-23 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52284: Summary: Fix divide-by-zero tests Key: SPARK-52284 URL: https://issues.apache.org/jira/browse/SPARK-52284 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-52270) User guide for native plotting

2025-05-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52270: Summary: User guide for native plotting Key: SPARK-52270 URL: https://issues.apache.org/jira/browse/SPARK-52270 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52266) Arrow fails to infer the schema with string and int column when creating a DataFrame

2025-05-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52266: - Description: {code:java} >>> pdf = pd.DataFrame({"a": ["x"], "b": [0]}) >>> pdf    a  b 0  x  0

[jira] [Created] (SPARK-52266) Arrow fails to infer the schema with string and int column when creating a DataFrame

2025-05-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52266: Summary: Arrow fails to infer the schema with string and int column when creating a DataFrame Key: SPARK-52266 URL: https://issues.apache.org/jira/browse/SPARK-52266

[jira] [Commented] (SPARK-52266) Arrow fails to infer the schema with string and int column when creating a DataFrame

2025-05-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953529#comment-17953529 ] Xinrong Meng commented on SPARK-52266: -- numpy version might be the cause > Arrow f

[jira] [Updated] (SPARK-52264) Test divide-by-zero behavior with more numeric data types

2025-05-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52264: - Summary: Test divide-by-zero behavior with more numeric data types (was: Test divide-by-zero be

[jira] [Created] (SPARK-52264) Test divide-by-zero behavior with more data types

2025-05-22 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52264: Summary: Test divide-by-zero behavior with more data types Key: SPARK-52264 URL: https://issues.apache.org/jira/browse/SPARK-52264 Project: Spark Issue Type:

[jira] [Created] (SPARK-52249) Enable divide-by-zero with ANSI enabled

2025-05-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52249: Summary: Enable divide-by-zero with ANSI enabled Key: SPARK-52249 URL: https://issues.apache.org/jira/browse/SPARK-52249 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-52145) Add tests for mapInPandas schema mismatch

2025-05-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52145. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

  1   2   3   4   5   6   7   8   9   10   >