issues  

Messages by Thread

• [jira] [Updated] (SPARK-60538) Guard optional dependencies in worker-environment and streaming tester tests ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61184) Send the server-side session ID that the client observed, and check that of the responses, so that a session ends when its server restarts, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61162) Share the streaming query listener bus of a session, post the started events of queries, and give the listeners the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60537) Fix ProtobufSerdeSuite descriptor lookup in Maven builds ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61172) Add _set_opts to the readers and writers, which pandas-on-Spark's to_csv and to_json call, in the Python client as PySpark has it ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61172) Add _set_opts to the readers and writers, which pandas-on-Spark's to_csv and to_json call, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61195) Stop the threads that read a task's input on their own before its readers are closed Gengliang Wang (Jira) via issues
• [jira] [Resolved] (SPARK-61177) Quote the field names of DataType::to_ddl, and keep the case of the collation of DataType::from_ddl, in the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61189) Send the metadata edited in place of a StructType in the schemas of mapInPandas, applyInPandas and the other map functions, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61097) Preserve a session streaming listener manager across property access DB Tsai (Jira) via issues
• [jira] [Created] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61170) Add the Python 2 operators __div__, __rdiv__ and __nonzero__, and __getnewargs__, to Column in the Python client, as PySpark has them Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61172) Add _set_opts to the readers and writers, which pandas-on-Spark's to_csv and to_json call, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61030) Raise the error of the bool of a Column, take any value in like, rlike, ilike and getField, and raise the errors of the arguments of Column methods in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61137) Make StructType give back the same StructField objects in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61193) Support native LinearRegression training and prediction in the Rust client Ruifeng Zheng (Jira) via issues
• [jira] [Created] (SPARK-61182) Connect over TLS when the connection string has a token for a host other than localhost, take any UUID as the session ID, and default the user ID to SPARK_USER or USER, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61178) Make StructType.fields the list of the struct, and the name, dataType and nullable of StructField assignable, so that their edits show in the struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61152) mapInPandas, mapInArrow and the grouped and cogrouped applyIn functions accept a non-struct return type Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61179) Unset a DataFrameReader option of None, and take the description of Catalog.createExternalTable, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61105) Upgrade docker images to Apache Spark 4.3.0, 4.1.4, and 4.0.5 Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60911) Raise server errors in Spark Connect Rust with the exception class and details PySpark gives Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60879) Speed up build status update workflow ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61188) Raise RecursionError instead of crashing when progress handlers run queries without end, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61194) CHECK constraints added by ALTER TABLE still freeze the current time and the like when the condition also has a part that a write reads differently Yang Jie (Jira) via issues
• [jira] [Created] (SPARK-61192) Non-deterministic or MATERIALIZED CTE whose body ends in COALESCE is evaluated once per reference Artem Kupchinskiy (Jira) via issues
• [jira] [Updated] (SPARK-61179) Unset a DataFrameReader option of None, and take the description of Catalog.createExternalTable, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61179) Unset a DataFrameReader option of None, and take the description of Catalog.createExternalTable, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61182) Connect over TLS when the connection string has a token for a host other than localhost, take any UUID as the session ID, and default the user ID to SPARK_USER or USER, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61177) Quote the field names of DataType::to_ddl, and keep the case of the collation of DataType::from_ddl, in the Rust client ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61177) Quote the field names of DataType::to_ddl, and keep the case of the collation of DataType::from_ddl, in the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61102) Match PySpark NumPy numeric scalar-class checks DB Tsai (Jira) via issues
• [jira] [Commented] (SPARK-61102) Match PySpark NumPy numeric scalar-class checks DB Tsai (Jira) via issues
• [jira] [Updated] (SPARK-61099) Preserve binaryAsBytes configuration timing and terminate failed iterators DB Tsai (Jira) via issues
• [jira] [Commented] (SPARK-61097) Cancel pending streaming listener registration and avoid callback deadlocks during shutdown DB Tsai (Jira) via issues
• [jira] [Assigned] (SPARK-61187) Raise NO_ACTIVE_SESSION when a stream of a stopped session reattaches, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61185) Remove each registration of a streaming query listener exactly once, also of a listener added twice or removed through another session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61182) Connect over TLS when the connection string has a token for a host other than localhost, take any UUID as the session ID, and default the user ID to SPARK_USER or USER, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61178) Make StructType.fields the list of the struct, and the name, dataType and nullable of StructField assignable, so that their edits show in the struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61193) Support native LinearRegression training and prediction in the Rust client Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61193) Support native LinearRegression training and prediction in the Rust client ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61098) Deliver streaming query start callbacks before returning the query DB Tsai (Jira) via issues
• [jira] [Created] (SPARK-61155) Unpickle the DataFrames that foreachBatch functions capture on the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61186) Forget the tags and user context extensions of a thread when the thread ends, in the Rust and Python clients, as PySpark's thread locals do Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61177) Quote the field names of DataType::to_ddl, and keep the case of the collation of DataType::from_ddl, in the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61176) Keep the sign of a negative year-month interval of less than a year in the collected values of the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61176) Keep the sign of a negative year-month interval of less than a year in the collected values of the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61183) Give back the SparkSession object of a DataFrame in DataFrame.sparkSession, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61192) Non-deterministic or MATERIALIZED CTE whose body ends in COALESCE is evaluated once per reference ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61181) Read the local relation settings of the server for local relations of 64 KiB or more, and raise LOCAL_RELATION_SIZE_LIMIT_EXCEEDED, in the Rust and Python clients as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61181) Read the local relation settings of the server for local relations of 64 KiB or more, and raise LOCAL_RELATION_SIZE_LIMIT_EXCEEDED, in the Rust and Python clients as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61190) Keep the CASE WHEN of a pickled when() Column, so when and otherwise chain on it, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61189) Send the metadata edited in place of a StructType in the schemas of mapInPandas, applyInPandas and the other map functions, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61190) Keep the CASE WHEN of a pickled when() Column, so when and otherwise chain on it, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61190) Keep the CASE WHEN of a pickled when() Column, so when and otherwise chain on it, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61188) Raise RecursionError instead of crashing when progress handlers run queries without end, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61191) Pickle WindowSpec, so UDFs and foreachBatch functions can capture windows, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61181) Read the local relation settings of the server for local relations of 64 KiB or more, and raise LOCAL_RELATION_SIZE_LIMIT_EXCEEDED, in the Rust and Python clients as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61187) Raise NO_ACTIVE_SESSION when a stream of a stopped session reattaches, as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61189) Send the metadata edited in place of a StructType in the schemas of mapInPandas, applyInPandas and the other map functions, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61189) Send the metadata edited in place of a StructType in the schemas of mapInPandas, applyInPandas and the other map functions, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61187) Raise NO_ACTIVE_SESSION when a stream of a stopped session reattaches, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61190) Keep the CASE WHEN of a pickled when() Column, so when and otherwise chain on it, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61191) Pickle WindowSpec, so UDFs and foreachBatch functions can capture windows, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61191) Pickle WindowSpec, so UDFs and foreachBatch functions can capture windows, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61189) Send the metadata edited in place of a StructType in the schemas of mapInPandas, applyInPandas and the other map functions, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61188) Raise RecursionError instead of crashing when progress handlers run queries without end, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61188) Raise RecursionError instead of crashing when progress handlers run queries without end, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61188) Raise RecursionError instead of crashing when progress handlers run queries without end, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61185) Remove each registration of a streaming query listener exactly once, also of a listener added twice or removed through another session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61186) Forget the tags and user context extensions of a thread when the thread ends, in the Rust and Python clients, as PySpark's thread locals do Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61182) Connect over TLS when the connection string has a token for a host other than localhost, take any UUID as the session ID, and default the user ID to SPARK_USER or USER, as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61182) Connect over TLS when the connection string has a token for a host other than localhost, take any UUID as the session ID, and default the user ID to SPARK_USER or USER, as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61176) Keep the sign of a negative year-month interval of less than a year in the collected values of the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61184) Send the server-side session ID that the client observed, and check that of the responses, so that a session ends when its server restarts, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61186) Forget the tags and user context extensions of a thread when the thread ends, in the Rust and Python clients, as PySpark's thread locals do Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61185) Remove each registration of a streaming query listener exactly once, also of a listener added twice or removed through another session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61185) Remove each registration of a streaming query listener exactly once, also of a listener added twice or removed through another session, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61169) Add get_configs, get_config_dict and get_config_with_defaults to SparkConnectClient, of which pandas-on-Spark reads its configurations, in the Python client as PySpark has them Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61177) Quote the field names of DataType::to_ddl, and keep the case of the collation of DataType::from_ddl, in the Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61176) Keep the sign of a negative year-month interval of less than a year in the collected values of the Rust client Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61176) Keep the sign of a negative year-month interval of less than a year in the collected values of the Rust client ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61178) Make StructType.fields the list of the struct, and the name, dataType and nullable of StructField assignable, so that their edits show in the struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61178) Make StructType.fields the list of the struct, and the name, dataType and nullable of StructField assignable, so that their edits show in the struct, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61183) Give back the SparkSession object of a DataFrame in DataFrame.sparkSession, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61180) Add DataFrame._joinAsOf, the as-of join of pandas-on-Spark's merge_asof, in the Rust and Python clients as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61180) Add DataFrame._joinAsOf, the as-of join of pandas-on-Spark's merge_asof, in the Rust and Python clients as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61180) Add DataFrame._joinAsOf, the as-of join of pandas-on-Spark's merge_asof, in the Rust and Python clients as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61178) Make StructType.fields the list of the struct, and the name, dataType and nullable of StructField assignable, so that their edits show in the struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61172) Add _set_opts to the readers and writers, which pandas-on-Spark's to_csv and to_json call, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61169) Add get_configs, get_config_dict and get_config_with_defaults to SparkConnectClient, of which pandas-on-Spark reads its configurations, in the Python client as PySpark has them Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61175) Make rint return a canonical NaN regardless of the JIT tier ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61175) Make rint return a canonical NaN regardless of the JIT tier Max Gekk (Jira) via issues
• [jira] [Updated] (SPARK-61097) Cancel pending streaming listener registration and avoid callback deadlocks during shutdown DB Tsai (Jira) via issues
  • [jira] [Updated] (SPARK-61097) Cancel pending streaming listener registration and avoid callback deadlocks during shutdown ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61168) Log the gRPC error of the call as the exception of the query context loggers, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61168) Log the gRPC error of the call as the exception of the query context loggers, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61097) Avoid listener callback deadlocks and preserve retries during streaming bus shutdown DB Tsai (Jira) via issues
• [jira] [Resolved] (SPARK-61135) Parse the JSON of GeometryType and GeographyType, such as bare geometry and geography(SPHERICAL), and add their _from_crs, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61167) Pickle Columns as their expressions, also for the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61166) Make the threads of inheritable_thread_target share the copy of the tags of the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61166) Make the threads of inheritable_thread_target share the copy of the tags of the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61167) Pickle Columns as their expressions, also for the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61172) Add _set_opts to the readers and writers, which pandas-on-Spark's to_csv and to_json call, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61163) Make GroupedData.apply take only pandas UDFs of SQL_GROUPED_MAP_PANDAS_UDF, and warn, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61171) Let the objects of the Python client be referred to weakly and take attributes, as those of PySpark Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61099) Preserve binaryAsBytes configuration timing and iterator failure semantics DB Tsai (Jira) via issues
• [jira] [Updated] (SPARK-61171) Let the objects of the Python client be referred to weakly and take attributes, as those of PySpark Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61167) Pickle Columns as their expressions, also for the Python workers of the server, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61170) Add the Python 2 operators __div__, __rdiv__ and __nonzero__, and __getnewargs__, to Column in the Python client, as PySpark has them Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61170) Add the Python 2 operators __div__, __rdiv__ and __nonzero__, and __getnewargs__, to Column in the Python client, as PySpark has them Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61163) Make GroupedData.apply take only pandas UDFs of SQL_GROUPED_MAP_PANDAS_UDF, and warn, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61162) Share the streaming query listener bus of a session, post the started events of queries, and give the listeners the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61164) Make AnalyzeArgument, PartitioningColumn, OrderingColumn and SelectedColumn the frozen dataclasses of PySpark in the Python client Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61164) Make AnalyzeArgument, PartitioningColumn, OrderingColumn and SelectedColumn the frozen dataclasses of PySpark in the Python client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61169) Add get_configs, get_config_dict and get_config_with_defaults to SparkConnectClient, of which pandas-on-Spark reads its configurations, in the Python client as PySpark has them Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61169) Add get_configs, get_config_dict and get_config_with_defaults to SparkConnectClient, of which pandas-on-Spark reads its configurations, in the Python client as PySpark has them ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61165) Keep the metadata of a StructField as its own dict, so that edits of it show in the field and its struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61151) Vendor pyspark.sql.streaming.listener, of the listener and its event and progress classes, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61151) Vendor pyspark.sql.streaming.listener, of the listener and its event and progress classes, in the Python client as PySpark has it Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61165) Keep the metadata of a StructField as its own dict, so that edits of it show in the field and its struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61168) Log the gRPC error of the call as the exception of the query context loggers, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61168) Log the gRPC error of the call as the exception of the query context loggers, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61167) Pickle Columns as their expressions, also for the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61146) Create DataFrames of pandas frames whose struct fields repeat names in the Python client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61163) Make GroupedData.apply take only pandas UDFs of SQL_GROUPED_MAP_PANDAS_UDF, and warn, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61155) Unpickle the DataFrames that foreachBatch functions capture on the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61135) Parse the JSON of GeometryType and GeographyType, such as bare geometry and geography(SPHERICAL), and add their _from_crs, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61155) Unpickle the DataFrames that foreachBatch functions capture on the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61141) Run Rust WASM UDFs once per Arrow batch in the Spark Connect Rust client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61166) Make the threads of inheritable_thread_target share the copy of the tags of the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61166) Make the threads of inheritable_thread_target share the copy of the tags of the session, in the Rust and Python clients, as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61166) Make the threads of inheritable_thread_target share the copy of the tags of the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61165) Keep the metadata of a StructField as its own dict, so that edits of it show in the field and its struct, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61165) Keep the metadata of a StructField as its own dict, so that edits of it show in the field and its struct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61164) Make AnalyzeArgument, PartitioningColumn, OrderingColumn and SelectedColumn the frozen dataclasses of PySpark in the Python client Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61164) Make AnalyzeArgument, PartitioningColumn, OrderingColumn and SelectedColumn the frozen dataclasses of PySpark in the Python client ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61140) Send the renames of DataFrame.withColumnsRenamed in their order, in the Rust core and the Python client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61164) Make AnalyzeArgument, PartitioningColumn, OrderingColumn and SelectedColumn the frozen dataclasses of PySpark in the Python client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61163) Make GroupedData.apply take only pandas UDFs of SQL_GROUPED_MAP_PANDAS_UDF, and warn, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61163) Make GroupedData.apply take only pandas UDFs of SQL_GROUPED_MAP_PANDAS_UDF, and warn, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61160) Close the local iterator of toLocalIterator as a generator, so contextlib.closing and close() end the execution in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61162) Share the streaming query listener bus of a session, post the started events of queries, and give the listeners the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61162) Share the streaming query listener bus of a session, post the started events of queries, and give the listeners the session, in the Rust and Python clients, as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61161) Export the deprecated functions of pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61081) GROUP BY, DISTINCT and hash functions on GEOMETRY or GEOGRAPHY fail with scala.MatchError ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61161) Export the deprecated functions of pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61146) Create DataFrames of pandas frames whose struct fields repeat names in the Python client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61160) Close the local iterator of toLocalIterator as a generator, so contextlib.closing and close() end the execution in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61158) Delete the cached server model of a native LinearSVC or LogisticRegression fit when its last owner is dropped, as pyspark.ml does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61157) Column operations capture their call site with a failing IPython import on every call, which makes them slow without ipykernel Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61157) Column operations capture their call site with a failing IPython import on every call, which makes them slow without ipykernel Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61158) Delete the cached server model of a native LinearSVC or LogisticRegression fit when its last owner is dropped, as pyspark.ml does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61156) createDataFrame of local rows with a year-month or calendar interval raises the wrong error Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61156) createDataFrame of local rows with a year-month or calendar interval raises the wrong error Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61140) Send the renames of DataFrame.withColumnsRenamed in their order, in the Rust core and the Python client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61027) Extract shared DDL and DML analysis helpers ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61143) Decode the Arrow batches that the server compresses with zstd or lz4 in the Rust client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61143) Decode the Arrow batches that the server compresses with zstd or lz4 in the Rust client, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61154) Raise VALUE_NOT_BETWEEN for a literal of an int beyond the range of a long, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61154) Raise VALUE_NOT_BETWEEN for a literal of an int beyond the range of a long, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61095) Add the modules geo_utils, sql_formatter, table_arg and tvf_argument of pyspark.sql in the Python client as the PySpark client has them Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61153) Run the queries of progress handlers and hooks, and keep an execution reattachable when a hook adds reattach options, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61162) Share the streaming query listener bus of a session, post the started events of queries, and give the listeners the session, in the Rust and Python clients, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61159) Reduce and stagger scheduled workflow runs ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-61153) Run the queries of progress handlers and hooks, and keep an execution reattachable when a hook adds reattach options, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61152) mapInPandas, mapInArrow and the grouped and cogrouped applyIn functions accept a non-struct return type Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61142) Make the functions of pyspark.sql.functions those of pyspark.sql.functions.builtin, which pickle by reference, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61142) Make the functions of pyspark.sql.functions those of pyspark.sql.functions.builtin, which pickle by reference, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61137) Make StructType give back the same StructField objects in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61134) Make DayTimeIntervalType and YearMonthIntervalType check their fields, and the types without parameters their arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61161) Export the deprecated functions of pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61134) Make DayTimeIntervalType and YearMonthIntervalType check their fields, and the types without parameters their arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61161) Export the deprecated functions of pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61161) Export the deprecated functions of pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61160) Close the local iterator of toLocalIterator as a generator, so contextlib.closing and close() end the execution in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61160) Close the local iterator of toLocalIterator as a generator, so contextlib.closing and close() end the execution in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61160) Close the local iterator of toLocalIterator as a generator, so contextlib.closing and close() end the execution in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61149) Retry by the policy past the bound of RetryExceptions, take SESSION_NOT_FOUND and a response already received in reattach, and bound the config read of an error, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61149) Retry by the policy past the bound of RetryExceptions, take SESSION_NOT_FOUND and a response already received in reattach, and bound the config read of an error, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61150) Plan IDs are per session, so a column of another session's DataFrame resolves to a node of this one Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61150) Plan IDs are per session, so a column of another session's DataFrame resolves to a node of this one Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61159) Stagger scheduled workflows on a three-day cadence Ruifeng Zheng (Jira) via issues
• [jira] [Resolved] (SPARK-61147) Refer to the column of withMetadata and pivot through the DataFrame, so a missing column is CANNOT_RESOLVE_DATAFRAME_COLUMN as in PySpark Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60535) Investigate Non-ANSI nested-class assertion in the MergeRows codegen regression test ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61158) Delete the cached server model of a native LinearSVC or LogisticRegression fit when its last owner is dropped, as pyspark.ml does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61158) Delete the cached server model of a native LinearSVC or LogisticRegression fit when its last owner is dropped, as pyspark.ml does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61157) Column operations capture their call site with a failing IPython import on every call, which makes them slow without ipykernel Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61158) Delete the cached server model of a native LinearSVC or LogisticRegression fit when its last owner is dropped, as pyspark.ml does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61157) Column operations capture their call site with a failing IPython import on every call, which makes them slow without ipykernel Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61157) Column operations capture their call site with a failing IPython import on every call, which makes them slow without ipykernel ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61156) createDataFrame of local rows with a year-month or calendar interval raises the wrong error Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61156) createDataFrame of local rows with a year-month or calendar interval raises the wrong error ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61148) Leave a builder option of None unset, check the destination of copyFromLocalToFs, and raise NO_ACTIVE_SESSION for the requests of a stopped session, as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61155) Unpickle the DataFrames that foreachBatch functions capture on the Python workers of the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues

• Earlier messages