Bo Gao created SPARK-52195:
--
Summary: Fix initial state column dropping issue for Python TWS
Key: SPARK-52195
URL: https://issues.apache.org/jira/browse/SPARK-52195
Project: Spark
Issue Type: Task
Bo Gao created SPARK-51889:
--
Summary: Fix MapState bug on clear() for TWS Python
Key: SPARK-51889
URL: https://issues.apache.org/jira/browse/SPARK-51889
Project: Spark
Issue Type: Task
Com
Bo Gao created SPARK-51697:
--
Summary: PySpark - Fix list state test failure for TWS
Key: SPARK-51697
URL: https://issues.apache.org/jira/browse/SPARK-51697
Project: Spark
Issue Type: Task
Bo Gao created SPARK-51684:
--
Summary: PySpark - Fix test failure for TWS
Key: SPARK-51684
URL: https://issues.apache.org/jira/browse/SPARK-51684
Project: Spark
Issue Type: Task
Components:
[
https://issues.apache.org/jira/browse/SPARK-51587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-51587:
---
Description:
Fix an issue where timestamp cannot be used in ListState when multiple state
data is involved.
[
https://issues.apache.org/jira/browse/SPARK-51587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-51587:
---
Description:
Fix an issue where timestamp cannot be used in ListState when multiple state
data is involved.
Bo Gao created SPARK-51587:
--
Summary: [PySpark] Fix an issue where timestamp cannot be used in
ListState when multiple state data is involved
Key: SPARK-51587
URL: https://issues.apache.org/jira/browse/SPARK-51587
[
https://issues.apache.org/jira/browse/SPARK-51506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-51506:
---
Summary: Do not enforce users to implement close() in
TransformWithStateInPandas (was: Not enforce implemen
Bo Gao created SPARK-51506:
--
Summary: Not enforce implement close() in
TransformWithStateInPandas
Key: SPARK-51506
URL: https://issues.apache.org/jira/browse/SPARK-51506
Project: Spark
Issue Type:
Bo Gao created SPARK-51147:
--
Summary: Refactor some streaming related classes to a dedicated
streaming directory
Key: SPARK-51147
URL: https://issues.apache.org/jira/browse/SPARK-51147
Project: Spark
Bo Gao created SPARK-50540:
--
Summary: [PySpark] Fix the issue for string schema in
StatefulProcessHandle
Key: SPARK-50540
URL: https://issues.apache.org/jira/browse/SPARK-50540
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-50341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-50341:
---
Summary: PySpark - Use UDS for communication between JVM and Streaming
Python worker (was: PySpark - Use UD
Bo Gao created SPARK-49899:
--
Summary: [PySpark] Support deleteIfExists
Key: SPARK-49899
URL: https://issues.apache.org/jira/browse/SPARK-49899
Project: Spark
Issue Type: Task
Components: S
Bo Gao created SPARK-49821:
--
Summary: [PySpark] Support MapState
Key: SPARK-49821
URL: https://issues.apache.org/jira/browse/SPARK-49821
Project: Spark
Issue Type: Task
Components: Structu
Bo Gao created SPARK-49744:
--
Summary: [PySpark] State TTL support - ListState
Key: SPARK-49744
URL: https://issues.apache.org/jira/browse/SPARK-49744
Project: Spark
Issue Type: Task
Compon
Bo Gao created SPARK-49463:
--
Summary: [PySpark] Support ListState
Key: SPARK-49463
URL: https://issues.apache.org/jira/browse/SPARK-49463
Project: Spark
Issue Type: Task
Components: Struct
[
https://issues.apache.org/jira/browse/SPARK-48755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-48755:
---
Summary: [PySpark] Base implementation and ValueState support (was:
[Python State V2] Base implementation a
[
https://issues.apache.org/jira/browse/SPARK-49233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49233:
---
Summary: [PySpark] Classify internal and user facing errors in PySpark
transformWithState (was: [Python Sta
[
https://issues.apache.org/jira/browse/SPARK-49212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49212:
---
Summary: [PySpark] Implement schema evolution support (was: [Python State
V2] Implement schema evolution su
[
https://issues.apache.org/jira/browse/SPARK-49100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49100:
---
Summary: [PySpark] Add verification for result iterator of
transformWithState UDF (was: [Python State V2] A
[
https://issues.apache.org/jira/browse/SPARK-49233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49233:
---
Summary: [Python State V2] Classify internal and user facing errors in
PySpark transformWithState (was: [Py
[
https://issues.apache.org/jira/browse/SPARK-49233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49233:
---
Summary: [Python State V2] Classify internal and user facing errors in
PySpark (was: [Python State V2] Clas
Bo Gao created SPARK-49233:
--
Summary: [Python State V2] Classify errors thrown by internal
methods
Key: SPARK-49233
URL: https://issues.apache.org/jira/browse/SPARK-49233
Project: Spark
Issue Type:
Bo Gao created SPARK-49212:
--
Summary: [Python State V2] Implement schema evolution support
Key: SPARK-49212
URL: https://issues.apache.org/jira/browse/SPARK-49212
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-49146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49146:
---
Summary: Move assertion errors related to watermark missing in append mode
streaming queries to error framew
[
https://issues.apache.org/jira/browse/SPARK-49146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49146:
---
Description: This is a followup for
https://issues.apache.org/jira/browse/SPARK-45539. The errors added ther
Bo Gao created SPARK-49146:
--
Summary: Move assertion errors related to watermarks to error
framework
Key: SPARK-49146
URL: https://issues.apache.org/jira/browse/SPARK-49146
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-49100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-49100:
---
Description: add verification that elements in result_iter for are indeed
of type pd.DataFrame and confirm t
Bo Gao created SPARK-48755:
--
Summary: [Python State V2] Base implementation and ValueState
support
Key: SPARK-48755
URL: https://issues.apache.org/jira/browse/SPARK-48755
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-46963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao resolved SPARK-46963.
Resolution: Won't Do
> Verify AQE is not enabled for Structured Streaming
> --
Bo Gao created SPARK-46963:
--
Summary: Verify AQE is not enabled for Structured Streaming
Key: SPARK-46963
URL: https://issues.apache.org/jira/browse/SPARK-46963
Project: Spark
Issue Type: Task
Bo Gao created SPARK-44877:
--
Summary: Support python protobuf functions for Spark Connect
Key: SPARK-44877
URL: https://issues.apache.org/jira/browse/SPARK-44877
Project: Spark
Issue Type: Task
Bo Gao created SPARK-44626:
--
Summary: Followup on streaming query termination when client
session is timed out for Spark Connect
Key: SPARK-44626
URL: https://issues.apache.org/jira/browse/SPARK-44626
Projec
[
https://issues.apache.org/jira/browse/SPARK-44434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-44434:
---
Summary: Add more tests for Scala foreachBatch and streaming listeners
(was: Add more tests for Scala fore
Bo Gao created SPARK-44436:
--
Summary: Session improvement for Scala foreachBatch
Key: SPARK-44436
URL: https://issues.apache.org/jira/browse/SPARK-44436
Project: Spark
Issue Type: Task
Com
[
https://issues.apache.org/jira/browse/SPARK-44400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-44400:
---
Description: Improve the Listener to provide users a way to access the
Spark session and perform arbitrary a
Bo Gao created SPARK-44400:
--
Summary: Improve Scala StreamingQueryListener to provide users a
way to access the Spark session for Spark Connect
Key: SPARK-44400
URL: https://issues.apache.org/jira/browse/SPARK-44400
Bo Gao created SPARK-44201:
--
Summary: Add support for Streaming Listener in Scala for Spark
Connect
Key: SPARK-44201
URL: https://issues.apache.org/jira/browse/SPARK-44201
Project: Spark
Issue Type
Bo Gao created SPARK-44136:
--
Summary: StateManager may get materialized in executor instead of
driver in FlatMapGroupsWithStateExec
Key: SPARK-44136
URL: https://issues.apache.org/jira/browse/SPARK-44136
Pro
[
https://issues.apache.org/jira/browse/SPARK-43511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722891#comment-17722891
]
Bo Gao edited comment on SPARK-43511 at 6/12/23 6:59 PM:
-
Create
[
https://issues.apache.org/jira/browse/SPARK-43511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722891#comment-17722891
]
Bo Gao commented on SPARK-43511:
Created PR https://github.com/apache/spark/pull/40959
Bo Gao created SPARK-43511:
--
Summary: Implemented State APIs for Spark Connect Scala
Key: SPARK-43511
URL: https://issues.apache.org/jira/browse/SPARK-43511
Project: Spark
Issue Type: Task
42 matches
Mail list logo
