[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-36338: ------------------------------------ Assignee: (was: Apache Spark) > Move distributed-sequence implementation to Scala side > ------------------------------------------------------ > > Key: SPARK-36338 > URL: https://issues.apache.org/jira/browse/SPARK-36338 > Project: Spark > Issue Type: Improvement > Components: PySpark > Affects Versions: 3.2.0 > Reporter: Hyukjin Kwon > Priority: Major > > https://github.com/apache/spark/blob/c22f7a4834e6fb7b69c4cc4af87c61c2fbbe0786/python/pyspark/pandas/internal.py#L925-L945 > This can be implemented in JVM side to make it more performance without extra > serializations, and working around the nullability. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org