bogao007 commented on code in PR #50349:
URL: https://github.com/apache/spark/pull/50349#discussion_r2008404579
##########
python/pyspark/sql/pandas/types.py:
##########
@@ -1424,6 +1424,12 @@ def _to_numpy_type(type: DataType) ->
Optional["np.dtype"]:
return np.dtype("float32")
elif type == DoubleType():
return np.dtype("float64")
+ elif type == TimestampType():
Review Comment:
This utility function is only used by TWS, but we followed the suggestion to
move this util to the base types file since it's doing basic type conversion.
This issue only happens when we use Arrow to transmit state data to the JVM
side so only multiple state data is involved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
