Hossein Falaki created SPARK-17781:
--------------------------------------
Summary: datetime is serialized as double inside dapply()
Key: SPARK-17781
URL: https://issues.apache.org/jira/browse/SPARK-17781
Project: Spark
Issue Type: Bug
Components: SparkR
Affects Versions: 2.0.1
Reporter: Hossein Falaki
When we ship a SparkDataFrame to workers for dapply family functions, inside
the worker DateTime objects are serialized as double.
To reproduce:
{{code}}
df <- createDataFrame(data.frame(id = 1:10, date = Sys.Date()))
dapplyCollect(df, function(x) { return(x$date) })
{{code}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
