Re: Java to show struct field from a Dataframe

2016-12-17 Thread Richard Xin
: Richard Xin Sent: Saturday, December 17, 2016 8:53 PM To: Yong Zhang; zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe I tried to transform root  |-- latitude: double (nullable = false)  |-- longitude: double (nullable = false)  |-- name: string (nullable = true) to: root

Re: Java to show struct field from a Dataframe

2016-12-17 Thread Yong Zhang
: Richard Xin Sent: Saturday, December 17, 2016 8:53 PM To: Yong Zhang; zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe I tried to transform root |-- latitude: double (nullable = false) |-- longitude: double (nullable = false) |-- name: string (nullable = true) to

Re: Java to show struct field from a Dataframe

2016-12-17 Thread Richard Xin
dicates the data doesn't match with  the type specified in the schema. I wonder how you are so sure about your data? Do you check it under other tool? Yong From: Richard Xin Sent: Saturday, December 17, 2016 10:56 AM To: zjp_j...@163.com; user Subject: Re: Java to show struct field from a Da

Re: Java to show struct field from a Dataframe

2016-12-17 Thread Yong Zhang
sure about your data? Do you check it under other tool? Yong From: Richard Xin Sent: Saturday, December 17, 2016 10:56 AM To: zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe data is good On Saturday, December 17, 2016 11:50 PM, &q

Re: Java to show struct field from a Dataframe

2016-12-17 Thread Richard Xin
data is good On Saturday, December 17, 2016 11:50 PM, "zjp_j...@163.com" wrote: #yiv7434848277 body {line-height:1.5;}#yiv7434848277 blockquote {margin-top:0px;margin-bottom:0px;margin-left:0.5em;}#yiv7434848277 div.yiv7434848277foxdiv20161217234614718397 {}#yiv7434848277 body {font

Re: Java to show struct field from a Dataframe

2016-12-17 Thread zjp_j...@163.com
I think the causation is your invanlid Double data , have u checked your data ? zjp_j...@163.com From: Richard Xin Date: 2016-12-17 23:28 To: User Subject: Java to show struct field from a Dataframe let's say I have a DataFrame with schema of followings: root |-- name: string (nullable = true