Re: How to load a big csv to dataframe in Spark 1.6

2016-12-30 Thread theodondre
You can use the structtype and structfield approach or use the inferSchema approach. Sent from my T-Mobile 4G LTE Device Original message From: "write2sivakumar@gmail" Date: 12/30/16 10:08 PM (GMT-05:00) To: Raymond Xie , user@spark.apache.org Subject: Re: How to l

RE: How to deal with string column data for spark mlib?

2016-12-20 Thread theodondre
Give a snippets of the data. Sent from my T-Mobile 4G LTE Device Original message From: big data Date: 12/20/16 4:35 AM (GMT-05:00) To: user@spark.apache.org Subject: How to deal with string column data for spark mlib? our source data are string-based data, like t