Re: making dataframe for different types using spark-csv

2015-07-02 Thread Hafiz Mujadid
shown here: >> >> >> >> >> https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema >> >> >> >> Mohammed >> >> >> >> *From:* Krishna Sankar [mailto:ksanka...@gmail.com] >>

Re: making dataframe for different types using spark-csv

2015-07-02 Thread Kohler, Curt E (ELS-STL)
atically-specifying-the-schema Mohammed From: Krishna Sankar [mailto:ksanka...@gmail.com<mailto:ksanka...@gmail.com>] Sent: Wednesday, July 1, 2015 3:09 PM To: Hafiz Mujadid Cc: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: making dataframe for different types us

Re: making dataframe for different types using spark-csv

2015-07-01 Thread Hafiz Mujadid
1, 2015 3:09 PM > *To:* Hafiz Mujadid > *Cc:* user@spark.apache.org > *Subject:* Re: making dataframe for different types using spark-csv > > > > · use .cast("...").alias('...') after the DataFrame is read. > > · sql.functions.udf for any domain-specific co

RE: making dataframe for different types using spark-csv

2015-07-01 Thread Mohammed Guller
Mohammed From: Krishna Sankar [mailto:ksanka...@gmail.com] Sent: Wednesday, July 1, 2015 3:09 PM To: Hafiz Mujadid Cc: user@spark.apache.org Subject: Re: making dataframe for different types using spark-csv · use .cast("...").alias('...') after the DataFrame is read. · sql.f

Re: making dataframe for different types using spark-csv

2015-07-01 Thread Krishna Sankar
default it makes > type of each column as string. Is there some way to get dataframe of actual > types like int,double etc.? > > > Thanks > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/making-dataframe-for-differen

making dataframe for different types using spark-csv

2015-07-01 Thread Hafiz Mujadid
-dataframe-for-different-types-using-spark-csv-tp23570.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h