Re: Read all the columns from a file in spark sql

Hi Pandees, You may also be helped by looking into the ability to read and write Parquet files which is available in the present release. Parquet files allow you to store columnar data in HDFS. At present, Spark "infers" the schema from the Parquet file. In pyspark, some of the methods you'd be

Re: Read all the columns from a file in spark sql

I think what you might be looking for is the ability to programmatically specify the schema, which is coming in 1.1. Here's the JIRA: SPARK-2179 On Wed, Jul 16, 2014 at 8:24 AM, pandees waran wrote: > Hi, > > I am newbie to spark sql and i wou