Re: Escape commas in file names

2014-12-26 Thread Daniel Siegmann
Thanks for the replies. Hopefully this will not be too difficult to fix. Why not support multiple paths by overloading the parquetFile method to take a collection of strings? That way we don't need an appropriate delimiter. On Thu, Dec 25, 2014 at 3:46 AM, Cheng, Hao wrote: > I’ve created a ji

RE: Escape commas in file names

2014-12-25 Thread Cheng, Hao
commas in file names No, there is not. Can you open a JIRA? On Tue, Dec 23, 2014 at 6:33 PM, Daniel Siegmann mailto:daniel.siegm...@velos.io>> wrote: I am trying to load a Parquet file which has a comma in its name. Yes, this is a valid file name in HDFS. However, sqlContext.parqu

Re: Escape commas in file names

2014-12-24 Thread Michael Armbrust
No, there is not. Can you open a JIRA? On Tue, Dec 23, 2014 at 6:33 PM, Daniel Siegmann wrote: > I am trying to load a Parquet file which has a comma in its name. Yes, > this is a valid file name in HDFS. However, sqlContext.parquetFile > interprets this as a comma-separated list of parquet fil

Escape commas in file names

2014-12-23 Thread Daniel Siegmann
I am trying to load a Parquet file which has a comma in its name. Yes, this is a valid file name in HDFS. However, sqlContext.parquetFile interprets this as a comma-separated list of parquet files. Is there any way to escape the comma so it is treated as part of a single file name? -- Daniel Sie