Re: custom REST port from spark-defaults.cof

2015-06-25 Thread giive chen
HI Niranda I think "spark.master.rest.port" is what you want. Wisely Chen On Tue, Jun 23, 2015 at 2:03 PM, Niranda Perera wrote: > > Hi, > > is there a configuration setting to set a custom port number for the master > REST URL? can that be included in the spark-defaults.conf? > > cheers > --

Re: SparkSQL 1.3.0 (RC3) failed to read parquet file generated by 1.1.1

2015-03-12 Thread giive chen
Hi all My team has the same issue. It looks like Spark 1.3's sparkSQL cannot read parquet file generated by Spark 1.1. It will cost a lot of migration work when we wanna to upgrade Spark 1.3. Is there anyone can help me? Thanks Wisely Chen On Tue, Mar 10, 2015 at 5:06 PM, Pei-Lun Lee wrote