Re: External Table not getting updated from parquet files written by spark streaming

2015-11-19 Thread Michael Armbrust
We cache metadata to speed up interactive querying. try REFRESH TABLE On Thu, Nov 19, 2015 at 11:18 AM, Abhishek Anand wrote: > Hi , > > I am using spark streaming to write the aggregated output as parquet files > to the hdfs using SaveMode.Append. I have an external table created like : > > >

External Table not getting updated from parquet files written by spark streaming

2015-11-19 Thread Abhishek Anand
Hi , I am using spark streaming to write the aggregated output as parquet files to the hdfs using SaveMode.Append. I have an external table created like : CREATE TABLE if not exists rolluptable USING org.apache.spark.sql.parquet OPTIONS ( path "hdfs:" ); I had an impression that in case o