Re: SparkSQL not able to read a empty table location

2017-05-21 Thread Bajpai, Amit X. -ND
processed the query will again fail. How to deal with this scenario. From: Sea <261810...@qq.com> Date: Sunday, May 21, 2017 at 8:04 AM To: Steve Loughran , "Bajpai, Amit X. -ND" Cc: "user@spark.apache.org" Subject: Re: SparkSQL not able to read a empty t

Re: SparkSQL not able to read a empty table location

2017-05-21 Thread Sea
please try spark.sql.hive.verifyPartitionPath true -- Original -- From: "Steve Loughran";; Date: Sat, May 20, 2017 09:19 PM To: "Bajpai, Amit X. -ND"; Cc: "user@spark.apache.org"; Subject: Re: SparkSQL not able to read a empt

Re: SparkSQL not able to read a empty table location

2017-05-20 Thread Steve Loughran
On 20 May 2017, at 01:44, Bajpai, Amit X. -ND mailto:n...@disney.com>> wrote: Hi, I have a hive external table with the S3 location having no files (but the S3 location directory does exists). When I am trying to use Spark SQL to count the number of records in the table it is throwing error s

SparkSQL not able to read a empty table location

2017-05-19 Thread Bajpai, Amit X. -ND
Hi, I have a hive external table with the S3 location having no files (but the S3 location directory does exists). When I am trying to use Spark SQL to count the number of records in the table it is throwing error saying “File s3n://data/xyz does not exist. null/0”. select * from tablex limit