Re: [DISCUSS] Support subdirectories when accessing partitioned Parquet Hive table

2020-01-06 Thread Wenchen Fan
uesday, December 3, 2019 at 10:28 AM > *To: *"dev@spark.apache.org" > *Subject: *Support subdirectories when accessing partitioned Parquet Hive > table > > > > *Originally https://issues.apache.org/jira/browse/SPARK-30024 > <https://issues.apache.org/jira/browse/S

[DISCUSS] Support subdirectories when accessing partitioned Parquet Hive table

2020-01-06 Thread Lotkowski, Michael
0:28 AM To: "dev@spark.apache.org" Subject: Support subdirectories when accessing partitioned Parquet Hive table Originally https://issues.apache.org/jira/browse/SPARK-30024 Hi all, We have ran in to issues when trying to read parquet partitioned table created by Hive. I think I have nar

Support subdirectories when accessing partitioned Parquet Hive table

2019-12-03 Thread Lotkowski, Michael
Originally https://issues.apache.org/jira/browse/SPARK-30024 Hi all, We have ran in to issues when trying to read parquet partitioned table created by Hive. I think I have narrowed down the cause to how InMemoryFileIndex created a pare