[DISCUSS] Support subdirectories when accessing partitioned Parquet Hive table

2020-01-06 Thread Lotkowski, Michael
Hi all, Reviving this thread, we still have this issue and we have been using our updated jar which seems to work. It would be great to get some feedback whether this is the correct approach. Kind regards, Michael From: "Lotkowski, Michael" Date: Tuesday, December 3, 2019 at 1

Support subdirectories when accessing partitioned Parquet Hive table

2019-12-03 Thread Lotkowski, Michael
Originally https://issues.apache.org/jira/browse/SPARK-30024 Hi all, We have ran in to issues when trying to read parquet partitioned table created by Hive. I think I have narrowed down the cause to how InMemoryFileIndex created a pare