Hi I have a spark job which creates ORC files in partitions using the
following code
dataFrame.write().mode(SaveMode.Append).partitionBy("entity","date").format("orc").save("baseTable");
Above code creates successfully orc files which is readable in Spark
dataframe
But when I try to load orc files generated using above code into hive orc
table or hive external table nothing gets printed looks like table is empty
what's wrong here I can see orc files in hdfs but hive table does not read
it please guide
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/ORC-files-created-by-Spark-job-can-t-be-accessed-using-hive-table-tp24954.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
