Hi, I have a DF based on a table and sorted and shown below
This is fine and when I register as tempTable I can populate the underlying table sales 2 in Hive. That sales2 is an ORC table val s = HiveContext.table("sales_staging") val sorted = s.sort("prod_id","cust_id","time_id","channel_id","promo_id") sorted.registerTempTable("tmp") sqltext = """ INSERT INTO TABLE oraclehadoop.sales2 SELECT PROD_ID , CUST_ID , TIME_ID , CHANNEL_ID , PROMO_ID , QUANTITY_SOLD , AMOUNT_SOLD FROM tmp """ HiveContext.sql(sqltext) HiveContext.sql("select count(1) from oraclehadoop.sales2").show HiveContext.sql("truncate table oraclehadoop.sales2") sorted.save("oraclehadoop.sales2") HiveContext.sql("select count(1) from oraclehadoop.sales2").show When I truncate the Hive table and use sorted.save("oraclehadoop.sales2") It does not save any data Started at [20/06/2016 21:21:57.57] +------+ | _c0| *+------+|918843| // This works+------+* [Stage 7:============================================> (3 + 1) / 4]SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. +---+ |_c0| *+---+| 0| // This does not+---+* Finished at [20/06/2016 21:22:30.30] Any ideas if anyone has seen this before? The issue is saving data. Saving through tempTable works but the other one does not work. Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com