Re: Hive transactional table with delta files, Spark cannot read and sends error

2016-08-01 Thread Gopal Vijayaraghavan
> I am on Spark 1.6.1 and getting the following error Ah, I realize that it's yet to be released officially. Here's the demo from HadoopSummit - I doubt this will ever be available for older spark releases but will be a datasource package lik

Re: Hive transactional table with delta files, Spark cannot read and sends error

2016-08-01 Thread Mich Talebzadeh
Thanks Gopal. I am on Spark 1.6.1 and getting the following error scala> var conn = LlapContext.newInstance(sc, hs2_url); :28: error: not found: value LlapContext var conn = LlapContext.newInstance(sc, hs2_url); Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?i

Re: Hive transactional table with delta files, Spark cannot read and sends error

2016-08-01 Thread Gopal Vijayaraghavan
> Spark fails reading this table. What options do I have here? Would your issue be the same as https://issues.apache.org/jira/browse/SPARK-13129? LLAPContext in Spark can read those tables with ACID semantics (as in delete/updates will work right). var conn = LlapContext.newInstance(sc, hs2_u