This JIRA https://issues.apache.org/jira/browse/HIVE-12366 moved the heartbeat 
logic from the engine to the client.  AFAIK this was the only issue preventing 
working with Spark as an engine.  That JIRA was released in 2.0.

I want to stress that to my knowledge no one has tested this combination of 
features, so there may be other problem.  But at least this issue has been 
resolved.

Alan.

> On Jun 2, 2016, at 01:54, Mich Talebzadeh <mich.talebza...@gmail.com> wrote:
> 
> 
> Hi,
> 
> Spark does not support transactions because as I understand there is a piece 
> in the execution side that needs to send heartbeats to Hive metastore saying 
> a transaction is still alive". That has not been implemented in Spark yet to 
> my knowledge."
> 
> Any idea on the timelines when we are going to have support for transactions 
> in Spark for Hive ORC tables. This will really be useful.
> 
> 
> Thanks,
> 
> 
> Dr Mich Talebzadeh
>  
> LinkedIn  
> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>  
> http://talebzadehmich.wordpress.com
>  

Reply via email to