Hello,

    I am working with an external storage handler written for Hive 0.11 and run 
on a Shark execution engine.  I’d like to move forward and upgrade to hive 
1.2.1 on spark 1.6 or even 2.0.

   This storage has a need to run queries across tables existing in different 
databases in the external data store, so existing drivers that map hive to 
external storage in 1 to 1 mappings are insufficient. I have attempted this 
upgrade already, but found out that predicate pushdown was not occurring.  Was 
this changed in 1.2?

   Can I update and use the same storage handler in Hive or has this concept 
been replaced by the RDDs and DataFrame API?

   Are these questions better for the Spark list?

   Thank you,

~ Shawn M Lavelle



[cid:image2a7f96.GIF@6678ebd7.468dcc41]

Shawn Lavelle
Software Development

4101 Arrowhead Drive
Medina, Minnesota 55340-9457
Phone: 763 551 0559
Fax: 763 551 0750
Email: shawn.lave...@osii.com<mailto:shawn.lave...@osii.com>
Website: www.osii.com<http://www.osii.com>

Reply via email to