Hello, I am working with an external storage handler written for Hive 0.11 and run on a Shark execution engine. I’d like to move forward and upgrade to hive 1.2.1 on spark 1.6 or even 2.0.
This storage has a need to run queries across tables existing in different databases in the external data store, so existing drivers that map hive to external storage in 1 to 1 mappings are insufficient. I have attempted this upgrade already, but found out that predicate pushdown was not occurring. Was this changed in 1.2? Can I update and use the same storage handler in Hive or has this concept been replaced by the RDDs and DataFrame API? Are these questions better for the Spark list? Thank you, ~ Shawn M Lavelle [cid:image2a7f96.GIF@6678ebd7.468dcc41] Shawn Lavelle Software Development 4101 Arrowhead Drive Medina, Minnesota 55340-9457 Phone: 763 551 0559 Fax: 763 551 0750 Email: shawn.lave...@osii.com<mailto:shawn.lave...@osii.com> Website: www.osii.com<http://www.osii.com>