Hello, I am looking to upgrade a Hive 0.11 external storage handler that was run on Shark 0.9.2 to work on spark-sql 1.6.1. I’ve run into a snag in that it seems that the storage handler is not receiving predicate pushdown information.
Being fairly new to Spark’s development, would someone please tell me A) Can I still use external storage handlers in HIVE or am I forced to use the new DataFrame API and B) Did I miss something in how Pushdown Predicates work or are accessed due to the upgrade from hive 0.11 to hive 1.2.1? Thank you, ~ Shawn M Lavelle [cid:image81c412.GIF@06ba31c3.4ab1cd04] Shawn Lavelle Software Development 4101 Arrowhead Drive Medina, Minnesota 55340-9457 Phone: 763 551 0559 Fax: 763 551 0750 Email: shawn.lave...@osii.com<mailto:shawn.lave...@osii.com> Website: www.osii.com<http://www.osii.com>