RE: UDF cannot be found when the query is submitted via templeton

2015-04-19 Thread Xiaoyong Zhu
No, it doesn't... What surprises me is that for HDInsight (Hadoop on Azure) which is using Azure BLOB storage, using ADD JAR wasb:///test/HiveUDF.jar; CREATE TEMPORARY FUNCTION FindPat as 'HiveUDF.FindPattern' select count(FindPat(columnname)) from table1; would work. However, for my own cluste

RE: Orc file and Hive Optimiser

2015-04-19 Thread Mich Talebzadeh
Thanks John for the link Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books "A Practitioner's Guide to Upgrading to Sybase ASE 15", ISBN 978-0-9563693-0-7. co-author "Sybase Transact SQL Guidelines Best Practices", ISBN 978-0-9759693-0-4 Publications due shortly:

Re: Orc file and Hive Optimiser

2015-04-19 Thread John Pullokkaran
If you wish to contribute to CBO, there is a CBO branch on which current dev work is being done. Current dev work is captured by HIVE-9132. Looking forward to your contributions. Thanks John From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Rep

RE: Orc file and Hive Optimiser

2015-04-19 Thread Mich Talebzadeh
Thanks John, I have already registered my interest on development work for Hive. So hopefully I may be able to contribute at some level. Regards, Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books "A Practitioner's Guide to Upgrading to Sybase ASE 15", IS

Re: Orc file and Hive Optimiser

2015-04-19 Thread John Pullokkaran
ORC format is transparent to CBO. Currently we are working on a new cost model which might reflect ORC's performance advantages in optimization decisions. Thanks John From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org" mailto:user@hiv

Orc file and Hive Optimiser

2015-04-19 Thread Mich Talebzadeh
My understanding is that the Optimized Row Columnar (ORC) file format provides a highly efficient way to store Hive data. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC In a nutshell the columnar storage allows pretty efficient compression of columns on par with wha