Anyone try this yet : http://hadoop-pig-hive-thejas.blogspot.com/2013/04/running-hive-in-local-mode.html
? On Sat, Dec 28, 2013 at 8:09 PM, Jay Vyas <jayunit...@gmail.com> wrote: > -Local mode should have clear instructions on how to run fully local hive > jobs, with no hadoop installation. > > -I like the hive_test repo but I'm not yet sure hive_test is 100% up to > date with the simplest strategy for testing hive workflows on the JVM. > > > On Dec 28, 2013, at 4:19 PM, Lefty Leverenz <leftylever...@gmail.com> > wrote: > > This sounds like something the documentation should cover. > > - What information should be added to the Local > Mode<https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin#AdminManualMetastoreAdmin-LocalMetastore>section? > - Should the wiki have a link to > hive_test<https://github.com/edwardcapriolo/hive_test> (for > example, in Hive Developer > FAQ<https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ> > )? > > > -- Lefty > > > On Sat, Dec 28, 2013 at 8:02 AM, Edward Capriolo <edlinuxg...@gmail.com>wrote: > >> I do not think so. Local mode, just implies the job tracker is local (and >> some of the temp storage directories) it does not imply hive will use >> hadoop without forking. >> >> >> On Sat, Dec 28, 2013 at 10:43 AM, Jay Vyas <jayunit...@gmail.com> wrote: >> >>> Thanks... But are you sure this is the only way? Or is there some magic >>> way to run hive in local mode that we both are missing out on ?:)... >>> >>> - isn't hive in local mode supposed to be run simply via the jdbc://hive >>> URL which runs local mode... Or maybe by the fork config parameter? >>> >>> - For example see the parameters in this file: >>> >>> >>> https://github.com/riptano/brisk/blob/master/resources/hive/conf/hive-site.xml >>> >>> >>> On Dec 28, 2013, at 10:22 AM, Edward Capriolo <edlinuxg...@gmail.com> >>> wrote: >>> >>> You can follow along to what I do here. >>> >>> https://github.com/edwardcapriolo/hive_test >>> >>> Essentially hive requires a HADOOP_HOME because it always wants to fork >>> a bin/hadoop process. Hive-test helps you unpack hadoop inside target and >>> change your hadoop_home to some other directory. >>> >>> It would be nice if there was some other way to do this. >>> >>> >>> On Fri, Dec 27, 2013 at 10:27 PM, Jay Vyas <jayunit...@gmail.com> wrote: >>> >>>> Hi Hive: >>>> >>>> I'm attempting to create a robust eclipse based dev environment for >>>> testing my hive jobs in localmode however I run into classnotfound errors >>>> depending on which maven dependencies I use. Also, it seems when I change >>>> these dependencies from hive 0.12 to hive 0.11, I get other errors related >>>> to hive trying to launch jobs via calling /usr/bin/hadoop. >>>> >>>> This I am stuck: I can't run hive 12 in local java mode because of >>>> subtle datanucleus class and API inconsistencies which are tough to >>>> resolve, and when going to hive 11, it seems local mode is not natively >>>> detected via the jdbc URL... >>>> >>>> So I have 2 questions: >>>> >>>> 0) how does hive 12 versus 11 implement local mode differently ? >>>> >>>> And >>>> >>>> 1) What is the right way to in hive in pure java/ local environments? >>>> >>>> The hive book suggests modifying configuration properties, for local >>>> mode.. >>>> >>>> but I also have found that in hive 0.12 , using the jdbc://hive >>>> connection URL automagically launches jobs in local mode.. >>>> >>>> However in 0.11 , I see calls to /usr/bin/hadoop when running java >>>> classes in local eclipse environment. >>>> >>>> Thanks! >>>> >>>> FYI to see an example of my pom.xml, you can checkout the >>>> github://jayunit100/bigpetstore pom.xml file. >>>> >>> >>> >> > -- Jay Vyas http://jayunit100.blogspot.com
