Re: Issue while running Hive 0.13

Thanks Deepesh. To use hive with embedded derby mode, I have put the below configuration in hive-site.xml. As suggested on the net, I ran "schematool -dbType derby -initSchema" and it created $HIVE_HOME/metastore_db folder. Then as suggested by you, I ran "hive --service metastore". Strangely I'm

Re: hive job stuck at map=100%, reduce 0%

Thank you Bala, sorry I missed this session at Hadoop Summit. I did manage to catch most the Hive sessions, but this looks like it might have been one of the more important ones for me … :-( I notice you suggest setting memory parameters via "set mapreduce.reduce.memory.mb=5120". I presume th

Re: hive job stuck at map=100%, reduce 0%

hive> explain select i_item_desc , i_category , i_class , i_current_price , i_item_id ,sum(ws_ext_sales_price) as itemrevenue, sum(ws_ext_sales_price)*100/sum(sum(ws_ext_sales_price)) over (partition by i_class) as revenueratio > from item JOIN web_sales ON (web_sales.ws_item_sk = item.i_it

Re: hive job stuck at map=100%, reduce 0%

Hi Tim Can you please provide the "explain plan" for the query. If this happens because of the memory issues with mapjoin in the query, you can set hive.auto.convert.join=false and give it a try. Thanks Hari On Tue, Jul 8, 2014 at 1:18 PM, Tim Harsch wrote: > Hi, > I asked a question on Stack

Re: hive job stuck at map=100%, reduce 0%

At first look, it seems like a heap out of memory issue. But need to perform detailed analysis to nail down the issue further. Hive logs can provide more insights to it. We gave a presentation in Hadoop Summit on "Debugging Hive with Hadoop". The slide deck link is specified below. The slide# 42 a

hive job stuck at map=100%, reduce 0%

Hi, I asked a question on Stack Overflow (http://stackoverflow.com/questions/24621002/hive-job-stuck-at-map-100-redu ce-0) which hasn't seemed to get much traction, so I'd like to ask it here as well. I'm running hive-0.12.0 on hadoop-2.2.0. After submitting the query: select i_item_desc ,i_ca

Re: Change default meta store location

Under your HIVE_HOME/conf create a fine hive-site.xml and override the following property: javax.jdo.option.ConnectionURL jdbc:derby:;databaseName=*/new_db_location* /metastore_db;create=true JDBC connect string for a JDBC metastore substitute the new_db_location with the new location you

Re: Issue while running Hive 0.13

Did you start the Hive Metastore? You can start that by running hive --service metastore On Tue, Jul 8, 2014 at 5:27 AM, Sarath Chandra < sarathchandra.jos...@algofusiontech.com> wrote: > Thanks Santhosh. > So before going to launch hive shell, we need to start hive server is what > I understan

Hive UDF performance issue

Hello All, Can any one help me to answer to my question posted on Stackoverflow? http://stackoverflow.com/questions/24416373/hive-udf-performance-too-slow It is pretty urgent. Please help me. Thanks and Regards, Sankar S.

Change default meta store location

Hi All, Whenever I am logging to hive from any directory it's creating new metastore_db I also update the hive-default.xml to change the metastore location to different location but it's not working Any help appreciated Rahul

Re: Issue while running Hive 0.13

Thanks Santhosh. So before going to launch hive shell, we need to start hive server is what I understand. I tried starting hive server by running ./bin/hiveserver2. It just prompts "Starting HiveServer2" and keeps waiting. Nothing is happening even after waiting for several minutes. On Tue, Jul 8

Re: Possible memory leak with 0.13 and JDBC

Hello again, Some progress has been made on this issue. From initial testing this patch has fixed my problem. I had my cluster running all night and the memory usage is floating around 700 MB. Before it would be > 1GB and climbing. https://issues.apache.org/jira/browse/HIVE-7353 -Benjamin O

Re: Issue while running Hive 0.13

how did you start hive? Use hive-server2 From: Sarath Chandra To: user@hive.apache.org Sent: Tuesday, July 8, 2014 4:02 PM Subject: Issue while running Hive 0.13 Hi, I'm a newbie to Hive. Facing an issue while installing hive stable version (0.13). I dow

Issue while running Hive 0.13

Hi, I'm a newbie to Hive. Facing an issue while installing hive stable version (0.13). I downloaded the tar file from the site ( apache-hive-0.13.1-bin.tar.gz ) and followed the instructions given on Hive Wiki

capturing onAlterTable event

Hello I have a requirement to capture the onAlterTable() event of hive metastore.  I intend to do some data processing stuff if any of the column has been altered (ADD/DROP etc.). Can someone please help me   find what has changed  in the 'alter table' operation? I have this code   public voi

capturing onAlterTable event

Hello I have a requirement to capture the onAlterTable() event of hive metastore.  I intend to do some data processing stuff if any of the column has been altered (ADD/DROP etc.). Can someone please help me   find what has changed  in the 'alter table' operation? I have this code   public void

Re: Possible memory leak with 0.13 and JDBC

Could you try "jmap -histo:live " and check hive objects which seemed too many? Thanks, Navis 2014-07-07 22:22 GMT+09:00 jonas.partner : > Hi Benjamin, > Unfortunately this was a really critical issue for us and I didn’t think > we would find a fix in time so we switched to generating a hive s

Re: mapjoin error

Looks like HIVE-6913(https://issues.apache.org/jira/browse/HIVE-6913) and will be fixed in hive-0.14.0. Thanks, Navis 2014-07-04 17:12 GMT+09:00 sunww : > Hi > I'm using hive0.11 and hadoop2.2. When I use a large table join on > two empty tables , it convert to mapjoin automatic.But mr fa