Re: Need urgent help

Yes. Sent from Samsung Mobile Original message From: Andre Araujo Date:02/07/2014 00:10 (GMT-08:00) To: user Subject: Re: Need urgent help Did you manage to load the jar from the local file? On 2 July 2014 16:57, mailto:shouvanik.hal...@accenture.com>> wrote: This copy was

Re: Need urgent help

This copy was successful. The file was not corrupted Sent from Samsung Mobile Original message From: Andre Araujo Date:01/07/2014 23:45 (GMT-08:00) To: user Subject: Re: Need urgent help Can you try the following to check if there's any problem with the jar itself? hadoop fs

RE: Need urgent help

-rw-r--r-T 1 ipg_intg_user supergroup 621942 2014-05-20 21:33 hdfs://xx.xx.xx.xxx:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar From: Andre Araujo [mailto:ara...@pythian.com] Sent: Tuesday, July 01, 2014 10:46 PM To: user Subject: Re: Need urgent help What's the result of the command

Re: Need urgent help

Yes Sent from Samsung Mobile Original message From: Abirami V Date:01/07/2014 22:15 (GMT-08:00) To: user@hive.apache.org Subject: Re: Need urgent help Hi, have you add the property in hive( hive.aux.jars.path. The location of the plugin jars that contain implementations o

RE: Need urgent help

The user has read permission Its rw-r—r— Thanks, Shouvanik From: hadoop hive [mailto:hadooph...@gmail.com] Sent: Tuesday, July 01, 2014 9:45 PM To: user@hive.apache.org Subject: RE: Need urgent help Jar must have read permission by that user. Which you are using to run the jobs. On Jul 2, 2014 9

RE: Need urgent help

Can you please elaborate on the permission Hi, Cannot add a jar to hive classpath. Once I launch HIVE, I type -> ADD JAR hdfs://xx.xx.xx.xxx:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar; I get the error, Failed to read external resource hdfs://xx.xx.xx.xxx:9000/user/ipg_intg_user/AP/scr

Recall: Need urgent help

Haldar, Shouvanik would like to recall the message, "Need urgent help". This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender i

Recall: Need urgent help

Haldar, Shouvanik would like to recall the message, "Need urgent help". This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender i

Need urgent help

Hi, Cannot add a jar to hive classpath. Once I launch HIVE, I type -> ADD JAR hdfs://10.37.83.117:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar; I get the error, Failed to read external resource hdfs://10.37.83.117:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar Query returned non-zero

Getting weird error after M/R job completes with status as 100%

Hi Nitin, I have a M/R job which gets executed as soon as a hive query runs. This hive query has many complex joins. Both the Map/Reduce jobs complete with status at 100%, after which I get the below error 2014-06-27 23:42:06,396 INFO org.apache.hadoop.hive.ql.exec.Task (SessionState.java:p

Greetings:::A idea about XACML

Hi Nitin, Can you please provide me some insight into how to secure HIVE using XACML? Scenario. User A owns a table A User B owns a table B. Using Hive QL, User A cannot delete table B User B cannot delete table A. Is that achievable? PS-> Hive is installed on EMR Please help me. Thanks, S

RE: Need urgent help on hive query performance

Thanks to all for all your suggestions. Really appreciate. But we have a constraint on Amazon EMR. It would be great if I get any pointer on how to tune Hadoop configurations(e.g. core-site.xml, mapred-site.xml etc) so that HIVE query gets executed faster. Please help ASAP. Sorry for the urgenc

RE: Need urgent help on hive query performance

Pls find the answers From: kulkarni.swar...@gmail.com [mailto:kulkarni.swar...@gmail.com] Sent: Friday, May 30, 2014 3:34 PM To: user@hive.apache.org Subject: Re: Need urgent help on hive query performance I feel it's pretty hard to answer this without understanding the following: 1. Wha

RE: Need urgent help on hive query performance

Can you please give a specific example or blog to refer to. I did not understand From: Ashish Garg [mailto:gargcreation1...@gmail.com] Sent: Friday, May 30, 2014 3:31 PM To: user@hive.apache.org Subject: Re: Need urgent help on hive query performance try partitioning the table and run the queries

Need urgent help on hive query performance

Hi, Does anybody help urgently on optimizing hive query performance? I am looking more Hadoop tuning point of view. Currently, small amount of table takes much time to query? We are running EMR cluster with 1 MASTER node, 2 Core Nodes and Task Nodes. Quick help is much appreciated. Thanks,

RE: Any idea how to find out how long map reduce jobs are running?

There is no specific map reduce program here. Actually sqoop jobs run and internally that executes a map-reduce job. From: Brad Ruderman [mailto:bruder...@radiumone.com] Sent: Tuesday, May 20, 2014 9:54 AM To: user@hive.apache.org Subject: Re: Any idea how to find out how long map reduce jobs are

RE: Any idea how to find out how long map reduce jobs are running?

Thanks for the quick reply, Brad. Actually, the requirement is, We have to write a monitor to track how long a map-reduce job runs. If the map reduce job runs after a specific time, certain actions should be taken. Have you ever created one? Thanks, Shouvanik From: Brad Ruderman [mailto:brude

Any idea how to find out how long map reduce jobs are running?

Hi, I need help in finding how long a map-reduce job runs. Any help is highly appreciated. Thanks, Shouvanik This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received

RE: Is there any monitoring tool available for hiveserver2

Sure thing. Thanks Biswajit. Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Friday, February 21, 2014 9:23 AM To: user@hive.apache.org Subject: RE: Is there any monitoring tool available for hiveserver2 This one is for monitoring of metastore only. It has t

RE: Is there any monitoring tool available for hiveserver2

Thanks Biswajit. I will try it and let you know. Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Friday, February 21, 2014 2:28 AM To: user@hive.apache.org Subject: Re: Is there any monitoring tool available for hiveserver2 Below is the script that does my grap

RE: Is there any monitoring tool available for hiveserver2

That will be great! Thanks in advance. Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Thursday, February 20, 2014 8:37 PM To: user@hive.apache.org Subject: RE: Is there any monitoring tool available for hiveserver2 I could share the script that does it. I w

RE: Is there any monitoring tool available for hiveserver2

Hi Biswajit, Could you give an idea of how to do it, please? Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Thursday, February 20, 2014 8:30 PM To: user@hive.apache.org Subject: Re: Is there any monitoring tool available for hiveserver2 I have built up a c

Is there any monitoring tool available for hiveserver2

Hi, It might happen that hiveserver2 memory gets exhausted. Similarly there would be many other things to monitor for hiveserver2. Is there any monitoring tool available in the market? I am using EMR, for FYI. Thanks, Shouvanik This message is for the

RE: hiveserver2 crashes now and then

Hey, Thanks for the reply. But we were looking at options on how to resize the Hadoop_heapsize parameter, so that hiveserver2 don't crash next time? Is there any good write-up on this? Thanks, Shouvanik From: Brad Ruderman [mailto:bruder...@radiumone.com] Sent: Tuesday, February 18, 2014 3:2

hiveserver2 crashes now and then

Hi, HiveServer2 is getting crashed every now and then, within an interval to 2 days or so. Is this related to memory leak or something? Developers are executing very complex queries which they suspect is causing the problem. Please help. Thanks, Shouvanik ___

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

After adding this, do we have to restart mysql / hive? From: Satish Mittal [mailto:satish.mit...@inmobi.com] Sent: Thursday, December 26, 2013 4:41 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore Can you check the following

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

Hi, Which database should I select in MYSQL? I have two databases presently mysql> show databases; ++ | Database | ++ | information_schema | | test | ++ 2 rows in set (0.00 sec) And once inside test database, I

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

Hi, I will check and let you know. Thanks, Shouvanik From: zeekvfu [mailto:wzmind...@gmail.com] Sent: Thursday, December 26, 2013 12:46 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore You can get the table name, using: sel

Adding a table in HIVE does not create a table on mysql which is the metastore

Hi, I am exploring HIVE options on EMR box from Amazon. Once I create a table from HUE(Hadoop User Experience) console, I expect a table to get created on MYSQL as this is the metastore. But I don't find the table inside MYSQL database. Any ideas? Thanks, Shouvanik ___

Re: Error when issuing select query

Below is the message that I get. Sent from Samsung Mobile Original message From: Nitin Pawar Date:15/11/2013 16:30 (GMT+05:30) To: "Shouvanik Haldar (Contingent)" Cc: user@hive.apache.org Subject: Re: Error when issuing select query what is the error ? On Fri, Nov 15, 2013

Looking for help related to HUE

Hi Nitin, Can you please help me with HUE issue. I am not able to create table in HUE using HCatalog? Thanks, Shouvanik This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have

RE: Doing FSCK throws error

The script for this table is add jar json-serde-1.1.3-jar-with-dependencies.jar; list jars; CREATE EXTERNAL TABLE IF NOT EXISTS table1 ( instance_type string, category string, session_id string, nonce string, user_id string, properties array>, instance map, true_as_of_secs string ) PARTITIONED

Doing FSCK throws error

Hi, On executing "MSCK REPAIR TABLE table1", I get the below error. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask What can possibly be the error. Thanks, Shouvnik This message is for the designated recipient only and may c

RE: Not able to execute this query

Thanks Nitin. I am able to create the table in HUE now. You are right. There was no directory and no permission accordingly. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 9:08 PM To: Haldar, Shouvanik Cc: user@hive.apache.org Subject: Re:

RE: Not able to execute this query

Hi Nitin, Thanks. That answers my previous query. But, if I add LOCATION '/user/hue/' string below, I get a big fat exception in beeswax. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 8:22 PM To: user@hive.apache.org Subject: Re: Not able

RE: Not able to execute this query

Hi, Have you used HUE WEB console. Actually I have not used same columns. But, when I give a query, I get that error.! Please help? Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 7:34 PM To: user@hive.apache.org Subject: Re: Not able to ex

Not able to execute this query

When I executing the query to create table in HIVE, I am getting this error. 'NoneType' object has no attribute 'columns' The table script below create external table test1( - ) PARTITIONED BY (col1 timestamp, col2 timestamp) CLUSTERED BY(col1) SORTED BY(col1 ASC)

RE: User accounts to execute hive queries

Hi Nitin, I want it secured. Yes, I would like to give specific access to specific users. E.g. "select * from" access to some and "add/modify/delete" options to some "What kind of security do you have on hdfs? " I could not follow this question Thanks, Shouvanik From: Nitin Pawar [mailto:niti

RE: User accounts to execute hive queries

Hi Nitin, Users want to execute hive queries from their user name? Is it possible or they have to do it logged in as hive user? Thanks, Shouvanik -Original Message- From: Haldar, Shouvanik Sent: Monday, September 16, 2013 4:06 PM To: user@hive.apache.org Subject: User accounts to execut

User accounts to execute hive queries

Hi, Can you please tell me if its possible to execute hive queries as different users? Can we create read-only access for hive? Please help. Thanks Shouvanik Sent from my Windows Phone -Original Message- From: "Nitin Pawar" Sent: ‎16-‎09-‎2013 15:57 To: "user@hive.apache.org" Subject:

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi Nitin, Latest update. Am able to start metastore and table getting created. But when I execute the command “hive> select * from table_name”, hive compaints Failed with exception java.io.IOException:java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified a

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Sorry again. File system will be hadoop Sent from my Windows Phone From: Haldar, Shouvanik Sent: ‎10-‎09-‎2013 16:59 To: user@hive.apache.org Subject: RE: error executing the tutorial -> https://c

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

The issue is if I paste it in core-site.xml of Hadoop on the node in question, then will starting datanode would do only? Actually,. I am a bit confused what all daemons to start. I have a YARN architecture running 1 separate - Resource Manager, 1 NameNode & 4 datanodes. From: Nitin Pawar [ma

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

The values are showing when I run "hive> set;" command. But it's not getting identified. I guess I am not starting HIVE properly. Do you know what are the steps? From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Tuesday, September 10, 2013 4:04 PM To: user@hive.apache.org Subject: Re: err

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi Nitin, PFA hive-site.xml. I wanted to start Hortonworks HIVE. Can you please help. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Tuesday, September 10, 2013 11:15 AM To: user@hive.apache.org Subject: Re: error executing the tutorial -> https://cwiki.apache.org/co

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Please help. I am badly stuck on this. Please help. From: Haldar, Shouvanik Sent: Tuesday, September 10, 2013 1:03 AM To: 'user@hive.apache.org' Subject: RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely When I set values inside hive-s

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

When I set values inside hive-site.xml & test whether values are set by typing hive> set; I see that the values are set. Yet, when I run "CREATE EXTERNAL TABLE..." command, I get the same error FAILED: Error in metadata: MetaException(message:java.lang.IllegalArgumentException: AWS Access Key I

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi Nitin, Please help me with the below? Thanks, Shouvanik From: Haldar, Shouvanik Sent: Saturday, September 07, 2013 2:30 AM To: user@hive.apache.org Subject: RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely Hi , I tried to set th

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi, Can anybody please reply to this below? I am stuck up very bad. Regards, Shouvanik From: Haldar, Shouvanik Sent: Friday, September 06, 2013 11:22 PM To: user@hive.apache.org Subject: RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemote

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi , I tried to set the parameters inside hive-site.xml on the node from where I am running hive. Even "hive>set;" command showed me that the parameters were successfully set. Yet, when running hive "CREATE EXTERNAL TABLE...", I am getting the following error FAILED: Error in metadata: MetaEx

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi, Is it possible to permanently set the below parameters? Please help. Thanks, SHouvanik From: Jitendra Yadav [mailto:jeetuyadav200...@gmail.com] Sent: Thursday, September 05, 2013 6:02 PM To: user@hive.apache.org Subject: Re: error executing the tutorial -> https://cwiki.apache.org/confluenc

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Once I have access keys & ID in hand, I will execute this step and let you know. But, I suspect that the access secret key might have "/" in it. I came across this JIRA-> https://issues.apache.org/jira/browse/HADOOP-3733 . Do you know if there is a workaround other than regenerating secret key w

RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi, Thanks for the reply. I had seen in some posts, that you could mention these keys on the Hive CLI. If things work, then I am later planning to include it in core-site.xml of Hadoop config. Presently, I am not allowed to restart Hadoop services. "create external table . LOCATION 's

error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi, I am executing the example, but got initial roadblock while trying out "Setting up tables (DDL Statements)" section. When I executed the command "hive> create external table kv (key int, values string) location 's3n://data.s3ndemo.hive/kv';" I got the error FAILED: Error in metadata: Me

RE: Issue with creating HIVE metadata for a HBASE table with 2000 + columns

Hi, "if your values for the column on postgres are more than 4000 chars then I would recommend you alter your postgres meta data table to have a bigger limit." How to do the above? Actually, while looking at the logs, I found out that /usr/lib/hive/scripts/metastore/upgrade/postgres location,

RE: Issue with creating HIVE metadata for a HBASE table with 2000 + columns

Hi, Can anybody please reply. I thought this forum is ACTIVE? -Original Message- From: Haldar, Shouvanik Sent: Thursday, June 06, 2013 2:08 PM To: 'user@hive.apache.org' Subject: Issue with creating HIVE metadata for a HBASE table with 2000 + columns Hi, I have a HBASE table with 2000 +

Issue with creating HIVE metadata for a HBASE table with 2000 + columns

Hi, I have a HBASE table with 2000 + columns. I have to create a HIVE metadata. But am facing issue while creating the HIVE table FAILED: Error in metadata: MetaException(message:javax.jdo.JDODataStoreException: Put request failed : INSERT INTO "SERDE_PARAMS" ("PARAM_VALUE","SERDE_ID","PARAM_K