Re: hive permissions issue on a database

2012-10-01 Thread Rahul Sarma
Hi Sriram Let me try that option. On default I have only create permissions. And yes a user is not able to see own tables. On Oct 1, 2012 9:22 PM, "Sriram Krishnan" wrote: > In general, Hive authorization is not very secure, as is documented on > the wiki: > https://cwiki.apache.org/confluenc

Re: hive permissions issue on a database

2012-10-01 Thread Sriram Krishnan
In general, Hive authorization is not very secure, as is documented on the wiki: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Authorization. You are likely running into this issue: https://issues.apache.org/jira/browse/HIVE-2538. Try this as user demo2: "use demo1db; drop ta

Re: hive permissions issue on a database

2012-10-01 Thread Rahul Sarma
Hi Bejoy, Thanks for your help. Is there any other way to meet this requirement? How about giving it at the table level? Also can you share some thoughts on why my "show tables" command doesn't show me the tables created by the user? Regards, Rahul Sarma On Mon, Oct 1, 2012 at 8:01 PM, Bejoy KS

Re: Percentile calculation

2012-10-01 Thread MiaoMiao
More info, please. On Mon, Oct 1, 2012 at 4:50 PM, Mayank Bansal wrote: > Hi, > > > > I am trying to run the hive udf percentile, I am trying to run it on a > column with something around 116 million unique values. > > The maximum space that I can give to the reducer is 12 GB, the job keeps on >

Re: hive permissions issue on a database

2012-10-01 Thread Bejoy KS
Hi Rahul Hive currently have this limitation. You can have permissions on hdfs but not on the metastore. So as a result any user can drop any table in hive. I have seen such discussions popping up before as well since it a genuine requirement you can expect permissions on metastore level in fu

Re: HIVE NOT EXISTS

2012-10-01 Thread Mohit Anchlia
thanks! that works On Mon, Oct 1, 2012 at 3:43 PM, Matt Tucker wrote: > Hi Mohit, > > > > Hive doesn’t support correlated subqueries. In this instance, you can do > a left outer join to find values that are not in a table. > > > > SELECT > > “”, > > a.pagename, > > a.pagedetail,

Re: HIVE NOT EXISTS

2012-10-01 Thread Matt Tucker
Hi Mohit, Hive doesn’t support correlated subqueries. In this instance, you can do a left outer join to find values that are not in a table. SELECT “”, a.pagename, a.pagedetail, “”, a.pagetitle, a.page_id, a.pagetype FROM page_temp_ext a LEFT OUTER JO

Re: Defining collection items terminated by for a nested data type

2012-10-01 Thread Sadananda Hegde
I tested the nesting with the following DDL. CREATE TABLE test_tbl ( col1 STRING, col2: INT, col3 MAP>) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' COLLECTION ITEMS TERMINATED BY ',' MAP KEYS TERMINATED BY ':' LINES TERMINATED BY '\n' STORED AS TEXTFILE; I was able to load and

hive permissions issue on a database

2012-10-01 Thread Rahul Sarma
I have a Hadoop cluster running CDH4 version. I am having issues giving privileges to users on hive. My requirement is for each linux user I need to create a database on hive and give access to only that user(or group). So other users should not be able to see those tables or do anything with them.

is it possible to disable running termiatePartial and merge() methods in UDAF

2012-10-01 Thread java8964 java8964
Hi, I am trying to implement a UDAF of Kurtosis (<�a href="http://en.wikipedia.org/wiki/Kurtosis";>http://en.wikipedia.org/wiki/Kurtosis<�/a> in the hive. I already found a library to do it, from Apache commons math (<�a href="http://commons.apache.org/math/apidocs/org/apache/commons/math/stat

Re: Cartesian Product in HIVE

2012-10-01 Thread Abhishek
Thanks for the reply Bejoy. Sent from my iPhone On Oct 1, 2012, at 12:30 AM, "Bejoy KS " wrote: > Hi Abshiek > > Both your tables are ideal candidates for map join. > > Can you try a plain join statement without setting any properties other than > num reducers and a map join as the next step

RE: hive query fails

2012-10-01 Thread Mayank Bansal
Could you give more details, it would be helpful if you could share the log files from the tasktracker for this job. Your tracking url has details for the process, you could start from there and share the logs. From: Ajit Kumar Shreevastava [mailto:ajit.shreevast...@hcl.com] Sent: Monday, Octobe

Re: hive query fails

2012-10-01 Thread Nitin Pawar
select * from table does not start a mapreduce job what you need to check why is your job not started on jobtracker (may be enough resources not available or something wrong with setup) On Mon, Oct 1, 2012 at 4:29 PM, Ajit Kumar Shreevastava wrote: > Dear all, > > > > I am running following que

RE: hive query fails

2012-10-01 Thread yogesh dhari
Hi Ajit, Select * command doesn't invoke reducer, its just dump the data. check out your network proxy settings. Regards Yogesh Kumar Dhari From: ajit.shreevast...@hcl.com To: user@hive.apache.org Date: Mon, 1 Oct 2012 16:29:27 +0530 Subject: hive query fails Dear all, I am running following

hive query fails

2012-10-01 Thread Ajit Kumar Shreevastava
Dear all, I am running following query and I m not getting any output. But select * from pokes is working fine. [hadoop@NHCLT-PC44-2 bin]$ hive Logging initialized using configuration in file:/home/hadoop/Hive/conf/hive-log4j.properties Hive history file=/home/hadoop/tmp/hadoop/hive_job_log_ha

Percentile calculation

2012-10-01 Thread Mayank Bansal
Hi, I am trying to run the hive udf percentile, I am trying to run it on a column with something around 116 million unique values. The maximum space that I can give to the reducer is 12 GB, the job keeps on failing due to java heap space error. Is there a way to optimize this, so that I don't en

Re: Embedded mode for jdbc client inside a multi-threaded (web) application

2012-10-01 Thread Bertrand Dechoux
We had almost the same discussion on another thread. I know your article and I have read it but it does not provide more information than the official documenation. And it is not clear about concurrency issue with the embedded mode. Sure if there is only one user per embedded server, there won't be

Re: Issue uploading data to S3 with Hive

2012-10-01 Thread Florin Diaconeasa
Hello, I've met this issue several times before. The problem, from what i saw, is that Hive isn't actually aware of the underlying storage system (which is rather normal), as Hadoop should handle that. Also, Hadoop might get 404 from Amazon WS (i guess in order for them to throttle) and simply st