Have you looked into file and folder level permissions? Or is your requirement
to do this through DDL options?
Thanks,
Ranjith
From: Babe Ruth [mailto:gtevelde-h...@hotmail.com]
Sent: Wednesday, October 24, 2012 09:49 PM
To: user@hive.apache.org
Subject: EXTERNAL: setting HIVE table property
thanks guys for the clarification. What about multiple queries run through a
single session? Do they get queued and executed one after the other?
Thanks,
Ranjith
On Aug 27, 2012, at 5:27 PM, Bertrand Dechoux wrote:
> Thanks a lot.
>
> > It's possible to live with this lim
.
Thanks,
Ranjith
From: Bertrand Dechoux [mailto:decho...@gmail.com]
Sent: Monday, August 27, 2012 11:01 AM
To: user@hive.apache.org
Subject: HiveServer can not handle concurrent requests from more than one
client?
Hi,
I would like to have more information about this specific sentence from the
Thanks Bejoy. What if those values a,b are not static and are housed in a
table. Much like a type 2 dimension. Is the current solution still to put it in
the where clause?
Thanks,
Ranjith
From: Bejoy Ks [mailto:bejoy...@yahoo.com]
Sent: Wednesday, August 08, 2012 06:55 AM
To: user
Since Hive (0.7.1) only supports equi-based join how are people using it for
joins employing the between clause?
Thanks,
Ranjith
You can do this using case statements and summing the values. The only item to
remember here is that the values in the grid need to be numeric for the sum to
work.
Thanks,
Ranjith
From: richin.j...@nokia.com [mailto:richin.j...@nokia.com]
Sent: Tuesday, August 07, 2012 3:58 PM
To: user
300, where
does the rest of the 200 mb get assigned to? Is sitting there idle? If I
increase the io.sort mb to the size of the jvm what effects does that have?
Thanks,
Ranjith
Thanks philip.
Thanks,
Ranjith
On May 23, 2012, at 4:15 AM, Philip Tromans wrote:
> Hi Ranjith,
>
> I haven't checked the code (so this might not be true), but I think that the
> map side aggregation stuff uses it's own hash map within the map phase to do
> the aggr
Thanks Matt. I am not performing a join so does that matter? What does this
local task do?
Thanks,
Ranjith
On May 22, 2012, at 8:17 PM, "Tucker, Matt" wrote:
> Try setting hive.auto.convert.join to true. The CLI will have a local task
> before it starts a map-reduce jo
ng in hive 0.7.1?
Thanks,
Ranjith
How are others setting up hive for use in production? I guess my real question
how are many of us getting around these security gaps?
Thanks,
Ranjith
On May 19, 2012, at 12:05 AM, Bejoy Ks wrote:
> Hi Ranjith
>
> AFAIK Segmenting tables into databases won't help much
Is separate metastores and separate hive servers the only way to go here? Or
can we segment tables into databases and then use hive authorization.
Thanks,
Ranjith
On May 18, 2012, at 11:08 PM, "Bejoy KS" wrote:
> Hi patrick
> The Authorization mechanisms in hive are not a
This could be a result of the data being skewed. When you look at the job
tracker page are you noticing just a few lurking around?
Thanks,
Ranjith
On May 18, 2012, at 1:57 PM, Balaji Rao wrote:
> I have a simple query running on HIVE using Amazon EMR where the
> reduce operation seems
Take a look at this, https://cwiki.apache.org/Hive/languagemanual-auth.html.
This may be what you are looking for .
From: shashwat shriparv [mailto:dwivedishash...@gmail.com]
Sent: Friday, May 18, 2012 3:08 PM
To: user@hive.apache.org
Subject: Re: Is there a way to create user account and grant r
Thanks Mark. I going to give this a shot a get back with some results.
Thanks,
Ranjith
On May 16, 2012, at 9:27 PM, Mark Grover wrote:
> Hi Ranjith,
> Here are the steps for using an index in Hive 0.7.1.
>
> 1) Create the index
> CREATE INDEX x ON T
associated with the row?
4. And I am guessing that you need to use the columns in the same order as it
is defined in the index?
Thanks,
Ranjith
- Original Message -
From: Mark Grover [mailto:mgro...@oanda.com]
Sent: Wednesday, May 16, 2012 07:52 PM
To: user@hive.apache.org
Cc
'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler'
WITH DEFERRED REBUILD
The query is as follows:
Select a,count(*) from x where j='and' group by a
Is there anything I am doing incorrectly?
Thanks,
Ranjith
With 0.7.1 hive allows for grants on tables and some ability to restrict table
alterations. What shortcomings are compensated for with multiple instances
versus those?
Thanks,
Ranjith
On May 13, 2012, at 3:32 PM, Vinod Singh wrote:
> Yes, security is one of the motivation. As hive is weak
vice versa?
Thanks,
Ranjith
On May 13, 2012, at 6:47 PM, Edward Capriolo wrote:
> I believe I walked through the entire process.
>
> You can ALTER TABLE a table and change it from external to managed. So
> someone could always change the table to MANAGED do the index thing
> and
Edward,
Did you confirm this through the explain plan or through the execution of the
ddl alone. And have you tried buckets with external tables?
Thanks,
Ranjith
On May 13, 2012, at 2:33 PM, Edward Capriolo wrote:
> The original design docs say you can not build indexes on external tables
Good info Edward. Thanks.
Thanks,
Ranjith
On May 13, 2012, at 2:33 PM, Edward Capriolo wrote:
> The original design docs say you can not build indexes on external tables but
> I tried it in 0.8.x and confirmed you can.
>
> On Sunday, May 13, 2012, Ranjith wrote:
> > Index
Given that hive has the concept of multiple databases to categorize objects.
What is the motivation behind having multiple hive instances? I am curious
here...is it for security?
Thanks,
Ranjith
On May 13, 2012, at 9:53 AM, Vinod Singh wrote:
> That if perfectly fine. Even each user
Starting in .7 hive introduced indexing,
https://issues.apache.org/jira/browse/HIVE-417. So indexes are available in
hive.
Thanks,
Ranjith
On May 12, 2012, at 11:13 PM, Raja Thiruvathuru wrote:
> No indexing in hive.
>
>
> On Sunday, May 13, 2012, Ranjith wrote:
> Indexes
Indexes can be built on tables managed by hive. For external tables I do not
believe that to be true. Please feel to correct if I am wrong.
Thanks,
Ranjith
On May 12, 2012, at 9:24 PM, Nanda Vijaydev wrote:
> In hive, the raw data is in HDFS and there is a metadata layer that defines
&g
Anyone implementing authorization and roles within their hive environment? If
so how successful has it been?
Thanks,
Ranjith
Thinking out loud here and may be worth a shot. Please perform an explain to
see if the where takes place after the join but this may work,
Select a.* from a left join b on a.key=b.key where b.key is null
Thanks,
Ranjith
From: Richard [mailto:codemon...@163.com]
Sent: Monday, March 12, 2012
. hive.metastore.server.min.threads
b. hive.metastore.server.max.threads
Thanks,
Ranjith
Sorry didn't read that you were trying to drop the header row specifically.
Having said that the solution outlined below is probably not a way to go on
this. I like Matt's suggestion and seems like a better approach.
From: Raghunath, Ranjith [mailto:ranjith.raghuna...@usaa.com]
Sent:
Give you a key column that is unique within your dataset I think this could
work.
1. Load the file as is, gunzipped, into a hive table
2. Determine the total row size.
3. Perform a insert into table Select * from Order by
desc limit
From: Dan Y [mailto:dan.m.y
Thanks Mark, Loren, and Vijay for helping out with this. I did try the serde
configuration and it worked well. I did come across the performance
implications as I increased the volume so I went ahead and cleansed the data
prior to inserting it. Thanks again.
Thank you,
Ranjith
string,
f3 string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
WITH SERDEPROPERTIES (
"input.regex" = "([^\"~]*) ([^\"~]*) ([^\"~]*)?",
"output.format.string" = "%1$s %2$s %3$s");
When I load the data in and try to perform a select get NULL values. Thanks
again.
Thank you,
Ranjith
Thanks Bejoy. This was helpful.
Thanks,
Ranjith
From: bejoy...@yahoo.com [mailto:bejoy...@yahoo.com]
Sent: Thursday, December 22, 2011 11:23 AM
To: user@hive.apache.org
Subject: Re: Schemas/Databases in Hive
Also multiple databases have proved helpful for me in organizing tables into
What is the intent of having tables in different databases or schemas in Hive?
Thanks
Thank you,
Ranjith
Thanks for the help with this.
Thanks,
Ranjith
From: Bejoy Ks [mailto:bejoy...@yahoo.com]
Sent: Friday, December 16, 2011 04:41 AM
To: user@hive.apache.org
Subject: Re: bucketing in hive
Ranjith
You can definitely change the number of buckets in a hive table even after
its creation. You
Thanks Bejoy. Appreciate the insight.
Do you know of altering the number of buckets once a table has been set up?
Thanks,
Ranjith
From: Bejoy Ks [mailto:bejoy...@yahoo.com]
Sent: Thursday, December 15, 2011 06:13 AM
To: user@hive.apache.org ; hive dev list
Subject: Re: bucketing in hive
Hi
1
If the file above were inserted into a table with Col1 as the bucket column,
can we dynamically allow all of the rows with “Apple” in one file and “Orange”
in one file and so on. Is there a way to do this without specifying the bucket
size to be 3.
Thank you,
Ranjith
.
From: Patrick Hunt [ph...@apache.org]
Sent: Friday, May 20, 2011 11:39 AM
To: user@hive.apache.org
Cc: Raghunath, Ranjith
Subject: Re: Hive connecting to squirrel on windows
What's the error you get?
Perhaps this one? https://issues.apache.org/jira/browse/HIVE-2163
(seems to
I have followed the document outlining how to perform the connection listed in
http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface. However, I keep getting a
error when trying to connect. I would appreciate any input on this.
Thank you,
Ranjith
Is there any advantage to changing the value of the 'hive.exec.submitviachild'
parameter?
Thank you,
Ranjith
Is there some advantage to gathering stats in this case?
Thank you,
Ranjith N. Raghunath
From: wd [mailto:w...@wdicc.com]
Sent: Tuesday, May 10, 2011 9:54 PM
To: user@hive.apache.org
Subject: Re: What does 'TempStatsStore' do ?
Thanks, I found some new configure options for hive.s
Thanks for the help on this. The option to set the header worked out great. Is
there a way that I can export data out to the local file system with the header
information?
Thank you,
Ranjith N. Raghunath
-Original Message-
From: Steven Wong [mailto:sw...@netflix.com]
Sent: Tuesday
Thanks Loren. Pardon my ignorance but what is an NPE?
Thank you,
Ranjith N. Raghunath
-Original Message-
From: Loren Siebert [mailto:lo...@siebert.org]
Sent: Tuesday, May 03, 2011 1:23 PM
To: user@hive.apache.org
Cc: user@hive.apache.org
Subject: Re: Export data with column names
Thanks. Is there something I can do with cli?
Thanks,
Ranjith
- Original Message -
From: Matthew Rathbone
To: user@hive.apache.org
Sent: Tue May 03 09:45:58 2011
Subject: Re: Export data with column names
If you use the thrift client you can call connection.getSchema
Does anyone know how to export data out with column names? Any help here is
appreciated.
Thanks,
Ranjith
Very cool. What is the non strict option for?
Thanks,
Ranjith
From: Ashish Thusoo
To:
Sent: Mon May 02 16:00:39 2011
Subject: Re: Cross join in Hive.
you could probably just say (1 = 1) in the on clause for the join.
set hive.mapred.mode=nonstrict;
select
Forgot to mentionthe condition for the inner join should be the column set
to 1 in the first table to be equal to the same column in the other table.
Thanks,
Ranjith
From: Raghunath, Ranjith
To: 'user@hive.apache.org'
Sent: Mon May 02 00:21:57 20
I haven't tested this out but plan to in 6 hours. Add an extra column and set
it to 1 in both tables. Perform an inner join between the two tables.
Thanks,
Ranjith
From: Abhinov Agarwal
To: user@hive.apache.org
Sent: Sun May 01 22:50:34 2011
Subject:
on this.
Thank you,
Ranjith N. Raghunath
custom map reduce
job to generate the base data if you plan to use that as an external table.
Please feel free to correct me here if I am wrong.
Thanks,
Ranjith
From: Shantian Purkad
To: user@hive.apache.org
Sent: Tue Apr 26 11:18:46 2011
Subject: External tables
49 matches
Mail list logo
