testing

2010-10-08 Thread Namit Jain
Testing the new mailing list alias

RE: [howldev] RE: Howl Authorization proposal

2010-10-13 Thread Namit Jain
Moreover, there are metadata operations which do not require access to the dfs today (like alter table add columns...). This should also have some privilege model - depending on hdfs for that seems like a overkill. If the metastore stores all privilege information, and all access (hive/pig/ho

RE: hive svn is up and hive.apache.org is up

2010-10-13 Thread Namit Jain
Let us punt it for now From: John Sichi [jsi...@facebook.com] Sent: Wednesday, October 13, 2010 6:08 PM To: Cc: Subject: Re: hive svn is up and hive.apache.org is up A related question is whether we want to rename Java packages from org.apache.hadoop.hiv

RE: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-03 Thread Namit Jain
congrats Carl From: Zheng Shao [zsh...@gmail.com] Sent: Tuesday, November 02, 2010 11:34 PM To: dev@hive.apache.org Subject: Re: [ANNOUNCE] New Committer - Carl Steinbach Congratulations Carl! Zheng On Tue, Nov 2, 2010 at 11:23 AM, Ashish Thusoo wrote:

[ANNOUNCE] New Hive Committer - Amareshwari Sriramadasu

2010-11-08 Thread Namit Jain
Hi Folks, The Hive PMC has passed the vote to make Amareshwari Sriramadasu a new committer on the Apache Hive project. Following is a list of the contributions that Amareshwari has made to the project: http://bit.ly/c3z0ty Congratulations Amareshwari. Please send over your CLA to Apache. Than

RE: Confusing in hive-default.xml

2010-11-09 Thread Namit Jain
It is a typo. Can you file a jira and fix it ? Thanks, -namit -Original Message- From: 김영우 [mailto:warwit...@gmail.com] Sent: Tuesday, November 09, 2010 3:12 AM To: dev@hive.apache.org Subject: Confusing in hive-default.xml Hi, Myabe it is a typo but i'm not sure. Excerpt from hive

hive roadmap

2010-11-23 Thread Namit Jain
For the interest of the community, we have updated the following page: http://wiki.apache.org/hadoop/Hive/Roadmap If you are planning to work on a task, please add it to the appropriate section. This helps to track the major new features, and also help new contributors to pick up a project. T

Re: Issue with map join

2010-12-23 Thread Namit Jain
Can you send the exact query along with the schema of the tables ? On 12/23/10 1:48 AM, "jaydeep vishwakarma" wrote: >Hi, > >I am trying to running some MAPJOIN queries. When I am placing single >table in MAP JOIN it works fine,But when I run same query with two >tables on MAPJOIN it gives erro

patch review process

2011-01-19 Thread Namit Jain
It would be good to have a policy for submitting a new patch for review. If the patch is small, usually it is pretty easy to review.But, if it large, a GUI like reviewboard (https://reviews.apache.org) makes it easy. So, going forward, I would like to propose either of the following. 1. All pa

Re: patch review process

2011-01-20 Thread Namit Jain
tional people can disagree >>>about >>> > what qualifies as a small patch and what does not, and I'd like >>>people to >>> > make ReviewBoard a habit instead of something that they use >>>occasionally. >>> I >>> > think tha

Re: patch review process

2011-01-20 Thread Namit Jain
post a review >> request >> > for a first (or second) time contributor, but in general it's >>important >> for >> > the contributor to create the request since only the creator can >>update >> it. >> > >> > Thanks. >> > >

Re: The control flow of hive

2011-01-24 Thread Namit Jain
Do you want to do it offline - I mean, insert in a hive table - that will be done parallely using map-reduce. This is a jira on export-import for hive being worked on. It might be simpler to just export the data and import it into another db table. It might take some work to get the format compati

Re: Scheduling the Hive 0.7.0 Release

2011-01-24 Thread Namit Jain
Before finalizing on the date, let us go over the 68 issues. Based on that, let us come up with a release date. There is no point in having a release with lots of bugs or mostly working features. Don¹t get me wrong - I am very interested in 0.7 release, but don¹t want to hurry up something - a d

hive release 0.7

2011-01-31 Thread Namit Jain
In the last contributor meeting, we had decided to switch to a time-based release. Carl Steinbach would act as the release manager for hive 0.7.0. We would cut a release branch in 2 weeks. Please go over the jiras and mark the jiras as blockers for 0.7. Currently, 12 jiras are marked as blocker

Re: Query Optimization in Hive

2011-02-01 Thread Namit Jain
Absolutely, that is one direction we are looking into, and none of us has actively started on that. Bharath is planning to start on join-reordering https://issues.apache.org/jira/browse/HIVE-1938. Similar to the above jira, can you file one and we can discuss in more detail in the jira ? Than

Re: Query regarding Metastore(Derby) SDS table data

2011-02-03 Thread Namit Jain
Different partitions can have different paths - A partition's path need not be a sub-direcotry of the table's path. In facebook, we use this regularly, specially for external tables. So, it simplifies things if the full path is stored for the partition in the metastore. Thanks, -namit On 2/3/1

Re: Query regarding Metastore(Derby) SDS table data

2011-02-04 Thread Namit Jain
y whose address >is listed above. Any use of the information contained herein in any way >(including, but not limited to, total or partial disclosure, reproduction, >or dissemination) by persons other than the intended recipient's) is >prohibited. If you receive this e-mail in er

Review Request: Diff for HIVE-1900

2011-02-04 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/393/ --- Review request for hive. Summary --- Diff for HIVE-1900 This addresses bug

Re: Review Request: Support archiving for multiple partitions if the table is partitioned by multiple columns

2011-10-28 Thread namit jain
; https://reviews.apache.org/r/2595/ > --- > > (Updated 2011-10-28 18:28:45) > > > Review request for hive and namit jain. > > > Summary > --- > > Support archiving for multiple partitions if the tabl

Re: Review Request: Support archiving for multiple partitions if the table is partitioned by multiple columns

2011-10-28 Thread namit jain
-- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/2595/ > --- > > (Updated 2011-10-28 18:28:45) > > > Review request for hive and namit jain. > > > Summary >

Re: Review Request: Use sorted nature of compact indexes

2011-11-01 Thread namit jain
- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/2605/ > --- > > (Updated 2011-10-29 01:39:50) > > > Review request for hive, Yong

Re: Review Request: Use sorted nature of compact indexes

2011-11-01 Thread namit jain
n automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/2605/ > --- > > (Updated 2011-10-29 01:39:50) > > > Review request for hive, Yongqiang He, Ning Zhang, and namit jain. > > > S

multi cluster suppoort in hive

2012-02-01 Thread Namit Jain
I added a new document: https://cwiki.apache.org/confluence/display/Hive/Hive+across+Multiple+Data+Centers+(Physical+Clusters) for https://issues.apache.org/jira/browse/HIVE-2612 Please comment. Thanks, -namit

Re: Hive projects for Google Summer of code 2012 ?

2012-02-05 Thread Namit Jain
Hi Alexis/Bharath, Great to see your interests. If you looking for ideas, some things that will be very useful are: 1. Removing the map-join hint completely. Moving all processing to runtime. Currently, bucketed map joins and sort merge joins are completely driven off hints. It would be

Re: Thrift build

2012-02-08 Thread Namit Jain
Check out svn+ssh://tubbs/svnhive/hadoop/external/thrift-0.7.0 And set your thrift.home to the above On 2/8/12 12:32 PM, "Aniket Mokashi" wrote: >Hi, > >I made some changes to hive_metastore.thrift to add a few new apis. I am >trying to generate code with thrift, but I am hitting following err

partitioned views

2012-02-09 Thread Namit Jain
We found a bug recently, that partitioned views do not have storage descriptors. https://issues.apache.org/jira/browse/HIVE-2795 We will fix this bug, but the existing data needs to be upgraded (if you really care about the describe output of a view partition). It seems fairly difficult to come

Re: Changing defaults for dynamic partitioning and enforced bucketing?

2012-03-02 Thread Namit Jain
I agree with changing the hive.exec.dynamic.partitions. I am not sure about enforcing hive.enforcing.bucketing. It can have a additional cost, which may or may not be needed. If we change this, we should trust the metastore completelely and also change hive.optimize.bucketmapjoin and hive.optimiz

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
I filed a couple of gsoc 2012 jiras. Please submit your proposal if you are interested. https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=1231927 0 Thanks, -namit On 2/7/12 6:32 PM, "Alexis De La Cruz Toledo" wrote: >Hi Namit Jain, I'm Alexis, I'

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=1231927 0 0 was in the next line by mistake Look for HIVE jiras. On 3/6/12 7:37 PM, "Alexis De La Cruz Toledo" wrote: >Sorry Mr. Namit Jain I can't see the jiras. > >Thanks > >El 6 de m

Re: Hive projects for Google Summer of code 2012 ?

2012-03-06 Thread Namit Jain
ache.org/jira/browse/HIVE-1362 > >On Wed, Mar 7, 2012 at 6:46 AM, Namit Jain wrote: > >> >>https://issues.apache.org/jira/secure/IssueNavigator.jspa?requestId=12319 >>27 >> 0 >> >> >> >> 0 was in the next line by mistake >> Look for H

Re: Automatic/parallel patch testing

2012-03-08 Thread Namit Jain
I won't be able to work on this right now. John, do you have some cycles ? On 3/7/12 9:30 PM, "Amareshwari Sri Ramadasu" wrote: >+1 for HIVE-1175 > >-Amareshwari >On 3/8/12 3:21 AM, "Ashutosh Chauhan" wrote: > >I am very much in favor of >https://issues.apache.org/jira/browse/HIVE-1175 since >

Re: GSOC project for Hive

2012-03-21 Thread Namit Jain
Hi Nitika, I have proposed a few Hive projects on the GSOC. Do you want to add more projects ? What are you exactly looking for - new project ideas, or proposals for existing projects. Thanks, -namit On 3/21/12 3:37 PM, "nitika gupta" wrote: >Hi Hive Devs, >I am a student planning to apply

Re: Make hive support various charsets

2012-03-28 Thread Namit Jain
Kai, That would be great. Please file a jura, and submit a patch. We would definitely like to get it for the whole community Thanks, -namit On 3/28/12 8:46 PM, "Zhang Kai" wrote: >Hi all > >I've been working with hive for some time. > >In my company, we use hive for querying on large datase

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/489/#review341 --- trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/489/#review342 --- It would be very useful to have the JDO expression for the table under

Re: Review Request: HIVE-2049. Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-21 Thread namit jain
> On 2011-03-21 13:45:49, namit jain wrote: > > It would be very useful to have the JDO expression for the table under > > consideration in the explain plan (extended). The client side logs are very difficult to debug

Re: [VOTE] Hive 0.7.0 Release Candidate 1

2011-03-25 Thread Namit Jain
+1 - go ahead On 3/25/11 12:53 PM, "John Sichi" wrote: >+1, ship it! > >JVS > >On Mar 20, 2011, at 2:32 AM, Carl Steinbach wrote: > >> Hive 0.7.0 Release Candidate 1 is available here: >> >> http://people.apache.org/~cws/hive-0.7.0-candidate-1 >> >> We need 3 +1 votes from Hive PMC members in

Re: Review Request: HIVE-2050. batch processing partition pruning process

2011-03-28 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/522/#review355 --- mostly minor issues - can you update the patch, and I will try to get it

Re: Review Request: HIVE-2082. Reduce memory consumption in preparing MapReduce job

2011-04-06 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/556/#review396 --- Also, why should the test outputs be different. trunk/metastore/src/j

Re: Review Request: auto map join bug

2011-04-07 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/559/#review401 --- also add a test for A Rigth Outer Join B on .. Join C trunk/ql/src/ja

Re: Review Request: HIVE-2107. Log4J initialization info should not be printed out if -S is specified

2011-04-11 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/580/#review427 --- Ship it! - namit On 2011-04-11 22:36:06, Ning Zhang wrote: > > -

[ANNOUNCE] New Hive Committer - Siying Dong

2011-04-13 Thread Namit Jain
Hi Folks, The Hive PMC has passed the vote to make Siying Dong a new committer on the Apache Hive project. Following is a list of the contributions that Siying has made to the project: http://bit.ly/goFnzw Congratulations Siying. Please send over your CLA to Apache. Than

Re: Review Request: HIVE-2127. Improve stats gathering reliability by retries on failures

2011-04-26 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/664/#review570 --- One minor comment: In both statspublisher and statsaggregator, you are

Re: Review Request: Input Sampling Splits

2011-04-28 Thread namit jain
> > (Updated 2011-04-28 08:32:17) > > > Review request for hive, Ning Zhang and namit jain. > > > Summary > --- > > We need a better input sampling to serve at least two purposes: > 1. test their queries against a smaller data set > 2. understand

Re: Review Request: HIVE-2056

2011-05-09 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/700/#review651 --- Change hive-default.xml with the new parameter. Add the new parameter in

Re: ant test fails

2012-04-22 Thread Namit Jain
When you run ant test -Dtestcase=TestCliDriver Which test fails ? Also, can you try running the tests in non-debug mode. I.e Do ant package (Instead of ant -Djavac.debug=on package) -namit On 4/22/12 9:59 PM, "Srinivasan Rajivelu" wrote: >Hi All, > After running ant package, if

new feature in hive: links

2012-05-21 Thread Namit Jain
There is a requirement for a new feature, for which Sambavi has written a detailed overview https://cwiki.apache.org/confluence/display/Hive/Links. We would like to get some core concepts out of it, and implement them in open source hive, so that the whole community gets it. There are new conc

Re: new feature in hive: links

2012-05-21 Thread Namit Jain
ave regions been abandoned? > >On Mon, May 21, 2012 at 3:30 PM, Namit Jain wrote: >> >> >> There is a requirement for a new feature, for which Sambavi has written >>a >> detailed overview >>https://cwiki.apache.org/confluence/display/Hive/Links. >> >>

non-string partition columns

2012-05-24 Thread Namit Jain
http://svn.apache.org/viewvc?view=revision&revision=1308427 The patch above broke drop partitions if the partition happens to be non-string. This is due to a JDO issue with non-string columns. Is anyone using non-string partition columns ? Should be force the partition columns to be only of type

Re: non-string partition columns

2012-05-24 Thread Namit Jain
Should we disallow non-string partition columns completely ? Does anyone depend on that ? On 5/24/12 6:49 PM, "Namit Jain" wrote: > >http://svn.apache.org/viewvc?view=revision&revision=1308427 > >The patch above broke drop partitions if the partition happens to be &g

Re: non-string partition columns

2012-05-25 Thread Namit Jain
.org/jira/browse/HIVE-2702 Is the underlying problem >same as the one which I described on that jira ? > >Thanks, >Ashutosh > >On Thu, May 24, 2012 at 10:59 PM, Namit Jain wrote: > >> Should we disallow non-string partition columns completely ? >> Does anyone depend o

Re: non-string partition columns

2012-05-25 Thread Namit Jain
Should I go ahead and file a jira to disallow non-string partition columns ? Or, someone depends on that functionality. On 5/25/12 10:01 AM, "Namit Jain" wrote: >Yes, but the meta-question is: > >Is anyone dependent on non-string partition columns ? Should we drop the >

Re: non-string partition columns

2012-05-29 Thread Namit Jain
n production. I think non >>>string >>> partition columns are a good thing to have - it allows you to do all >>>sorts >>> of date range calculations etc. AFAIK, MySQL's partition columns can >>>be of >>> any type. >>> >>> Phil.

not able to commit

2012-06-01 Thread Namit Jain
There seems to be some problems with my apache account. When I try to reset my password from http://people.apache.org/~joes/jira-hacked.txt And visit https://issues.apache.org/jira/secure/ForgotPassword!default.jspa, I am getting a bad page. Is anyone else running into the same issue ? Thanks

test errors

2012-06-11 Thread Namit Jain
I am seeing the following errors on a fresh hive trunk ? [junit] Running org.apache.hadoop.hive.thrift.TestZooKeeperTokenStore [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec [junit] Test org.apache.hadoop.hive.thrift.TestZooKeeperTokenStore FAILED (crashed) Is any

Re: Hive Unit Tests: Read-Only Table

2012-06-12 Thread Namit Jain
You cannot change tables which are created by QTestUtil (like src). On 6/12/12 12:34 PM, "Shefali Vohra" wrote: >Fair enough. So (just to make sure) if I need to create a table to run a >test, I should do so within the .q file itself? > >Thanks so much for your help!! >Shefali > >-Original

Re: Hive Unit Tests: Read-Only Table

2012-06-12 Thread Namit Jain
alidate her >new UDFs. Are there any guidelines on where to create new tables with >different data to validate new UDFs? > >Thanks, >Kanna > > >-Original Message- >From: Namit Jain [mailto:nj...@fb.com] >Sent: Tuesday, June 12, 2012 2:13 PM >To: dev@hive.ap

Re: Lisk Bucketing DDL Patch

2012-07-26 Thread Namit Jain
Note that, we are also planning to use the same syntax for specifying the syntax for skew for optimizing joins. https://cwiki.apache.org/Hive/skewed-join-optimization.html Thanks, -namit On 7/25/12 1:01 PM, "Gang Tim Liu" wrote: >Dear all hive developers, > >Please review the documentation:

Re: Lisk Bucketing DDL Patch

2012-07-27 Thread Namit Jain
Yes, that patch will become quiet big to be done a single shot. Moreover, the skew information can be used by a variety of use-cases. 1. List Bucketing 2. Skew Joins: https://cwiki.apache.org/Hive/skewed-join-optimization.html 3. Another variant of skew joins: https://issues.apache.org/jira/brows

non map-reduce for simple queries

2012-07-28 Thread Namit Jain
Currently, hive does not launch map-reduce jobs for the following queries: select * from where (limit )? This behavior is not configurable, and cannot be altered. HIVE-2925 wants to extend this behavior. The goal is not to spawn map-reduce jobs for the following queries: Select from where

Re: non map-reduce for simple queries

2012-07-29 Thread Namit Jain
ng specific columns seems >simple >> enough and useful. >> >> On Saturday, July 28, 2012, Namit Jain wrote: >>> Currently, hive does not launch map-reduce jobs for the following >queries: >>> >>> select * from where (limit )? >>> >>

Re: non map-reduce for simple queries

2012-07-29 Thread Namit Jain
This can be a follow-up to HIVE-2925. Navis, if you want, I can work on it. On 7/29/12 7:58 PM, "Namit Jain" wrote: >I like Navis's idea. The timeout can be configurable. > > >On 7/29/12 6:47 AM, "Navis류승우" wrote: > >>I was thinking of timeout

Re: non map-reduce for simple queries

2012-07-30 Thread Namit Jain
The total number of bytes of the input will be used to determine whether to not launch a map-reduce job for this query. That was in my original mail. However, given any complex where condition and the lack of column statistics in hive, we cannot determine the number of bytes that would be needed t

Re: non map-reduce for simple queries

2012-07-30 Thread Namit Jain
On 7/31/12 12:01 PM, "Owen O'Malley" wrote: >On Mon, Jul 30, 2012 at 9:12 PM, Namit Jain wrote: > >> The total number of bytes of the input will be used to determine whether >> to not launch a map-reduce job for this >> query. That was in my original

Re: non map-reduce for simple queries

2012-07-31 Thread Namit Jain
On 7/31/12 9:23 PM, "Owen O'Malley" wrote: >On Mon, Jul 30, 2012 at 11:38 PM, Namit Jain wrote: > >> That would be difficult. The % done can be estimated from the data >>already >> read. >> > >I'm confused. Wouldn't the maximum size

compiling hive on hadoop 23

2012-08-07 Thread Namit Jain
I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package ant -Dhadoop.version=0.23.0 package looking at

Re: compiling hive on hadoop 23

2012-08-07 Thread Namit Jain
11:22 AM, "Ashutosh Chauhan" wrote: >Try with hadoop version as 0.23.1 (instead of 0.23) > >ant -Dhadoop.version=0.23.1 -Dhadoop.security.version=0.23.1 package > >Thanks, >Ashutosh >On Tue, Aug 7, 2012 at 10:41 PM, Namit Jain wrote: > >> >> >&

Re: compiling hive on hadoop 23

2012-08-07 Thread Namit Jain
and it worked for me. But I don't know exact meaning of it. -navis 2012/8/8 Namit Jain mailto:nj...@fb.com>> I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0

Re: compiling hive on hadoop 23

2012-08-08 Thread Namit Jain
Thanks Navis, with your new ivy.xml - I was able to compile On 8/8/12 12:22 PM, "Namit Jain" wrote: >Navis, > >org.apache.hadoop#hadoop-core;0-23.1 > >Do you know where is the corresponding jar stored ? >I didn't find it in mvn. > >For now, I can try hard

Re: compiling hive on hadoop 23

2012-08-08 Thread Namit Jain
However, when I run a test, I am still using hadoop-20 On 8/8/12 1:10 PM, "Namit Jain" wrote: >Thanks Navis, with your new ivy.xml - I was able to compile > >On 8/8/12 12:22 PM, "Namit Jain" wrote: > >>Navis, >> >>org.apache.hadoo

Re: [ANNOUNCE] New Hive Committer - Navis Ryu

2012-08-12 Thread Namit Jain
Congrats Navis On 8/11/12 3:17 AM, "Ashutosh Chauhan" wrote: >Congrats, Navis! Well deserved. Welcome, aboard! > >Ashutosh >On Fri, Aug 10, 2012 at 11:10 AM, Carl Steinbach >wrote: > >> Congratulations Navis! This is very well deserved. Looking forward to >>many >> more patches from you. >> >>

Re: Review Request: HIVE-3056: Ability to bulk update location field in Db/Table/Partition records

2012-08-22 Thread namit jain
nd assumes a JDO. metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java <https://reviews.apache.org/r/6650/#comment22717> System.out.println() in hive code seems like a bad idea - namit jain On Aug. 22, 2012, 2:48 a.m., Shree

Re: Review Request: HIVE-3392 - Review request

2012-09-10 Thread namit jain
/r/7004/#comment24335> no tabs - namit jain On Sept. 11, 2012, 5:10 a.m., Ajesh kumar wrote: > > --- > This is an automatically generated e-mail. To reply, visit: &g

Re: Review Request: HIVE-3392 - Review request

2012-09-11 Thread namit jain
and - I am not sure if it removes the jars also. Can you confirm ? ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java <https://reviews.apache.org/r/7004/#comment24425> space after if - namit jain On Sept. 12, 2012, 3:20 a.m., A

Re: Review Request: HIVE-3495: For UDAFs, when generating a plan without map-side-aggregation, constant agg parameters will be replaced by ExprNodeColumnDesc

2012-09-30 Thread namit jain
ou are trying - namit jain On Sept. 30, 2012, 8:55 p.m., Yin Huai wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews

Re: Review Request: HIVE-3495: For UDAFs, when generating a plan without map-side-aggregation, constant agg parameters will be replaced by ExprNodeColumnDesc

2012-10-01 Thread namit jain
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7221/#review12070 --- Ship it! Ship It! - namit jain On Oct. 1, 2012, 2:35 p.m., Yin

Re: Review Request: HIVE-1362: Support for column statistics in Hive

2012-10-03 Thread namit jain
ull variable name instead of Rwt ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java <https://reviews.apache.org/r/6878/#comment25820> LHS should not be an arraylist Please fix all such occurences - namit jain On Oct. 3, 2012, 3:10 a.m., Shree

Re: number of buckets in bucket map join

2012-10-31 Thread Namit Jain
The number of mappers is the greater common factor for all the tables. So, it it is not a multiple, a single mapper will be assigned. On 11/1/12 5:20 AM, "Mahsa Mofidpoor" wrote: >Hi, > >Hive summit 2011 says for performing a bucket join the number of buckets >of >all tables has to be a multipl

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-04 Thread Namit Jain
I like the idea of Hcatalog becoming a Hive sub-project. The enhancements/bugs in the serde/metastore areas can indirectly benefit the hive community, and it will be easier for the fix to be in one place. Having said that, I don't see serde/metastore moving out of hive into a separate component. Th

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-06 Thread Namit Jain
Alan, that would not be a good idea. Metastore code is part of hive code, and it would be safer if only Hive committers had commit access to that. On 11/6/12 11:25 PM, "Alan Gates" wrote: > >On Nov 4, 2012, at 8:35 PM, Namit Jain wrote: > >> I like the idea of Hca

Re: hive 0.10 release

2012-11-07 Thread Namit Jain
+1 to the idea On 11/8/12 6:33 AM, "Edward Capriolo" wrote: >That sounds good. I think this issue needs to be solved as well as >anything else that produces a bugus query result. > >https://issues.apache.org/jira/browse/HIVE-3083 > >Edward > >On Wed, Nov 7, 2012 at 7:50 PM, Ashutosh Chauhan >wr

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-11-14 Thread Namit Jain
they would be unsafe with access to the metastore. And the Hive PMC >is there to assure this does not happen. If there are issues I am sure >they can deal with them. > >Alan. > > >On Nov 6, 2012, at 8:06 PM, Namit Jain wrote: > >> Alan, that would not be a good idea. M

Re: Top-K optimization

2012-11-19 Thread Namit Jain
Hi Siva, Take a look at https://issues.apache.org/jira/browse/HIVE-3562. It is in my todo list, but I have not been able to review this. I think, this addresses a very similar problem. If yes, can you also review the above patch ? Thanks, -namit On 11/19/12 3:10 PM, "Sivaramakrishnan Naraya

Re: Transform.java Vs. PhysicalPlanResolver.java

2012-11-27 Thread Namit Jain
Optimizations in the Transform take the operator tree and transform that into a new operator tree. Then the operator tree is broken into various tasks. Physical optimizer takes a task and optimizes/changes the task. Both these optimizations are done at compile time. There is nothing like a runti

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-12-13 Thread Namit Jain
ot others. Greg and Bertrand argued (and Arun seemed to >>> imply) that splitting up committer lists by sections of the code did >>>not >>> work out well. >>> >>> These insights cause me to question what we mean by subproject. I had >>> or

Re: [DISCUSS] HCatalog becoming a subproject of Hive

2012-12-19 Thread Namit Jain
gt;other >> ASF >> >> projects. Furthermore, if Hive adds a dependency on HCatalog then it >> will >> >> be subject to these same problems (in addition to the gross circular >> >> dependency!). >> >> >> >>

Re: write access to the Hive wiki?

2013-01-02 Thread Namit Jain
What is your id ? On 1/3/13 1:18 AM, "Sean Busbey" wrote: >Hi All! > >Could I have write access to the Hive wiki? > >I'd like to fix some documentation errors. The most immediate is the Avro >SerDe page, which contains incorrect table creation statements. > >-- >Sean

running apache jenkins build on hadoop 23

2013-01-06 Thread Namit Jain
I forgot who had setup apache jenkins build for all hive checkins. These tests are Currently running on hadoop 20. It would be really useful if these tests can also be run on hadoop 23 – we have added a lot of tests recently, which only work on hadoop 23.

Re: running apache jenkins build on hadoop 23

2013-01-08 Thread Namit Jain
op1 build at >https://builds.apache.org/job/hive-trunk-hadoop1/ > >Enjoy, >Ashutosh > > >On Sun, Jan 6, 2013 at 10:56 PM, Namit Jain wrote: > >> I forgot who had setup apache jenkins build for all hive checkins. These >> tests are >> Currently running on hadoop 20. It w

Re: [VOTE] Apache Hive 0.10.0 Release Candidate 0

2013-01-08 Thread Namit Jain
+1 Build from src. Ran some sanity tests both from bin and compiled src - they looked good On 12/27/12 3:08 AM, "Ashutosh Chauhan" wrote: >+1 >Built from sources. Ran unit tests. All looked good. > >Thanks, >Ashutosh > > >On Fri, Dec 21, 2012 at 2:25 PM, Alan Gates wrote: > >> +1 (non-bindin

Re: running apache jenkins build on hadoop 23

2013-01-09 Thread Namit Jain
ds.apache.org/job/hive-trunk-hadoop1/ > >Enjoy, >Ashutosh > > >On Sun, Jan 6, 2013 at 10:56 PM, Namit Jain wrote: > >> I forgot who had setup apache jenkins build for all hive checkins. These >> tests are >> Currently running on hadoop 20. It would be really

reduced unit test timings

2013-01-30 Thread Namit Jain
I have noticed that the time taken to run the unit tests has reduced considerably (it has become nearly half) from the last week or so. Just wondering, if anyone else has noticed this too. If yes, does anyone know the root cause of this speedup ? Thanks, -namit

Re: reduced unit test timings

2013-01-30 Thread Namit Jain
MiniMRCliDriver and NegativeMiniMRCliDriver used to remain in hung state >for ~10 minutes after all tests have run and minicluster is tearing down. >That patch has saved atleast ~15 mins for test runs in my environment. > >Thanks to Navis for that! > >Ashutosh > > >On W

Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-31 Thread Namit Jain
+1 and +1 On 1/30/13 6:53 AM, "Gunther Hagleitner" wrote: >+1 and +1 > >Thanks, >Gunther. > > >On Tue, Jan 29, 2013 at 5:18 PM, Edward Capriolo >wrote: > >> Measure 1: +1 >> Measure 2: +1 >> >> On Mon, Jan 28, 2013 at 2:47 PM, Carl Steinbach wrote: >> >> > I am calling a vote on the following t

Re: branch for ptf and windowing fuction

2013-02-03 Thread Namit Jain
+1 On 2/2/13 11:01 AM, "Clark Yang (杨卓荦)" wrote: >+1 > >Cheers, >Zhuoluo (Clark) Yang > > >2013/2/2 Jarek Jarcec Cecho > >> +1. >> >> Jarcec >> >> On Fri, Feb 01, 2013 at 10:11:32AM -0800, Ashutosh Chauhan wrote: >> > Hi all, >> > >> > Harish and Prajkta are doing some cool work over at >> > h

Re: [VOTE] Graduate HCatalog from the incubator and become part of Hive

2013-02-06 Thread Namit Jain
+1 On 2/5/13 2:54 PM, "Alexander Alten-Lorenz" wrote: >+1, non-binding > >- Alex > >On Feb 5, 2013, at 10:06 AM, Sushanth Sowmyan wrote: > >> And my axe! Erm... I mean, my +1. >> >> >> On Mon, Feb 4, 2013 at 10:18 PM, Alan Gates >>wrote: >>> FYI. >>> >>> Alan. >>> >>> Begin forwarded mess

ant clean package failing

2013-03-30 Thread Namit Jain
BUILD FAILED /Users/njain/hive/hive_commit3/build.xml:270: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:109: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:111: The following error occurred whil

ant clean package failing

2013-03-30 Thread Namit Jain
BUILD FAILED /Users/njain/hive/hive_commit3/build.xml:270: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:109: The following error occurred while executing this line: /Users/njain/hive/hive_commit3/build.xml:111: The following error occurred whil

Re: ant clean package failing

2013-03-30 Thread Namit Jain
;Mark > > >On Sat, Mar 30, 2013 at 3:22 AM, Namit Jain wrote: > >> BUILD FAILED >> /Users/njain/hive/hive_commit3/build.xml:270: The following error >>occurred >> while executing this line: >> /Users/njain/hive/hive_commit3/build.xml:109: The following

Re: Branch for HIVE-4160

2013-04-02 Thread Namit Jain
It will be difficult to merge back the branch. Can you stage your changes incrementally ? I mean, start with the making the operators vectorized - it can be a for loop to start with ? I think it will be very difficult to merge it back if we diverge on this. I would recommend starting with simple i

  1   2   3   4   5   6   7   8   9   10   >