Documentation related to DB operations

2010-10-28 Thread Ashutosh Chauhan
I see that https://issues.apache.org/jira/browse/HIVE-675 is committed and Hive now has support for databases and related operations associated with it. But I am unable to find any user facing documentation for it. Can someone update the http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL with ne

Re: Upgrading Hypertable Hive connector

2010-11-04 Thread Ashutosh Chauhan
+1 for shorter release cycles. Currently, is it time based or feature based ? If time based, whats the timeline for 0.7 and if its feature based, which features are "must" for 0.7 release? Ashutosh On Thu, Nov 4, 2010 at 11:42, John Sichi wrote: > We branched 0.6 quite early and by that point we

Re: Does anyone get past TestEmbeededHiveMetaStore in ant test?

2010-12-03 Thread Ashutosh Chauhan
This happens because you have a slower machine :) In this test HiveMetaStore is brought up in separate thread and then current thread sleeps for 5 secs, hoping MetaStore will be up by then. On heavily loaded machine (or slow machines) 5 seconds may be too less. Change TestRemoteHiveMetaStore.java

Re: Documentation related to DB operations

2010-12-10 Thread Ashutosh Chauhan
osh, > You're correct that this is currently not documented anywhere. I'll try to > write something up in the next couple of days. > Thanks. > Carl > > On Thu, Oct 28, 2010 at 10:55 AM, Ashutosh Chauhan > wrote: >> >> I see that https://issues.apache.o

Re: [VOTE] Sponsoring Howl as an Apache Incubator project

2011-02-03 Thread Ashutosh Chauhan
+1 On Wed, Feb 2, 2011 at 13:18, Alan Gates wrote: > Howl is a table management system built to provide metadata and storage > management across data processing tools in Hadoop (Pig, Hive, MapReduce, > ...).  You can learn more details at http://wiki.apache.org/pig/Howl.  For > the last six month

Re: [VOTE] Sponsoring Howl as an Apache Incubator project

2011-02-03 Thread Ashutosh Chauhan
There are none as of today. In the past, whenever we had to have changes, we do it in a separate branch in Howl and once those get committed to hive repo, we pull it over in our trunk and drop the branch. Ashutosh On Thu, Feb 3, 2011 at 13:41, yongqiang he wrote: > I am interested in some numbers

Re: [VOTE] Sponsoring Howl as an Apache Incubator project

2011-02-03 Thread Ashutosh Chauhan
Thu, Feb 3, 2011 at 14:49, John Sichi wrote: > But Howl does layer on some additional code, right? > > https://github.com/yahoo/howl/tree/howl/howl > > JVS > > On Feb 3, 2011, at 1:49 PM, Ashutosh Chauhan wrote: > >> There are none as of today. In the past, whenever we

Re: What's official site for howl ?

2011-05-04 Thread Ashutosh Chauhan
Hey Jeff, official landing page is: https://cwiki.apache.org/confluence/display/HCATALOG/Index https://cwiki.apache.org/confluence/display/HCATALOG/HCatalogJournal has real useful content. Thanks, Ashutosh On Wed, May 4, 2011 at 19:04, Jeff Zhang wrote: > > Hi all, > Sorry for bothering this mail

Re: Can Hive 0.7 Rebuild partitions ?

2011-05-19 Thread Ashutosh Chauhan
Indeed a useful feature: created jira for it: https://issues.apache.org/jira/browse/HIVE-2173 Ashutosh On Thu, May 19, 2011 at 15:52, Roberto Congiu wrote: > I agree it's useful, especially for external tables, that may be loaded by > an external process that may 'forget' to issue a ADD PARTITION

Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-28 Thread Ashutosh Chauhan
Measure 1: +1 Measure 2: +1 Ashutosh On Mon, Jan 28, 2013 at 11:48 AM, Carl Steinbach wrote: > Measure 1: +1 (binding) > Measure 2: +1 (binding) > > On Mon, Jan 28, 2013 at 11:47 AM, Carl Steinbach wrote: > > > I am calling a vote on the following two measures. > > > > Measure 1: Amend Hive B

Re: ROW_NUMBER() equivalent in Hive

2013-02-21 Thread Ashutosh Chauhan
Kumar, If you are willing to be on bleeding edge, this and many other partitioning and windowing functionality some of us are developing in a branch over at: https://svn.apache.org/repos/asf/hive/branches/ptf-windowing Check out this branch, build hive and than you can have row_number() functional

Re: ROW_NUMBER() equivalent in Hive

2013-02-21 Thread Ashutosh Chauhan
I am interested / reviewing your windowing feature. Can you be more > specific about which (a) tests and (b) src files constitute your additions > (there are lots of files there ;) ) > > thanks > > stephen boesch > > > 2013/2/21 Ashutosh Chauhan > >> Kumar, >> &g

Re: why apache hive 0.10 document not found?

2013-03-08 Thread Ashutosh Chauhan
This is now fixed via HIVE-4074. Docs are now online again. Thanks, Gunther! Ashutosh On Tue, Mar 5, 2013 at 6:42 PM, 周梦想 wrote: > from version 0.80, the release document is not found. > > http://hive.apache.org/docs/r0.10.0/ > > Not Found > > The requested URL /docs/r0.10.0/ was not found on th

Re: builtins submodule - is it still needed?

2013-04-05 Thread Ashutosh Chauhan
I haven't used it myself anytime till now. Neither have met anyone who used it or plan to use it. Ashutosh On Thu, Apr 4, 2013 at 2:01 PM, Travis Crawford wrote: > Hey hive gurus - > > Is the "builtins" hive submodule in use? The submodule was added in > HIVE-2523 as a location for builtin-UDFs

[VOTE] Apache Hive 0.11.0 Release Candidate 0

2013-04-29 Thread Ashutosh Chauhan
Hey all, I am excited to announce availability of Apache Hive 0.11.0 Release Candidate 0 at: http://people.apache.org/~hashutosh/hive-0.11.0-rc0/ Maven artifacts are available here: https://repository.apache.org/content/repositories/orgapachehive-154/ This release has many goodies including Hive

[VOTE] Apache Hive 0.11.0 Release Candidate 1

2013-04-30 Thread Ashutosh Chauhan
Hey all, Based on feedback from folks, I have respun release candidate, RC1. Please take a look. It basically fixes the size bloat of tarball. Source tag for RC1 is at: https://svn.apache.org/repos/asf/hive/tags/release-0.11.0-rc1 Source tar ball and convenience binary artifacts can be found a

Re: Use of virtual columns in joins

2013-06-10 Thread Ashutosh Chauhan
You might be hitting into https://issues.apache.org/jira/browse/HIVE-4033in which case its recommended that you upgrade to 0.11 where in this bug is fixed. On Mon, Jun 10, 2013 at 1:57 AM, Peter Marron < peter.mar...@trilliumsoftware.com> wrote: > Hi, > > ** ** > > I’m using hive 0.10.0 ove

Re: Help in ROW_NUMBER() OVER (PARTITION BY) in Hive

2013-07-02 Thread Ashutosh Chauhan
Windowing functions (over clause) were introduced in 0.11 You need to upgrade to 0.11 to make use of them. Ashutosh On Tue, Jul 2, 2013 at 7:19 AM, dyuti a wrote: > Hi Experts, > I'm working with Teradata query conversion to hive environment (Hive > version 0.10.0).The challenge that am facing

Re: Write access for the wiki

2013-07-30 Thread Ashutosh Chauhan
Mark, Do you have an account on hive cwiki. Whats your id ? Thanks, Ashutosh On Tue, Jul 30, 2013 at 1:06 PM, Mark Wagner wrote: > Hi all, > > Would someone with the right permissions grant me write access to the Hive > wiki? I'd like to update some information on the Avro Serde. > > Thanks, >

Re: Write access for the wiki

2013-07-30 Thread Ashutosh Chauhan
Is that your cwiki id ? I am not seeing it there. Remember cwiki is separate than jira account. Ashutosh On Tue, Jul 30, 2013 at 1:40 PM, Mark Wagner wrote: > My id is mwagner. Thanks! > > > On Tue, Jul 30, 2013 at 1:36 PM, Ashutosh Chauhan wrote: > >> Mark, >> &

Re: Write access for the wiki

2013-07-30 Thread Ashutosh Chauhan
Done. Added you as contributor. Happy Documenting !! Ashutosh On Tue, Jul 30, 2013 at 2:15 PM, Mark Wagner wrote: > Yes, I created it right before emailing the list: > https://cwiki.apache.org/confluence/display/~mwagner > > > On Tue, Jul 30, 2013 at 1:45 PM, Ashutosh Chauhan

Re: Last time request for cwiki update privileges

2013-08-20 Thread Ashutosh Chauhan
Hi Sanjay, Really sorry for that. I apologize for the delay. You are added now. Feel free to make changes to make Hive even better! Thanks, Ashutosh On Tue, Aug 20, 2013 at 2:39 PM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > Hey guys > > I can only think of two reason

Re: Last time request for cwiki update privileges

2013-08-21 Thread Ashutosh Chauhan
prague > >> Sanjay gets some love after all! :) >> >> >> On Tue, Aug 20, 2013 at 4:00 PM, Sanjay Subramanian < >> sanjay.subraman...@wizecommerce.com> wrote: >> >>> Thanks Ashutosh >>> >>> From: Ashutosh Chauhan mailto:has

Re: Last time request for cwiki update privileges

2013-08-21 Thread Ashutosh Chauhan
Not able to find this id in cwiki. Did you create an account on cwiki.apache.org On Wed, Aug 21, 2013 at 2:59 PM, Mikhail Antonov wrote: > mantonov

Re: Hive Metastore Server 0.9 Connection Reset and Connection Timeout errors

2013-08-29 Thread Ashutosh Chauhan
Thanks Agatea for digging in. Seems like you have hit a bug. Would you mind opening a jira and adding your findings to it. Thanks, Ashutosh On Thu, Aug 29, 2013 at 11:22 AM, agateaaa wrote: > Sorry hit send too soon ... > > Hi All: > > Put some debugging code in TUGIContainingTransport.getTran

Re: Problems with 0.11, count(DISTINCT), and NPE

2013-09-03 Thread Ashutosh Chauhan
Fix in very related area has been checked in trunk today : https://issues.apache.org/jira/browse/HIVE-5129 Likely that will fix your issue. Can you try latest trunk? Ashutosh On Tue, Sep 3, 2013 at 2:03 PM, Nathanial Thelen wrote: > I am running Hive in EMR and since upgrading to 0.11 from 0.8.

Re: Problems with 0.11, count(DISTINCT), and NPE

2013-09-03 Thread Ashutosh Chauhan
Not sure about EMR. Your best bet is to ask on EMR forums. Thanks, Ashutosh On Tue, Sep 3, 2013 at 2:18 PM, Nathanial Thelen wrote: > Is there a way to run a patch on EMR? > > Thanks, > Nate > > On Sep 3, 2013, at 2:14 PM, Ashutosh Chauhan wrote: > > Fix in very relat

Re: Access

2013-09-04 Thread Ashutosh Chauhan
Added. Thanks, Ellen for helping in improving hive documentation. Ashutosh On Wed, Sep 4, 2013 at 3:13 PM, Ellen Evans wrote: > > > -- Forwarded message -- > From: Ellen Evans > Date: Wed, Sep 4, 2013 at 3:11 PM > Subject: Access > To: user@hive.apache.org > > > Hi - > > My na

Re: Operators && and || do not work

2013-09-19 Thread Ashutosh Chauhan
I have not tested it on historical versions, so don't know on which versions it used to work (if ever), but possibly antlr upgrade [1] may have impacted this. [1] : https://issues.apache.org/jira/browse/HIVE-2439 Ashutosh On Thu, Sep 19, 2013 at 4:52 AM, amareshwari sriramdasu < amareshw...@gma

Re: request Hive wiki write access

2013-10-28 Thread Ashutosh Chauhan
Hi Eric, Added you as a contributor to Hive wiki. Thanks, Ashutosh On Mon, Oct 28, 2013 at 4:39 PM, Eric Hanson (SQL SERVER) < eric.n.han...@microsoft.com> wrote: > Hi, > > I would like write access to the Hive wiki to add documentation on how to > used vectorized query. Can the owner please a

Re: request Hive wiki write access

2013-10-28 Thread Ashutosh Chauhan
Hi Mikhail, Sure, but first you first need to create an account on https://cwiki.apache.org/confluence/display/Hive/Home Once you have done that, than let me know your cwiki id and I will add you as a contributor. Ashutosh On Mon, Oct 28, 2013 at 5:55 PM, Mikhail Antonov wrote: > olorinb...@gmai

Re: request Hive wiki write access

2013-10-29 Thread Ashutosh Chauhan
o add details about LDAP integration >> >> -Mikhail >> >> 2013/10/28, Ashutosh Chauhan : >> > Hi Eric, >> > >> > Added you as a contributor to Hive wiki. >> > >> > Thanks, >> > Ashutosh >> > >> > >

Re: requesting access to hive confluence wiki

2013-12-10 Thread Ashutosh Chauhan
Sorry, I missed this one. Xiao you should now have perms to edit cwiki. Thanks, Ashutosh On Tue, Dec 10, 2013 at 6:26 PM, Navis류승우 wrote: > Is there someone who knows how to do this? > > > 2013/11/30 Xiao Meng > >> Hi, >> >> >> >> I would like update/fix some contents on the performance test

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-27 Thread Ashutosh Chauhan
Proposed changes look good to me, both suggested by Carl and Thejas. Another one I would like to add for consideration is: 24 hour rule between +1 and commit. Since this exists only in Hive (no other apache project which I am aware of) this surprises new contributors. More importantly, I have seen

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-27 Thread Ashutosh Chauhan
es after +1, > >> resulting in patches going stale. > >> > >> But I think 24 hours wait between creation of jira and patch commit is > >> not very useful, as the thing to be examined is the patch and not the > >> jira summary/description. > >> I thin

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-19 Thread Ashutosh Chauhan
I will echo Thejas's concern w.r.t RC voting. Usually it takes 2-3 rounds of RC and folks generally tend to vote towards end of cycle. So, if we increase it to 7 days, we are looking at 21 days (in worst case) to get a release out, which may not be what we want. So, for RC vote my suggestion will

Re: Write Access to Wiki to edit "HiveServer2 Clients" page

2014-02-18 Thread Ashutosh Chauhan
Hi Tsuyoshi, I added you to Hive cwiki. Feel free to contribute. Thanks, Ashutosh On Mon, Feb 17, 2014 at 11:41 PM, Tsuyoshi OZAWA wrote: > Hi, > > I'd like to contribute update Hive's wiki. > Could you give me a permission to write it? > > As described in HIVE-4232, we need to set "auth=noSasl

Re: Request for Write Access to Hive Wiki

2014-03-31 Thread Ashutosh Chauhan
Done. Thanks, Anthony for helping out to improve our documentation. Ashutosh On Mon, Mar 31, 2014 at 10:03 AM, Anthony Hsu wrote: > Hi, > > Could somebody grant me write access to the Hive wiki? I'd like to update > some outdated information on the Hive > Tutorial

Re: How to skip the malformatted records while loading data

2011-08-24 Thread Ashutosh Chauhan
One possibility is to filter out NULLs, something like following: hive> select * from tb where id != NULL or pref != NULL or zip != NULL; This is not most efficient, but will work. 2011/8/18 XieXianshan > Hi,everyone, > > Is there an option to ignore malformatted records while loading data > i

Re: Re: RE: Why a sql only use one map task?

2011-08-24 Thread Ashutosh Chauhan
This may be because CombineHiveInputFormat is combining your splits in one map task. If you don't want that to happen, do: hive> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat 2011/8/24 Daniel,Wu > I pasted the inform I pasted blow, the map capacity is 6. And no matter how >

Re: Problem in hive

2011-08-24 Thread Ashutosh Chauhan
Vikas, Looks like your metadata is corrupted. Can you paste the output of following: hive> describe formatted aircel_obd; Ashutosh On Wed, Aug 24, 2011 at 03:46, Vikas Srivastava wrote: > hey thanks for reply, > > i m using hadoop 0.20.2, > and hive: 0.7.0 > > i have install hive on new server a

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Ashutosh Chauhan
Edward, Apart from recommended best practices what Christian is asking for is why HiveServer is still trying to interact with local db instance even after setting the config variables. AFAIK it should not. Christian, you found that out by looking at files opened by HiveServer jvm. Can you provide

Re: Maximum Nos of table in hive

2011-08-24 Thread Ashutosh Chauhan
Vikas, You are bounded by database used by metastore which usually is mysql. On a modern machine, mysql easily scales for few millions of rows, so I will expect that you should be able to create atleast those many tables. Thanks, Ashutosh On Wed, Aug 24, 2011 at 03:45, Chinna wrote: > Hi,

Re: Local and remote metastores

2011-08-24 Thread Ashutosh Chauhan
Alex, Difference between the two is that in case of local metastore, hive client communicates directly to the mysql while in case of remote metastore, hive client first talks to a remote metastore which in turns talks to mysql. In terms of feature-set they are identical. Hope it helps, Ashutosh

Re: One Schema Per Partition? (Multiple schemas per table?)

2011-08-24 Thread Ashutosh Chauhan
Hey Tim, Hive does support different schema's for different partitions. If your data comes out garbled, that seems to be a bug then. In your case, is the following sequence of steps resemble what you did: a) create table tbl (id: int, name: string, level: int) partitioned by date; b) -- add parti

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-25 Thread Ashutosh Chauhan
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:1865) > at > org.apache.hadoop.hive.ql.metadata.Hive.getTablesByPattern(Hive.java:917) > ... 13 more > FAILED: Error in metadata: MetaException(message:Could not connect to meta > store using any of the URIs pro

Re: One Schema Per Partition? (Multiple schemas per table?)

2011-08-29 Thread Ashutosh Chauhan
a section titled "Different Schemas per > Partition" and basically give the syntax you give (from quoted, assuming > after I test it, it works). > > > [1] > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterTable%2FPartitionStat

Re: Hive thrift interface and user permissions / user auditing

2011-09-06 Thread Ashutosh Chauhan
Hey Koert, I am assuming 'thrift' is the name of user through which thrift metastore is running. I also assume you are running in unsecure mode. If you run with security turned on, meaning secure hadoop cluster with secure thrift server, you will see the name of the original user. This is so becau

Re: Hive thrift interface and user permissions / user auditing

2011-09-07 Thread Ashutosh Chauhan
> query in the logs, i have to use secure hadoop (with Kerberos)? > Does secure mode suport hive JDBC? > Thanks! Koert > > > On Tue, Sep 6, 2011 at 11:47 AM, Ashutosh Chauhan wrote: > >> Hey Koert, >> >> I am assuming 'thrift' is the name of us

Re: Pentaho issue with hive

2011-09-12 Thread Ashutosh Chauhan
>> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.io.Writable Seems like you have classpath issues. Make sure hadoop-core.jar (or whatever is the name of your hadoop jars) are in classpath Hope it helps, Ashutosh On Mon, Sep 12, 2011 at 09:20, Siddharth Tiwari wrote: > Hi Jasper

Re: CREATE INDEX

2011-09-12 Thread Ashutosh Chauhan
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create%2FDropIndexhas DDL commands using which you can create and manipulate indices in Hive. Hope it helps, Ashutosh On Mon, Sep 12, 2011 at 05:46, Adriaan Tijsseling wrote: > Does anyone know the proper docum

Re: Hive issue

2011-09-13 Thread Ashutosh Chauhan
+ user@hive Siddharth, >> java.sql.SQLException: Method not supported >> at org.apache.hadoop.hive.jdbc.HiveConnection.createStatement(HiveConnection.java:207) Hive's jdbc implementation is not fully jdbc compliant yet and doesn't support all the features. Hope it helps, Ashutosh On Tue, Sep

Re: Change in serdeproperties does not update existing partitions

2011-09-13 Thread Ashutosh Chauhan
Hey Maxime, Yeah, thats intended behavior. After you do alter on table, all subsequent actions on table and partitions will inherit from it. If you want to modify properties of already existing partitions, you should be able to do something like 'alter table test_table partition (day='2011-09-02')

Re: HBase and Hivehandler compatibly

2011-09-14 Thread Ashutosh Chauhan
Hi Naila, That combination should work fine. Is there any specific problem you are encountering ? Hope it helps, Ashutosh On Tue, Sep 13, 2011 at 22:28, Naila karim <09msitnka...@seecs.edu.pk>wrote: > Dear All, Hello > > I have Hadoop 0-20.2 append version and HBase-0.90.3. > I am trying to bui

Re: Change in serdeproperties does not update existing partitions

2011-09-14 Thread Ashutosh Chauhan
file format evolves you don't > have to convert the whole history? > > Best, > Maxime > > On Tue, Sep 13, 2011 at 7:03 PM, Ashutosh Chauhan wrote: > >> Hey Maxime, >> >> Yeah, thats intended behavior. After you do alter on table, all subsequent >> ac

Re: One Schema Per Partition? (Multiple schemas per table?)

2011-10-06 Thread Ashutosh Chauhan
-datafile-20110101 > 12010-07-01Jeff32 > 22010-07-01Lisa33 > 32010-07-01Bob22 > 42010-07-01Fred27 > [hdfs@laxhadoop1-012 ~/Tim] :) cat multischema-datafile-20110102 > 100GregoryMale452010-08-01 > 101HorusMale14

Re: Running hive on large number of files in S3

2011-10-20 Thread Ashutosh Chauhan
Hey Thulasi, There are two factors which may affect job startup time in case of large number of partitions: a) Getting partition info from metastore: Hive stores metadata about each partiton in metastore. Depending on number of partitions, it needs to fetch, that can take some time. b) Input spli

Re: testing out Phabricator for code review

2011-10-20 Thread Ashutosh Chauhan
Hey John, Thanks for the heads up. I am interested in phabricator especially since I am thinking of setting up some review tool for HCatalog too. I have couple of questions: a) I can configure RB to use apache email address (or any email for that matter). Is that possible with Phabricator. Looks l

Re: UnixODBC and Hive setup

2011-10-26 Thread Ashutosh Chauhan
>> When I run the ant build, it fails because it can’t find header file fb303_types.h. Any idea where this file should come from? You need to build fb303 for this. Go to the dir where you untarred thrift tar ball. Then, cd contrib/fb303 . Then ./bootstrap.sh && configure && make && make install. B

Re: UnixODBC and Hive setup

2011-10-26 Thread Ashutosh Chauhan
fix for this? Thanks! > > ** ** > > Tony > > ** ** > > ** ** > > ** ** > > ** ** > > *From:* Ashutosh Chauhan [mailto:hashut...@apache.org] > *Sent:* 26 October 2011 17:27 > *To:* user@hive.apache.org > *Subject:* Re: UnixODBC and Hive setup > >

Re: Latest hive source code

2011-10-27 Thread Ashutosh Chauhan
You can get the latest hive trunk source from here: http://svn.apache.org/repos/asf/hive/trunk/ Hope it helps, Ashutosh On Thu, Oct 27, 2011 at 20:01, trang van anh wrote: > Thanks for your response, i check your link sent and i see that latest > source code version 0.7.1., But according to my

Re: Hive installation problem: java.lang.NoSuchFieldError: type

2011-11-10 Thread Ashutosh Chauhan
We are planning to upgrade antlr version which should fix this issue. https://issues.apache.org/jira/browse/HIVE-2439 Ashutosh 2011/11/10 Nicolas Lalevée > > Le 4 nov. 2011 à 17:19, Jian Fang a écrit : > > > Hi, > > > > I installed hive 0.7.1 to work with Hadoop 0.20.2. I have set up > HADOOP_

Re: Hive build error - Ant related

2011-11-10 Thread Ashutosh Chauhan
Following should help: 1) rm -rf ~/.ant/cache 2) rm -rf ~/.ivy2/cache 3) ant clean && ant package. Also make sure you are using ant 1.8+ Hope it helps, Ashutosh On Wed, Nov 9, 2011 at 14:14, Vandana Ayyalasomayajula < avand...@yahoo-inc.com> wrote: > Hi All, > > When I run "ant clean package" in

Re: MongoDB storage handler for HIVE

2011-11-17 Thread Ashutosh Chauhan
Great work YC. Alas, mongodb is GPL licensed, otherwise we could have it in hive-contribs (ofcourse only if you have decided it to contribute). Ashutosh On Thu, Nov 17, 2011 at 18:47, Stephen Boesch wrote: > Nice idea! I have worked a bit with Mongo and am leaning towards hive . > This could be

Re: Is there a reason for the Hive remote metastore to execute commands as different users?

2011-11-29 Thread Ashutosh Chauhan
Hey Alex, This indeed is a bug. I have done a patch for it on https://issues.apache.org/jira/browse/HIVE-2616 Would you like to try it out to see if that works for you? Ashutosh On Tue, Nov 29, 2011 at 02:45, Alex Holmes wrote: > Running mysql as the metastore doesn't change the behavior of the

Re: Hive projects for Google Summer of code 2012 ?

2012-02-04 Thread Ashutosh Chauhan
Hey Bharath, Great to see your enthusiasm for Hive! I would be happy to mentor you for the project. For the start, you can take a look at https://cwiki.apache.org/confluence/display/Hive/Roadmap for a list of open projects in Hive. The document is bit dated, so some of those projects may not be r

Re: Hive Web Interface boots-up fine but doest show the webapp (Hive 0.8.1)

2012-02-16 Thread Ashutosh Chauhan
Try: 127.0.0.1:9900/hwi On Thu, Feb 16, 2012 at 19:53, Abhishek Parolkar wrote: > > Hi there, >I just want to have a simple hive interface with HWI. when I start it > with "hive --service hwi' it boots up but when I visit the index.jsp it > always complain 404. > This is what I am doing htt

Re: Hive query on existing HBase table

2012-04-07 Thread Ashutosh Chauhan
Hi Vishal, Not through a released version of Hive. But, if you are willing to build hive from svn trunk, you will be able to do query on existing hbase tables. Or, you can wait for 0.9 to be released. Hope it helps, Ashutosh On Sat, Apr 7, 2012 at 11:43, Vishal M. Katkar wrote: > Is there a w

Re: Hive query on existing HBase table

2012-04-08 Thread Ashutosh Chauhan
>> *From:* Vishal M. Katkar >> *To:* user@hive.apache.org >> *Sent:* Sunday, April 8, 2012 12:52 AM >> *Subject:* Re: Hive query on existing HBase table >> >> Oh ok, thanks Ashutosh >> >> Is there a new API introduced for this or works for External Table? &g

Re: Thrift service + zklocks + time = death

2012-04-11 Thread Ashutosh Chauhan
Premise of the locking is that in well-behaved queries you will obtain a lock at the start of the query and then relinquish it at the end of query. Since, locks are lease-based, in badly-behaving queries after lease expires, lock will be relinquished. Are you are NPE for same repeated query after

Re: Lag function in Hive

2012-04-11 Thread Ashutosh Chauhan
Hey Harish, Awesome work on SQL Windowing. Judging from participation on this thread, it seems windowing is of sizable interest to Hive community. Would you consider contributing your work upstream in Hive? If its in Hive contrib, it will be accessible to lot of folks using Hive out of box. Thank

[ANNOUNCE] Apache Hive 0.9.0 Released

2012-04-30 Thread Ashutosh Chauhan
The Apache Hive team is proud to announce the the release of Apache Hive version 0.9.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extra

Re: does hive 0.9 supported hbase 0.90?

2012-05-09 Thread Ashutosh Chauhan
Hi Ransom, Hive 0.9 requires HBase 0.92 to work correctly. Thanks, Ashutosh On Wed, May 9, 2012 at 12:47 AM, Hezhiqiang (Ransom) < ransom.hezhiqi...@huawei.com> wrote: > In 0.8.1 version ,it’s ok > > But in 0.9 > > When I run selelct * from tbl, it was faild. > > ** ** > > Exceptio

Re: does hive 0.9 supported hbase 0.90?

2012-05-09 Thread Ashutosh Chauhan
n JIRA and 0.90 release > notes. > > ** ** > > Best regards > > Ransom. > > ** ** > > *From:* Ashutosh Chauhan [mailto:hashut...@apache.org] > *Sent:* Wednesday, May 09, 2012 4:29 PM > *To:* user@hive.apache.org > *Cc:* Wenzaohua > *Subject:*

Re: Is there a metastore schema script for postgresql for Hive version 0.9.0

2012-05-12 Thread Ashutosh Chauhan
Hi Xiaobo, It depends on what your current setup is: a) If you are trying Hive for the first time, then you don't necessarily need to create schema in postgres upfront. As wd suggested, datanucleus (ORM used by Hive) can autocreate the schema if it doesn't exist. b) If you are already using Hive 0

What is hive doing wrong?

2012-05-26 Thread Ashutosh Chauhan
Actually, whats more interesting is Shark. I attended one of the meetup here in Bay Area couple of months back where Chris presented Shark. Had a follow-up conversation with Matei after that. They have an interesting goal of making (unaltered) Hive queries run on Spark running on cluster managed by

Re: HIVE and S3 via EMR?

2012-05-29 Thread Ashutosh Chauhan
Which hive version you are using? You need fix of https://issues.apache.org/jira/browse/HIVE-1444 which was released in 0.9.0 Thanks, Ashutosh On Tue, May 29, 2012 at 1:20 PM, Russell Jurney wrote: > How do I load data from S3 into Hive using Amazon EMR? I've booted a > small cluster, and I wan

Re: Setup for contributing to Hive from MAC

2012-05-31 Thread Ashutosh Chauhan
https://cwiki.apache.org/confluence/display/Hive/HowToContribute will help you get started. Thanks, Ashutosh On Thu, May 31, 2012 at 8:55 AM, Mapred Learn wrote: > Hi, > Does anyone know how to set up apache hive on MAC to contribute and fix > JIRAs ? > > Thanks, > JJ > > Sent from my iPhone

Re: Behavior of Hive 2837: insert into external tables should not be allowed

2012-06-01 Thread Ashutosh Chauhan
Hi Mark, I understand your concern w.r.t backward compatibility. But as Ed pointed out there is a config variable and by default semantic is unchanged so you can continue to insert into your external table. I have a question though. Why are you creating all your tables as "external" tables ? Why n

Re: Querying HBase Records with null valued-columns using hive

2012-06-02 Thread Ashutosh Chauhan
Hey Sagar, Seems like you have inserted data in your hbase table directly through hbase client and not through hive client. If so, you need https://issues.apache.org/jira/browse/HIVE-1634 to correctly read pre-existing data in hbase. Hive-1634 is available as a part of 0.9 release. So, upgrade to

Re: 回复: [ANNOUNCE] New PMC member - Ashutosh Chauhan

2012-07-18 Thread Ashutosh Chauhan
Tue, 17 Jul 2012 15:37:32 +0800 > *To: *user > *ReplyTo: * user@hive.apache.org > *Subject: *回复: [ANNOUNCE] New PMC member - Ashutosh Chauhan > > congratulates~! > > 2012-07-17 > -- > ** > Best Regards > Andes > > ** > ---

Re: Issue while using hive 0.9

2012-09-17 Thread Ashutosh Chauhan
That won't work. You must use the exact same version which was used while compiling Hive, i.e., 3.0.1 any other version won't work. Look at the classpath of java process of Hive to make sure there is no other version in your classpath. Hope it helps, Ashutosh On Mon, Sep 17, 2012 at 4:40 AM, Sara

Re: Issue while using hive 0.9

2012-09-17 Thread Ashutosh Chauhan
Only thing which is different then usual setups is jdk1.7 Is it possible for you to test with jdk1.6 ? Ashutosh On Mon, Sep 17, 2012 at 10:02 PM, Sarath Chandra < sarathchandra.jos...@algofusiontech.com> wrote: > @Ashutosh > I haven't built my hive from sources. I just downloaded the binaries fro

Re: Issue while using hive 0.9

2012-09-17 Thread Ashutosh Chauhan
lder? > > > On Tuesday 18 September 2012 10:35 AM, Ashutosh Chauhan wrote: > > Only thing which is different then usual setups is jdk1.7 Is it possible > for you to test with jdk1.6 ? > > Ashutosh > On Mon, Sep 17, 2012 at 10:02 PM, Sarath Chandra < > sarathchandra.jos...@al

Re: Hive Meta Server (Thrift Server) Failover / Redundancy / Load Balancing

2012-11-08 Thread Ashutosh Chauhan
Hi Manish, Your understanding is mostly correct, though there is one additional bit. MetastoreClient in current incarnation don't automatically reconnect in case connection gets dropped for a connected session. As a result, it won't failover active connections. New connections would be fine. Fortu

Re: Hive Meta Server (Thrift Server) Failover / Redundancy / Load Balancing

2012-11-13 Thread Ashutosh Chauhan
ailable for review but not > available as the one which is ready to use. Or I can try out that patch > when using the secured one? > > Again thanks your help !! > > Regards, > Manish > > > > On Thu, Nov 8, 2012 at 9:39 AM, Ashutosh Chauhan wrote: > >>

Re: MapJoin error: .hashtable file not found

2012-11-27 Thread Ashutosh Chauhan
Hi Vivek, I will encourage you to try out latest trunk or hive-0.10 branch. Lots of work has gone in since 0.9 to make Hive work better on Windows. Ashutosh On Tue, Nov 27, 2012 at 11:08 PM, Vivek Mishra wrote: > Hi, > > I am using 0.9.0 hive with Windows 2008 server. > > I did try debugging in

Re: Hive double-precision question

2012-12-08 Thread Ashutosh Chauhan
There is a work going on at https://issues.apache.org/jira/browse/HIVE-2693to add support for BigDecimal in Hive. I think your use-case will benefit from it. Ashutosh On Sat, Dec 8, 2012 at 11:23 AM, Periya.Data wrote: > Hi Lauren and Zhang, > The book "Programming Hive" suggests to use Doub

Re: hiveserver leak zookeeper connections?

2013-01-05 Thread Ashutosh Chauhan
We have found one source of leak which we think we have fixed. https://issues.apache.org/jira/browse/HIVE-3723 This is a part of hive-0.10 RC0 http://people.apache.org/~hashutosh/hive-0.10.0-rc0/ You can try hive from there and see if this fixes this connection leaking problem. Thanks, Ashutosh

Re: ASF HiveServer2 release plan !!

2013-01-08 Thread Ashutosh Chauhan
Hi Manish, Currently the blocker for HiveServer2 in ASF is https://issues.apache.org/jira/browse/HIVE-3785 Patch there outlines changes HS2 requires in existing hive codebase. That patch is currently under review. Once thats reviewed and checked-in than remaining of HS2 patch will made it in trunk

[ANNOUNCE] Apache Hive 0.10.0 Released

2013-01-11 Thread Ashutosh Chauhan
The Apache Hive team is proud to announce the the release of Apache Hive version 0.10.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extr

Re: edit permissions to wiki

2014-06-26 Thread Ashutosh Chauhan
Done. Thanks, Nitin for your help in improving Hive wiki! On Tue, Jun 24, 2014 at 12:57 PM, Nitin Pawar wrote: > nitinpawar432

Re: Write access to wiki

2014-06-27 Thread Ashutosh Chauhan
Done. On Fri, Jun 27, 2014 at 6:26 PM, Sudarshan Rangarajan < tr.sudars...@gmail.com> wrote: > 'tr.sudarshan

Re: Requesting write access to the Hive wiki

2014-08-04 Thread Ashutosh Chauhan
Hi Ashish, I added you to confluence. Ashutosh On Sun, Aug 3, 2014 at 9:25 PM, Ashish Singh wrote: > Kindly grant me write access to the Hive wiki, so that I can edit the > content. > > Confluence username: asingh > > -- > > Regards, > Ashish >

Re: request write access to Hive Wiki

2014-08-14 Thread Ashutosh Chauhan
Hi Chengxiang, Granted write access to wiki to you. Thanks, Ashutosh On Thu, Aug 14, 2014 at 2:38 AM, Li, Chengxiang wrote: > Hi, > > I'm working on HIVE-7142 > which should document some information on Hive wiki, while I didn't have > write

Re: Help needed: Out of memory with windowing functions

2014-08-20 Thread Ashutosh Chauhan
Hi Furcy, Sorry that you run into this, but this is a non-trivial problem. But, good news is Harish has done some good work in this area. See following links. All this will be available in upcoming release, date for which is under discussion on dev list. 1. https://issues.apache.org/jira/browse/H

Re: Reading and Writing with Hive 0.13 from a Yarn application

2014-09-03 Thread Ashutosh Chauhan
Hi Nathan, This was done in https://issues.apache.org/jira/browse/HIVE-6248 Reasoning was to minimize api surface area to users so that they are immune of incompatible changes in internal classes and thus making it easier for them to consume this and not get worried about version upgrade. Seems li

Re: Reading and Writing with Hive 0.13 from a Yarn application

2014-09-03 Thread Ashutosh Chauhan
e's another avenue I should be pursuing as a yarn app (metadata vs. > HCatalog, for instance). > > All that being said :), the ability to get the block locations (and > sizes, if possible) would certainly solve my problems. > > > Thanks, > > > Nathan > > &

Re: wiki edit access

2014-09-08 Thread Ashutosh Chauhan
Done. Sorry for delay. Ashutosh On Tue, Sep 2, 2014 at 11:59 AM, Sergey Shelukhin wrote: > Hi. > Can I get wiki edit access for Hive? Confluence username sershe > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and m

Re: Hive being slow

2015-01-09 Thread Ashutosh Chauhan
Hi Abhishek, How are you determining its resulting in full table scan? One way to ascertain that filter got pushed down is to see how many tasks were launched for your query, with and without filter. One would expect lower # of splits (and thus tasks) for query having filter. Thanks, Ashutosh On

  1   2   >