Re: Avro column type in Hive

Sergey, Is your table a partitioned or a non-partitioned one? I have usually seen this problem manifest itself for partitioned tables and that is mostly where the pruning bites. So if you now try to add a partition to this table, you might see an exception like: java.sql.BatchUpdateException: Dat

Re: Derby version used by Hive

Richard, A quick eye-balling of the code doesn't show anything that could potentially be a blocker for this upgrade. Also +1 on staying on the latest and greatest. Please feel free to open up a JIRA and submit the patch. Also just out of curiosity, what are you really using a derby backed store f

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations! Well deserved! On Thu, Sep 17, 2015 at 12:03 AM, Vikram Dixit K wrote: > Congrats Ashutosh! > > On Wed, Sep 16, 2015 at 9:01 PM, Chetna C wrote: > >> Congrats Ashutosh ! >> >> Thanks, >> Chetna Chaudhari >> >> On 17 September 2015 at 06:53, Navis Ryu wrote: >> >> > Congratulat

Patches needing review

Hello all, I have couple of patches submitted and out for review for some time. If I can get some help on getting them reviewed and merged, I would highly appreciate that! HIVE-11691 (Wiki update for developer debugging. Already one +1 from Lefty) HIVE-11647 (HBase dependency bump to 1.1.1) HIVE-

Re: hiveserver2 hangs

g. >> >> On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < >> kulkarni.swar...@gmail.com> wrote: >> >>> How much memory have you currently provided to HS2? Have you tried >>> bumping that up? >>> >>> On Mon, Sep 7,

Re: [DISCUSS] github integration

I personally am a big fan of pull requests which is primarily the reason for a similar proposal that I made almost a year and half ago[1] :). I think the consensus we reached at the time was that to move the primary source code from svn to git(which we did) but still use patches submitted to JIRAs

Re: hiveserver2 hangs

; teValue(TColumn.java:381) > Local Variable: org.apache.hive.service.cli.thrift.TColumn#504 > Local Variable: org.apache.hive.service.cli.thrift.TStringColumn#453 > at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) > at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) > at org.apach

Re: [ANNOUNCE] New Hive Committer - Lars Francke

Congrats! On Mon, Sep 7, 2015 at 3:54 AM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Lars Francke a committer on the > Apache Hive Project. > > Please join me in congratulating Lars! > > Thanks. > > - Carl > > -- Swarnim

Patches needing review love

Hey all, I have couple of patches currently review state which are either ready to merge or need review. If I can have someone help me out with these, I would really appreciate that. HIVE-11513 (Ready to merge) HIVE-5277 (Ready to merge) HIVE-11559 (Needs review) HIVE-11469 (Needs review) Swarni

Re: hiveserver2 hangs

ive-0.13 with hadoop1. > > On Thu, Aug 20, 2015 at 11:49 AM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >> Sanjeev, >> >> Can you tell me more details about your hive version/hadoop version etc. >> >> On Wed, Aug 19, 2015 at 1:

Re: hiveserver2 hangs

Sanjeev, Can you tell me more details about your hive version/hadoop version etc. On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma wrote: > Can somebody gives me some pointer to looked upon? > > On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma > wrote: > >> Hi >> We are experiencing a strange prob

Re: [DISCUSS] Hive and HBase dependency

think that would > be ok. > > Alan. > > kulkarni.swar...@gmail.com > August 14, 2015 at 11:12 > Thanks Alan. I created [1] to revert the non-passive changes from 1.x. > > Out of curiosity, what are your plans on merging the metastore branch to > master? It seems l

Re: [DISCUSS] Hive and HBase dependency

. [1] https://issues.apache.org/jira/browse/HIVE-11559 On Thu, Aug 13, 2015 at 12:52 PM, Alan Gates wrote: > On the hbase-metastore branch I've actually already moved to HBase 1.1. > I'm +1 for moving to 1.1 or 1.0 on master and staying at 0.98 on branch-1. > > A

[DISCUSS] Hive and HBase dependency

Hi all, It seems like our current dependency on HBase is a little fuzzy to say the least. And with increased features relying on HBase(HBase integration, HBase metastore etc), I think it would be worth giving a thought into how we want to manage this dependency. I have also seen regressions[1][2]

Re: Hive column mapping to hbase

Sunile, Starting hive 0.12, you can use prefixes to pull the columns corresponding to the column families. So in your case as long as you have sensible prefixes, for example for everything in july, if you use "july-DATE-speed", then you can simply do something like WITH SERDEPROPERTIES ('hbase.col

Re: [ANNOUNCE] New Hive PMC Member - Sushanth Sowmyan

Congrats Sushanth! On Thu, Jul 23, 2015 at 3:40 PM, Eugene Koifman wrote: > Congratulations! > > On 7/22/15, 9:45 AM, "Carl Steinbach" wrote: > > >I am pleased to announce that Sushanth Sowmyan has been elected to the > >Hive > >Project Management Committee. Please join me in congratulating Sus

Re: hbase column without prefix

e to store a map in hbase. That's why i > want to cut prefixes. > > What do you think about it? Does it make sense for you? Even if it's > not a bug it would be nice to have option to hide prefixes in keys of > map. > > Kindly regards > Wojciech Indyk > > > 2

Re: hbase column without prefix

Hey, Just so that I understand your issue better, why do you think it should be key: one, value: 0.5 key: two: value: 0.5 instead of key: tag_one, value: 0.5 key: tag_two, value: 0.5 when you know that the prefixes for your columns are tag_. Hive won't really do anything but simply pull all th

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

+1 on the new proposal. Feedback below: > New features must be put into master. Whether to put them into branch-1 is at the discretion of the developer. How about we change this to "*All* features must be put into master. Whether to put them into branch-1 is at the discretion of the *committer*.

Re: [ANNOUNCE] New Hive Committer - Chaoyu Tang

Congrats Chaoyu! On Thu, May 21, 2015 at 9:17 AM, Sergio Pena wrote: > Congratulations Chaoyu !!! > > On Wed, May 20, 2015 at 5:29 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Chaoyu Tang a committer on the > Apache > > Hive Project. > > > > Please join me in congratula

Re: JIRA notifications

e moved to git, you can try using github pull request > > instead. > > > It also integrates with jira. > > > More git instructions - http://accumulo.apache.org/git.html > > > > > > > > > On Thu, May 14, 2015 at 8:01 AM, kulkarni.swar...@gmail.com

[DISCUSS] Hive API passivity

While reviewing some of the recent patches, I came across a few with non-passive changes and or discussion around them. I was wondering what kind of passivity guarantees should we provide to our consumers? I understand that Hive API is probably not as widely used as some of its peers in the ecosyst

Re: JIRA notifications

archives don't > > have a complete record of JIRA activity. > > > > -- Lefty > > > > On Wed, May 13, 2015 at 10:03 AM, Thejas Nair > > wrote: > > > >> comments now added go to iss...@hive.apache.org . > >> emails for JIRAs crea

Re: Questions related to HBase general use

+ hive-dev Thanks for your question. We recently have been busy adding quite a few features on top on Hive/HBase Integration to make it more stable and easy to use. We also did a talk very recently at HBaseCon 2015 showing off the latest improvements. Slides here[1]. Like Jerry mentioned, if you r

JIRA notifications

I noticed that I haven't been getting notifications(or they are really delayed) on any of the new JIRAs created/ comments added. Anyone else noticing similar issues as well? -- Swarnim

[DISCUSS] Hive/HBase Integration

Hello all, So last week, Myself, Brock Noland and Nick Dimiduk got a chance to present some of the work we have been doing in the Hive/HBase integration space at HBaseCon 2015 (slides here[1] for anyone interested). One of the interesting things that we noted at this conference was that even thoug

Re: [ANNOUNCE] New Hive Committer - Alex Pivovarov

Congratulations Alex!! On Thu, Apr 30, 2015 at 2:49 PM, Sergey Shelukhin wrote: > Congratulations! > > On 15/4/29, 17:57, "Jimmy Xiang" wrote: > > >Congrats!! > > > >On Wed, Apr 29, 2015 at 5:48 PM, Xu, Cheng A > wrote: > > > >> Congratulations Alex! > >> > >> -Original Message- > >> F

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congratulations!! On Wed, Apr 15, 2015 at 10:57 AM, Viraj Bhat wrote: > Mithun Congrats!! > Viraj > > From: Carl Steinbach > To: dev@hive.apache.org; u...@hive.apache.org; mit...@apache.org > Sent: Tuesday, April 14, 2015 2:54 PM > Subject: [ANNOUNCE] New Hive Committer - Mithun Radhak

Re: Can anyone review dayofyear UDF (HIVE-3378)?

Alexander, I reviewed your code and left a few suggestions on how to possibly simplify it(if I understood your implementation correctly). Let me know if they don't make sense to you. On Wed, Apr 8, 2015 at 12:34 PM, Alexander Pivovarov wrote: > https://issues.apache.org/jira/browse/HIVE-3378 >

Re: [ANNOUNCE] New Hive PMC Member - Sergey Shelukhin

Congratulations Sergey! Well deserved! On Fri, Feb 27, 2015 at 1:51 AM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > Congratulations and keep up the great work! > > +Vinod > > On Feb 25, 2015, at 8:43 AM, Carl Steinbach wrote: > > > I am pleased to announce that Sergey Shelukhin h

Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

Congratulations! Nice Job! On Mon, Sep 15, 2014 at 2:54 AM, Damien Carol wrote: > Congratulations, Eugene. > > Damien CAROL > >- tél : +33 (0)4 74 96 88 14 >- fax : +33 (0)4 74 96 31 88 >- email : dca...@blitzbs.com > > BLITZ BUSINESS SERVICE > Le 14/09/2014 09:23, Thejas Nair a é

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congratulations guys! On Mon, Jun 23, 2014 at 2:09 AM, Lefty Leverenz wrote: > Bravo, Szehon and Gopal! > > -- Lefty > > > On Mon, Jun 23, 2014 at 12:53 AM, Gopal V wrote: > > > On 6/22/14, 8:42 PM, Carl Steinbach wrote: > > > >> The Apache Hive PMC has voted to make Gopal Vijayaraghavan and S

Re: Documentation Policy

add any new labels. > > -- Lefty > > > On Fri, Jun 13, 2014 at 1:31 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > > > +1 on deleting the TODOC tag as I think it's assumed by default that once > > an enhancement is done, it will b

Re: Documentation Policy

t; > > (a) Just remove the TODOC## label. > > (b) Replace TODOC## with docdone (no caps, no version number). > > (c) Add a docdone label but keep TODOC##. > > (d) Something else. > > > > > > -- Lefty > > > > > > On Thu, Jun 12

Re: Documentation Policy

%3D%20TODOC14%20AND%20status%20in%20(Resolved%2C%20Closed) I'll continue digging through the queue going backwards to 0.12 and 0.11 and see if I find similar stuff there as well. On Wed, Jun 11, 2014 at 10:36 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: >

Re: Documentation Policy

> Feel free to label such jiras with this keyword and ask the contributors for more information if you need any. Cool. I'll start chugging through the queue today adding labels as apt. On Tue, Jun 10, 2014 at 9:45 PM, Thejas Nair wrote: > > Shall we lump 0.13.0 and 0.13.1 doc tasks as TODOC13?

Re: Documentation Policy

> Writing documentation sooner rather than later is likely to increases the chances of things getting documented. Big +1 on this. I think documentation contributes towards one of the major technical debts(I personally have quite a bit for the patches I contributed). IMHO committers may choose to r

Re: Fixing Trunk tests and getting stable nightly build on b.a.o

Hi Lewis, Are there any specific tests that you are seeing trouble with? If so, please feel free to log appropriate JIRAs to get them fixed (and submit patches ;) ) There is a developer guide[1] that explains in quite detail how to run tests. > Are there any suggested EXTRA_PARAMETERS to be pass

Re: Bumping a few JIRAs

Left few minor comments on the JIRAs On Thu, Mar 20, 2014 at 2:42 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > I am also definitely willing to help out with reviewing the JIRAs. Just my > +1 won't matter much as it is non-binding. :) > > > On

Re: Bumping a few JIRAs

I am also definitely willing to help out with reviewing the JIRAs. Just my +1 won't matter much as it is non-binding. :) On Thu, Mar 20, 2014 at 1:21 PM, Lefty Leverenz wrote: > I gave HIVE-6331 a +1 > and > asked for a trivial fix in > HIVE-5652

Re: Proposal to switch to pull requests

/improved_integration_between_apache_and > > > > On Wed, Mar 5, 2014 at 9:19 AM, kulkarni.swar...@gmail.com > > wrote: > >> Hello, > >> > >> Since we have a nice mirrored git repository for hive[1], any specific > >> reason why we can't swit

Proposal to switch to pull requests

Hello, Since we have a nice mirrored git repository for hive[1], any specific reason why we can't switch to doing pull requests instead of patches? IMHO pull requests are awesome for peer review plus it is also very easy to keep track of JIRAs with open pull requests instead of looking for JIRAs i

Re: [Discuss] project chop up

> I'd like to propose we move towards Maven. Big +1 on this. Most of the major apache projects(hadoop, hbase, avro etc.) are maven based. Also can't agree more that the current build system is frustrating to say the least. Another issue I had with the existing ant based system is that there are n

Re: Access to trigger jobs on jenkins

re-commit builds? > > Unfortunately to trigger *regular* builds you'd need an Apache username > according the Apache Infra Jenkins <http://wiki.apache.org/general/Jenkins > >page. > > Brock > > > On Sun, Aug 4, 2013 at 1:37 PM, kulkarni.swar...@gmail.com <

Access to trigger jobs on jenkins

Hello, I was wondering if it is possible to get access to be able to trigger jobs on the jenkins server? Or is that access limited to committers? Thanks, -- Swarnim

Re: is there set of queries, which can be used to benchmark the hive performance?

Hi Rob, HiBench[1] is one I have seen most commonly used. [1] https://github.com/intel-hadoop/HiBench/tree/master/hivebench On Tue, Apr 16, 2013 at 6:42 PM, ur lops wrote: > I am looking to benchmark my database with hive. but before I do that, > I want to run a set of tests on hive to benchm

Preferred way to run unit tests

Hello, I have been trying to run the unit tests for the last hive release (0.10). For me they have been taking in access of 10 hrs to run (not to mention the occasional failures with some of the flaky tests). Current I am just doing a "ant clean package test". Is there a better way to run these?

Re: Review Requests

Would someone have a chance to take a quick look at these review requests[1][2]. [1] https://reviews.apache.org/r/9275/ [2] https://reviews.apache.org/r/9276/ Thanks, On Tue, Feb 5, 2013 at 10:00 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Thanks Mark. A

Re: Review Requests

Thanks Mark. Appreciate that. I'll take a look. On Mon, Feb 4, 2013 at 10:23 PM, Mark Grover wrote: > Swarnim, > I left some comments on reviewboard. > > On Mon, Feb 4, 2013 at 8:00 AM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >

Review Requests

Hello, I opened up two reviews for small issues, HIVE-3553[1] and HIVE-3725[2]. If you guys get a chance to review and provide feedback on it, I will really appreciate. Thanks, [1] https://reviews.apache.org/r/9275/ [2] https://reviews.apache.org/r/9276/ -- Swarnim

Re: hive 0.10 release

There are couple of enhancements that I have been working on mainly related to the hive/hbase integration. It would be awesome if it is possible at all to include them in this release. None of them should really be high risk. I have patches submitted for few of them. Will try to get for others subm

Hive JIRA slow/dead

Seems like the hive JIRA is extremely slow to respond since this morning. Is there anyway to may be cycle the instance to fix the issue? Thanks, -- Swarnim

Re: Logging info is not present in console output

Are you running via console? The default logging level is WARN. $HIVE_HOME/bin/hive -hiveconf hive.root.logger=INFO,console This should print the INFO messages onto the console. On Tue, Aug 7, 2012 at 4:07 PM, Ablimit Aji wrote: > Hi, > > I have put some LOG.info() statements inside the join

Re: Some Weird Behavior

e, Aug 7, 2012 at 11:04 AM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >> What is the hive version that you are using? >> >> >> On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck wrote: >> >>> I am not sure about the data, b

Re: Some Weird Behavior

What is the hive version that you are using? On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck wrote: > I am not sure about the data, but when we do > > SELECT count(*) from data_realtime where dt='20120730' and uid is null > > I get the count > > but If I do- > > SELECT * from data_realtime where dt=

Re: Custom UserDefinedFunction in Hive

Have you tried using EXPLAIN[1] on your query? I usually like to use that to get a better understanding of what my query is actually doing and debugging at other times. [1] https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain On Tue, Aug 7, 2012 at 12:20 PM, Raihan Jamal wrote

Re: Casting exception while converting from "LazyDouble" to "LazyString"

Hi Kanna, This might just mean that in your query you are having a STRING type for a field which is actually a DOUBLE. On Tue, Jul 10, 2012 at 3:05 PM, Kanna Karanam wrote: > Has anyone seen this error before? Am I missing anything here? > > ** ** > > 2012-07-10 11:11:02,203 INFO org.apache

Re: Developing Hive UDF in eclipse

Did you try this[1]? It had got me most of my way through the process. [1] https://cwiki.apache.org/Hive/gettingstarted-eclipsesetup.html On Tue, Jun 5, 2012 at 8:49 AM, Arun Prakash wrote: > Hi Friends, > I tried to develop udf for hive but i am getting package import error > in eclipse. > > im

getStructFieldData method on StructObjectInspector

I am trying to write a custom ObjectInspector extending the StructObjectInspector and got a little confused about the use of the getStructFieldData method on the inspector. Looking at the definition of the method: public Object getStructFieldData(Object data, StructField fieldRef); I understand t

Re: Hive join does not execute

It looks more like a permissions problem to me. Just make sure that whatever directories hadoop is writing to are owned by hadoop itself. Also it looks a little weird to me that it is using the "RawLocalFileSystem" instead of the "DistributedFileSystem". You might want to look at "fs.default.name"