Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

2014-09-15 Thread Rajesh Balamohan
Congratulations Eugene. ~Rajesh.B On Tue, Sep 16, 2014 at 1:53 AM, Sergey Shelukhin wrote: > Congrats! > > On Mon, Sep 15, 2014 at 12:37 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > > > Congratulations! Nice Job! > > > > On Mon, Sep 15, 2014 at 2:54 AM, Damien Carol

Re: FYI: MetaStore running out of threads

2022-08-31 Thread Rajesh Balamohan
W.r.t to connection reuse issues, LLAP had a similar issue (not in HMS) https://issues.apache.org/jira/browse/HIVE-16020. It was making a connection in every task and UGI had to be persisted in the QueryInfo level to reduce the impact. In hive, FileUtils.checkFileAccessWithImpersonation can be fix

Re: FYI: MetaStore running out of threads

2022-08-31 Thread Rajesh Balamohan
t may not be relevant here. On Thu, Sep 1, 2022 at 4:48 AM Rajesh Balamohan wrote: > > W.r.t to connection reuse issues, LLAP had a similar issue (not in HMS) > https://issues.apache.org/jira/browse/HIVE-16020. It was making a > connection in every task and UGI had to be persisted i

Re: TPCDS query degrade with hive-3.1.2 because of wrong estimation for reducers

2022-10-02 Thread Rajesh Balamohan
Based on the plan, filtered output in map-1 had mis-estimates and also groupby operators have large misestimates. This is causing the number of reducers to be estimated as "4" which is less for this query. Due to the partition factor of tez, it ends up with 8 reducer slots at runtime for hive 3.x.

Re: Proposal to deprecate Hive on Spark from branch-3

2023-02-22 Thread Rajesh Balamohan
+1 on removing Hive on Spark in branch-3. It was not done earlier since it was removing a feature in the branch. But if there is enough consensus, we should consider removing it. ~Rajesh.B On Wed, Feb 22, 2023 at 12:48 PM Aman Raj wrote: > Hi team, > > We have been trying to fix Hive on Spark

Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Rajesh Balamohan
Congratulations Simhadri. :) ~Rajesh.B On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha wrote: > Congrats Simhadri ! > > On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam > wrote: > >> Congrats Simhadri. Looking forward to many more contributions in the >> future. >> >> On Thu, Apr 18, 2024 at 12:25 PM

Re: [ANNOUNCE] New PMC Member : Vineet Garg

2018-07-31 Thread Rajesh Balamohan
Congratulations Vineet! ~Rajesh.B On Tue, Jul 31, 2018 at 3:34 PM Marta Kuczora wrote: > Congratulations Vineet! > > On Mon, Jul 30, 2018 at 9:45 AM Peter Vary > wrote: > > > Congratulations Vineet! > > > > > On Jul 30, 2018, at 01:59, Ashutosh Chauhan > > wrote: > > > > > > On behalf of the

Re: [ANNOUNCE] New PMC Member : Vihang Karajgaonkar

2018-07-31 Thread Rajesh Balamohan
Congratulations Vihang! ~Rajesh.B On Tue, Jul 31, 2018 at 3:35 PM Marta Kuczora wrote: > Congratulations Vihang! > > On Mon, Jul 30, 2018 at 9:44 AM Peter Vary > wrote: > > > Congratulations Vihang! > > > > > On Jul 29, 2018, at 22:32, Vineet Garg wrote: > > > > > > Congratulations Vihang! >

Re: [ANNOUNCE] New committer: Slim Bouguerra

2018-07-31 Thread Rajesh Balamohan
Congratulations Slim! ~Rajesh.B On Tue, Jul 31, 2018 at 3:34 PM Marta Kuczora wrote: > Congratulations Slim! > > On Mon, Jul 30, 2018 at 2:01 AM Ashutosh Chauhan > wrote: > > > Apache Hive's Project Management Committee (PMC) has invited Slim > Bouguerra > > to become a committer, and we are p

Re: [ANNOUNCE] New PMC Member : Peter Vary

2018-07-31 Thread Rajesh Balamohan
Congratulations Peter! ~Rajesh.B On Tue, Jul 31, 2018 at 3:58 PM Marta Kuczora wrote: > Congratulations Peter! > > On Mon, Jul 30, 2018 at 7:53 PM Andrew Sherman > wrote: > > > Congratulations Peter! > > > > On Sun, Jul 29, 2018 at 1:32 PM Vineet Garg > wrote: > > > > > Congratulations Peter

Re: [ANNOUNCE] New PMC Member : Sahil Takiar

2018-07-31 Thread Rajesh Balamohan
Congratulations Sahil! ~Rajesh.B On Tue, Jul 31, 2018 at 3:57 PM Marta Kuczora wrote: > Congratulations Sahil! > > On Mon, Jul 30, 2018 at 9:44 AM Peter Vary > wrote: > > > Congratulations Sahil! > > > > > On Jul 29, 2018, at 22:32, Vineet Garg wrote: > > > > > > Congratulations Sahil! > > >

Re: [ANNOUNCE] New committer: Nishant Bangarwa

2018-10-22 Thread Rajesh Balamohan
Congrats Nishant! :) ~Rajesh.B On Fri, Oct 19, 2018 at 11:43 PM Vaibhav Gumashta wrote: > Congrats Nishant. > > On 10/19/18, 11:12 AM, "Prasanth Jayachandran" < > pjayachand...@hortonworks.com> wrote: > > Congratulations! > > > On Oct 19, 2018, at 11:10 AM, Vihang Karajgaonkar > wrote:

Re: Review Request 71708: HIVE-22435

2019-11-07 Thread Rajesh Balamohan
g/r/71708/#comment306300> minor: Is tag needed here? - Rajesh Balamohan On Nov. 4, 2019, 5:01 a.m., Krisztian Kasa wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 71904: HIVE-21164: ACID: explore how we can avoid a move step during inserts/compaction

2020-02-04 Thread Rajesh Balamohan
4382 (original), 4397 (patched) <https://reviews.apache.org/r/71904/#comment307695> Is this needed for direct insert?. In objectstores, we could have calls getting throttled. - Rajesh Balamohan On Jan. 31, 2020, 4:12 p.m., Marta Kuczora

Review Request 72129: HIVE-22850: Optimise lock acquisition in TxnHandler

2020-02-13 Thread Rajesh Balamohan
be4ad Diff: https://reviews.apache.org/r/72129/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72129: HIVE-22850: Optimise lock acquisition in TxnHandler

2020-02-13 Thread Rajesh Balamohan
ed/files/2020/02/13/74ec6cbd-c552-4d46-b5a6-e2fa6da41bdc__HIVE-22850.5.patch Thanks, Rajesh Balamohan

Re: Review Request 72129: HIVE-22850: Optimise lock acquisition in TxnHandler

2020-02-13 Thread Rajesh Balamohan
This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72129/#review219575 ------- On Feb. 13, 2020, 1:22 p.m., Rajesh Balamohan wrote: > >

Re: Review Request 72129: HIVE-22850: Optimise lock acquisition in TxnHandler

2020-02-13 Thread Rajesh Balamohan
Diff: https://reviews.apache.org/r/72129/diff/3/ Changes: https://reviews.apache.org/r/72129/diff/2-3/ Testing --- File Attachments HIVE-22850.5.patch https://reviews.apache.org/media/uploaded/files/2020/02/13/74ec6cbd-c552-4d46-b5a6-e2fa6da41bdc__HIVE-22850.5.patch Thanks, Rajesh Balamohan

Re: Review Request 72129: HIVE-22850: Optimise lock acquisition in TxnHandler

2020-02-19 Thread Rajesh Balamohan
22850.5.patch https://reviews.apache.org/media/uploaded/files/2020/02/13/74ec6cbd-c552-4d46-b5a6-e2fa6da41bdc__HIVE-22850.5.patch Thanks, Rajesh Balamohan

Review Request 72213: HIVE-22975: Optimise TopNKeyFilter with boundary checks

2020-03-08 Thread Rajesh Balamohan
/r/72213/diff/1/ Testing --- Yes. Updated in ticket Thanks, Rajesh Balamohan

Review Request 72333: HIVE-23154: Fix race condition in Utilities::mvFileToFinalPath

2020-04-08 Thread Rajesh Balamohan
ot;. Patch fixes this issue as well. Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java e25dc54e7d Diff: https://reviews.apache.org/r/72333/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72333: HIVE-23154: Fix race condition in Utilities::mvFileToFinalPath

2020-04-09 Thread Rajesh Balamohan
--- File Attachments (updated) HIVE-23154.3.patch https://reviews.apache.org/media/uploaded/files/2020/04/09/38ab8dfe-18c2-4174-84da-e1028ad4133c__HIVE-23154.3.patch Thanks, Rajesh Balamohan

Review Request 72434: Reduce number of DB calls in ObjectStore::getPartitionsByExprInternal

2020-04-26 Thread Rajesh Balamohan
/1/ Testing --- Thanks, Rajesh Balamohan

Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan
: https://reviews.apache.org/r/72499/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-12 Thread Rajesh Balamohan
/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/1/ Testing --- Thanks, Rajesh Balamohan

Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
/ShuffleHandler.java aff2c2ec39 llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72503/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
------ On May 12, 2020, 9:59 p.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72503/ >

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
/files/2020/05/13/36724ea5-265e-4e61-98a4-18af913b5b48__HIVE-23449.2.patch Thanks, Rajesh Balamohan

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
his is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72503/#review220732 ------- On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote: > > --- >

Re: Review Request 72503: HIVE-23449: LLAP: Reduce mkdir and config creations in submitWork hotpath

2020-05-12 Thread Rajesh Balamohan
omatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72503/#review220734 ------- On May 13, 2020, 2:28 a.m., Rajesh Balamohan wrote: > > --- > This is

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-13 Thread Rajesh Balamohan
- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72499/#review220748 --- On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote: > > --

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-13 Thread Rajesh Balamohan
----- On May 12, 2020, 12:06 p.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72499/ > ---

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
/llap/daemon/impl/QueryTracker.java eae8e08540 llap-server/src/test/org/apache/hadoop/hive/llap/daemon/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/2/ Changes: https://reviews.apache.org/r/72499/diff/1-2/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
> > Is this logic needed? You already have valueloader in get() which must > > return a ugi, so it cant be null. > > Rajesh Balamohan wrote: > Yes, value loader is for initial miss. This is to avoid single connection > becoming a contention for AM communication. > ht

Re: Review Request 72499: HIVE-23446:LLAP: Reduce IPC connection misses to AM for short queries

2020-05-14 Thread Rajesh Balamohan
/impl/TaskExecutorTestHelpers.java 50dec4759e Diff: https://reviews.apache.org/r/72499/diff/3/ Changes: https://reviews.apache.org/r/72499/diff/2-3/ Testing --- Thanks, Rajesh Balamohan

Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-17 Thread Rajesh Balamohan
/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/PartitionManagementTask.java e4488f4709 Diff: https://reviews.apache.org/r/72521/diff/1/ Testing --- Thanks, Rajesh Balamohan

Review Request 72522: HIVE-23488: Optimise PartitionManagementTask::Msck::repair

2020-05-17 Thread Rajesh Balamohan
/HiveMetaStoreChecker.java 6f4400a8ef standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/Msck.java f4e109d1b0 Diff: https://reviews.apache.org/r/72522/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-26 Thread Rajesh Balamohan
once and reuses it across tables. (i.e in Configuration msckConf = Msck.getMsckConf(conf);) - Rajesh --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72521/#review220874 -------

Re: Review Request 72521: HIVE-23487: Optimise PartitionManagementTask

2020-05-26 Thread Rajesh Balamohan
c == null) so would have happened > > only once, but now will happen everytime. > > Can you explain how this change is more performant? > > Rajesh Balamohan wrote: > This is because, it was creating this for every table. > > With the fix in "PartitionM

Review Request 72675: Improve key evictions in VectorGroupByOperator

2020-07-13 Thread Rajesh Balamohan
/vector/TestVectorGroupByOperator.java 3835987170 Diff: https://reviews.apache.org/r/72675/diff/1/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 72675: Improve key evictions in VectorGroupByOperator

2020-07-20 Thread Rajesh Balamohan
/diff/1-2/ Testing --- Thanks, Rajesh Balamohan

Re: [Announce] New committer : Peter Varga

2021-02-01 Thread Rajesh Balamohan
Congratulations Peter Varga. :) ~Rajesh.B On Tue, Feb 2, 2021 at 1:19 AM Peter Vary wrote: > Congratulations! > > > On Feb 1, 2021, at 17:45, László Bodor > wrote: > > > > Congrats, well-deserved! > > > > Regards, > > Laszlo Bodor > > > > > > Ashutosh Chauhan ezt írta (időpont: 2021. febr. >

Re: [Announce] New committer : Mustafa Iman

2021-02-01 Thread Rajesh Balamohan
Congratulations Mustafa. :) ~Rajesh.B On Tue, Feb 2, 2021 at 1:19 AM Peter Vary wrote: > Congratulations! > > > On Feb 1, 2021, at 17:45, László Bodor > wrote: > > > > Congrats, well-deserved! > > > > Regards, > > Laszlo Bodor > > > > Ashutosh Chauhan ezt írta (időpont: 2021. febr. > 1., > >

Re: [Announce] New committer : Mustafa Iman

2021-02-01 Thread Rajesh Balamohan
Congratulations Mustafa. :) ~Rajesh.B On Tue, Feb 2, 2021 at 1:19 AM Peter Vary wrote: > Congratulations! > > > On Feb 1, 2021, at 17:45, László Bodor > wrote: > > > > Congrats, well-deserved! > > > > Regards, > > Laszlo Bodor > > > > Ashutosh Chauhan ezt írta (időpont: 2021. febr. > 1., > >

Re: Welcome Adam to Hive PMC

2021-02-01 Thread Rajesh Balamohan
Congratulations Adam. :) ~Rajesh.B On Tue, Feb 2, 2021 at 1:19 AM Peter Vary wrote: > Congratulations! > > > On Feb 1, 2021, at 17:47, László Bodor > wrote: > > > > Congrats, very well-deserved! > > > > Regards, > > Laszlo Bodor > > > > Ashutosh Chauhan ezt írta (időpont: 2021. febr. > 1., >

Re: [EXTERNAL] [Announce] New committer : Naresh PR

2021-03-08 Thread Rajesh Balamohan
Congrats Naresh. :) ~Rajesh.B On Tue, Mar 9, 2021 at 9:55 AM Prasanth Jayachandran wrote: > Congratulations Naresh! > > Thanks > > Prasanth > > > > From: Sankar Hariappan > Sent: Tuesday, March 9, 2021 9:11:11 AM > To: dev@hive.apache.org > Subject: RE: [EXTER

Re: [EXTERNAL] [Announce] New committer : Panos Garefalakis

2021-03-08 Thread Rajesh Balamohan
Congrats Panos. :) ~Rajesh.B On Tue, Mar 9, 2021 at 9:55 AM Prasanth Jayachandran wrote: > Congratulations Panos! > > Thanks > > Prasanth > > > > From: Sankar Hariappan > Sent: Tuesday, March 9, 2021 9:12:27 AM > To: dev@hive.apache.org > Subject: RE: [EXTERNA

Re: Review Request 62593: HIVE-17610 LLAP IO: an exception in exception handling can hide the original exception

2017-09-26 Thread Rajesh Balamohan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62593/#review186338 --- Ship it! Ship It! - Rajesh Balamohan On Sept. 26, 2017, 8

Re: [Announce] New committer: Sankar Hariappan

2017-09-29 Thread Rajesh Balamohan
Congrats Sankar!! ~Rajesh.B On Sat, Sep 30, 2017 at 4:30 AM, Vaibhav Gumashta wrote: > Congratulations Sankar! > > On 9/29/17, 3:58 PM, "Thejas Nair" wrote: > > >Congrats Sankar! > > > >On Fri, Sep 29, 2017 at 11:36 AM, Peter Vary wrote: > > > >> Congratulations Sankar! > >> > >> > On Sep 29,

Re: [Announce] New committer: Anishek Agarwal

2017-09-29 Thread Rajesh Balamohan
Congrats Anishek!! ~Rajesh.B On Sat, Sep 30, 2017 at 4:30 AM, Vaibhav Gumashta wrote: > Congratulations Anishek! > > > On 9/29/17, 3:57 PM, "Thejas Nair" wrote: > > >Congrats Anishek! > > > >On Fri, Sep 29, 2017 at 11:36 AM, Peter Vary wrote: > > > >> Congratulations Anishek! > >> > >> > On S

Re: [Announce] New committer: Tao Li

2017-11-06 Thread Rajesh Balamohan
Congrats Tao Li!! ~Rajesh.B On Mon, Nov 6, 2017 at 3:56 PM, Zoltan Haindrich wrote: > Congratulations Tao!! > > On 4 Nov 2017 6:11 p.m., Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > Congratulations Tao! > > Thanks > Prasanth > > > > On Sat, Nov 4, 2017 at 1:15 AM -0700, "Va

Re: [Announce] New committer: Deepak Jaiswal

2018-01-10 Thread Rajesh Balamohan
Congrats Deepak.. :) ~Rajesh.B On Wed, Jan 10, 2018 at 11:32 PM, Jesus Camacho Rodriguez < jcama...@apache.org> wrote: > Congrats Deepak! > > -Jesús > > > > On 1/9/18, 11:36 PM, "Prasanth Jayachandran" < > pjayachand...@hortonworks.com> wrote: > > Congratulations Deepak! > > Thanks >

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Rajesh Balamohan
s Rajesh! :) >> >> On Tue, Dec 13, 2016 at 9:36 PM, Pengcheng Xiong >> wrote: >> >>> Congrats Rajesh! :) >>> >>> On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran < >>> prasan...@apache.org >>> > wrote: >>> >

Re: Invitation for Hive committers to become ORC committers

2016-12-15 Thread Rajesh Balamohan
I would be interested. Thanks. ~Rajesh.B On Fri, Dec 16, 2016 at 3:31 AM, Mithun Radhakrishnan < mithun.radhakrish...@yahoo.com.invalid> wrote: > I'd be keen. > Thanks,Mithun > On Thursday, December 15, 2016, 1:37:36 PM PST, Wei Zheng < > wzh...@hortonworks.com> wrote:I’m interested. Thanks. > >

Re: Naveen Gangam has become a Hive Committer

2016-12-17 Thread Rajesh Balamohan
Congratulations Naveen!! ~Rajesh.B On Fri, Dec 16, 2016 at 11:40 PM, Xuefu Zhang wrote: > Bcc: dev/user > > Hi all, > > It's my honor to announce that Apache Hive PMC has voted on and approved > Naveen's committership. Please join me in congratulate him on his > contributions and achievements.

Re: [ANNOUNCE] New committer: Zoltan Haindrich

2017-02-21 Thread Rajesh Balamohan
Congrats Zoltan. :) ~Rajesh.B On Wed, Feb 22, 2017 at 4:43 AM, Wei Zheng wrote: > Congrats Zoltan! > > Thanks, > Wei > > On 2/21/17, 13:09, "Alan Gates" wrote: > > On behalf of the Hive PMC I am happy to announce Zoltan Haindrich is > our newest committer. He has been contributing to Hive

Re: [ANNOUNCE] New PMC Member : Eugene Koifman

2017-03-14 Thread Rajesh Balamohan
Congrats Eugene!! :) ~Rajesh.B On Wed, Mar 15, 2017 at 11:21 AM, Pengcheng Xiong wrote: > Congrats! Well deserved! > > Thanks. > Pengcheng > > On Tue, Mar 14, 2017 at 10:39 PM, Ashutosh Chauhan > wrote: > > > On behalf of the Hive PMC I am delighted to announce Eugene Koifman is > > joining Hi

Re: [Announce] New committer: Vineet Garg

2017-05-11 Thread Rajesh Balamohan
Congrats Vineet! ~Rajesh.B On Fri, May 12, 2017 at 10:04 AM, Lefty Leverenz wrote: > Congratulations Vineet! > > -- Lefty > > > On Wed, May 10, 2017 at 2:08 PM, Vineet Garg > wrote: > > > Thanks all! > > > > > On May 10, 2017, at 12:47 AM, Rui Li wrote: > > > > > > Congrats :) > > > > > > On

Review Request 59517: HIVE-16746: Reduce number of index lookups for same table in IndexWhereTaskDispatcher

2017-05-24 Thread Rajesh Balamohan
ae96def Diff: https://reviews.apache.org/r/59517/diff/1/ Testing --- Jenkins passed all tests. Thanks, Rajesh Balamohan

Review Request 59569: HIVE-15300: Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2017-05-25 Thread Rajesh Balamohan
iff: https://reviews.apache.org/r/59569/diff/1/ Testing --- Jenkins passed. TestCliDriver.testCliDriver[index_serde] failure is not related to this patch, it passed in local environment. Thanks, Rajesh Balamohan

Re: [Announce] New PMC members

2017-05-28 Thread Rajesh Balamohan
Congratulations to new PMC members! ~Rajesh.B On Sat, May 27, 2017 at 12:14 PM, Zoltan Haindrich < zhaindr...@hortonworks.com> wrote: > Congratulations! > > On 27 May 2017 06:26, Lefty Leverenz wrote: > Congratulations to the new PMC members, and also to Hive for having such a > strong and tale

Re: [ANNOUNCE] New PMC Member : Matt McCline

2017-07-07 Thread Rajesh Balamohan
Congrats Matt! ~Rajesh.B On Sat, Jul 8, 2017 at 2:35 AM, Chaoyu Tang wrote: > Congratulations Matt! > > On Fri, Jul 7, 2017 at 12:27 PM, Xuefu Zhang wrote: > > > Congratulations! > > > > On Fri, Jul 7, 2017 at 8:27 AM, Eugene Koifman > > > wrote: > > > > > Congratulations! > > > > > > On 7/7/

Re: [Announce] New committer: Peter Vary

2017-07-07 Thread Rajesh Balamohan
Congrats Peter! On Sat, Jul 8, 2017 at 7:09 AM, Lefty Leverenz wrote: > Congrats! > > -- Lefty > > On Fri, Jul 7, 2017 at 5:04 PM, Chaoyu Tang wrote: > > > Congratulations Peter! > > > > On Fri, Jul 7, 2017 at 3:29 PM, Jimmy Xiang wrote: > > > > > Congrats!! > > > > > > On Fri, Jul 7, 2017 at

Re: [Announce] New committer: Teddy Choi

2017-07-07 Thread Rajesh Balamohan
Congrats Teddy! On Sat, Jul 8, 2017 at 7:09 AM, Lefty Leverenz wrote: > Congrats! > > -- Lefty > > On Fri, Jul 7, 2017 at 5:05 PM, Chaoyu Tang wrote: > > > Congratulations Teddy! > > > > On Fri, Jul 7, 2017 at 4:07 PM, Peter Vary wrote: > > > > > Congratulatins Teddy! > > > > > > > On Jul 7, 2

Re: [Announce] New committer: Sahil Takiar

2017-07-07 Thread Rajesh Balamohan
Congrats Sahil!! On Sat, Jul 8, 2017 at 7:07 AM, Lefty Leverenz wrote: > Congratulations! > > -- Lefty > > On Fri, Jul 7, 2017 at 5:05 PM, Chaoyu Tang wrote: > > > Congratulations Sahil !!! > > > > On Fri, Jul 7, 2017 at 2:38 PM, Sergio Pena > > wrote: > > > > > Congratulations Sahil !!! > > >

Re: [Announce] New committer: Vihang Karajgaonkar

2017-07-07 Thread Rajesh Balamohan
Congrats Vihang!! On Sat, Jul 8, 2017 at 7:07 AM, Lefty Leverenz wrote: > Congratulations! > > -- Lefty > > On Fri, Jul 7, 2017 at 5:06 PM, Chaoyu Tang wrote: > > > Congratulations Vihang !!!. > > > > On Fri, Jul 7, 2017 at 2:38 PM, Sergio Pena > > wrote: > > > > > Congratulations Vihang !!!.

Re: [Announce] New committer: Deepesh Khandelwal

2017-07-07 Thread Rajesh Balamohan
Congrats Deepesh!! On Sat, Jul 8, 2017 at 7:09 AM, Lefty Leverenz wrote: > Congratulations! > > -- Lefty > > On Fri, Jul 7, 2017 at 5:04 PM, Chaoyu Tang wrote: > > > Congratulations Deepesh! > > > > On Fri, Jul 7, 2017 at 4:07 PM, Peter Vary wrote: > > > > > Congratulations Deepesh! > > > > >

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

2015-10-23 Thread Rajesh Balamohan
Congratulations Sid!! ~Rajesh.B On Fri, Oct 23, 2015 at 3:55 PM, Eugene Koifman wrote: > Congratulations! > > On 10/22/15, 10:59 PM, "Lefty Leverenz" wrote: > > >Congratulations, Sirddharth! > > > >-- Lefty > > > >On Thu, Oct 22, 2015 at 11:53 AM, Siddharth Seth > wrote: > > > >> Thanks every

Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-01 Thread Rajesh Balamohan
d72e Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
iffs (updated) - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ff5c858 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 94dd72e Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
Rajesh --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48159/#review136018 --- On June 3, 2016, 1:40 a.m., Rajesh Balamohan wrote:

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
doop/hive/conf/HiveConf.java 9cc8fbe metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 94dd72e Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
doop/hive/conf/HiveConf.java 9cc8fbe metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 94dd72e Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
ds to be updated below. As far as I can tell, when this > > throws there can be completed operations yet to be added to the set, unless > > they are decisively terminated or allowed to finish > > Rajesh Balamohan wrote: > Same approach is followed as in earlier case (wher

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-02 Thread Rajesh Balamohan
ere as well, but out of scope of this JIRA. Will create a separate jira for it. - Rajesh Balamohan On June 3, 2016, 3:03 a.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply,

Re: Review Request 48520: Use multi-threaded approach to listing files for msck

2016-06-10 Thread Rajesh Balamohan
408) <https://reviews.apache.org/r/48520/#comment202103> Same as above. If executor can be passed from previous method, shutdown can be avoided here and can be moved to getAllLeafDirs(Path basePath, Set allDirs) - Rajesh Balamohan On June 10, 2016, 11:58 p.m., pen

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-13 Thread Rajesh Balamohan
n be expensive (e.g msck which adds all partitions). Diffs (updated) - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 285caa3 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java c0827ea Diff: https://reviews.apache.org/r/48159/diff/ Testing --- T

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-16 Thread Rajesh Balamohan
doop/hive/conf/HiveConf.java cc95008 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java c0827ea Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-06-16 Thread Rajesh Balamohan
ssed out in earlier patch. This was wrong patch which got uploaded. Uploading the correct one now. - Rajesh --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/48159/#review137561 -----

Re: Review Request 48159: HIVE-13901: Hivemetastore add partitions can be slow depending on filesystems

2016-07-07 Thread Rajesh Balamohan
g partitions can be expensive (e.g msck which adds all partitions). Diffs (updated) - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java b13fc65 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java f45b90d Diff: https://reviews.apache.org/r/48159/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-11 Thread Rajesh Balamohan
--- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-14 Thread Rajesh Balamohan
82abd52 Diff: https://reviews.apache.org/r/49881/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-20 Thread Rajesh Balamohan
/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-21 Thread Rajesh Balamohan
/lockmgr/DbTxnManager.java 7b0369d ql/src/java/org/apache/hadoop/hive/ql/lockmgr/SynchronizedMetaStoreClient.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java ef0bb3d Diff: https://reviews.apache.org/r/49881/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-24 Thread Rajesh Balamohan
/DbLockManager.java b4ae1d1 ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 7b0369d ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 9d927bd Diff: https://reviews.apache.org/r/49881/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-07-24 Thread Rajesh Balamohan
ch fetches the partitions on need basis (instead of fetching all partitions) - Rajesh --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/49881/#review143246 ---------

Review Request 50434: HIVE-14323: Reduce number of FS permissions and redundant FS operations

2016-07-25 Thread Rajesh Balamohan
che/hadoop/hive/ql/metadata/Hive.java 9d927bd Diff: https://reviews.apache.org/r/50434/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50434: HIVE-14323: Reduce number of FS permissions and redundant FS operations

2016-08-01 Thread Rajesh Balamohan
xec/Utilities.java cadda8f ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 9d927bd Diff: https://reviews.apache.org/r/50434/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-08-03 Thread Rajesh Balamohan
/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 49881: HIVE-14204: Optimize loading loaddynamic partitions

2016-08-03 Thread Rajesh Balamohan
/DbLockManager.java b4ae1d1 ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 02c17b5 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 57433bb Diff: https://reviews.apache.org/r/49881/diff/ Testing --- Thanks, Rajesh Balamohan

Review Request 50788: S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

2016-08-04 Thread Rajesh Balamohan
://reviews.apache.org/r/50788/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50788: S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

2016-08-04 Thread Rajesh Balamohan
/org/apache/hadoop/hive/conf/HiveConf.java 9f5f619 ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java 2a9dc11 Diff: https://reviews.apache.org/r/50788/diff/ Testing --- Thanks, Rajesh Balamohan

Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-08 Thread Rajesh Balamohan
- metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 38c0eed Diff: https://reviews.apache.org/r/50888/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-08 Thread Rajesh Balamohan
--- Thanks, Rajesh Balamohan

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-10 Thread Rajesh Balamohan
/hadoop/hive/ql/metadata/CheckResult.java ec9deeb ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecker.java a164b12 ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java 5b8ec60 Diff: https://reviews.apache.org/r/50888/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-22 Thread Rajesh Balamohan
/hadoop/hive/ql/metadata/HiveMetaStoreChecker.java a164b12 ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java 5b8ec60 Diff: https://reviews.apache.org/r/50888/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan
/metadata/CheckResult.java ec9deeb ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecker.java 34b76b8 ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java 3f26bcd Diff: https://reviews.apache.org/r/50888/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan
ps://reviews.apache.org/r/50888/#review146669 ------- On Aug. 24, 2016, 11:22 p.m., Rajesh Balamohan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/50888/ > -

Re: Review Request 50888: Reduce number of partition check calls in add_partitions

2016-08-24 Thread Rajesh Balamohan
/CheckResult.java ec9deeb ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecker.java 34b76b8 ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java 3f26bcd Diff: https://reviews.apache.org/r/50888/diff/ Testing --- Thanks, Rajesh Balamohan

Re: Oversized container estimation

2016-11-25 Thread Rajesh Balamohan
Those are cumulative figures in the DAG level. You may want to check the gc logs emitted at task level to check the details on whether complete memory is used or not. Not sure what is the yarn-min container size specified in your cluster. But based on that, you may run into the risk of running too

  1   2   3   4   5   6   >