Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-28 Thread Rui Li
/27283/diff/ Testing --- Thanks, Rui Li

Re: Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-28 Thread Rui Li
-CREATION Diff: https://reviews.apache.org/r/27283/diff/ Testing --- Thanks, Rui Li

Re: Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-29 Thread Rui Li
ks a lot for the catch. The method can work the way it's being used. But you're right, I will make it more robust. - Rui --- This is an automatically generated e-mail. To reply, visit: https://reviews.ap

Re: Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-29 Thread Rui Li
wSchema rwsch, Map colExprMap, > > List> oplist) Thanks Xuefu. I can try change Operatot.clone to call this method. - Rui --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27283/#review59116 -------

Re: Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-30 Thread Rui Li
/test/results/clientpositive/skewjoin_mapjoin7.q.out PRE-CREATION ql/src/test/results/clientpositive/skewjoin_mapjoin8.q.out PRE-CREATION ql/src/test/results/clientpositive/skewjoin_mapjoin9.q.out PRE-CREATION Diff: https://reviews.apache.org/r/27283/diff/ Testing --- Thanks, Rui Li

Re: Review Request 27283: Compile time skew join optimization doesn't work with auto map join

2014-10-30 Thread Rui Li
/test/results/clientpositive/skewjoin_mapjoin7.q.out PRE-CREATION ql/src/test/results/clientpositive/skewjoin_mapjoin8.q.out PRE-CREATION ql/src/test/results/clientpositive/skewjoin_mapjoin9.q.out PRE-CREATION Diff: https://reviews.apache.org/r/27283/diff/ Testing --- Thanks, Rui Li

Review Request 25774: Support merging small files

2014-09-18 Thread Rui Li
/results/clientpositive/spark/merge1.q.out 772984d ql/src/test/results/clientpositive/spark/merge2.q.out 8d8dcb8 Diff: https://reviews.apache.org/r/25774/diff/ Testing --- Thanks, Rui Li

Re: Review Request 25774: Support merging small files

2014-09-18 Thread Rui Li
/results/clientpositive/spark/union_remove_9.q.out 0ec55de Diff: https://reviews.apache.org/r/25774/diff/ Testing --- Thanks, Rui Li

Re: Review Request 25774: Support merging small files

2014-09-19 Thread Rui Li
ql/src/test/results/clientpositive/spark/union_remove_9.q.out 0ec55de Diff: https://reviews.apache.org/r/25774/diff/ Testing --- Thanks, Rui Li

Re: [VOTE] Apache Hive 2.3.10 Release Candidate 1

2024-05-07 Thread Rui Li
com/apache/kyuubi/pull/6328 > > > > Thanks, > > Cheng Pan > > > > > > > -- Cheers, Rui Li

Is Github PR mandatory?

2019-03-14 Thread Rui Li
Hi, I believe we still need to upload patch to JIRA for precommit testing. So just want to make sure whether opening a github PR is mandatory? Or is it just a substitution for the review board? -- Best regards! Rui Li

Re: Is Github PR mandatory?

2019-03-17 Thread Rui Li
Got it. Thanks! On Fri, Mar 15, 2019 at 1:47 PM Mani M wrote: > It's used as substitution for review board. > > > With Regards > M.Mani > +61 432 461 087 > > On Fri, 15 Mar 2019, 13:59 Rui Li, wrote: > > > Hi, > > > > I believe we still need

Hit HIVE-13023 with 2.0.1 maven artifacts

2019-09-04 Thread Rui Li
e: 屏幕快照 2019-09-04 下午5.14.00.png] I wonder whether anybody could help verify the issue, and whether it's possible to update the published jars if the issue is valid? -- Best regards! Rui Li

Re: 【Hive Alter Table Add column at specified position】

2020-07-19 Thread Rui Li
ified > position. > For instance,the Table A has c1,c2,c3 columns,and i want to add column c4 > after c1,therefore,the table would be like c1,c4,c2,c3 instead of > c1,c2,c3,c4. > > > Thanks. -- Best regards! Rui Li

Re: checkstyle changes

2017-12-07 Thread Rui Li
t;>> On Dec 5, 2017, at 1:02 PM, Zoltan Haindrich wrote: > > >>> > > >>> Hello, > > >>> > > >>> I've filed a ticket to make the checkstyle warnings less noisy > > >>>(https://issues.apache.org/jira/browse/HIVE-18222) > > >>> > > >>> * set maxlinelength to 140 > > >>> I think everyone is working with big-enough displays to handle this > > >>>:) > > >>> There are many methods which have complicated names / arguments / > > >>>etc ; breaking the lines more frequently hurts readability... > > >>> * disabled some restrictions like: declaration&hiding via get/set > > >>>methods for protected/package fields are not mandatory > > >>> > > >>> If you don't feel comfortable with these changes, please share your > > >>>point of view. > > >>> > > >>> cheers, > > >>> Zoltan > > >>> > > >>> > > >> > > >> > > >> > > >> > > > > > > > > -- Best regards! Rui Li

Re: [DISCUSS] Unsustainable situation with ptests

2018-05-14 Thread Rui Li
failure count to zero. > > > > Hence, I am suggesting *we stop committing any patch before we get a > > green > > run*. If someone thinks this proposal is too radical, please come up > > with > > an alternative, because I do not think it is OK to have the ptest > runs > > in > > their current state. Other projects of certain size (e.g., Hadoop, > > Spark) > > are always green, we should be able to do the same. > > > > Finally, once we get to zero failures, I suggest we are less tolerant > > with > > committing without getting a clean ptests run. If there is a failure, > > we > > need to fix it or revert the patch that caused it, then we continue > > developing. > > > > Please, let’s all work together as a community to fix this issue, > that > > is > > the only way to get to zero quickly. > > > > Thanks, > > Jesús > > > > PS. I assume the flaky tests will come into the discussion. Let´s see > > first how many of those we have, then we can work to find a fix. > > > > > > > > > > > > > > > > > -- Best regards! Rui Li

Re: [VOTE] Stricter commit guidelines

2018-05-15 Thread Rui Li
_mbox/hive-dev/201805. > mbox/%3C63023673-AEE5-41A9-BA52-5A5DFB2078B6%40apache.org%3E > > [2] https://cwiki.apache.org/confluence/display/Hive/ > HowToCommit#HowToCommit-PreCommitruns,andcommittingpatches > > > > > -- Best regards! Rui Li

Re: Review Request 30739: HIVE-9574 Lazy computing in HiveBaseFunctionResultList may hurt performance [Spark Branch]

2015-02-08 Thread Rui Li
tCache.java <https://reviews.apache.org/r/30739/#comment117425> I suppose this is to avoid frequent switch buffer? But why the magic number 1? - Rui Li On Feb. 7, 2015, 3:09 a.m., Jimmy Xiang wrote: > > --- > This is an a

Re: Review Request 30739: HIVE-9574 Lazy computing in HiveBaseFunctionResultList may hurt performance [Spark Branch]

2015-02-08 Thread Rui Li
/HiveKVResultCache.java <https://reviews.apache.org/r/30739/#comment117428> What happens if input!=null and we're creating the temp file again? - Rui Li On Feb. 7, 2015, 3:09 a.m., Jimmy Xiang wrote: > > --- > This is an automatica

Re: Review Request 30739: HIVE-9574 Lazy computing in HiveBaseFunctionResultList may hurt performance [Spark Branch]

2015-02-08 Thread Rui Li
> On Feb. 9, 2015, 2:51 a.m., Rui Li wrote: > > Some high level question, do we still need two buffers? And does it make sense to use something like a queue instead of an array as the buffer? - Rui --- This is an auto

Re: Review Request 30739: HIVE-9574 Lazy computing in HiveBaseFunctionResultList may hurt performance [Spark Branch]

2015-02-09 Thread Rui Li
> On Feb. 9, 2015, 2:51 a.m., Rui Li wrote: > > > > Rui Li wrote: > Some high level question, do we still need two buffers? And does it make > sense to use something like a queue instead of an array as the buffer? > > Jimmy Xiang wrote: > Queue should wor

Re: Review Request 30739: HIVE-9574 Lazy computing in HiveBaseFunctionResultList may hurt performance [Spark Branch]

2015-02-09 Thread Rui Li
> On Feb. 9, 2015, 2:51 a.m., Rui Li wrote: > > > > Rui Li wrote: > Some high level question, do we still need two buffers? And does it make > sense to use something like a queue instead of an array as the buffer? > > Jimmy Xiang wrote: > Queue should wor

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-14 Thread Rui Li
l.com> > >> > >> > wrote: > >> > >> > > >> > >> >> Congrats Rajesh! :) > >> > >> >> > >> > >> >> On Tue, Dec 13, 2016 at 9:36 PM, Pengcheng Xiong > >> > >> >> > >> > >> >> wrote: > >> > >> >> > >> > >> >>> Congrats Rajesh! :) > >> > >> >>> > >> > >> >>> On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran < > >> > >> >>> prasan...@apache.org > >> > >> >>> > wrote: > >> > >> >>> > >> > >> >>> > The Apache Hive PMC has voted to make Rajesh Balamohan a > >> > committer on > >> > >> >>> the > >> > >> >>> > Apache Hive Project. Please join me in congratulating Rajesh. > >> > >> >>> > > >> > >> >>> > Congratulations Rajesh! > >> > >> >>> > > >> > >> >>> > Thanks > >> > >> >>> > Prasanth > >> > >> >>> > >> > >> >> > >> > >> >> > >> > >> >> > >> > >> >> -- > >> > >> >> Nothing better than when appreciated for hard work. > >> > >> >> -Mark > >> > >> >> > >> > >> > > >> > >> > > >> > >> > >> > > > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Invitation for Hive committers to become ORC committers

2016-12-15 Thread Rui Li
e last stages of removing the > > > forked > > > > > ORC > > > > > >code out of Hive. The goal of moving ORC out of Hive was to > > > increase > > > > > its > > > > > >community and we want to be very deliberately inclusive of the > > > Hive > > > > > >development community. Towards that end, the ORC PMC wants to > > > > welcome > > > > > >anyone who is already a Hive committer to become a committer > on > > > ORC. > > > > > > > > > > > > Please respond on this thread to let us know if you are > > > > interested. > > > > > > > > > > > >Thanks, > > > > > > Owen on behalf of the ORC PMC > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > Hope It Helps, > Chinna > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: [ANNOUNCE] New committer: Zoltan Haindrich

2017-02-21 Thread Rui Li
>>> > On 2/21/17, 13:09, "Alan Gates" wrote: > >> >>> > > >> >>> > On behalf of the Hive PMC I am happy to announce Zoltan > >> >>>Haindrich is > >> >>> > our newest committer. He has been contributing to Hive for > >several > >> >>> months > >> >>> > across a number of areas, including the parser, HiveServer2, > >and > >> >>>cleaning > >> >>> > up unit tests and documentation. Please join me in welcoming > >Zoltan > >> >>>to > >> >>> > Hive. > >> >>> > > >> >>> > Zoltan, feel free to say a few words introducing yourself > >if you > >> >>> would > >> >>> > like to. > >> >>> > > >> >>> > Alan. > >> >>> > > >> >>> > > >> >>> > > >> >>> > >> > > >> > >> > > > > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Review Request 56687: Intern strings in various critical places to reduce memory consumption.

2017-02-23 Thread Rui Li
java (line 322) <https://reviews.apache.org/r/56687/#comment238682> will this cause the hash map to resize since the default load factor is 0.75? and several similar concerns below - Rui Li On Feb. 23, 2017, 9:01 p.m., Misha Dmitriev wrote: > >

Re: Review Request 56687: Intern strings in various critical places to reduce memory consumption.

2017-02-27 Thread Rui Li
> On Feb. 24, 2017, 7:38 a.m., Rui Li wrote: > > ql/src/java/org/apache/hadoop/hive/ql/plan/ConditionalResolverMergeFiles.java, > > line 322 > > <https://reviews.apache.org/r/56687/diff/2/?file=1643011#file1643011line322> > > > > will this cause the ha

Re: Review Request 56687: Intern strings in various critical places to reduce memory consumption.

2017-02-27 Thread Rui Li
ng a new map, can we use the pathToAliases map and intern the paths in-place? - Rui Li On Feb. 27, 2017, 7:42 p.m., Misha Dmitriev wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-14 Thread Rui Li
ews.apache.org/r/57586/#comment241306> do we still need this method? ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java Line 545 (original), 520 (patched) <https://reviews.apache.org/r/57586/#comment241307> same as above - Rui Li On March 14, 2017,

Re: Review Request 57586: HIVE-16183: Fix potential thread safety issues with static variables

2017-03-15 Thread Rui Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57586/#review169094 --- Ship it! Ship It! - Rui Li On March 15, 2017, 10:03 p.m

Re: [ANNOUNCE] New PMC Member : Eugene Koifman

2017-03-16 Thread Rui Li
>> >> > > >> >> On Tue, Mar 14, 2017 at 10:39 PM, Ashutosh Chauhan > > >> >> > > >> >> wrote: > > >> >> > > >> >> > On behalf of the Hive PMC I am delighted to announce Eugene > > >>Koifman is > > >> >> > joining Hive PMC. > > >> >> > Eugene is a long time contributor in Hive and is focusing on > > ACID > > >> >>support > > >> >> > areas these days. > > >> >> > > > >> >> > Welcome, Eugene! > > >> >> > > > >> >> > Thanks, > > >> >> > Ashutosh > > >> >> > > > >> >> > > >> > > >> > > > > > > > > > > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Review Request 50787: Add a timezone-aware timestamp

2017-04-26 Thread Rui Li
--- Thanks, Rui Li

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-01 Thread Rui Li
s.apache.org/r/58865/#comment246544> I think the total task count needs only be computed once. It shouldn't change during the execution of the job, assuming we don't count failed/retried tasks. - Rui Li On May 1, 2017, 5

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-02 Thread Rui Li
he total task only once when the job first reaches RUNNING state, i.e. in the "if (!running)". At this point, the total count is determined and won't change. - Rui Li On May 2, 2017, 6:49 p.m., Xuefu Zhang wrote: > > -

Re: [VOTE] Apache Hive 2.3.0 Release Candidate 0

2017-05-02 Thread Rui Li
t; > https://repository.apache.org/content/repositories/ > orgapachehive-1073/ > > > > > > > > > > > > Source tag for RC0 is at: > > > > > > > > https://github.com/apache/hive/releases/tag/release-2.3.0-rc0 > > > > > > > > Voting will conclude in 72 hours. > > > > > > > > Hive PMC Members: Please test and vote. > > > > > > > > Thanks. > > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-02 Thread Rui Li
--- Thanks, Rui Li

Re: Review Request 58865: HIVE-16552: Limit the number of tasks a Spark job may contain

2017-05-03 Thread Rui Li
> On May 3, 2017, 3:35 a.m., Rui Li wrote: > > Xuefu, the patch looks good to me overall. Thanks for the work. Do you think we should add some negative test case for it? > On May 3, 2017, 3:35 a.m., Rui Li wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkT

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-03 Thread Rui Li
This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review173833 --- On May 3, 2017, 6:34 a.m., Rui Li wrote: > > ---

Re: Welcome new Hive committer, Zhihai Xu

2017-05-07 Thread Rui Li
ffer > > Zhihai a committership which he accepted. Please join me in > congratulating > > on this recognition and thanking him for his contributions to Hive. > > > > Regards, > > Xuefu > > > > > > > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-07 Thread Rui Li
Can you also make a note about the source of the code, like > > TimeStampTZWritable? sure, will do - Rui --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review174136 -

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-08 Thread Rui Li
/diff/7-8/ Testing --- Thanks, Rui Li

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-09 Thread Rui Li
is already in UTC. I will add the comment when we convert string to timestamptz. - Rui --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review174383 -------

Re: Review Request 50787: Add a timezone-aware timestamp

2017-05-09 Thread Rui Li
://reviews.apache.org/r/50787/diff/8-9/ Testing --- Thanks, Rui Li

Re: [Announce] New committer: Vineet Garg

2017-05-10 Thread Rui Li
AM, "Peter Vary" wrote: > > >Congratulations Vineet! :) > > > >2017. máj. 9. 22:25 ezt írta ("Ashutosh Chauhan" ): > > > >> The Project Management Committee (PMC) for Apache Hive has invited > Vineet > >> Garg to become a committer and we are pleased to announce that he has > >> accepted. > >> > >> Welcome, Vineet! > >> > >> Thanks, > >> Ashutosh > >> > > > > > -- Best regards! Rui Li Cell: (+86) 13564950210

Re: Welcome Rui Li to Hive PMC

2017-05-25 Thread Rui Li
Thank you guys :) On Thu, May 25, 2017 at 3:29 PM, Peter Vary wrote: > Congratulations Rui! > > > On May 25, 2017, at 6:19 AM, Xuefu Zhang wrote: > > > > Hi all, > > > > It's an honer to announce that Apache Hive PMC has recently voted to > invite &

Re: Review Request 60632: HIVE-16659: Query plan should reflect hive.spark.use.groupby.shuffle

2017-07-04 Thread Rui Li
ine 471 (original), 477 (patched) <https://reviews.apache.org/r/60632/#comment254319> let's delete this comment - Rui Li On July 4, 2017, 8:48 a.m., Bing Li wrote: > > --- > This is an automatically

Re: Review Request 60632: HIVE-16659: Query plan should reflect hive.spark.use.groupby.shuffle

2017-07-04 Thread Rui Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60632/#review179595 --- Ship it! Ship It! - Rui Li On July 5, 2017, 4:07 a.m., Bing

Review Request 36033: HIVE-11108: HashTableSinkOperator doesn't support vectorization [Spark Branch]

2015-06-29 Thread Rui Li
rg/r/36033/diff/ Testing --- Thanks, Rui Li

Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Rui Li
t may involve the optimization haven't been enabled for spark, e.g. vector_char_mapjoin1.q. We can consider enable these tests in follow on task. Thanks, Rui Li

Re: Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Rui Li
lving Orc tables and vectorization enabled) should be covered automatically. On the other hand, some tests that may involve the optimization haven't been enabled for spark, e.g. vector_char_mapjoin1.q. We can consider enable these tests in follow on task. Thanks, Rui Li

Re: Review Request 47185: HIVE-13716

2016-05-11 Thread Rui Li
ct. ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java (line 2871) <https://reviews.apache.org/r/47185/#comment196882> I guess this is redundant? - Rui Li On May 10, 2016, 3:41 p.m., Ashutosh Chauhan wrote: > > --- &g

Re: Review Request 47185: HIVE-13716

2016-05-11 Thread Rui Li
--- > > (Updated May 10, 2016, 3:41 p.m.) > > > Review request for hive and Rui Li. > > > Bugs: HIVE-13716 > https://issues.apache.org/jira/browse/HIVE-13716 > > > Repository: hive-git > > > Description > --- > > Parallelize

Re: Review Request 47185: HIVE-13716

2016-05-11 Thread Rui Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47185/#review132684 --- Ship it! Ship It! - Rui Li On May 11, 2016, 4:29 p.m

Re: Review Request 47242: HIVE-13726

2016-05-11 Thread Rui Li
I think FileNotFoundException is not needed here. - Rui Li On May 11, 2016, 4:36 p.m., Ashutosh Chauhan wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 47242: HIVE-13726

2016-05-11 Thread Rui Li
This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/47242/ > --- > > (Updated May 11, 2016, 4:36 p.m.) > > > Review request for hive and Rui Li. > > > Bugs: HIVE-1

Review Request 50787: Add a timezone-aware timestamp

2016-08-04 Thread Rui Li
serde/src/test/org/apache/hadoop/hive/serde2/io/TestTimestampWritable.java 7619efa storage-api/src/java/org/apache/hadoop/hive/common/type/HiveTimestamp.java PRE-CREATION Diff: https://reviews.apache.org/r/50787/diff/ Testing --- Thanks, Rui Li

Re: YourKit open source license

2016-08-15 Thread Rui Li
Tue, 31 Mar 2015 01:22:51 + > To: "dev@hive.apache.org" > > - Contents - > > Thanks Alan! But I don’t see Hive in the sponsored open source project > list. I’ll contact them anyway. > > > > Cheers, > > Rui Li

Re: YourKit open source license

2016-08-16 Thread Rui Li
like only committer can get an email account according to this > page http://www.apache.org/dev/committers.html > > Does it mean that only Hive committers can get YourKit free licenses for > Hive performance profiling? > > > > > > On Tue, 16 Aug 2016 13:33:34 +0800 R

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-11 Thread Rui Li
/50787/diff/ Testing --- Thanks, Rui Li

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-21 Thread Rui Li
/50787/diff/ Testing --- Thanks, Rui Li

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-21 Thread Rui Li
/50787/diff/ Testing --- Thanks, Rui Li

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-23 Thread Rui Li
/ Testing --- Thanks, Rui Li

Re: Review Request 50787: Add a timezone-aware timestamp

2016-09-23 Thread Rui Li
erting to timestamp. - Rui --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50787/#review149983 --- On Sept. 22, 2016, 4:05 a.m., Rui Li

[jira] [Created] (HIVE-8300) Missing guava lib causes IllegalStateException when deserializing a task [Spark Branch]

2014-09-29 Thread Rui Li (JIRA)
Rui Li created HIVE-8300: Summary: Missing guava lib causes IllegalStateException when deserializing a task [Spark Branch] Key: HIVE-8300 URL: https://issues.apache.org/jira/browse/HIVE-8300 Project: Hive

[jira] [Assigned] (HIVE-8406) Research on skewed join [Spark Branch]

2014-10-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8406: Assignee: Rui Li > Research on skewed join [Spark Bra

[jira] [Commented] (HIVE-7893) Find a way to get a job identifier when submitting a spark job [Spark Branch]

2014-10-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170353#comment-14170353 ] Rui Li commented on HIVE-7893: -- Thanks [~joshrosen]. Yes I've seen your PR a

[jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]

2014-10-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170387#comment-14170387 ] Rui Li commented on HIVE-7439: -- The async APIs are stabilized in SPARK-3902. > Sp

[jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]

2014-10-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170417#comment-14170417 ] Rui Li commented on HIVE-7439: -- +1 patch looks good to me. Only a minor point: can we p

[jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]

2014-10-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170426#comment-14170426 ] Rui Li commented on HIVE-7439: -- [~brocknoland] - Yep, that'll be fine. &g

[jira] [Commented] (HIVE-7467) When querying HBase table, task fails with exception: java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

2014-10-14 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171844#comment-14171844 ] Rui Li commented on HIVE-7467: -- [~jxiang] - thanks for the update! I know there's wo

[jira] [Commented] (HIVE-8456) Support Hive Counter to collect spark job metric[Spark Branch]

2014-10-15 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173247#comment-14173247 ] Rui Li commented on HIVE-8456: -- I'm not familiar how the counter/accumulator work

[jira] [Commented] (HIVE-8456) Support Hive Counter to collect spark job metric[Spark Branch]

2014-10-15 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173414#comment-14173414 ] Rui Li commented on HIVE-8456: -- [~chengxiang li] - thanks for the explanation! I agre

[jira] [Commented] (HIVE-8456) Support Hive Counter to collect spark job metric[Spark Branch]

2014-10-15 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173443#comment-14173443 ] Rui Li commented on HIVE-8456: -- I see. That makes sense. +1 The patch looks good t

[jira] [Commented] (HIVE-8406) Research on skewed join [Spark Branch]

2014-10-15 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173449#comment-14173449 ] Rui Li commented on HIVE-8406: -- Skew join optimization depends on map join. > Rese

[jira] [Resolved] (HIVE-7893) Find a way to get a job identifier when submitting a spark job [Spark Branch]

2014-10-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li resolved HIVE-7893. -- Resolution: Fixed Fixed via HIVE-7439 > Find a way to get a job identifier when submitting a spark job [Sp

[jira] [Created] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
Rui Li created HIVE-8518: Summary: Compile time skew join optimization returns duplicated results Key: HIVE-8518 URL: https://issues.apache.org/jira/browse/HIVE-8518 Project: Hive Issue Type: Bug

[jira] [Assigned] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8518: Assignee: Rui Li > Compile time skew join optimization returns duplicated resu

[jira] [Updated] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8518: - Attachment: HIVE-8518.1.patch > Compile time skew join optimization returns duplicated resu

[jira] [Updated] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8518: - Status: Patch Available (was: Open) > Compile time skew join optimization returns duplicated resu

[jira] [Commented] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176755#comment-14176755 ] Rui Li commented on HIVE-8518: -- cc [~xuefuz] > Compile time skew join optimization

[jira] [Commented] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177807#comment-14177807 ] Rui Li commented on HIVE-8518: -- Hi [~xuefuz], I find there're already several unit

[jira] [Created] (HIVE-8535) Enable compile time skew join optimization for spark [Spark Branch]

2014-10-20 Thread Rui Li (JIRA)
Rui Li created HIVE-8535: Summary: Enable compile time skew join optimization for spark [Spark Branch] Key: HIVE-8535 URL: https://issues.apache.org/jira/browse/HIVE-8535 Project: Hive Issue Type

[jira] [Created] (HIVE-8536) Enable runtime skew join optimization for spark [Spark Branch]

2014-10-20 Thread Rui Li (JIRA)
Rui Li created HIVE-8536: Summary: Enable runtime skew join optimization for spark [Spark Branch] Key: HIVE-8536 URL: https://issues.apache.org/jira/browse/HIVE-8536 Project: Hive Issue Type

[jira] [Commented] (HIVE-8406) Research on skewed join [Spark Branch]

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177960#comment-14177960 ] Rui Li commented on HIVE-8406: -- Created and linked two sub tasks for compile-time and run

[jira] [Created] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-20 Thread Rui Li (JIRA)
Rui Li created HIVE-8537: Summary: Update to use the stable TaskContext API [Spark Branch] Key: HIVE-8537 URL: https://issues.apache.org/jira/browse/HIVE-8537 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8537: - Issue Type: Task (was: Bug) > Update to use the stable TaskContext API [Spark Bra

[jira] [Assigned] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8537: Assignee: Rui Li > Update to use the stable TaskContext API [Spark Bra

[jira] [Updated] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8537: - Attachment: HIVE-8537-spark.patch > Update to use the stable TaskContext API [Spark Bra

[jira] [Updated] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8537: - Status: Patch Available (was: Open) > Update to use the stable TaskContext API [Spark Bra

[jira] [Commented] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178157#comment-14178157 ] Rui Li commented on HIVE-8537: -- [~chengxiang li] - I created this because it breaks the b

[jira] [Assigned] (HIVE-8537) Update to use the stable TaskContext API [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8537: Assignee: Chengxiang Li (was: Rui Li) Assign this to you [~chengxiang li], as it's related to HIVE

[jira] [Commented] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179446#comment-14179446 ] Rui Li commented on HIVE-8518: -- Thank you [~xuefuz] for the review! Could you also merge

[jira] [Commented] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179483#comment-14179483 ] Rui Li commented on HIVE-8518: -- OK got it. > Compile time skew join optimization

[jira] [Commented] (HIVE-8518) Compile time skew join optimization returns duplicated results

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179517#comment-14179517 ] Rui Li commented on HIVE-8518: -- Thanks [~xuefuz] and [~brocknoland]! Everything seems

[jira] [Commented] (HIVE-8528) Add remote Spark client to Hive [Spark Branch]

2014-10-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179644#comment-14179644 ] Rui Li commented on HIVE-8528: -- Forgive my ignorance, just some high level questions: *

[jira] [Commented] (HIVE-8528) Add remote Spark client to Hive [Spark Branch]

2014-10-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180919#comment-14180919 ] Rui Li commented on HIVE-8528: -- [~xuefuz] - thanks for pointing me to the detailed inf

[jira] [Commented] (HIVE-8528) Add remote Spark client to Hive [Spark Branch]

2014-10-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180931#comment-14180931 ] Rui Li commented on HIVE-8528: -- Yep, I see. Thanks for explaining :-) > Add remot

[jira] [Updated] (HIVE-8535) Enable compile time skew join optimization for spark [Spark Branch]

2014-10-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8535: - Attachment: HIVE-8535.1-spark.patch Since compile time optimization runs in logical layer and is quite independent

[jira] [Updated] (HIVE-8535) Enable compile time skew join optimization for spark [Spark Branch]

2014-10-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8535: - Status: Patch Available (was: Open) > Enable compile time skew join optimization for spark [Spark Bra

[jira] [Updated] (HIVE-8535) Enable compile time skew join optimization for spark [Spark Branch]

2014-10-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8535: - Attachment: HIVE-8535.2-spark.patch Enable more tests. > Enable compile time skew join optimization for sp

  1   2   3   4   5   6   7   8   >