now documented in the wiki, including
*hive.vectorized.execution.enabled* (added by this patch).
* [Configuration Properties -- Vectorization |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Vectorization]
> Merge vectorization branch t
n to vectorization-branch for these 106
jiras (fixed+ fix-version=vectorization-branch ).
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
>
into trunk, I think we should *add*
fix-version of 0.13 to the jiras. That way the release notes for 0.13 will
include these changes as well. I will go ahead and make that change to the
jiras.
> Merge vectorization branch to trunk
> ---
>
>
(See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/187/])
HIVE-5283 : Merge vectorization branch to trunk (Jitendra Nath Pandey via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527858)
* /hive/trunk
* /hive/trunk/ant/src/org/apache
(See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/121/])
HIVE-5283 : Merge vectorization branch to trunk (Jitendra Nath Pandey via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527858)
* /hive/trunk
* /hive/trunk/ant/src/org/apache
ttps://builds.apache.org/job/Hive-trunk-hadoop2/467/])
HIVE-5283 : Merge vectorization branch to trunk (Jitendra Nath Pandey via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527858)
* /hive/trunk
* /hive/trunk/ant/src/org/apache/had
ttps://builds.apache.org/job/Hive-trunk-h0.21/2369/])
HIVE-5283 : Merge vectorization branch to trunk (Jitendra Nath Pandey via
Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1527858)
* /hive/trunk
* /hive/trunk/ant/src/org/apache/had
Available)
Committed to trunk. Thanks, Jitendra!
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
>
iras for the follow up work:
HIVE-5397, HIVE-5398 and HIVE-5399.
HIVE-5397 is aimed for the discussion/work related to public members in
VectorizedRowBatch.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
>
t;
"So the reality is that while final might be a useful hint to a dumb run-time
optimizer that doesn't perform any global dependency analysis, its use doesn't
actually enable very many compile-time optimizations, and is not needed by a
smart JIT to perform run-time optimizations.
s to indicate that these
variables should be accessed only in restricted packages. Would that be
reasonable?
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/ji
ence showing that the method calls
are not inlined by JIT?
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
>
view [~brocknoland].
VectorizedRowBatch is accessed and mutated by vectorized expressions in the
inner loops. The members are exposed as public to avoid method call overheads.
I will file jiras to address rest of the comments.
> Merge vectorization branch t
ason we shouldn't be exposing the members of
VectorizedRowBatch publicly.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Pro
o me.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
> Issue Type: Bug
>Reporter: Jitendra Nath
so I am familiar with this work. But it
won't harm to get extra pair of eyes on it. So, it will be good if other
committers also chime in.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
>
All tests pass.
[~cwsteinbach] Please take a look, the patch addresses your feedback comments.
Other committers are also requested to take a look.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
>
file that patch
doesn't handle correctly.
Uploaded the binary file. I will run the tests manually and provide the results.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https
ting org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 51 tests failed
{noformat}
This message is automatically generated.
> Merge vectorization branch to trunk
> ---
>
>
pply a patch, or are we going to SVN merge? I would
rather see a merge so we do not lose the commit history on the branch.
I am fine with either approach to get this work into trunk.
> Merge vectorization branch to trunk
> ---
>
>
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Open (was: Patch Available)
> Merge vectorization branch to tr
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Patch Available (was: Open)
> Merge vectorization branch to tr
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Attachment: HIVE-5283.4.patch
> Merge vectorization branch to tr
mart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0 to p2
+ exit 1
'
{noformat}
This message is automatically generated.
> Merge vectorization branch to trunk
>
, or are we going to SVN merge? I would
rather see a merge so we do not lose the commit history on the branch.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.o
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Patch Available (was: Open)
> Merge vectorization branch to tr
on review board as well.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
> Issue Type: Bug
Chauhan.
Changes
---
Updated patch, addressing the review comments and rebased to the latest state
of the trunk.
Bugs: HIVE-5283
https://issues.apache.org/jira/browse/HIVE-5283
Repository: hive-git
Description
---
Merge vectorization branch to trunk.
Diffs
-
ant/src/org
Chauhan.
Changes
---
Updated patch, addressing the review comments and rebased to the latest state
of the trunk.
Bugs: HIVE-5283
https://issues.apache.org/jira/browse/HIVE-5283
Repository: hive-git
Description
---
Merge vectorization branch to trunk.
Diffs (updated)
-
ant
the information from
above in a comment at the top of the file. It would also be great if you could
include a short comment per query so folks have an easy way of telling them
apart.
> Merge vectorization branch to trunk
> ---
>
>
. To reply, visit:
https://reviews.apache.org/r/14130/#review26119
---
On Sept. 13, 2013, 5:51 p.m., Jitendra Pandey wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r
/jira/browse/HIVE-5283
>
>
> Repository: hive-git
>
>
> Description
> ---
>
> Merge vectorization branch to trunk.
>
>
> Diffs
> -
>
> .gitignore c0e9b3c
> build-common.xml ee219a9
> common/src/java/org/apache/hadoop/hive/c
-
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14130/#review26119
---
On Sept. 13, 2013, 5:51 p.m., Jitendra Pandey wrote:
>
> ---
> This is an automatically generated e-mail.
each scenario.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
> Issue Type: Bug
>
d to note here since the site seems
overwhelmed by the size of this patch and I have my doubts that they're
actually going to get reposted here.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
>
;
>
> Review request for hive and Ashutosh Chauhan.
>
>
> Bugs: HIVE-5283
> https://issues.apache.org/jira/browse/HIVE-5283
>
>
> Repository: hive-git
>
>
> Description
> ---
>
> Merge vectorization branch to trunk.
>
>
> Diffs
org/jira/browse/HIVE-5283
>
>
> Repository: hive-git
>
>
> Description
> ---
>
> Merge vectorization branch to trunk.
>
>
> Diffs
> -
>
> .gitignore c0e9b3c
> build-common.xml ee219a9
> common/src/java/org/apache/hadoop/hiv
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-5283:
-
Status: Open (was: Patch Available)
> Merge vectorization branch to tr
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
> Issue Type: Bug
>Repo
ting org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
> Merge vectorization branch t
here is quite a queue at present
so you might want to run locally.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
>
port$ReaderThread.run(SynchronousCommandTransport.java:48)
{code}
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
>
long, it might make sense to just get it committed as a patch.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project:
://issues.apache.org/jira/browse/HIVE-5283
Repository: hive-git
Description
---
Merge vectorization branch to trunk.
Diffs
-
.gitignore c0e9b3c
build-common.xml ee219a9
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java c5a8ff3
metastore/src/java/org/apache/hadoop/hive
uest on phabricator or reviewboard?
Also, is the plan to commit this patch or to merge the vectorization branch
into trunk?
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https:
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Open (was: Patch Available)
> Merge vectorization branch to tr
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Patch Available (was: Open)
> Merge vectorization branch to tr
s the updated patch.
> Merge vectorization branch to trunk
> ---
>
> Key: HIVE-5283
> URL: https://issues.apache.org/jira/browse/HIVE-5283
> Project: Hive
> Issue Type: Bug
>
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Attachment: HIVE-5283.1.patch
> Merge vectorization branch to tr
[
https://issues.apache.org/jira/browse/HIVE-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jitendra Nath Pandey updated HIVE-5283:
---
Status: Patch Available (was: Open)
> Merge vectorization branch to tr
a/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0 to p2
+ exit 1
'
{noformat}
This message is automatically generated.
> Mer
Jitendra Nath Pandey created HIVE-5283:
--
Summary: Merge vectorization branch to trunk
Key: HIVE-5283
URL: https://issues.apache.org/jira/browse/HIVE-5283
Project: Hive
Issue Type: Bug
On Mon, Sep 9, 2013 at 6:51 PM, Edward Capriolo wrote:
> Can we vote to change the by-laws and then svn merge the branch? Seems
> better then making a big patch and losing the commit history.
Yes, we can do that, but amending the bylaws requires a 2/3 majority vote
from
active PMC members and a
Can we vote to change the by-laws and then svn merge the branch? Seems
better then making a big patch and losing the commit history.
On Mon, Sep 9, 2013 at 9:44 PM, Carl Steinbach wrote:
> > First of all I'd like to say thanks for your hard work! I also agree
> > that this should go in post 0.1
> First of all I'd like to say thanks for your hard work! I also agree
> that this should go in post 0.12 branch.
>
Ditto.
As far as merging this into trunk goes, we're currently hamstrung
by the fact that the Hive Bylaws don't include any provisions covering
development work done on feature bra
Hi Brock,
I will merge latest trunk to the branch and run all the tests again, and
provide you the run time difference. Trunk has moved ahead since the last
merge, therefore test results are a bit stale right now.
> What new modules or dependencies are added?
No new dependencies have been add
Hi,
First of all I'd like to say thanks for your hard work! I also agree
that this should go in post 0.12 branch. I have a couple questions:
Do all the tests pass?
How long does ant test test take in comparison with trunk?
What new modules or dependencies are added?
Can the feature be disabled
Hi Folks,
Vectorized query execution work has been under development for around 6
months now. We have made good progress in making basic datatypes and
queries to work in vectorized mode and also we have laid sufficient
groundwork so that any future development can happen directly on trunk.
Th
58 matches
Mail list logo
