See
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/122/changes>
Changes:
[sershe] Commit some initial prototype code
[sershe] Fix build
[sershe] delete wrongly resolved conflicts
[sershe] Refactor prototype with regard to updated design, remove chunk format
(currently discarded). Builds, but doesn't work in any form; cache is a no-op
too (layering for cache will be different)
[prasanthj] experimental version of orc metadata cache
[sershe] Preliminary patch for low-level cache, needs few more touches and LRFU
policy would not be thread-safe
[sershe] Finish reworking LRFU policy for low-level cache (not clear if it's a
good pick due to concurrency); tests; some pipeline adjustments
[sershe] Separated allocator and cache; unit tests for allocator, fixed a bunch
of bugs
[sershe] Add tests for cache, clean up allocator debug logging left over
[sershe] Re-add thread pool (in arbitrary place), input format wrapping; add
pause w/o implementation
[sershe] Fix a pom, some minor changes to visibility
[sershe] Actually fix pom
[sershe] Disable LLAP IO for now
[sershe] HIVE-9418p1 : ORC using low-level cache
[sershe] Follow-up to previous commit - logging and comment
[sershe] Rename some config settings, fix issue
[sershe] Disable LLAP IO again
[gunther] HIVE-9460: LLAP: Fix some static vars in the operator pipeline
(Gunther Hagleitner)
[gunther] HIVE-9461: LLAP: Enable local mode tests on tez to facilitate llap
testing (Gunther Hagleitner)
[gunther] HIVE-9506: LLAP: Add an execution daemon (Siddharth Seth via Gunther
Hagleitner)
[sershe] HIVE-9418p2 : Part of the encoded data production pipeline
(incomplete, only to allow parallel work)
[sershe] HIVE-9418p3 : Part of the encoded data production pipeline - missing
index and bugfixing
[sershe] HIVE-9418p4 : Index reading and more bugfixing (mostly from trunk port)
[sershe] HIVE-9418p5 : Yet more bugfixes
[sershe] HIVE-9418p6 : Yet more bugfixes, error handling improvement (another
pointless commit for parallel work enablement)
[sershe] HIVE-9418p7 : Final bugfixes, at least some queries work thru lower
level now
[sershe] HIVE-9418p7 : Additional logging; also fix build break from some
previous commit
[prasanthj] HIVE-9419: LLAP: ORC decoding of row-groups (Partial patch)
[sershe] HIVE-9419p1: LLAP: ORC decoding of row-groups - add stream kind for
ease of decoding
[sershe] HIVE-9418p8 : Refactor code out of RecordReader
[sershe] Remove VectorReader; roll it into InputFormat, since it's no longer an
interface to LLAP
[prasanthj] HIVE-9419p2: LLAP: ORC decoding of row-groups (Partial patch2)
[prasanthj] HIVE-9419p3: LLAP: ORC decoding of row-groups (Partial patch3)
[sershe] Bugfixes, comments and the test (doesn't work yet)
[sershe] Amend previous commit
[sershe] Fix one more issue
[sershe] Yet more fixes; right now buffers are permanently locked in cache
after reading, which I will fix shortly (better than assert)
[gunther] HIVE-9635: LLAP: I'm the decider (Gunther Hagleitner)
[prasanthj] HIVE-9419p4: LLAP: ORC decoding of row-groups (Partial patch4)
[gunther] HIVE-9694: LLAP: add check for udfs/udafs to llapdecider (Gunther
Hagleitner)
[prasanthj] HIVE-9419p5: LLAP: ORC decoding of row-groups (Partial patch5)
[prasanthj] HIVE-9419p6: LLAP: ORC decoding of row-groups (Partial patch6)
[sershe] HIVE-9728 : LLAP: add heap mode to allocator (for q files, YARN w/o
direct buffer accounting support)
[prasanthj] HIVE-9419p7: LLAP: ORC decoding of row-groups (Partial patch7)
[sershe] HIVE-9730p1 : LLAP: make sure logging is never called when not needed
(in LLAP proper)
[prasanthj] HIVE-9419: LLAP: ORC decoding of row-groups (final commit)
[sershe] Change the way DiskRange-s are managed, and fix decref for cache, some
more bugfixes
[prasanthj] HIVE-9751: LLAP: Fix issue with reading last row group of string
column (Prasanth Jayachandran)
[sershe] Fix a bug caused by compressed boundary estimates for repeated queries
[sershe] Fix another bug and update the q files
[prasanthj] Adding llap client and server to packaging pom
[gunther] HIVE-9654: LLAP: initialize IO during service startup, with service
configuration (Gunther Hagleitner)
[sershe] Remove FS cache, fix potential read issue
[sershe] Fix split generation NPE
[sershe] HIVE-9653 : LLAP: create a reasonable q file test for ORC IO
[sershe] HIVE-9759 : LLAP: Update launcher, scheduler to work with Tez changes
(Siddharth Seth)
[sershe] Another bunch of checks for HDFS
[gunther] HIVE-9782: LLAP: hook up decider + dag utils (Gunther Hagleitner)
[gunther] HIVE-9761: LLAP: Misc fixes to launch scripts, startup error handling
(Siddharth Seth via Gunther Hagleitner)
[gunther] HIVE-9765: LLAP: uber mode where applicable (Gunther Hagleitner)
[gopalv] HIVE-9764: Update tez dependency in branch & fix build (Siddharth Seth
via Gopal V)
[gunther] HIVE-9776: LLAP: add simple way to determine wether you're running in
daemon (Gunther Hagleitner)
[gunther] HIVE-9777: LLAP: Add an option to disable uberization (Gunther
Hagleitner)
[sershe] Add logging to initialization
[sershe] Potential fix for evict issue; revert if it breaks things
[sershe] Add logging for some bug
[prasanthj] HIVE-9782: LLAP: InStream creation for every row group is expensive
(Prasanth Jayachandran)
[prasanthj] Duplicate config removed in llap-daemon-site.xml
[sershe] HIVE-9799: LLAP: config not passed to daemon init
[sershe] Fix issue w/0-length streams
[sershe] Fix an issue with cache collisions
[sershe] Some minor cleanup
[sershe] Another attempt at fixing the decRef issue (forgot to replace the
buffer in results)
[prasanthj] HIVE-9827: LLAP: Make stripe level column readers thread safe
(Prasanth Jayachandran)
[sershe] HIVE-9829: LLAP: fix unit tests
[sershe] HIVE-9729p1 : LLAP: design and implement proper metadata cache - make
sure java metadata objects are not accessed via cache from decode side (so they
could be evicted); also clean up some interfaces
[sershe] ADDENDUM to 1663518
[gunther] HIVE-9837: LLAP: Decision to use llap or uber is being lost in some
reducers (Gunther Hagleitner)
[sershe] HIVE-9843 : LLAP: instrument logging for fragments
[gopalv] HIVE-9843 addendum: fix build
[gunther] HIVE-9849: LLAP: add multi threaded object registry (Gunther
Hagleitner)
[sershe] HIVE-9844 : LLAP: change caches to use unique file ID, not name
[prasanthj] HIVE-9801: LLAP: need metrics for llap daemon (Prasanth
Jayachandran)
[prasanthj] HIVE-9879: LLAP: Fix exception with HDFS getFileInfo (Prasanth
Jayachandran)
[prasanthj] HIVE-9881: Print ASCII art of LLAP during daemon startup (Prasanth
Jayachandran)
[prasanthj] HIVE-9878: LLAP: Add executor threadpool metrics (Prasanth
Jayachandran)
[gopalv] HIVE-9883: LLAP: Slider packaging for LLAP
[gopalv] HIVE-9884: LLAP : Add llap-daemon jars to the Tez session if the
execution mode is LLAP
[gopalv] HIVE-9887: LLAP: Add LLAP_DAEMON_LD_PATH to add native libs in
[gopalv] HIVE-9887: addendum
[prasanthj] HIVE-9888: LLAP: Provide per query counters (Prasanth Jayachandran)
[gunther] HIVE-9891: LLAP: disable plan caching (Gunther Hagleitner)
[sershe] HIVE-9729p2 : LLAP: design and implement proper metadata cache (most
of the implementation)
[sershe] HIVE-9729p2 addendum
[sseth] HIVE-9807. LLAP: Add event logging for execution elements. (Siddharth
Seth)
[sseth] HIVE-9808. LLAP: Push work into daemons instead of the current pull.
(Siddharth Seth)
[sseth] HIVE-9775. LLAP: Add a MiniLLAPCluster for tests. (Siddharth Seth)
[sershe] Ignore error during close due to FS being closed
[prasanthj] HIVE-9890: LLAP: Provide metrics for producer/consumer queue
(Prasanth Jayachandran)
[sseth] Minor changes to work with the API changes in TEZ-2175 and TEZ-2187.
(Siddharth Seth)
[sershe] HIVE-9729p3 : LLAP: design and implement proper metadata cache
[gopalv] HIVE-9958: LLAP: YARN registry for Auto-organizing Slider instances
(Gopal V)
[sershe] HIVE-9729p4 : LLAP: design and implement proper metadata cache (tests
part 1)
[sershe] HIVE-9729p4 : LLAP: design and implement proper metadata cache (Sergey
Shelukhin)
[sershe] HIVE-9978 : LLAP: OrcColumnVectorProducer should handle reading
isPresent columns only (Sergey Shelukhin)
[sershe] HIVE-9978 : LLAP: OrcColumnVectorProducer should handle reading
isPresent columns only ADDENDUM (Sergey Shelukhin)
[sseth] HIVE-9999. LLAP: Handle task rejection from daemons in the AM.
(Siddharth Seth)
[gunther] HIVE-10002: fix yarn service registry not found in ut problem
(Gunther Hagleitner)
[gopalv] LLAP: Pass additional JVM args via Slider appConfig (Gopal V)
[gunther] HIVE-10003: MiniTez ut fail with missing configs (Gunther Hagleitner
and Gopal V)
[sershe] HIVE-9979 : LLAP: LLAP Cached readers for StringDirectTreeReaders
over-read data (Sergey Shelukhin)
[sershe] HIVE-10024 : LLAP: q file test is broken again (Sergey Shelukhin)
[sseth] HIVE-9912. LLAP: Improvements to the Shuffle handler to avoid
unnecessary disk scans. (Siddharth Seth)
[sershe] HIVE-10014 : LLAP : investigate showing LLAP IO usage in explain
(Sergey Shelukhin)
[sershe] HIVE-10039 : LLAP : llap_partitioned test is broken (Sergey Shelukhin)
[sershe] HIVE-10045 : LLAP : NPE in DiskRangeList helper init - initial fix
(Sergey Shelukhin)
[sershe] HIVE-10046 : LLAP : disable ORC trace logging for now (Sergey
Shelukhin)
[prasanthj] HIVE-10043: LLAP: cache counters are incorrect (Prasanth
Jayachandran)
[prasanthj] HIVE-10064: LLAP: Cache hit rate could be wrong in some cases
(Prasanth Jayachandran)
[sershe] HIVE-10063 : LLAP: LowLevelCacheImpl does not match cached ranges
properly (Sergey Shelukhin)
[sershe] HIVE-10075 : LLAP: Object Estimator digs in via a deep hashCode()
(Sergey Shelukhin)
[sershe] HIVE-10067 : LLAP: read file ID when generating splits to avoid extra
NN call in the tasks (Sergey Shelukhin)
[gunther] HIVE-10082: LLAP: UnwrappedRowContainer throws exceptions (Gunther
Hagleitner)
[sershe] HIVE-10110 : LLAP: port updates from HIVE-9555 to llap branch in
preparation for trunk merge (Sergey Shelukhin)
[gunther] HIVE-10082: Addendum: LLAP: UnwrappedRowContainer throws exceptions
(Gunther Hagleitner)
[prasanthj] HIVE-10125: LLAP: Print execution modes in tez in-place UI
(Prasanth Jayachandran)
[sershe] Merge trunk ADDENDUM
[prasanthj] HIVE-10129: LLAP: Fix ordering of execution modes
[gunther] HIVE-10144: merge brought in file blocking github sync (Gunther
Hagleitner)
[sershe] HIVE-10128 : LLAP: BytesBytesMultiHashMap does not allow concurrent
read-only access (Sergey Shelukhin)
[sseth] HIVE-10104. LLAP: Generate consistent splits and locations for the same
split across jobs. (Siddharth Seth)
[sershe] HIVE-10092 : LLAP: improve how buffers are locked for split (Sergey
Shelukhin)
[prasanthj] HIVE-10081: LLAP: Make the low-level IO threadpool configurable
(Prasanth Jayachandran)
[sershe] HIVE-10103 : LLAP: Cancelling tasks fails to stop cache filling
threads (Sergey Shelukhin)
[vikram] HIVE-10201: Hive LLAP needs refactoring of the configuration class
(Vikram Dixit K, reviewed by Siddharth Seth)
[vikram] Revert HIVE-10201. Missed files.
[vikram] HIVE-10201: Hive LLAP needs refactoring of the configuration class
(Vikram Dixit K, reviewed by Siddharth Seth)
[gunther] HIVE-10162: LLAP: Avoid deserializing the plan > 1 times in a single
thread (Gunther Hagleitner)
[prasanthj] HIVE-10158: LLAP: Varchar columns are not handled in encoded
readers (Prasanth Jayachandran)
[gopalv] HIVE-10218: LLAP: Loglevel for daemons as a startup option (Gopal V)
[prasanthj] HIVE-10224: LLAP: Clean up encoded ORC tree readers after trunk
merge (Prasanth Jayachandran)
[sershe] HIVE-10196 : LLAP: start fetching earlier (Sergey Shelukhin)
[sershe] HIVE-10161 : LLAP: ORC file contains compression buffers larger than
bufferSize (OR reader has a bug) (Sergey Shelukhin)
[sershe] HIVE-10219 : BytesBytesMultiHashMap::clear() can't be concurrently
used with reads (Sergey Shelukhin)
[sseth] HIVE-10025. LLAP: Send heartbeats for queued work. (Siddharth Seth)
[prasanthj] HIVE-10248: LLAP: Fix merge conflicts related to HIVE-10067
(Prasanth Jayachandran)
[sershe] HIVE-10219 : BytesBytesMultiHashMap::clear() can't be concurrently
used with reads ADDENDUM (Sergey Shelukhin)
[prasanthj] HIVE-10258: LLAP: orc_llap test fails again (Prasanth Jayachandran)
[prasanthj] HIVE-10259: LLAP: Explain plan diff in llap_partitioned.q test case
(Prasanth Jayachandran)
[sseth] HIVE-10245. LLAP: Make use of the timed version of getDagStatus in
TezJobMonitor. (Siddharth Seth)
[sseth] HIVE-10279. LLAP: Allow the runtime to check whether a task can run to
completion. (Siddharth Seth)
[sseth] HIVE-10295. LLAP: Fix timeouts for tasks which stay in the pending
queue. (Siddharth Seth)
[sershe] HIVE-10298 : LLAP: Cache cleaner throws Negative sleep exception
(Sergey Shelukhin)
[sershe] HIVE-10154 : LLAP: GC issues 1 (Sergey Shelukhin)
[gopalv] HIVE-10012: LLAP: Dynamic refresh and blacklisting for daemons (gopalv)
[sershe] HIVE-10336 : LLAP: small improvement to unlocking cache data (Sergey
Shelukhin)
[sershe] HIVE-10334 : LLAP: Self-joins with the cache enabled (Sergey Shelukhin)
[sershe] HIVE-10333 : LLAP: NPE due to failure to find position (Sergey
Shelukhin)
[sershe] HIVE-10329 : Hadoop reflectionutils has issues (Sergey Shelukhin,
reviewed by Vikram Dixit K)
[sershe] HIVE-10329 : Hadoop reflectionutils has issues (Sergey Shelukhin,
reviewed by Vikram Dixit K) ADDENDUM
[prasanthj] LLAP: Name IO elevator threads (Prasanth Jayachandran)
[prasanthj] HIVE-10358: LLAP: Tez in-place UI gets misaligned when state is
TERMINATING (Prasanth Jayachandran)
[prasanthj] HIVE-10028: LLAP: Create a fixed size execution queue for daemons
(Prasanth Jayachandran)
[prasanthj] HIVE-10397: LLAP: Implement Tez SplitSizeEstimator for Orc
(Prasanth Jayachandran)
[sseth] HIVE-10405. LLAP: Provide runtime information to daemons to decide on
preemption order. (Siddharth Seth)
[prasanthj] LLAP: NPE caused by HIVE-10397 (Prasanth Jayachandran)
[sseth] LLAP: Avoid fetching data multiple times in case of broadcast.
(Siddharth Seth)
[sseth] HIVE-10408. Fix NPE in scheduler in case of rejected tasks. (Siddharth
Seth)
[sseth] HIVE-10424. LLAP: Factor known capacity into scheduling decisions.
(Siddharth Seth)
[sseth] HIVE-10475. LLAP: Minor fixes after tez api enhancements for dag
completion. (Siddharth Seth)
[sershe] HIVE-20217 : LLAP: Support caching of uncompressed ORC data (Sergey
Shelukhin)
[gopalv] HIVE-10498: LLAP: Resolve everything in llap-daemon-site.xml (Gopal V)
[j.prasanth.j] HIVE-10470: LLAP: NPE in IO when returning 0 rows with no
projection (Prasanth Jayachandran)
[sseth] HIVE-9911. LLAP: Clean up structures and intermediate data when a query
completes. (Siddharth Seth)
[sseth] HIVE-10480. Fix an issue with initial heartbeats which lead to
serialization errors and work timing out. (Siddharth Seth)
[j.prasanth.j] HIVE-10558: LLAP: Add test case for all row groups selection
with no column projection (Prasanth Jayachandran)
[sseth] HIVE-10560. Check if the dirWatcher is setup when trying to unregister
a DAG. (Siddharth Seth)
[sershe] HIVE-10482 : LLAP: AsertionError cannot allocate when reading from orc
(Sergey Shelukhin)
[sershe] HIVE-10633 : LLAP: remove default GC setting from runLlapDaemon
(Sergey Shelukhin)
[j.prasanth.j] Revert "LLAP: NPE caused by HIVE-10397 (Prasanth Jayachandran)"
[j.prasanth.j] Revert "HIVE-10397: LLAP: Implement Tez SplitSizeEstimator for
Orc (Prasanth Jayachandran)"
[j.prasanth.j] LLAP: Implement Tez SplitSizeEstimator for Orc (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-10429: LLAP: Abort hive tez processor on interrupts
(Prasanth Jayachandran reviewed by Gunther Hagleitner)
[sseth] HIVE-10663. LLAP: Update tez dependency. (Siddharth Seth)
[sseth] HIVE-10682. LLAP: Make use of the task runner which allows killing
tasks. (Siddharth Seth)
[sseth] HIVE-10683. LLAP: Add a mechanism for daemons to inform the AM about
killed tasks. (Siddharth Seth)
[sseth] HIVE-10652. LLAP: AM task communication retry is too long. (Siddharth
Seth)
[sseth] HIVE-10652 addendum. Remove unused imports introduced in earlier commit
(Siddharth Seth)
[sseth] HIVE-10700. LLAP: Log additional debug information in the scheduler.
(Siddharth Seth)
[j.prasanth.j] HIVE-10662: LLAP: Wait queue pre-emption (Prasanth Jayachandran)
[sseth] HIVE-10730. LLAP: fix guava stopwatch conflict. (Siddharth Seth)
[j.prasanth.j] Revert "HIVE-10730. LLAP: fix guava stopwatch conflict.
(Siddharth Seth)"
[j.prasanth.j] HIVE-10730. LLAP: fix guava stopwatch conflict. (Siddharth Seth)
[j.prasanth.j] HIVE-10744: LLAP: dags get stuck in yet another way (Prasanth
Jayachandran)
[sseth] HIVE-10756. LLAP: Misc changes to daemon scheduling. (Siddharth Seth)
[j.prasanth.j] HIVE-10759: LLAP: Add aging to wait queue tasks (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-10764: LLAP: Wait queue scheduler goes into tight loop
(Prasanth Jayachandran)
[j.prasanth.j] Revert "HIVE-10764: LLAP: Wait queue scheduler goes into tight
loop (Prasanth Jayachandran)"
[sseth] HIVE-10767. LLAP: Improve the way task finishable information is
processed. (Siddharth Seth)
[sseth] HIVE-10763. LLAP: Provide current attempt start time for wait queue
ordering. (Siddharth Seth)
[sseth] LLAP: NPE when calling abort on the TezProcessor. (Siddharth Seth)
[sseth] HIVE-10758. LLAP: Modify running / wait queues on on fragment finishable
[sershe] HIVE-10653 : LLAP: registry logs strange lines on daemons (Sergey
Shelukhin)
[sershe] HIVE-10777 : LLAP: add pre-fragment and per-table cache details
(Sergey Shelukhin)
[sseth] HIVE-10846. LLAP: preemption in AM due to failures / out of order
scheduling. (Siddharth Seth)
[sseth] HIVE-10842. Fix a deadlock in handling of finishable state change
notifications. (Siddharth Seth)
[sershe] HIVE-10871 : LLAP: bug in split processing in IO elevator causes
duplicate rows (Sergey Shelukhin)
[sershe] HIVE-10778 : LLAP: Utilities::gWorkMap needs to be cleaned in
HiveServer2 (Sergey Shelukhin, reviewed by Vikram Dixit K)
[sseth] HIVE-10425. LLAP: Limit number of threads used to communicate with a
[sseth] HIVE-10886. LLAP: Fixes to TaskReporter after recent Tez changes.
(Siddharth Seth)
[sershe] HIVE-10889 : LLAP: HIVE-10778 has NPE (Sergey Shelukhin)
[sershe] HIVE-10894 : LLAP: make sure the branch builds on hadoop-1 (Sergey
Shelukhin)
[sershe] HIVE-10896 : LLAP: the return of the stuck DAG (Sergey Shelukhin)
[sershe] HIVE-9814 : LLAP: JMX web-service end points for monitoring & metrics
(Gopal V, Sergey Shelukhin)
[sershe] HIVE-10913 : LLAP: cache QF counters have a wrong value for consumer
time (Sergey Shelukhin)
[sershe] HIVE-10913 : LLAP: cache QF counters have a wrong value for consumer
time (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-10914 : LLAP: fix hadoop-1 build for good by removing llap-server
from hadoop-1 build (Sergey Shelukhin)
[sershe] HIVE-10914 : LLAP: fix hadoop-1 build for good by removing llap-server
from hadoop-1 build - FIX (Sergey Shelukhin)
[sershe] HIVE-10920 : LLAP: elevator reads some useless data even if all RGs
are eliminated by SARG (Sergey Shelukhin)
[sseth] HIVE-10779. LLAP: Daemons should shutdown in case of fatal errors.
(Siddharth Seth)
[sershe] HIVE-10942 : LLAP: expose what's running on the daemon thru JMX
(Sergey Shelukhin)
[sershe] HIVE-10827 : LLAP: support parallel query compilation in HS2 (Sergey
Shelukhin)
[sershe] HIVE-10946 : LLAP: recent optimization introduced wrong assert to
elevator causing test to faill (Sergey Shelukhin)
[gopalv] HIVE-10960: LLAP: Allow finer control of startup options for LLAP
(gopalv)
[sseth] HIVE-10961. LLAP: Fix ShuffleHandler + Submit work init race condition.
(Siddharth Seth)
[sershe] HIVE-10872 : LLAP: make sure tests pass #1 (Sergey Shelukhin)
[gopalv] HIVE-11003: LLAP: Fix LLAP startup issues due to heap rounding errors
(gopalv)
[sershe] HIVE-11012 : LLAP: fix some tests in the branch and revert incorrectly
committed changed out files (from HIVE-11014) (Sergey Shelukhin)
[sseth] HIVE-10762. LLAP: Kill any fragments running in a daemon when a query
completes. (Siddharth Seth)
[vikram] HIVE-10647: Hive on LLAP: Limit HS2 from overwhelming LLAP (Vikram
Dixit K, reviewed by Gunther Hagleitner)
[sershe] HIVE-11014 : LLAP: some MiniTez tests have result changes compared to
master (Sergey Shelukhin)
[sershe] HIVE-11017 : LLAP: disable the flaky TestLlapTaskSchedulerService test
(Sergey Shelukhin)
[gopalv] HIVE-10981: LLAP: Accept --hiveconf parameters for the
LlapServiceDriver (gopalv)
[vikram] HIVE-11009: LLAP: fix TestMiniTezCliDriverLocal on the branch (Vikram
Dixit K, reviewed by Sergey Shelukhin)
[sershe] HIVE-11156 : LLAP: Cache arena size rounding (Sergey Shelukhin)
[sershe] HIVE-11015 : LLAP: MiniTez tez_smb_main, tez_bmj_schema_evolution fail
with NPE (Sergey Shelukhin, reviewed by Vikram Dixit K)
[j.prasanth.j] HIVE-11173: Fair ordering of fragments in wait queue (Prasanth
Jayachandran)
[sershe] HIVE-11169 : LLAP: more out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11177 : LLAP: spark out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11011 : LLAP: test auto_sortmerge_join_5 on MiniTez fails with
NPE (Sergey Shelukhin, reviewed by Vikram Dixit K)
[j.prasanth.j] HIVE-11186: Remove unused LlapUtils class from ql.io.orc
(Prasanth Jayachandran)
[sershe] HIVE-11213 : LLAP: more out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11222 : LLAP: occasional NPE in parallel queries in ORC reader
(Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[sershe] HIVE-11200 : LLAP: Cache BuddyAllocator throws NPE (Sergey Shelukhin)
[sseth] HIVE-11260. LLAP: Fix NPE in AMReporter. (Siddharth Seth)
[sershe] HIVE-10535 : LLAP: Cleanup map join cache when a query completes
(Sergey Shelukhin, reviewed by Siddharth Seth)
[sseth] HIVE-11273. LLAP: Register for finishable state change notifications
when adding a task instead of when scheduling it. (Siddharth Seth)
[sseth] HIVE-11263. LLAP: TaskExecutorService state is not cleaned up.
(Siddharth Seth)
[gopalv] HIVE-10930: LLAP: Set java.io.tmpdir correctly for LLAP Slider
instance (Gopal V)
[sseth] HIVE-11322. Fix API usage in plugins to match changes made in TEZ-2004
(Siddharth Seth)
[sseth] HIVE-11350. Fix API usage in plugins to match changes made in TEZ-2005.
(Siddharth Seth)
[sershe] HIVE-11259 : LLAP: clean up ORC dependencies part 1 (Sergey Shelukhin,
reviewed by Prasanth Jayachandran)
[sershe] HIVE-11305 : LLAP: Hybrid Map-join cache returns invalid data (Sergey
Shelukhin, reviewed by Gopal V)
[sseth] HIVE-11393. LLAP: Fix API usage to work with evolving Tez APIs -
TEZ-{2651,2652,2653}. (Siddharth Seth)
[sershe] HIVE-11479 : LLAP: ORC-related refactoring changes broke something
(Sergey Shelukhin)
[sseth] HIVE-11522. LLAP: Fix API usage to work with evolving Tez APIs -
TEZ-2678. (Siddharth Seth)
[sershe] HIVE-11385 : LLAP: clean up ORC dependencies - move encoded reader
path into a separate package and reader (Sergey Shelukhin, reviewed by Prasanth
Jayachandran)
[sershe] HIVE-11295 : LLAP: clean up ORC dependencies on object pools (Sergey
Shelukhin, reviewed by Prasanth Jayachandran)
[sseth] HIVE-11272. LLAP: Execution order within LLAP daemons should consider
query-specific priority assigned to fragments. (Siddharth Seth)
[sershe] HIVE-10535 : LLAP: move EncodedTreeReaderFactory, TreeReaderFactory
bits that rely on orc.encoded, and StreamUtils if needed, to orc.encoded
package (Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[sseth] HIVE-11612. Allow wait queue comparator to be specified as a classname.
(Siddharth Seth)
[sseth] HIVE-11148. LLAP: fix TestLlapTaskSchedulerService flakiness.
(Siddharth Seth)
[sershe] HIVE-11641 : LLAP: switch the branch to Tez master from branch (Sergey
Shelukhin)
[sershe] HIVE-11655 : clean build on the branch appears to be broken (Sergey
Shelukhin)
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin)
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM 2
[j.prasanth.j] HIVE-11674: LLAP: Update tez version to fix build
[sseth] HIVE-11660. LLAP: TestTaskExecutorService, TestLlapTaskSchedulerService
are flaky. Also fixes a real scheduling issue in LlapTaskSchedulerService.
(Siddharth Seth)
[j.prasanth.j] HIVE-9900: LLAP: Integrate MiniLLAPCluster into tests (Prasanth
Jayachandran reviewed by Siddharth Seth)
[sershe] HIVE-11729 : LLAP: update to use Tez 0.8 (Sergey Sheluhkin)
[j.prasanth.j] HIVE-11732: LLAP: MiniLlapCluster integration broke hadoop-1
build (Prasanth Jayachandran reviewed by Sergey Shelukhin)
[j.prasanth.j] HIVE-11773: LLAP: Create webapp/llap directory for
MiniLlapCluster
[j.prasanth.j] HIVE-11803: LLAP: MiniLlapCluster tests are slow
[sseth] HIVE-11805. LLAP: TaskCommunicator should not register MultiMRInput
Inputs for state updates. (Siddharth Seth)
[j.prasanth.j] HIVE-11810: LLAP: Exception is ignored if MiniLlap cluster fails
to start
[j.prasanth.j] HIVE-11811: Merge conflict addendum patch (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11818: LLAP: Rerunning MiniLlap does not start as web app
port is used (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11811: Merge conflict addendum patch2 (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11776: LLAP: Generate golden files for all MiniLlapCluster
tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11854: LLAP: Analyze and fix vectorization tests (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11867: LLAP: Generate join0.q golden file for java 8
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11869: LLAP: constprog_dpp.q,explainuser_1.q showing
explain diff (Prasanth Jaychandran)
[sershe] HIVE-11851 : LLAP: Test failures - file.splitmetainfo file not found
(Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[j.prasanth.j] LLAP: Remove fileformat_mix.q.out as it is not part of tez test
suite (Prasanth Jayachandran)
[sershe] HIVE-11851 : LLAP: Test failures - file.splitmetainfo file not found
(Sergey Shelukhin) ADDENDUM
[sershe] HIVE-11873 : LLAP: Plan is different for insert1.q (Sergey Shelukhin)
[j.prasanth.j] HIVE-11876: LLAP: Update errata.txt for HIVE-11871 (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11872: LLAP: Partition column value different for
identity_project_remove_skip.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11877: LLAP: Fix ordering difference in
acid_vectorization_partition.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11874: LLAP: Fix auto_join_nulls.q,auto_sortmerge_join_6.q
test diffs (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11884: LLAP: Fix discrepancies with
metadata_only_queries_with_filters.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11885: LLAP: Remove unused/old golden files (Prasanth
Jayachandran)
[sershe] HIVE-11868 : LLAP: Fix unionDistinct_1.q and union_view.q (Sergey
Shelukhin)
[sershe] HIVE-11886 : LLAP: merge master into branch (Sergey Shelukhin)
ADDENDUM SPARK TESTS
[j.prasanth.j] HIVE-11853: LLAP: Fix tests related to stats difference
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11893: LLAP: Update llap golden files after master merge
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11904: LLAP: Typo in webapps causing initialization error
for MiniLlap tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11905: LLAP: Update golden files for orc_llap and
llapdecider tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-9898: LLAP: Sort out issues with UGI and cached FileSystems
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11963: Llap: Disable web app for mini llap tests (Prasanth
Jayachandran reviewed by Sergey Shelukhin)
[sershe] HIVE-11978 : LLAP: NPE in Expr toString (Sergey Shelukhin)
[j.prasanth.j] HIVE-11923: allow qtests to run via a single client session for
tez and llap (Siddharth Seth reviewed by Prasanth Jayachandran)
[sershe] HIVE-12001 : LLAP: update some out files (Sergey Shelukhin)
[sershe] HIVE-12013 : LLAP: disable most llap tests before merge (Sergey
Shelukhin)
[sershe] HIVE-12034 : HIVE-4243 broke things for llap branch (Sergey Shelukhin)
[sershe] HIVE-12034 : HIVE-4243 broke things for llap branch (Sergey Shelukhin)
ADDENDUM
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin)
[sseth] HIVE-12043. Fix UGI usage in IO elevator threads. (Siddharth Seth)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM2
[sershe] HIVE-12066 : Add javadoc for methods added to public APIs (Sergey
Shelukhin)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM3
[sershe] HIVE-12073 : LLAP: disable session reuse for MiniTez cluster (Sergey
Shelukhin)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM4
[j.prasanth.j] HIVE-12081: LLAP: Make explainuser_1.q test consistent (Prasanth
Jayachandran)
[ekoifman] HIVE-11914 When transactions gets a heartbeat, it doesn't update the
lock heartbeat. (Eugene Koifman, reviewed by Alan Gates)
[ekoifman] HIVE-12025 refactor bucketId generating code (Eugene Koifman,
reviewed by Prashanth Jayachandran, Sergey Shelukhin, Elliot West)
[ekoifman] HIVE-12003 Hive Streaming API : Add check to ensure table is
transactional(Roshan Naik via Eugene Koifman)
[Jimmy Xiang] HIVE-12046: Re-create spark client if connection is dropped
(Jimmy, reviewed by Xuefu)
[sershe] HIVE-12078 : LLAP: document config settings (Sergey Shelukhin)
[thejas] HIVE-12095 - Revert "HIVE-11866 : Add framework to enable testing
using LDAPServer using LDAP protocol (Naveen Gangam via Szehon)"
[Ashutosh Chauhan] HIVE-12065 : FS stats collection may generate incorrect
stats for multi-insert query (Ashutosh Chauhan via Pengcheng Xiong)
[sershe] HIVE-12153 : LLAP: update errata for bad branch commits (Sergey
Shelukhin)
[sershe] HIVE-12153 : LLAP: update errata for bad branch commits (Sergey
Shelukhin) ADDENDUM
[sershe] HIVE-12048 : metastore file metadata cache should not be used when
deltas are present (Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[chengxiang] HIVE-11533 : Loop optimization for SIMD in integer comparisons.
(Teddy Choi, reviewed by ChengXiang Li)
------------------------------------------
[...truncated 324 lines...]
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHCommand.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHExecutionException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RemoteCommandResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommandExecutor.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommandExecutor.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommand.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHResult.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommand.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/NonZeroExitCodeException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/AbortDroneException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommandFactory.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ExecutionPhase.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/TestsFailedException.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/PrepPhase.java
A ptest2/src/main/java/org/apache/hive/ptest/api
A ptest2/src/main/java/org/apache/hive/ptest/api/client
A ptest2/src/main/java/org/apache/hive/ptest/api/client/PTestClient.java
A ptest2/src/main/java/org/apache/hive/ptest/api/response
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestListResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/GenericResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStartResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestLogResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatusResponse.java
A ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatus.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStopResponse.java
A ptest2/src/main/java/org/apache/hive/ptest/api/Status.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server
A
ptest2/src/main/java/org/apache/hive/ptest/api/server/ExecutionController.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server/TestExecutor.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server/Test.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server/TestLogger.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStopRequest.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestListRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStartRequest.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestLogRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStatusRequest.java
A ptest2/pom.xml
A ptest2/README.md
Checked out revision 1708292.
+ cd ptest2
+ mvn clean package -DskipTests -Drat.numUnapprovedLicenses=1000
-Dmaven.repo.local=<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/.m2>
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building hive-ptest 1.0
[INFO] ------------------------------------------------------------------------
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/maven-metadata.xml
Downloading:
http://repo.maven.apache.org/maven2/net/schmizz/sshj/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/maven-metadata.xml
790/790 B
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloaded:
http://repo.maven.apache.org/maven2/net/schmizz/sshj/maven-metadata.xml (790 B
at 0.9 KB/sec)
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
398/398 B
398/398 B 398/398 B
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
(398 B at 0.2 KB/sec)
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
(398 B at 0.2 KB/sec)
[WARNING] Could not transfer metadata net.schmizz:sshj/maven-metadata.xml
from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
(2 KB at 16.6 KB/sec)
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
(2 KB at 35.3 KB/sec)
[WARNING] Could not transfer metadata
net.schmizz:sshj:0.9.1-SNAPSHOT/maven-metadata.xml from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
(2 KB at 28.2 KB/sec)
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
(2 KB at 37.3 KB/sec)
[WARNING] Could not transfer metadata
net.schmizz:sshj:0.10.1-SNAPSHOT/maven-metadata.xml from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hive-ptest ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @
hive-ptest ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-ptest ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 62 source files to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/classes>
[WARNING] Note:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/src/main/java/org/apache/hive/ptest/execution/JIRAService.java>
uses unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @
hive-ptest ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 17 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-ptest ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 24 source files to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/test-classes>
[INFO]
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ hive-ptest ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- apache-rat-plugin:0.9:check (verify.rat) @ hive-ptest ---
[INFO] 51 implicit excludes (use -debug for more details).
[INFO] Exclude: .idea/
[INFO] Exclude: .git/
[INFO] Exclude: .gitignore
[INFO] Exclude: velocity.log
[INFO] Exclude: README.md
[INFO] Exclude: **/*.approved.txt
[INFO] Exclude: **/.settings/*
[INFO] Exclude: src/test/resources/
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/target/**
[INFO] 95 resources included (use -debug for more details)
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0
approved: 95 licence.
[INFO]
[INFO] --- maven-war-plugin:2.3:war (default-war) @ hive-ptest ---
[INFO] Packaging webapp
[INFO] Assembling webapp [hive-ptest] in
[<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0]>
[INFO] Processing war project
[INFO] Copying webapp resources
[<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/src/main/webapp]>
[INFO] Webapp assembled in [1750 msecs]
[INFO] Building war:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0.war>
[INFO] Packaging classes
[INFO] Building jar:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0-classes.jar>
[INFO]
[INFO] --- maven-dependency-plugin:2.8:copy-dependencies (copy-dependencies) @
hive-ptest ---
[INFO] Copying spring-core-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-core-3.2.1.RELEASE.jar>
[INFO] Copying sshj-0.8.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/sshj-0.8.1.jar>
[INFO] Copying hamcrest-core-1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/hamcrest-core-1.1.jar>
[INFO] Copying guice-3.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guice-3.0.jar>
[INFO] Copying ec2-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/ec2-1.7.3.jar>
[INFO] Copying jackson-core-asl-1.9.12.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jackson-core-asl-1.9.12.jar>
[INFO] Copying jclouds-bouncycastle-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-bouncycastle-1.7.3.jar>
[INFO] Copying jsch.agentproxy.sshj-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.sshj-0.0.7.jar>
[INFO] Copying commons-logging-1.1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-logging-1.1.1.jar>
[INFO] Copying jsch.agentproxy.usocket-nc-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.usocket-nc-0.0.7.jar>
[INFO] Copying httpcore-4.2.4.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/httpcore-4.2.4.jar>
[INFO] Copying spring-webmvc-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-webmvc-3.2.1.RELEASE.jar>
[INFO] Copying mockito-all-1.9.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/mockito-all-1.9.0.jar>
[INFO] Copying jsch.agentproxy.usocket-jna-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.usocket-jna-0.0.7.jar>
[INFO] Copying commons-io-2.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-io-2.1.jar>
[INFO] Copying log4j-1.2.17.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/log4j-1.2.17.jar>
[INFO] Copying junit-4.10.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/junit-4.10.jar>
[INFO] Copying xml-apis-1.0.b2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/xml-apis-1.0.b2.jar>
[INFO] Copying commons-lang-2.5.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-lang-2.5.jar>
[INFO] Copying httpclient-4.2.5.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/httpclient-4.2.5.jar>
[INFO] Copying sts-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/sts-1.7.3.jar>
[INFO] Copying rocoto-6.2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/rocoto-6.2.jar>
[INFO] Copying jclouds-log4j-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-log4j-1.7.3.jar>
[INFO] Copying aopalliance-1.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/aopalliance-1.0.jar>
[INFO] Copying jsr311-api-1.1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsr311-api-1.1.1.jar>
[INFO] Copying jclouds-sshj-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-sshj-1.7.3.jar>
[INFO] Copying commons-cli-1.2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-cli-1.2.jar>
[INFO] Copying aws-ec2-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/aws-ec2-1.7.3.jar>
[INFO] Copying jsch.agentproxy.core-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.core-0.0.7.jar>
[INFO] Copying jackson-mapper-asl-1.9.12.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jackson-mapper-asl-1.9.12.jar>
[INFO] Copying bcpkix-jdk15on-1.49.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/bcpkix-jdk15on-1.49.jar>
[INFO] Copying jsr250-api-1.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsr250-api-1.0.jar>
[INFO] Copying spring-aop-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-aop-3.2.1.RELEASE.jar>
[INFO] Copying bcprov-ext-jdk15on-1.49.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/bcprov-ext-jdk15on-1.49.jar>
[INFO] Copying jsch.agentproxy.connector-factory-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.connector-factory-0.0.7.jar>
[INFO] Copying spring-web-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-web-3.2.1.RELEASE.jar>
[INFO] Copying commons-collections-3.2.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-collections-3.2.1.jar>
[INFO] Copying jclouds-compute-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-compute-1.7.3.jar>
[INFO] Copying ApprovalsJava-013.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/ApprovalsJava-013.jar>
[INFO] Copying jclouds-scriptbuilder-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-scriptbuilder-1.7.3.jar>
[INFO] Copying spring-beans-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-beans-3.2.1.RELEASE.jar>
[INFO] Copying jclouds-slf4j-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-slf4j-1.7.3.jar>
[INFO] Copying slf4j-api-1.6.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/slf4j-api-1.6.1.jar>
[INFO] Copying javax.inject-1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/javax.inject-1.jar>
[INFO] Copying spring-expression-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-expression-3.2.1.RELEASE.jar>
[INFO] Copying jsch.agentproxy.pageant-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.pageant-0.0.7.jar>
[INFO] Copying slf4j-log4j12-1.6.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/slf4j-log4j12-1.6.1.jar>
[INFO] Copying jclouds-core-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-core-1.7.3.jar>
[INFO] Copying jsch.agentproxy.sshagent-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.sshagent-0.0.7.jar>
[INFO] Copying guava-15.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guava-15.0.jar>
[INFO] Copying jna-3.4.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jna-3.4.0.jar>
[INFO] Copying gson-2.2.4.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/gson-2.2.4.jar>
[INFO] Copying platform-3.4.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/platform-3.4.0.jar>
[INFO] Copying guice-assistedinject-3.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guice-assistedinject-3.0.jar>
[INFO] Copying velocity-1.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/velocity-1.7.jar>
[INFO] Copying commons-codec-1.6.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-codec-1.6.jar>
[INFO] Copying spring-context-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-context-3.2.1.RELEASE.jar>
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 49.616s
[INFO] Finished at: Tue Oct 13 06:02:10 EDT 2015
[INFO] Final Memory: 21M/56M
[INFO] ------------------------------------------------------------------------
+ set +e
+ optionalArgs=()
+ [[ -n '' ]]
+ java -cp 'target/hive-ptest-1.0-classes.jar:target/lib/*'
org.apache.hive.ptest.api.client.PTestClient --endpoint
http://ec2-174-129-184-35.compute-1.amazonaws.com:8181/hive-ptest-1.0/
--logsEndpoint http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/
--command testStart --profile trunkjava8-mr2 --password c0mmit --outputDir
target/ --testHandle HIVE-TRUNK-JAVA8-122
2015-10-13 08:30:11,255 ERROR TestExecutor.run:138 Error executing
HIVE-TRUNK-JAVA8-122 java.lang.NullPointerException: branch
at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:209)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.<init>(TestConfiguration.java:101)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.fromInputStream(TestConfiguration.java:276)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.fromFile(TestConfiguration.java:284)
at
org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:110)
Logs are located:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/HIVE-TRUNK-JAVA8-122
Exception in thread "main" java.lang.RuntimeException: 404 Not Found
at
org.apache.hive.ptest.api.client.PTestClient.downloadTestResults(PTestClient.java:181)
at
org.apache.hive.ptest.api.client.PTestClient.testStart(PTestClient.java:129)
at
org.apache.hive.ptest.api.client.PTestClient.main(PTestClient.java:312)
+ ret=1
+ cd target/
+ [[ -f test-results.tar.gz ]]
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
