[
https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426708#comment-15426708
]
Hive QA commented on HIVE-14165:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12824278/HIVE-14165.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 63 failed/errored test(s), 10426 tests
executed
*Failed tests:*
{noformat}
TestVectorTimestampExpressions - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[authorization_1_sql_std]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[cbo_const]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[decimal_precision2]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dynpart_sort_opt_bucketing]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[exim_04_evolved_parts]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[float_equality]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[select_dummy_source]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[timestamp_literal]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_add_months]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_aes_decrypt]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_aes_encrypt]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bitwise_shiftleft]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bitwise_shiftright]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bitwise_shiftrightunsigned]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_bround]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_cbrt]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_chr]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_crc32]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_current_database]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_date_add]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_date_format]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_date_sub]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_decode]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_factorial]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_format_number]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_from_utc_timestamp]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_get_json_object]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_last_day]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_levenshtein]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_first_n]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_hash]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_last_n]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_show_first_n]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_show_last_n]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_md5]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_months_between]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_quarter]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_replace]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_sha1]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_sha2]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_soundex]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_substring_index]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_to_utc_timestamp]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_trunc]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_version]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[hybridgrace_hashjoin_1]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[hybridgrace_hashjoin_2]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_1]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_2]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[load_dyn_part1]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[load_dyn_part2]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[select_dummy_source]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[transform_ppr1]
org.apache.hive.beeline.TestBeeLineWithArgs.testConnectionWithURLParams
org.apache.hive.beeline.TestBeeLineWithArgs.testEmbeddedBeelineOutputs
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadMissingPartitionBasicNeg[3]
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testConnectionSchemaAPIs
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testSelectThriftSerializeInTasks
org.apache.hive.jdbc.TestJdbcWithMiniLlap.testLlapInputFormatEndToEnd
org.apache.hive.jdbc.TestJdbcWithMiniLlap.testNonAsciiStrings
org.apache.hive.service.cli.operation.TestOperationLoggingLayout.testSwitchLogLayout
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/927/testReport
Console output:
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/927/console
Test logs:
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-927/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 63 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12824278 - PreCommit-HIVE-MASTER-Build
> Remove Hive file listing during split computation
> -------------------------------------------------
>
> Key: HIVE-14165
> URL: https://issues.apache.org/jira/browse/HIVE-14165
> Project: Hive
> Issue Type: Sub-task
> Affects Versions: 2.1.0
> Reporter: Abdullah Yousufi
> Assignee: Abdullah Yousufi
> Attachments: HIVE-14165.patch
>
>
> The Hive side listing in FetchOperator.java is unnecessary, since Hadoop's
> FileInputFormat.java will list the files during split computation anyway to
> determine their size. One way to remove this is to catch the
> InvalidInputFormat exception thrown by FileInputFormat#getSplits() on the
> Hive side instead of doing the file listing beforehand.
> For S3 select queries on partitioned tables, this results in a 2x speedup.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
