[
https://issues.apache.org/jira/browse/HIVE-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15269820#comment-15269820
]
Eugene Koifman commented on HIVE-13646:
---------------------------------------
{noformat}
Test Name Duration Age
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService.testDelayedLocalityNodeCommErrorImmediateAllocation
10 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby8_map
1 min 5 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucketmapjoin_negative3
1.4 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucketmapjoin11
0.95 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_cbo_udf_udaf
1 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt13
1.2 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join0 0.86
sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_avro_joins_native
0.74 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_stats13 0.53
sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby10 0.89
sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vector_cast_constant
0.83 sec 1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_14
0.9 sec 1
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorWithinDagPriority
5.1 sec 2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32 6.2 sec 3
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_select_read_only_encrypted_tbl
1 min 23 sec 3
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
1 min 16 sec 3
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskCommunicator.testFinishableStateUpdateFailure
2.7 sec 6
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testFetchingPartitionsWithDifferentSchemas
3 sec 7
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testAddPartitions
3 sec 7
org.apache.hadoop.hive.metastore.TestHiveMetaStoreGetMetaConf.testGetMetaConfDefault
10 sec 8
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_static
2 min 2 sec 9
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_selectindate 13 sec
13
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avrocountemptytbl
10 sec 13
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order_null 35 sec
13
org.apache.hive.hcatalog.api.repl.commands.TestCommands.org.apache.hive.hcatalog.api.repl.commands.TestCommands
20 sec 13
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_join_with_different_encryption_keys
1 min 49 sec 13
org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForMemoryTokenStore
1.8 sec 13
org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForDBTokenStore
0.38 sec 13
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testGetPartitionSpecs_WithAndWithoutPartitionGrouping
3.4 sec 13
org.apache.hive.minikdc.TestMiniHiveKdc.testLogin 1 min 32 sec 13
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3
7.2 sec 13
org.apache.hadoop.hive.cli.TestMinimrCliDriver.org.apache.hadoop.hive.cli.TestMinimrCliDriver
54 sec 13
{noformat}
test failures are not related
> make hive.optimize.sort.dynamic.partition compatible with ACID tables
> ---------------------------------------------------------------------
>
> Key: HIVE-13646
> URL: https://issues.apache.org/jira/browse/HIVE-13646
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 1.0.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Critical
> Attachments: HIVE-13646.2.patch, HIVE-13646.patch
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> HIVE-8875 disabled hive.optimize.sort.dynamic.partition for ACID queries.
> dynamic inserts are common in ACID and this leaves users with few options if
> they are seeing OutOfMemory errors due to too many writers.
> hive.optimize.sort.dynamic.partition sorts data by partition col/bucket
> col/sort col to ensure each reducer only needs 1 writer.
> Acid requires data in each bucket file to be sorted by ROW__ID and thus
> doesn't allow end user to determine sorting.
> So we should be able to support hive.optimize.sort.dynamic.partition with
> sort on partition col/bucket col/ROW__ID
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
