[ 
https://issues.apache.org/jira/browse/HIVE-13354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304482#comment-15304482
 ] 

Wei Zheng commented on HIVE-13354:
----------------------------------

Test failures unrelated.

Test Name
Duration
Age
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_memcheck        
3.7 sec 1
 
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService.testDelayedLocalityNodeCommErrorImmediateAllocation
        10 sec  1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_load_dyn_part2     
1 min 9 sec     1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_load_dyn_part6     
1.6 sec 1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan  
0.82 sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_temp_table_gb1     
0.65 sec        1
 
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_13
     0.82 sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join28     0.87 
sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_leftsemijoin_mr    
0.89 sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_16    
2.3 sec 1
 
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vectorization_decimal_date
 0.59 sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join5 0.64 
sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join7 0.83 
sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_vector_char_4      
0.94 sec        1
 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_17     
0.97 sec        1
 org.apache.hadoop.hive.ql.TestTxnCommands.testSimpleAcidInsert 2 min 41 sec    
1
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_partitioned  
21 sec  2
 
org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorWithinDagPriority
     5 sec   18
 
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_constprog_partitioner
    3.2 sec 22
 
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_static
 1 min 34 sec    38
 
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
        1 min 25 sec    38
 
org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForMemoryTokenStore
   1.6 sec 38
 
org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForDBTokenStore
       0.25 sec        38
 org.apache.hive.minikdc.TestMiniHiveKdc.testLogin      1 min 30 sec    38
 org.apache.hadoop.hive.llap.tez.TestConverters.testFragmentSpecToTaskSpec      
43 ms   58
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_selectindate    13 sec  
90
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avrocountemptytbl       
11 sec  90
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order_null      41 sec  
90
 
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_join_with_different_encryption_keys
     1 min 33 sec    90
 
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3
    10 sec  90
 
org.apache.hadoop.hive.cli.TestMinimrCliDriver.org.apache.hadoop.hive.cli.TestMinimrCliDriver
  1 min 2 sec     90

> Add ability to specify Compaction options per table and per request
> -------------------------------------------------------------------
>
>                 Key: HIVE-13354
>                 URL: https://issues.apache.org/jira/browse/HIVE-13354
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 1.3.0, 2.0.0
>            Reporter: Eugene Koifman
>            Assignee: Wei Zheng
>              Labels: TODOC2.1
>         Attachments: HIVE-13354.1.patch, 
> HIVE-13354.1.withoutSchemaChange.patch, HIVE-13354.2.patch, HIVE-13354.3.patch
>
>
> Currently the are a few options that determine when automatic compaction is 
> triggered.  They are specified once for the warehouse.
> This doesn't make sense - some table may be more important and need to be 
> compacted more often.
> We should allow specifying these on per table basis.
> Also, compaction is an MR job launched from within the metastore.  There is 
> currently no way to control job parameters (like memory, for example) except 
> to specify it in hive-site.xml for metastore which means they are site wide.
> Should add a way to specify these per table (perhaps even per compaction if 
> launched via ALTER TABLE)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to