[ https://issues.apache.org/jira/browse/HIVE-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871332#comment-13871332 ]
Hive QA commented on HIVE-5951: ------------------------------- {color:green}Overall{color}: +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12622970/HIVE-5951.07.patch {color:green}SUCCESS:{color} +1 4924 tests passed Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/910/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/910/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12622970 > improve performance of adding partitions from client > ---------------------------------------------------- > > Key: HIVE-5951 > URL: https://issues.apache.org/jira/browse/HIVE-5951 > Project: Hive > Issue Type: Improvement > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Attachments: HIVE-5951.01.patch, HIVE-5951.02.patch, > HIVE-5951.03.patch, HIVE-5951.04.patch, HIVE-5951.05.patch, > HIVE-5951.07.patch, HIVE-5951.07.patch, HIVE-5951.nogen.patch, > HIVE-5951.nogen.patch, HIVE-5951.nogen.patch, HIVE-5951.nogen.patch, > HIVE-5951.patch > > > Adding partitions to metastore is currently very inefficient. There are small > things like, for !ifNotExists case, DDLSemanticAnalyzer gets the full > partition object for every spec (which is a network call to metastore), and > then discards it instantly; there's also general problem that too much > processing is done on client side. DDLSA should analyze the query and make > one call to metastore (or maybe a set of batched calls if there are too many > partitions in the command), metastore should then figure out stuff and insert > in batch. -- This message was sent by Atlassian JIRA (v6.1.5#6160)