[
https://issues.apache.org/jira/browse/HIVE-25616?focusedWorklogId=666531&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-666531
]
ASF GitHub Bot logged work on HIVE-25616:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 18/Oct/21 20:44
Start Date: 18/Oct/21 20:44
Worklog Time Spent: 10m
Work Description: vihangk1 commented on a change in pull request #2730:
URL: https://github.com/apache/hive/pull/2730#discussion_r731302621
##########
File path: metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
##########
@@ -2565,34 +2566,68 @@ private Collection getPartitionPsQueryResults(String
dbName, String tableName,
return (Collection) query.execute(dbName, tableName, partNameMatcher);
}
+ /**
+ * If partVals all the values are empty strings, it means we are returning
+ * all the partitions and hence we can attempt to use a directSQL equivalent
API which
+ * is considerably faster.
+ * @param partVals The partitions values used to filter out the partitions.
+ * @return true if partVals is empty or if all the values in partVals is
empty strings.
Review comment:
I know this is from the original patch but looks like this javadoc is
incorrect. The method actually returns false if partVals is empty. I don't
really remember now why that was the case. Perhaps you can look at this if you
have some cycles? If not, please fix the java doc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 666531)
Time Spent: 20m (was: 10m)
> Backport HIVE-24741 to Hive 2, 3
> ---------------------------------
>
> Key: HIVE-25616
> URL: https://issues.apache.org/jira/browse/HIVE-25616
> Project: Hive
> Issue Type: Improvement
> Reporter: Neelesh Srinivas Salian
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> HIVE-24741 adds a major improvement to the `{{get_partitions_ps_with_auth}}`
> API that is used by Spark to retrieve all partitions of the table.
> This has caused problems in Spark 3 - running on a Hive 2.3.x metastore.
> Patched this in my org and it helped get past large partitioned tables having
> problems reading metadata through Spark.
> [~vihangk1], thoughts?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
