[
https://issues.apache.org/jira/browse/HIVE-28971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954140#comment-17954140
]
Raghav Aggarwal commented on HIVE-28971:
----------------------------------------
For 800 column table with 5000 parititions, without directSQL it was taking
around *16 sec (in my setup)* to perform msck repair. *Post the fix, it took
around 7 sec.*
> DirectSql for msck repair is failing because of wrong casting
> -------------------------------------------------------------
>
> Key: HIVE-28971
> URL: https://issues.apache.org/jira/browse/HIVE-28971
> Project: Hive
> Issue Type: Bug
> Reporter: Raghav Aggarwal
> Assignee: Raghav Aggarwal
> Priority: Major
> Attachments: repro.sql
>
>
> *ENV: Hive master branch (ccd9064ddc7ff38925230468186460e736478e1e) + JAVA 17
> patches (from Open PR) i.e datanucleus 6.x, Hadoop 3.4.1 (JAVA17), tez master
> branch (51ad671833472482bb53bf2e72568f3007b50ce2).*
> ERROR MESSAGE:
> {code:java}
> 2025-05-26 23:07:36,111 WARN metastore.ObjectStore: Falling back to ORM path
> due to direct SQL failure (this is not an error): class
> javax.jdo.identity.LongIdentity cannot be cast to class
> org.datanucleus.identity.DatastoreId (javax.jdo.identity.LongIdentity and
> org.datanucleus.identity.DatastoreId are in unnamed module of loader 'app')
> at
> org.apache.hadoop.hive.metastore.DirectSqlInsertPart.addPartitions(DirectSqlInsertPart.java:758)
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.addPartitions(MetaStoreDirectSql.java:516)
> at
> org.apache.hadoop.hive.metastore.ObjectStore$7.getSqlResult(ObjectStore.java:2747)
> {code}
> Attaching the steps to repro as well under Attachments.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
