I've noticed that the DefaultHiveMetaHook <https://github.com/apache/hive/blob/release-3.1.2-rc0/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/DefaultHiveMetaHook.java#L32> class has a commitInsertTable(Table table, boolean overwrite) method. So perhaps this is the method that I should plug in to detect the proper write mode before pushing data to the output table?
If so, by chance is there any way to somehow access the JobConf in that method? It looks like the DruidStorageHandler <https://github.com/apache/hive/blob/release-3.1.2-rc0/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandler.java#L806> uses that method, so I'll have to dive into that a bit more. Thanks, Julien On 2022/04/30 00:44:44 Julien Phalip wrote: > Hi, > > I'm working on a custom storage handler and am wondering if there's a way > to detect the appropriate write mode for the output table. For example, an > "INSERT" statement is expected to append rows to the table, whereas an > "INSERT OVERWRITE" statement should first clear the table before adding new > rows. > > Is there a way to tell which mode to use, either from the JobConf or any > other means? > > Thanks, > > Julien >
