Narayanan Venkateswaran created HIVE-24343:
----------------------------------------------
Summary: Table partition operations (create, drop, select) fail
when the number of partitions is greater than 32767 (signed int)
Key: HIVE-24343
URL: https://issues.apache.org/jira/browse/HIVE-24343
Project: Hive
Issue Type: Bug
Components: Metastore
Reporter: Narayanan Venkateswaran
The table partition operations - create, drop, select access the underlying
relation database using JDO, which internally routes the operations through the
JDBC driver. Most of the underlying JDBC driver implementations place a limit
on the number of parameters that can be passed through a statement
implementation. The limitations are as follows,
postgreSQL - 32767
(https://www.postgresql.org/message-id/16832734.post%40talk.nabble.com)
MySQL - 32767 - 2 Byte Integer - num of params
(https://dev.mysql.com/doc/internals/en/com-stmt-prepare-response.html#packet-COM_STMT_PREPARE_OK)
Oracle - 32767 -
https://www.jooq.org/doc/3.12/manual/sql-building/dsl-context/custom-settings/settings-inline-threshold/
Derby - 32767 - stored in an unsinged integer - Note the Prepared
Statement implementation here -
[https://svn.apache.org/repos/asf/db/derby/code/branches/10.1/java/client/org/apache/derby/client/am/PreparedStatement.java]
These limits should be taken into account when querying the underlying
metastore.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
