[
https://issues.apache.org/jira/browse/IMPALA-14081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jichen updated IMPALA-14081:
----------------------------
Description:
this patch mainly implement the creation/drop of paimon table through impala.
syntax for creating paimon table:
CREATE [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
(
[col_name data_type ,...]
[PRIMARY KEY (col1,col2)]
)
[PARTITIONED BY (col_name data_type [COMMENT 'col_comment'], ...)]
STORED AS PAIMON
[LOCATION 'hdfs_path']
[TBLPROPERTIES (
'primary-key'='col1,col2',
'file.format' = 'orc/parquet',
'bucket' = '2',
'bucket-key' = 'col3',
];
two types of paimon catalogs are supported.
(1) create table with hive catalog:
CREATE TABLE paimon_hive_cat(userid INT,movieId INT)
STORED AS PAIMON;
(2) create table with hadoop catalog:
CREATE EXTERNAL TABLE paimon_hadoop_cat
STORED AS PAIMON
TBLPROPERTIES('paimon.catalog'='hadoop',
'paimon.catalog_location'='/path/to/paimon_hadoop_catalog',
'paimon.table_identifier'='paimondb.paimontable');
SHOW TABLE STAT/SHOW COLUMN STAT/SHOW PARTITIONS/SHOW FILES/SHOW CREATE TABLE
statements are also supported.
Testing:
- Add test cases in metadata/test_show_create_table.py.
- Add custom cluster test test_paimon.py.
was:
this patch mainly implement the creation/drop of paimon table through impala.
syntax for creating paimon table:
CREATE [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
(
[col_name data_type ,...]
[PRIMARY KEY (col1,col2)]
)
[PARTITIONED BY (col_name data_type [COMMENT 'col_comment'], ...)]
STORED AS PAIMON
[LOCATION 'hdfs_path']
[TBLPROPERTIES (
'primary-key'='col1,col2',
'file.format' = 'orc/parquet',
'bucket' = '2',
'bucket-key' = 'col3',
];
two types of paimon catalogs are supported.
(1) create table with hive catalog:
CREATE TABLE paimon_hive_cat(userid INT,movieId INT)
STORED AS PAIMON;
(2) create table with hadoop catalog:
CREATE EXTERNAL TABLE paimon_hadoop_cat
STORED AS PAIMON
TBLPROPERTIES('paimon.catalog'='hadoop',
'paimon.catalog_location'='/path/to/paimon_hadoop_catalog',
'paimon.table_identifier'='paimondb.paimontable');
SHOW TABLE STAT/SHOW COLUMN STAT/SHOW PARTITIONS/SHOW FILES statements are also
supported.
Testing:
- Add test cases in metadata/test_show_create_table.py.
- Add custom cluster test test_paimon.py.
> Support create/drop paimon table for impala
> -------------------------------------------
>
> Key: IMPALA-14081
> URL: https://issues.apache.org/jira/browse/IMPALA-14081
> Project: IMPALA
> Issue Type: New Feature
> Reporter: jichen
> Assignee: jichen
> Priority: Major
> Labels: paimon
>
> this patch mainly implement the creation/drop of paimon table through impala.
> syntax for creating paimon table:
> CREATE [EXTERNAL] TABLE [IF NOT EXISTS] [db_name.]table_name
> (
> [col_name data_type ,...]
> [PRIMARY KEY (col1,col2)]
> )
> [PARTITIONED BY (col_name data_type [COMMENT 'col_comment'], ...)]
> STORED AS PAIMON
> [LOCATION 'hdfs_path']
> [TBLPROPERTIES (
> 'primary-key'='col1,col2',
> 'file.format' = 'orc/parquet',
> 'bucket' = '2',
> 'bucket-key' = 'col3',
> ];
> two types of paimon catalogs are supported.
> (1) create table with hive catalog:
> CREATE TABLE paimon_hive_cat(userid INT,movieId INT)
> STORED AS PAIMON;
> (2) create table with hadoop catalog:
> CREATE EXTERNAL TABLE paimon_hadoop_cat
> STORED AS PAIMON
> TBLPROPERTIES('paimon.catalog'='hadoop',
> 'paimon.catalog_location'='/path/to/paimon_hadoop_catalog',
> 'paimon.table_identifier'='paimondb.paimontable');
> SHOW TABLE STAT/SHOW COLUMN STAT/SHOW PARTITIONS/SHOW FILES/SHOW CREATE TABLE
> statements are also supported.
> Testing:
> - Add test cases in metadata/test_show_create_table.py.
> - Add custom cluster test test_paimon.py.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
