[ 
https://issues.apache.org/jira/browse/HUDI-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523630#comment-17523630
 ] 

Chuang Lee commented on HUDI-3898:
----------------------------------

I agree with you.
Now I just want to confirm whether we can add a more flexible configuration to 
synchronize only the _ro table or only the _rt table according to the needs of 
the business.


Of course, if only one table is synchronized, it may be confused to other 
users, but these can be explained at the business level to allow users who use 
this table to perceive whether this unsuffixed table is an _rt or _ro table.


I think adding these configurations is just to use hudi more flexibly and 
conveniently, because for some business scenarios, only one table is enough to 
synchronize, and at the same time, in order to keep the table name with the 
existing business before the transformation, I want to skip (_ro/ _rt) suffix.


So in general, my idea is to meet more business scenarios by adding optional 
configurations.[~danny0405] 

> Mor table hive synchronization supports _ro or _rt table type selection and 
> _rt table suffix skip configuration items
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-3898
>                 URL: https://issues.apache.org/jira/browse/HUDI-3898
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: hive, meta-sync
>            Reporter: Chuang Lee
>            Priority: Major
>             Fix For: 0.11.0
>
>
> Related links :https://github.com/apache/hudi/issues/5327
>  # The current mor table hive synchronization only supports the suffix 
> skipping of the _ro table. Can it also support the suffix skipping 
> configuration item of the _rt table? Because for some business scenarios, 
> especially non-partitioned tables, in order to be consistent with the table 
> names of existing businesses, some businesses only need the _ro table to skip 
> the suffix, and some businesses only need the _rt table to skip the suffix, 
> so do you consider adding configuration items? _rt table suffix.
>  # The current mor table hive synchronization synchronizes the _ro table and 
> the _rt table at the same time, which cannot be changed, but for some 
> non-partitioned business scenarios, some only need to synchronize the _ro 
> table or the _rt table to meet the requirements. If all are synchronized, it 
> will bring extra cost, so consider adding configuration items to be more 
> flexible to choose.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to