[ 
https://issues.apache.org/jira/browse/KUDU-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17348962#comment-17348962
 ] 

ASF subversion and git services commented on KUDU-3223:
-------------------------------------------------------

Commit 323d8ea7312678b7a910e55ed4f74acaf3813ffc in kudu's branch 
refs/heads/master from Hongjiang Zhang
[ https://gitbox.apache.org/repos/asf?p=kudu.git;h=323d8ea ]

KUDU-3223: management of per-table limit by kudu CLI

Use kudu CLI to set disk_size_limit and row_count_limit on table level.

If '--enable_table_write_limit' is not set 'true' for kudu-master, kudu
CLI fails to set the limit. The table's disk_size_limit and
row_count_limit are 'N/A' when calling 'kudu table statistics'.

Only when '--enable_table_write_limit' is set 'true', can the kudu CLI
change the table limit. Use 'kudu table statistics' to check the
updated result.

Change-Id: I59bb64cc85d5fca48ae8ec980f5cfc62e4b3a1d3
Reviewed-on: http://gerrit.cloudera.org:8080/17444
Reviewed-by: Alexey Serbin <aser...@cloudera.com>
Tested-by: Kudu Jenkins
Reviewed-by: Andrew Wong <aw...@cloudera.com>


> Total table size quota management for every user
> ------------------------------------------------
>
>                 Key: KUDU-3223
>                 URL: https://issues.apache.org/jira/browse/KUDU-3223
>             Project: Kudu
>          Issue Type: Wish
>            Reporter: Redriver
>            Priority: Major
>
> *Requirement description*
> In production environment, the quota management for total tables size and 
> single table size of a single user is necessary. If the quota is reached, the 
> write operation including insert and update is forbidden, only table 
> creation, scan and delete are allowed. 
> We need to allow admin to configure the quota for every user, monitor the 
> quota status, and stop the write operation with an error returned to client.
> So, I hope Kudu cli can list the status. Currently, the kudu table statistics 
> only gives the disk size and live row count. It is better improve this by 
> adding user name for table statistics, or create a new parameter to query 
> every table size for every user, and disable/enable a user's write privilege. 
> Can this be configured through Apache Ranger?
> *Typical scenarios*
>  # Some user has malicious operation to create a huge table, or many small 
> tables, as a result, the total table size exceeds the cluster's capacity, we 
> have to stop him in time. 
>  # When writing Kudu table through Flink, the streaming process is always 
> running, which means the Kudu table writing never stopped. If we do not have 
> a protection, the Kudu cluster will be exhausted someday. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to