Re: Re: Re: Support for forced drop of user data

2020-11-30 Thread ling miao
I checked the code of be. The config 'trash_file_expire_time_sec' is a unified configuration. It means that the expiration time of all tablets are the same. In other words, each tablet does not have its own expiration time. I wonder if the code I understand is correct? If I understand correctly, w

Re: Re: Re: Support for forced drop of user data

2020-11-23 Thread ling miao
It is true that the metadata can be cleared immediately, but the data cannot be cleared immediately. Or do we set the expire time of the tablet to a small value while force? Ling Miao 蔡聪辉 于2020年11月23日周一 上午10:46写道: > Now, Doris support Drop partition, Drop Table, Drop database force > operation,

Re:Re: Re: Support for forced drop of user data

2020-11-22 Thread 蔡聪辉
Now, Doris support Drop partition, Drop Table, Drop database force operation, so if we doesn't want to recover metadata anymore, we can simple execute drop force operation. From Conghui Cai At 2020-11-23 10:05:46, "ling miao" wrote: >Or can we have a new command to clear metadata and data direct

Re: Re: Support for forced drop of user data

2020-11-22 Thread ling miao
Or can we have a new command to clear metadata and data directly? Instead of adjusting the parameters before issuing the command. Because if you want to adjust the parameters, it may affect some data that you don't want to delete immediately. Instead, our repair function is affected. Ling Miao 陈明

Re:Re: Support for forced drop of user data

2020-11-21 Thread 陈明雨
Yes, there will be a problem that once the user recover the partition by executing `RECOVER` statement, it will only recover the meta data, but the data is lost. I think we can implement a command to view the meta data in Catalog Recycle Bin, and can drop them manually with some properties to t

Re: Support for forced drop of user data

2020-11-21 Thread ling miao
Now we often just drop the partition and go directly to clean up the files under trash However, Doris continues to keep the catalog as you said, will there be no problem? Ling Miao 陈明雨 于2020年11月21日周六 下午11:12写道: > First, after table is dropped, it will stay in Catalog Recycle bin for a > while,

Re: Support for forced drop of user data

2020-11-20 Thread Xu,Yang(AIDP)
Good idea. I think it is very useful for user. 在 2020/11/20 下午6:11,“ling miao” 写入: Hi folks, Currently, when user drop table or partition, Doris will first put the data in the trash directory, and then wait for the trash directory to be emptied. But during operation and

Support for forced drop of user data

2020-11-20 Thread ling miao
Hi folks, Currently, when user drop table or partition, Doris will first put the data in the trash directory, and then wait for the trash directory to be emptied. But during operation and maintenance, I found that when I need to clean up cluster data to release disk resources, I need the followin