Hi,Alexander

When Flink job deployed on Native k8s, taskmanager is a Pod.The data directory 
size of a single container is limited in our company.Are there any idea to deal 
with this ?




Best,
Hjw


 




------------------ ???????? ------------------
??????:                                                                         
                                               "Alexander Fedulov"              
                                                                      
<a...@deltastream.io&gt;;
????????:&nbsp;2022??9??6??(??????) ????3:19
??????:&nbsp;"hjw"<1010445...@qq.com&gt;;
????:&nbsp;"user"<user@flink.apache.org&gt;;
????:&nbsp;Re: Where will the state be stored in the taskmanager when using 
rocksdbstatebend??



https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-backend-rocksdb-localdir
Make sure to use a local SSD disk (not NFS/EBS).


Best,
Alexander Fedulov


On Mon, Sep 5, 2022 at 7:24 PM hjw <1010445...@qq.com&gt; wrote:

The EmbeddedRocksDBStateBackend holds in-flight data in 
a&nbsp;RocksDB&nbsp;database that is (per default) stored in the TaskManager 
local data directories.
Which path does local data directories store RocksDB database in 
TaskManager&nbsp;point to in operating system?
If the job state is very large, I think I should &nbsp;take some measures to 
deal with it.(mount a volume for local data directories store RocksDB database 
etc...)


thx.



Best,
Hjw

Reply via email to