Hi >From the given description, you use RocksDBStateBackend, and will always open 20k files in one machine, and app suddenly opened 35K files than crashed. Could you please share what are the opened files? and what the exception (given the full taskmanager.log maybe helpful)
Best, Congxian ApoorvK <apoorv.upadh...@razorpay.com> 于2020年2月11日周二 下午5:22写道： > flink app is crashing due to "too many file opens" issue , currently app is > having 300 operator and 60GB is the state size. suddenly app is opening 35k > around files which was 20k few weeks before, hence app is crashing, I have > updated the machine as well as yarn limit to 60k hoping it will not crash > again. > Please suggest if there is any alternative solution for this > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >
