We tried with 1.14.0, unfortunately we still run into the issue. Any thoughts or suggestions?
On Mon, Oct 4, 2021 at 9:09 AM Kevin Lam <kevin....@shopify.com> wrote: > Hi Fabian, > > We're using our own image built from the official Flink docker image, so > we should have the code to use jemalloc in the docker entrypoint. > > I'm going to give 1.14 a try and will let you know how it goes. > > On Mon, Oct 4, 2021 at 8:29 AM Fabian Paul <fabianp...@ververica.com> > wrote: > >> Hi Kevin, >> >> We bumped the RocksDb version with Flink 1.14 which we thought increases >> the memory control [1]. In the past we also saw problems with the allocator >> used of the OS. We switched to use jemalloc within our docker images which >> has a better memory fragmentation [2]. Are you using the official Flink >> docker image or did you build your own? >> >> I am also pulling in yun tang who is more familiar with Flink’s state >> backend. Maybe he has an immediate idea about your problem. >> >> Best, >> Fabian >> >> >> [1] https://issues.apache.org/jira/browse/FLINK-14482 >> [2] >> https://lists.apache.org/thread.html/r596a19f8cf7278bcf9e30c3060cf00562677d4be072050444a5caf99%40%3Cdev.flink.apache.org%3E >> <https://lists.apache.org/thread.html/r596a19f8cf7278bcf9e30c3060cf00562677d4be072050444a5caf99@%3Cdev.flink.apache.org%3E> >> >> >>
