Hi Jacob, Could you specify which StateBackend you are using?
The reason I am asking is that, from the documentation in [1]: "Note that if you use the MemoryStateBackend, metadata and savepoint state will be stored in the _metadata file. Since it is self-contained, you may move the file and restore from any location." I am also cc'ing Gordon who may know a bit more about state formats. I hope this helps, Kostas [1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/ops/state/savepoints.html On Wed, Mar 4, 2020 at 1:25 AM Jacob Sevart <jsev...@uber.com> wrote: > > Per the documentation: > > "The meta data file of a Savepoint contains (primarily) pointers to all files > on stable storage that are part of the Savepoint, in form of absolute paths." > > I somehow have a _metadata file that's 1.9GB. Running strings on it I find > 962 strings, most of which look like HDFS paths, which leaves a lot of that > file-size unexplained. What else is in there, and how exactly could this be > happening? > > We're running 1.6. > > Jacob
