Hi Seth, Sorry for the confusion. I mean currently we need to know the operator id, state name and the state type (eg. ListState, MapState) beforehand to get the states. Is possible that we can perform a scan to get all existing operator ids or state names in the savepoint? It would be good to know what states are in the savepoint before we get to a specific state.
For example, if we analyze a savepoint created weeks ago, and the corresponding job has been modified since that, say, moved from KafkaSink to KinesisSink, so we are not sure whether we have the Kafka sink states or the Kinesis sink states in the savepoint and might need to try twice to get the right one. I’m not familiar with the savepoint formats, so pardon me if it’s a dumb question. Best, Paul Lam > 在 2019年5月30日，11:09，Seth Wiesman <sjwies...@gmail.com> 写道： > > Hi Paul, > > I’m not following, could you provide and example of the kind of operation > your describing? > > Seth > >> On May 29, 2019, at 7:37 PM, Paul Lam <paullin3...@gmail.com> wrote: >> >> Hi Seth, >> >> +1 from my side. >> >> I was wondering if we can add a reader method to provide a full view of the >> states instead of the state of a specific operator? It would be helpful when >> there is some unrestored states of a previously removed operator in the >> savepoint. >> >> Best, >> Paul Lam >> >>> 在 2019年5月30日，09:55，vino yang <yanghua1...@gmail.com> 写道： >>> >>> Hi Seth, >>> >>> Glad to see this FLIP, big +1 for this feature! >>> >>> Best, >>> Vino >>> >>> Seth Wiesman <sjwies...@gmail.com> 于2019年5月30日周四 上午7:14写道： >>> >>>> Hey Everyone! >>>> >>>> Gordon and I have been discussing adding a savepoint connector to flink >>>> for reading, writing and modifying savepoints. >>>> >>>> This is useful for: >>>> >>>> Analyzing state for interesting patterns >>>> Troubleshooting or auditing jobs by checking for discrepancies in state >>>> Bootstrapping state for new applications >>>> Modifying savepoints such as: >>>> Changing max parallelism >>>> Making breaking schema changes >>>> Correcting invalid state >>>> >>>> We are looking forward to your feedback! >>>> >>>> This is the FLIP: >>>> >>>> >>>> https://cwiki.apache.org/confluence/display/FLINK/FLIP-43%3A+Savepoint+Connector >>>> >>>> Seth >>>> >>>> >>>> >>
