We added a new sink to the job graph and redeployed - but the new sink did not receive any records, as though it were not connected to the graph (possible it was a code bug, but I was trying to understand if this make sense given the implementation)
re-including mailing list, excluded by accident Padarn On Wed, Jun 16, 2021 at 10:59 AM Yun Gao <yungao...@aliyun.com> wrote: > Hi Padarn, > > Sorry I might not fully got the mean of new topology was ignored. > Do you mean the topology is not the same as expected ? > > Best, > Yun > > > ------------------Original Mail ------------------ > *Sender:*Padarn Wilson <pad...@gmail.com> > *Send Date:*Tue Jun 15 21:45:17 2021 > *Recipients:*Yun Gao <yungao...@aliyun.com> > *Subject:*Re: Upgrade job topology in checkpoint > >> Thanks Yun, >> >> Yes we do indeed retain checkpoints, but we were unable to restore with >> new topology from them for some reason. It seemed like the new topology was >> ignored totally which was surprising to me. >> >> Padarn >> >> On Tue, Jun 15, 2021 at 7:35 PM Yun Gao <yungao...@aliyun.com> wrote: >> >>> Hi Padarn, >>> >>> By default the checkpoint would be disposed when the job finished or >>> failed, >>> they would be retained only when explicitly required [1]. >>> >>> From the implementation perspective I think users could be able to >>> change topology when restored >>> from external checkpoint, but I think Flink would not guarantee this >>> functionality. >>> >>> Best, >>> Yun >>> >>> >>> [1] >>> https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/state/checkpoints/#retained-checkpoints >>> >>> ------------------Original Mail ------------------ >>> *Sender:*Padarn Wilson <pad...@gmail.com> >>> *Send Date:*Sat Jun 12 12:19:56 2021 >>> *Recipients:*user <user@flink.apache.org> >>> *Subject:*Upgrade job topology in checkpoint >>> >>>> Hi all, >>>> >>>> I'm looking for some clarity about changing job topology as described >>>> here: >>>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/upgrading/#application-topology >>>> >>>> My question is simple: Does this only apply to savepoints? Or can it >>>> also work for checkpoints? (also why if not) >>>> >>>> Cheers, >>>> Padarn >>>> >>>
