Re: state inside functions

2020-12-17 Thread Timo Walther
Hi, if you would like to dynamically adjust configuration of your streaming job, it might be a good approach to consider the configuration as a stream itself. The connect() API can be used to connect a main stream with a control stream. In any case the configuration should be persisted in st

Re: state inside functions

2020-12-16 Thread vishalovercome
When running in HA mode or taking savepoints, if we pass configuration as constructor arguments, then it seems as though changing configuration at a later time doesn't work as it uses state to restore older configuration. How can we pass configuration while having the flexibility to change the valu

Re: state inside functions

2017-08-04 Thread Fabian Hueske
Hi Peter, function objects (such as an instance of a class that extends MapFunction) that are used to construct a plan are serialized using Java serialization and shipped to the workers for execution. Therefore, function classes must be Serializable. In general it is recommended to configure funct

Re: state inside functions

2017-08-03 Thread Nico Kruber
Hi Peter, there's no need to worry about transient members as the operator itself is not serialized - only the state itself, depending on the state back-end. If you want your state to be recovered by checkpoints you should implement the open() method and initialise your state there as in your po