Re: Updating Closure Variables

2020-04-27 Thread Yun Gao
Hi Senthil, I think you are right that you cannot update closure variables directly and expect them to show up at the workers. If the variable values are read from S3 files, I think currently you will need to define a source explicitly to read the latest value of the file. Wh

Updating Closure Variables

2020-04-27 Thread Senthil Kumar
Hello Flink Community! We have a flink streaming application with a particular use case where a closure variable Set is used in a filter function. Currently, the variable is set at startup time. It’s populated from an S3 location, where several files exist (we consume the one with the last upd