We use the StreamingFileSink. An option to expire files after some time period would certainly be welcome. (I could probably figure out a way to do this from the S3 admin UI too though)
On Sat, Oct 10, 2020 at 10:45 PM Padarn Wilson <pad...@gmail.com> wrote: > Hi Flink Users, > > We need to expose some additional options for the s3 hadoop filesystem: > Specifically, we want to set object tagging and lifecycle. This would be a > fairly easy change and we initially thought to create a new Filsystem with > very minor changes to allow this. > > However then I wondered, would others use this? If it something that is > worth raising as a Flink issue and then contributing back upstream. > > Any others who would like to be able to set object tags for the s3 > filesystem? > > Cheers, > Padarn > -- Dan Diephouse @dandiep