You’re welcome. Unfortunately I am not aware about a such use case before
Piotrek
> On 20 Oct 2017, at 13:47, Rinat wrote:
>
> Piotrek, thanks for your reply.
>
> Yes, now I’m looking for the most suitable way to extend BucketingSink
> functionality, to handle moments of moving the file into
Piotrek, thanks for your reply.
Yes, now I’m looking for the most suitable way to extend BucketingSink
functionality, to handle moments of moving the file into final state.
I thought, that maybe someone has already implemented such thing or knows any
other approaches that will help me to not cop
Hi,
Maybe you can just list files in your basePath and filter out those that have
inProgress or pending suffixes?
I think you could wrap/implement your own Bucketer and track all the paths that
it returns. However some of those might be pending or in progress files that
will be committed in t
Hi All !
I’m trying to create a meta-info file, that contains link to file, created by
Flink BucketingSink.
At first I was trying to implement my own
org.apache.flink.streaming.connectors.fs.Writer, that creates a meta-file on
close method call.
But I understood, that it’s not completely right
