I'm working on such a thing.
It's in early stages and needs a lot more work.
I'm open to collaborating.
https://github.com/datakaveri/iudx-adaptor-framework
On Tue, 7 Jun 2022 at 23:49, sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Flink Community,
>
> can someone point me to
may still need the workaround method as Arvid points
> out,
> that we coordinate all the sources to wait till a final checkpoint is
> completed
> before exit.
>
> Best,
> yun
>
>
> ----------Original Mail --
> *Sender:*Rakshit Ramesh
&g
create a checkpoint
if my entire bounded job finishes before the checkpoint interval?
On Tue, 13 Jul 2021 at 17:58, Rakshit Ramesh
wrote:
> That's great news!
> Thanks.
>
> On Tue, 13 Jul 2021 at 14:17, Arvid Heise wrote:
>
>> The only known workaround is to provide your ow
ources with the old
> SourceFunction interface requires some external tool.
>
> FLIP-147 is targeted for 1.14 in August.
>
> On Sat, Jul 10, 2021 at 7:46 PM Rakshit Ramesh <
> rakshit.ram...@datakaveri.org> wrote:
>
>> Hi Arvid,
>> Since I'm trying to save
ce/display/FLINK/FLIP-147%3A+Support+Checkpoints+After+Tasks+Finished
Is there any userland workaround for this?
Thanks!
On Thu, 8 Jul 2021 at 11:52, Rakshit Ramesh
wrote:
> Yes! I was only worried about the jobid changing and the checkpoint being
> un-referenceable.
> But since I can
i/#starting-a-job-from-a-savepoint
>
> On Thu, Jul 8, 2021 at 6:31 AM Rakshit Ramesh <
> rakshit.ram...@datakaveri.org> wrote:
>
>> Sorry for being a little vague there.
>> I want to create a Savepoint from a DataStream right before the job is
>> finished o
o create the initial state of a datastream
> application.
>
> For your second question, yes retained checkpoints outlive the job in all
> regards. It's the users responsibility to eventually clean that up.
>
>
>
> On Wed, Jul 7, 2021 at 6:56 PM Rakshit Ramesh <
> ra
s/flink/flink-docs-release-1.13/docs/ops/state/checkpoints/#retained-checkpoints
>
> On Mon, Jul 5, 2021 at 5:56 PM Rakshit Ramesh <
> rakshit.ram...@datakaveri.org> wrote:
>
>> I'm trying to bootstrap state into a KeyedProcessFunction equivalent that
>>
I'm trying to bootstrap state into a KeyedProcessFunction equivalent that
takes in
a DataStream but I'm unable to find a reference for the same.
I found this gist
https://gist.github.com/alpinegizmo/ff3d2e748287853c88f21259830b29cf
But it seems to only apply for DataSet.
My usecase is to manually t
