Hi Qing, I’m afraid CheckpointedFunction cannot be applied to the new source API, but could you share the abstractions of your source implementation, like which component a split maps to etc.? Maybe we can try to do some workarounds.
Best, Qingsheng > On May 30, 2022, at 20:09, Qing Lim <q....@mwam.com> wrote: > > Hi, is it possible to use CheckpointedFunction with the new Source api? (The > one in package org.apache.flink.api.connector.source) > > My use case: > > I have a custom source that emit individual nodes update from a tree, and I > wish to create a stream of the whole Tree snapshots, so I will have to > accumulate all updates and keep it as state. In addition to this, I wish to > expose this functionality as a library to my organization. > > The custom source is written using the new Source api, I wonder if we can > attach state to it? > > Kind regards > > This e-mail and any attachments are confidential to the addressee(s) and may > contain information that is legally privileged and/or confidential. If you > are not the intended recipient of this e-mail you are hereby notified that > any dissemination, distribution, or copying of its content is strictly > prohibited. If you have received this message in error, please notify the > sender by return e-mail and destroy the message and all copies in your > possession. > > > To find out more details about how we may collect, use and share your > personal information, please see https://www.mwam.com/privacy-policy. This > includes details of how calls you make to us may be recorded in order for us > to comply with our legal and regulatory obligations. > > > To the extent that the contents of this email constitutes a financial > promotion, please note that it is issued only to and/or directed only at > persons who are professional clients or eligible counterparties as defined in > the FCA Rules. Any investment products or services described in this email > are available only to professional clients and eligible counterparties. > Persons who are not professional clients or eligible counterparties should > not rely or act on the contents of this email. > > > Marshall Wace LLP is authorised and regulated by the Financial Conduct > Authority. Marshall Wace LLP is a limited liability partnership registered in > England and Wales with registered number OC302228 and registered office at > George House, 131 Sloane Street, London, SW1X 9AT. If you are receiving this > e-mail as a client, or an investor in an investment vehicle, managed or > advised by Marshall Wace North America L.P., the sender of this e-mail is > communicating with you in the sender's capacity as an associated or related > person of Marshall Wace North America L.P. ("MWNA"), which is registered with > the US Securities and Exchange Commission ("SEC") as an investment adviser. > Registration with the SEC does not imply that MWNA or its employees possess a > certain level of skill or training. >
