Sorry, that was a red herring. Checkpointing was not getting triggered because we never enabled it.
Our application is inherently restartable because we can use our own output to rebuild state. All that is working fine for us - including restart semantics - without having to worry about upgrading flink topology. Once we have something in production, will be happy to share more details in flink forums. We are very pleased with flink so far. Some paradigms are messy (scale of select for e.g), but we are very pleased overall !! On Wed, Feb 15, 2017 at 7:54 PM vinay patil <vinay18.pa...@gmail.com> wrote: > Hi Abhishek, > > You can disable checkpointing by not commenting env.enableCheckpointing > > What do you mean by "We are trying to do application level checkpointing" > > Regards, > Vinay Patil > > On Thu, Feb 16, 2017 at 12:42 AM, abhishekrs [via Apache Flink User > Mailing List archive.] <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=11650&i=0>> wrote: > > Is it possible to set state backend as RocksDB without asking it to > checkpoint? > > We are trying to do application level checkpointing (since it gives us > better flexibility to upgrade our flink pipeline and also restore state in > a application specific upgrade friendly way). So we don’t really need > rocksDB to do any checkpointing. Moreover, we also observed that there is > 20s stall every hour that seems to correlate with rocksDB wanting to > checkpoint. > > Will the following work (effectively disable checkpointing)? > > new RocksDBStateBackend("file:///dev/null") > > > Or is there a better way? > > -Abhishek- > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/rocksdb-without-checkpointing-tp11645.html > To start a new topic under Apache Flink User Mailing List archive., email > [hidden > email] <http:///user/SendEmail.jtp?type=node&node=11650&i=1> > To unsubscribe from Apache Flink User Mailing List archive., click here. > NAML > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > > > > ------------------------------ > View this message in context: Re: rocksdb without checkpointing > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/rocksdb-without-checkpointing-tp11645p11650.html> > Sent from the Apache Flink User Mailing List archive. mailing list archive > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/> at > Nabble.com. >
