Good to hear that. On which machine you are running your Flink Job, also what are the configurations you have used for RocksDB
I am currently running on C3.4xlarge with predefined option set to FLASH_SSD_OPTIMIZED Regards, Vinay Patil On Thu, Feb 16, 2017 at 10:31 AM, abhishekrs [via Apache Flink User Mailing List archive.] <ml-node+s2336050n11653...@n4.nabble.com> wrote: > Sorry, that was a red herring. Checkpointing was not getting triggered > because we never enabled it. > > Our application is inherently restartable because we can use our own > output to rebuild state. All that is working fine for us - including > restart semantics - without having to worry about upgrading flink topology. > Once we have something in production, will be happy to share more details > in flink forums. We are very pleased with flink so far. Some paradigms are > messy (scale of select for e.g), but we are very pleased overall !! > > > On Wed, Feb 15, 2017 at 7:54 PM vinay patil <[hidden email] > <http:///user/SendEmail.jtp?type=node&node=11653&i=0>> wrote: > >> Hi Abhishek, >> >> You can disable checkpointing by not commenting env.enableCheckpointing >> >> What do you mean by "We are trying to do application level checkpointing" >> >> Regards, >> Vinay Patil >> >> On Thu, Feb 16, 2017 at 12:42 AM, abhishekrs [via Apache Flink User >> Mailing List archive.] <[hidden email] >> <http:///user/SendEmail.jtp?type=node&node=11650&i=0>> wrote: >> >> Is it possible to set state backend as RocksDB without asking it to >> checkpoint? >> >> We are trying to do application level checkpointing (since it gives us >> better flexibility to upgrade our flink pipeline and also restore state in >> a application specific upgrade friendly way). So we don’t really need >> rocksDB to do any checkpointing. Moreover, we also observed that there is >> 20s stall every hour that seems to correlate with rocksDB wanting to >> checkpoint. >> >> Will the following work (effectively disable checkpointing)? >> >> new RocksDBStateBackend("file:///dev/null") >> >> >> Or is there a better way? >> >> -Abhishek- >> >> >> ------------------------------ >> If you reply to this email, your message will be added to the discussion >> below: >> http://apache-flink-user-mailing-list-archive.2336050. >> n4.nabble.com/rocksdb-without-checkpointing-tp11645.html >> To start a new topic under Apache Flink User Mailing List archive., email >> [hidden >> email] <http:///user/SendEmail.jtp?type=node&node=11650&i=1> >> To unsubscribe from Apache Flink User Mailing List archive., click here. >> NAML >> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> >> >> >> >> ------------------------------ >> View this message in context: Re: rocksdb without checkpointing >> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/rocksdb-without-checkpointing-tp11645p11650.html> >> Sent from the Apache Flink User Mailing List archive. mailing list >> archive >> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/> >> at Nabble.com. >> > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > http://apache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/rocksdb-without-checkpointing-tp11645p11653.html > To start a new topic under Apache Flink User Mailing List archive., email > ml-node+s2336050n1...@n4.nabble.com > To unsubscribe from Apache Flink User Mailing List archive., click here > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=dmluYXkxOC5wYXRpbEBnbWFpbC5jb218MXwxODExMDE2NjAx> > . > NAML > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/rocksdb-without-checkpointing-tp11645p11655.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
