Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-17 Thread Piotr Nowojski
t as possible, which > also need the timer stored in RocksDB to not affect the sync part of > checkpoint. > > Best > Yun Tang > From: Andrey Zagrebin mailto:azagre...@apache.org>> > Sent: Friday, January 17, 2020 0:07 > To: Stephan Ewen mailto:se...@apache.org>>

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-17 Thread Congxian Qiu
ored in RocksDB to not affect the sync part of >>> checkpoint. >>> >>> Best >>> Yun Tang >>> -- >>> *From:* Andrey Zagrebin >>> *Sent:* Friday, January 17, 2020 0:07 >>> *To:* Stephan Ewen >

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Biao Liu
Tang >> ------ >> *From:* Andrey Zagrebin >> *Sent:* Friday, January 17, 2020 0:07 >> *To:* Stephan Ewen >> *Cc:* dev ; user >> *Subject:* Re: [DISCUSS] Change default for RocksDB timers: Java Heap => >> in RocksDB >> &g

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Jingsong Li
not affect the sync part of > checkpoint. > > Best > Yun Tang > -- > *From:* Andrey Zagrebin > *Sent:* Friday, January 17, 2020 0:07 > *To:* Stephan Ewen > *Cc:* dev ; user > *Subject:* Re: [DISCUSS] Change default for RocksDB timers: Java Heap =&

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Yun Tang
: Andrey Zagrebin Sent: Friday, January 17, 2020 0:07 To: Stephan Ewen Cc: dev ; user Subject: Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB Hi Stephan, Thanks for starting this discussion. I am +1 for this change. In general, number of timer state keys can have the s

Re: [DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Andrey Zagrebin
Hi Stephan, Thanks for starting this discussion. I am +1 for this change. In general, number of timer state keys can have the same order as number of main state keys. So if RocksDB is used for main state for scalability, it makes sense to have timers there as well unless timers are used for only v

[DISCUSS] Change default for RocksDB timers: Java Heap => in RocksDB

2020-01-16 Thread Stephan Ewen
Hi all! I would suggest a change of the current default for timers. A bit of background: - Timers (for windows, process functions, etc.) are state that is managed and checkpointed as well. - When using the MemoryStateBackend and the FsStateBackend, timers are kept on the JVM heap, like regula