Re: Activate bloom filter in RocksDB State Backend via Flink configuration

2021-05-07 Thread maver1ck
Hi Jun Qin, Do you have any example OptionsFactory for Bloom Filter. I did experiment and change Options from FLASH_SSD_OPTIMIZED to SPINNING_DISK_OPTIMIZED_HIGH_MEM. This gives me 2x better performance on NVME disk. I think the reason is that I'm doing a lot of reads and SPINNING_DISK_OPTIMIZED_H

Re: Activate bloom filter in RocksDB State Backend via Flink configuration

2021-02-09 Thread Jun Qin
un Tang > > From: Till Rohrmann > Sent: Monday, February 8, 2021 17:06 > To: dev > Subject: Re: Activate bloom filter in RocksDB State Backend via Flink > configuration > > Hi Jun, > > Making things easier to use and configure

Re: Activate bloom filter in RocksDB State Backend via Flink configuration

2021-02-08 Thread Yun Tang
Tang From: Till Rohrmann Sent: Monday, February 8, 2021 17:06 To: dev Subject: Re: Activate bloom filter in RocksDB State Backend via Flink configuration Hi Jun, Making things easier to use and configure is a good idea. Hence, +1 for this proposal. Maybe create a JIRA ticket fo

Re: Activate bloom filter in RocksDB State Backend via Flink configuration

2021-02-08 Thread Till Rohrmann
Hi Jun, Making things easier to use and configure is a good idea. Hence, +1 for this proposal. Maybe create a JIRA ticket for it. For the concrete default values it would be nice to hear the opinion of a RocksDB expert. Cheers, Till On Sun, Feb 7, 2021 at 7:23 PM Jun Qin wrote: > Hi, > > Acti