Re: Protection against huge values in RocksDB List State

2020-05-19 Thread Congxian Qiu
ce as that is on-heap and >>> lightweight. >>> >>> Best >>> Yun Tang >>> -- >>> *From:* Robin Cassan >>> *Sent:* Friday, May 15, 2020 20:59 >>> *To:* Yun Tang >>> *Cc:* user >>>

Re: Protection against huge values in RocksDB List State

2020-05-19 Thread Robin Cassan
u do not have >> many key-by keys, operator state is a good choice as that is on-heap and >> lightweight. >> >> Best >> Yun Tang >> -- >> *From:* Robin Cassan >> *Sent:* Friday, May 15, 2020 20:59 >> *To:* Yun Tang >

Re: Protection against huge values in RocksDB List State

2020-05-16 Thread Congxian Qiu
ent:* Friday, May 15, 2020 20:59 > *To:* Yun Tang > *Cc:* user > *Subject:* Re: Protection against huge values in RocksDB List State > > Hi Yun, thanks for your answer! And sorry I didn't see this limitation > from the documentation, makes sense! > In our case, we are mer

Re: Protection against huge values in RocksDB List State

2020-05-15 Thread Yun Tang
Yun Tang From: Robin Cassan Sent: Friday, May 15, 2020 20:59 To: Yun Tang Cc: user Subject: Re: Protection against huge values in RocksDB List State Hi Yun, thanks for your answer! And sorry I didn't see this limitation from the documentation, makes sens

Re: Protection against huge values in RocksDB List State

2020-05-15 Thread Robin Cassan
040/java/src/main/java/org/rocksdb/RocksDB.java#L1382 > > Best > Yun Tang > -- > *From:* Robin Cassan > *Sent:* Friday, May 15, 2020 0:37 > *To:* user > *Subject:* Protection against huge values in RocksDB List State > > Hi all! &

Re: Protection against huge values in RocksDB List State

2020-05-14 Thread Yun Tang
/50d63a2af01a46dd938dc1b717067339c92da040/java/src/main/java/org/rocksdb/RocksDB.java#L1382 Best Yun Tang From: Robin Cassan Sent: Friday, May 15, 2020 0:37 To: user Subject: Protection against huge values in RocksDB List State Hi all! I cannot seem to find any

Protection against huge values in RocksDB List State

2020-05-14 Thread Robin Cassan
Hi all! I cannot seem to find any setting to limit the number of records appended in a RocksDBListState that is used when we use SessionWindows with a ProcessFunction. It seems that, for each incoming element, the new element will be appended to the value with the RocksDB `merge` operator, without