Re: Pojo state schema evolution not working correctly

2022-08-09 Thread tao xiao
Not exactly reproduciable. I cannot reproduce the problem in a test environment with the same setting. This is only reproducible in PRD. I guess it has something to do with the state itself. Where you added the debugging log ? In RocksDBListState#get() ? > I added the debug log in *org.apache.fli

Re: Pojo state schema evolution not working correctly

2022-08-07 Thread Hangxiang Yu
Hi, IIUC, Conditions to reproduce it are: 1. Using RocksDBStateBackend with incremental strategy 2. Using ListState in the stateful operator 3. enabling TTL with cleanupInRocksdbCompactFilter 4. adding a field to make the job trigger schema evolution Then the exception will be thrown, right? As fo

Pojo state schema evolution not working correctly

2022-08-03 Thread tao xiao
Hi team, I encountered below exception after I added a new field to a POJO used in list state and resumed the job from checkpoint > [error occurred during error reporting , id > 0xb]\n","stream":"stdout","time": > \n","stream":"stdout","time": > #\n","stream":"stdout","time": > # http://bugre