Dear All,
In a Flink job using statementSet, I have two DMLs for index calculation. I
made a modification to one of the DMLs, changing the group keys from
"distinct_id, $city, $province, window_start, window_end" to "distinct_id,
window_start, window_end". When attempting to restore the job fro
{
"emoji": "👍",
"version": 1
}
Just a little update on this. We've made our first POC with the redesigned
approach and the numbers are promising :)
It still requires huge efforts in development/correctness/performance
perspective but seems like we have something in the pocket.
Test data: 256Mb state file with a single operator