Hi, flink community!
I have below scenario in medical field - record is frequently modified and must not be lost - when record is modified the results previously produced by this record should also be modified. e.g. table A, B, C. A join B and result is table D, A join C and result is table E. When record a1 in table A changes to a1’, corresponding results in table D and E should also be changed. I consider to use flink + kafka dynamic table to solve this. But there’s a potential problem: - records in medical field must not be lost. - kafka event is append-only, and kafka dynamic table event( INSERT / RETRACT / DELETE) will generate new kafka record(even tombstone), the volume of kafka topic is unlimited and cannot be expired. is there any solution for this problem? please help to offer some advices. thank you very much! Best Regards!
