Hi there,

I am using flink 1.11 and cdc connector 1.1 to stream changes from a
postgres table. I see the WAL consumption is increasing gradually even
though the writes to tables are very less.

I am using AWS RDS, from [1] I understand that setting the parameter
heartbeat.interval.ms solves this WAL consumption issue. However, I tried
setting this with no success.

I found a bug [2] which seems to be taking care of committing the lsn for
the db to release the wal. however this seems to be only fixed in 1.3 which
is compatible with flink 1.12.1. Is there any way this can be fixed in
1.11.1. Since I am using EMR and the latest flink version available is 1.11.


[1] - https://debezium.io/documentation/reference/connectors/postgresql.html
[2] - https://github.com/ververica/flink-cdc-connectors/issues/97

Thanks.
Hemant

Reply via email to