Usamah Jassat created FLINK-32394:
-------------------------------------

             Summary: Init.pos is partially stored in connector state
                 Key: FLINK-32394
                 URL: https://issues.apache.org/jira/browse/FLINK-32394
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kinesis
    Affects Versions: 1.17.1
            Reporter: Usamah Jassat


The Init.pos is partially stored in connector state which can lead to 
inconsistencies further down the line in idle streams. In particularly an issue 
arises when the init.pos is AT_TIMESTAMP, and the init.pos is later changed to 
TRIM_HORIZON.

The issue is that AT_TIMESTAMP is stored in the connector state but the 
timestamp itself isn't stored in the state. If a stream is idle and the 
init.pos is changed to TRIM_HORIZON then the connector attempts to read from 
AT_TIMSTAMP (due to it being stored in state) attempting to get the timestamp 
from the properties however it is no longer there as the init.pos property is 
not TRIM_HORIZON.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to