liuzhixin created FLINK-9238:
--------------------------------

             Summary: There are some questions about BuckeingSink when sinking 
data to S3. 
                 Key: FLINK-9238
                 URL: https://issues.apache.org/jira/browse/FLINK-9238
             Project: Flink
          Issue Type: Bug
          Components: filesystem-connector
    Affects Versions: 1.4.2
            Reporter: liuzhixin
             Fix For: 1.4.2


When flink is sinking data to S3,  there are some IOExceptions from fs. For 
some reasons I throw the exceptions, then the job will restart.  
Sometimes,fs.rename fails and there are pending part files which are from the 
last job and finished part files, but the count  of records is not the 
same,slight difference. The "Exactly once" should not be the results.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to