Chris Slotterback created FLINK-19460:
-----------------------------------------

             Summary: AWS Kinesis Producer EXACTLY_ONCE semantic 
                 Key: FLINK-19460
                 URL: https://issues.apache.org/jira/browse/FLINK-19460
             Project: Flink
          Issue Type: Improvement
            Reporter: Chris Slotterback


Wanted to create a ticket to discuss adding EXACTLY_ONCE semantics to the AWS 
Kinesis producer, similar to how the Kafka producer functions.

The kinesis producer would need to be modified to participate in commits, per 
kinesis:
{noformat}
Each PutRecords request can support up to 500 records. Each record in the 
request can be as large as 1 MiB, up to a limit of 5 MiB for the entire 
request, including partition keys. Each shard can support writes up to 1,000 
records per second, up to a maximum data write total of 1 MiB per second.
{noformat}

Order is not guaranteed when writing to kinesis. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to