Hi Team, Following is the pipeline Kafka => Processing => SNS Topics .
Flink Does not provide a SNS connector out of the box. a) I implemented the above by using AWS SDK and published the messages in the Map operator itself. The pipeline is working well. I see messages flowing to SNS topics. b) Another approach is that I could write a custom sink function and still publish to SNS using SDK in this stage. Questions 1) What would be the primary difference between approach a) and b). Is there any significant advantage of one over the other ? 2) Would at least once guarantee be confirmed if we follow the above approach? 3) Would there be any significant disadvantages(rather what we need to be careful ) of writing our custom sink functions ? Thanks, Prasanna.
