Hi Prasanna,
(General remark: For such questions, please send the email only to
user@flink.apache.org. There's no need to email to dev@ as well.)
I don't think Flink can do much if the library you are using isn't throwing
exceptions. Maybe the library has other means of error reporting (a
callbac
Thanks for the Reply Yun,
I see that when I publish the messages to SNS from map operator, in case of
any errors I find the checkpointing mechanism takes care of "no data loss".
One scenario I could not replicate is that, the method from SDK unable to
send messages to SNS but remains silent not t
Hi Prasanna,
1) Semantically both a) and b) would be Ok. If the Custom sink could be
chained with the map operator (I assume the map operator is the "Processing" in
the graph), there should be also no much difference physically, if they could
not chain, then writting a custom sink would caus
Hi Team,
Following is the pipeline
Kafka => Processing => SNS Topics .
Flink Does not provide a SNS connector out of the box.
a) I implemented the above by using AWS SDK and published the messages in
the Map operator itself.
The pipeline is working well. I see messages flowing to SNS topics.
b)
