On 15.09.20 09:55, Dawid Wysakowicz wrote:
BTW Let's not forget about Piotr's comment. I think we could add the isAvailable or similar method to the Writer interface in the FLIP.
I'm not so sure about this, the sinks I'm aware of would not be able to implement this method: Kafka doesn't have this, I didn't see it in the Iceberg interfaces, and HDFS/S3 also don't have it.
I can see why from a systems perspective it would be useful to have, of course.
Best, Aljoscha
