Hi all, I was wondering how to cancel a task that is enqueued by the callAsync() method, the one that takes in a time interval. For example, the KafkaSource uses this for topic partition discovery. It would be straightforward if the API returned the underlying future so that a process can cancel it.
For Kafka, the enumerator shutdown seems to be unclean since it only closes the admin client and kafka consumer but not the topic partition discovery task. Furthermore, exceptions from that task will cause job failure and can potentially happen if the task is still running with the admin client closed. How can we address this? Best, Mason
