Hi, I'm using StreamingFileSink to collect records into avro files. Inside of the BulkWriter implementation, I have to do some operations (such as dynamic schema lookup) which I want to record metrics about. However, the BulkWriter API, as it is defined, does not accept a RuntimeContext or MetricsGroup from the StreamingFileSink, so I seemingly don't have access to the metrics API. And it doesn't look like StreamingFileSink is particularly extensible. What alternatives do I have besides forking StreamingFileSink, or bypassing the Flink metrics API entirely?
Thanks, John