Hi Beam community, I have a streaming app that writes every hour’s data to a folder named with this hour. With Flink (for example), we can leverage “Bucketing File Sink”: https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/connectors/filesystem_sink.html
However I am not seeing Beam FileIO’s writeDynamic API supports specifying different output paths for different groups: https://beam.apache.org/releases/javadoc/2.28.0/index.html?org/apache/beam/sdk/io/FileIO.html Seems like writeDynamic() only supports specifying different naming strategy. How can I specify different hourly based output paths for hourly data with Beam writeDynamic? Please advise. Thanks!
