Hi, I would like to discuss the support for micro-batch streaming in Iceberg.
First of all, do we think micro-batch use-cases are appropriate for Iceberg? What do we consider as "slow-moving data"? Do we want to support batch intervals of 30s? What about intervals of 1m/2m/5m? The latter seems doable as we already have FastAppend and other optimizations in place. In particular, I am interested in Spark structured streaming. I have a few things I want to discuss, but let's confirm it is appropriate for Iceberg. Thanks, Anton
