Hi, Ryan: Yes, but as I have stated in the doc, this may make simple ingestion jobs more difficult to maintain. What's your opinion about the second approach?
On Mon, Dec 11, 2023 at 11:16 AM OpenInx <open...@gmail.com> wrote: > https://github.com/apache/iceberg/pull/2680/files > > On Mon, Dec 11, 2023 at 11:15 AM OpenInx <open...@gmail.com> wrote: > >> Just provided a little context: there was a stale PR which was trying to >> maintain the insertedRowMap into RocksDB.. >> >> On Sat, Dec 9, 2023 at 1:52 AM Ryan Blue <b...@tabular.io> wrote: >> >>> Thanks, Renjie! >>> >>> The option to use Flink's state tracking system seems like a good idea >>> to me. >>> >>> On Thu, Dec 7, 2023 at 8:19 PM Renjie Liu <liurenjie2...@gmail.com> >>> wrote: >>> >>>> Hi: >>>> I want to raise a discussion about controlling flink's upsert sink's >>>> memory usage: >>>> >>>> https://toys-flash-4hl.craft.me/3VHrdWbV30QMk6 >>>> >>>> Welcome to comment and share your thoughts. >>>> >>> >>> >>> -- >>> Ryan Blue >>> Tabular >>> >>
