On Sat, 5 Oct 2019 17:01:27 -0600 Micah Kornfield <emkornfi...@gmail.com> wrote: > I've opened a pull request [1] to clarify some recent conversations about > semantics/edge cases for dictionary encoding [2][3] around interleaved > batches and when isDelta=False. > > Specifically, it proposes isDelta=False indicates dictionary replacement.
So, why would we allow dictionary replacement instead of have the emitter use a new dictionary id? Is it to optimize memory consumption on the receiver? Regards Antoine.
