yihua opened a new issue, #20066: URL: https://github.com/apache/hudi/issues/20066
`HoodieWriteConfig` ships in every write and table service task. It holds about a dozen nested configs (metadata, storage, metrics, view storage, ...), each built from its own copy of all the write config props, so Java serialization writes the same property entries over and over: a default write config serializes to about 74 KB while its props alone take about 21 KB. This inflates the task binary and per-task deserialization CPU of every task that captures the write config. Proposal: serialize nested configs as the differences from the enclosing write config props, keeping the deserialized contents and isolation unchanged. part of #20064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
