Jackie-Jiang opened a new issue, #12426: URL: https://github.com/apache/pinot/issues/12426
- OpChain stats is a mapping from worker id to serialized map, then serialized as JSON bytes. It is very inefficient. Since we know the metadata key upfront, we can encode the metadata much more efficient. See `DataTable` for example of how v1 handles query stats - When tracing is not enabled, no need to send per worker stats. We should aggregate the stats for each stage when finishing the stage, instead of sending stats for each worker - EOS block containing the stats are duplicated to all workers. Sending the stats to only one worker should be enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
