tarun11Mavani commented on issue #13494: URL: https://github.com/apache/pinot/issues/13494#issuecomment-2252100429
As part of this analysis, I discovered that when we update the schema or the index on an upsert-realtime table and then use the reload segments API to reload all segments, it doesn't update the CRC of the existing segments. The CRC is stored in `creation.meta` and is not updated when server reload happens. I verified this by monitoring the `creation.meta` file and also compared the segment metadata from server and zookeeper before and after the segment reload. This behavior ensures that schema and index changes do not adversely affect the Upsert Compaction task, maintaining seamless compaction of older segments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
