[ https://issues.apache.org/jira/browse/SOLR-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684776#comment-17684776 ]
Jason Gerlowski commented on SOLR-16608: ---------------------------------------- Also - I see this is backported - should the ticket be closed? Hard to understand the state of the work and what's "remaining" from the discussion here. > Enable ability to compress state.json in Zookeeper > -------------------------------------------------- > > Key: SOLR-16608 > URL: https://issues.apache.org/jira/browse/SOLR-16608 > Project: Solr > Issue Type: Improvement > Reporter: Justin Sweeney > Priority: Major > Time Spent: 3h 20m > Remaining Estimate: 0h > > As noted in the Solr documentation, Zookeeper is intended to hold small > files, by default < 1MB: > [https://solr.apache.org/guide/7_4/setting-up-an-external-zookeeper-ensemble.html#increasing-the-file-size-limit.] > When creating collections with very large number of replicas, it is possible > to exceeded that size in the state.json that is created, which then requires > Solr operators to reconfigure Zookeeper to increase that limit and also has > performance implications. > I am proposing that we provide the ability to compress state.json using > standard ZLib compression. This will be based on a configuration parameter in > solr.xml which will provide a minimum size of state.json over which to use > compression. This will give Solr operators a better mechanism to handle > state.json for very large collections. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org