Shawn Heisey created SOLR-11166:
-----------------------------------

             Summary: Create a new router to automate time-based sharding
                 Key: SOLR-11166
                 URL: https://issues.apache.org/jira/browse/SOLR-11166
             Project: Solr
          Issue Type: New Feature
      Security Level: Public (Default Security Level. Issues are Public)
          Components: SolrCloud
            Reporter: Shawn Heisey


There has been some interest in time-based sharding on the mailing list.  It is 
disappointing to have to inform users that if they want to implement this, they 
will be entirely responsible for all shard management.

I think that creating new shards and directing new documents to the newest 
shard will be relatively easy parts of this router.  There are some additional 
features that I think would be really useful:

Automated merging of older shards into larger time periods.
Some kind of aliasing to allow searching today, yesterday, this week, last 
week, this month, last month, and so on, with the list of searched shards 
changing when a new shard is created.  I don't know if this would be part of 
the router or implemented elsewhere by another issue.

The router should have a configuration option to indicate how frequently new 
shards should be created.  Valid values should probably be hourly, daily, 
weekly, and monthly.  Multiples of those time periods would be a very good 
idea.  Another idea to consider: completely custom time periods.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to