Hi Keith, To answer the initial question, as far as I'm aware, Solr Sharding of Statistics should work in DSpace 7.6.x. However, prior versions may have issues. These two fixes in particular didn't come into DSpace until 7.6.x:
* 7.6 - Fix issue with statistics loading after sharding: https://github.com/DSpace/DSpace/issues/8478 * 7.6.1 (to be announced tomorrow) - Fix issue with sharded stats sometimes being counted twice: https://github.com/DSpace/DSpace/issues/8933 So, if you upgrade to the latest versions of 7.6.x, I believe sharding should be supported again. Tim On Tuesday, November 7, 2023 at 2:25:36 AM UTC-6 Adan Roman Ruiz wrote: > Hello > > We experience some problems with date ranges into big cores (60Gb), that > are solved sharding. > > Software as dspace-stats-collector of "lareferencia" fail working with > this cores (https://github.com/lareferencia/dspace-stats-collector) > > Maybe sharding is not the best sollution, but works. > > Adán > > While awaiting an answer to your question, may I propose a tangential > question of my own: what do you think sharding is doing for you, and have > you seen evidence to support this? Because DSpace uses Solr's sharding > support in a very eccentric manner, and I have my doubts that it actually > buys us anything. That is why I accepted the need to remove it in 7.0, in > exchange for the option to place Solr on a separate host if desired (since > supported Solr versions must now be installed separately anyway). The > custom sharding code in DSpace doesn't get enough information to work > across hosts. If sharding is really needed, Solr can do it much better on > its own, and we could scrap *all* of the sharding support in DSpace. > > On Monday, November 6, 2023 at 12:35:55 PM UTC-5 keith.gi...@gmail.com > wrote: > > > Hello DSpace fans, > > Is sharding of the statistics cores with a separate core for each > individual year of statistics supported again in the most recent version of > DSpace? > > The installation documentation mentions that sharding is no longer > supported in DSpace 7, but we noticed some recent commits to the DSpace > project that reference sharding and wondered if it is available again. > > In past versions of DSpace during solr index updates or maintenance > we've sometimes struggled with slow updates or running out of memory. We > have about 12 years of sharded statistics cores in DSpace 6 and are working > on a strategy for importing them into DSpace 7, perhaps doing most of the > exporting and importing on a separate server with solr before our upgrade > day. I am curious about whether we should import all statistics into the > same core for DSpace 7, as expected, or if we should keep them separated if > it turns out that sharding is supported again. > > Can someone please help to clarify which parts of sharding are now > supported, and which still do not work, and provide observations or advice? > > Thank you for the time, > Keith > > > -- > All messages to this mailing list should adhere to the Code of Conduct: > https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx > --- > You received this message because you are subscribed to the Google Groups > "DSpace Technical Support" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to dspace-tech...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/dspace-tech/f2953515-e38f-4ea3-81c9-751ef4a9afc7n%40googlegroups.com > > <https://groups.google.com/d/msgid/dspace-tech/f2953515-e38f-4ea3-81c9-751ef4a9afc7n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx --- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/d613eb8a-574d-490d-95ac-cdd617fce2fen%40googlegroups.com.
