did you try as the other gentleman suggested to roll back to 9.5? just for the sake of expediency?
On Wed, Sep 4, 2024 at 7:21 PM Sathish Ponnusamy <sathishrp...@gmail.com> wrote: > Hi Robi, > > Please find the details from solr.log. I noticed the same error for all the > shards that were down. We have stopped the solr/zk service and restarted. > In fact we rebooted the machine as well. Though it didn't solve the > problem. > > Please let me know if you need any other information. > > --------------- > > 2024-09-04 12:12:01.473 ERROR > (coreLoadExecutor-21-thread-2-processing-geslrd1.dev.nonprod.gcp.net:6010 > _solr) > [c:my_collection s:shard4 r:core_node59 x:my_collection_shard4_replica_n56 > t:] o.a.s.c.CoreContainer SolrCore failed to load on startup => > org.apache.solr.cloud.ZkController$NotInClusterStateException: coreNodeName > core_node59 does not exist in shard shard4, ignore the exception if the > replica was deleted > > at > org.apache.solr.cloud.ZkController.checkStateInZk(ZkController.java:2062) > > org.apache.solr.cloud.ZkController$NotInClusterStateException: coreNodeName > core_node59 does not exist in shard shard4, ignore the exception if the > replica was deleted > > at > org.apache.solr.cloud.ZkController.checkStateInZk(ZkController.java:2062) > ~[solr-core-9.6.0.jar:9.6.0 f8e5a93c11267e13b7b43005a428bfb910ac6e57 - gus > - 2024-04-22 23:20:52] > > at > org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1958) > ~[solr-core-9.6.0.jar:9.6.0 f8e5a93c11267e13b7b43005a428bfb910ac6e57 - gus > - 2024-04-22 23:20:52] > > at > > org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1704) > ~[solr-core-9.6.0.jar:9.6.0 f8e5a93c11267e13b7b43005a428bfb910ac6e57 - gus > - 2024-04-22 23:20:52] > > at > > org.apache.solr.core.CoreContainer.lambda$loadInternal$12(CoreContainer.java:1057) > ~[solr-core-9.6.0.jar:9.6.0 f8e5a93c11267e13b7b43005a428bfb910ac6e57 - gus > - 2024-04-22 23:20:52] > > at > > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:212) > ~[metrics-core-4.2.25.jar:4.2.25] > > at > > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) > ~[?:?] > > at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] > > at > > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:312) > ~[solr-solrj-9.6.0.jar:9.6.0 f8e5a93c11267e13b7b43005a428bfb910ac6e57 - gus > - 2024-04-22 23:20:52] > > at > > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) > ~[?:?] > > at > > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) > ~[?:?] > > at java.base/java.lang.Thread.run(Thread.java:840) [?:?] > > 2024-09-04 12:12:01.479 INFO > (coreLoadExecutor-21-thread-2-processing-geslrd1.dev.nonprod.gcp.net:6010 > _solr) > [c: s: r: x: t:] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.10.0 > > 2024-09-04 12:12:01.480 INFO > (coreLoadExecutor-21-thread-2-processing-geslrd1.dev.nonprod.gcp.net:6010 > _solr) > [c: s: r: x: t:] o.a.s.s.IndexSchema Schema name=my_collection > > 2024-09-04 12:12:01.480 INFO > (coreLoadExecutor-21-thread-2-processing-geslrd1.dev.nonprod.gcp.net:6010 > _solr) > [c: s: r: x: t:] o.a.s.s.IndexSchema Loaded schema my_collection/1.6 with > uniqueid field my_collection_unique_id > > --------------------------------- > > Sathish Ponnusamy > > Chennai > m: + 91 9962331981 > e: sathishrp...@gmail.com > > > On Wed, Sep 4, 2024 at 11:52 PM Robi Petersen <robip...@gmail.com> wrote: > > > could be a release bug? not likely? hopefully... > > > > I can't recreate it locally. But perhaps we need a 9.6.1 patch? Any other > > users out there experiencing this? > > > > On Wed, Sep 4, 2024 at 10:38 AM Robi Petersen <robip...@gmail.com> > wrote: > > > > > That's not a good sign... yeah something fatal happened loading solr > > core. > > > need more logs to see what... > > > > > > On Wed, Sep 4, 2024 at 6:31 AM Jose, Manu <m.j...@ub.uni-frankfurt.de> > > > wrote: > > > > > >> > > >> Hallo Sathish P, > > >> > > >> I have the same issue while upgrading from 9.5.0 to 9.6.0. So that I > > have > > >> reverted to 9.5.0 then the issue solved... > > >> > > >> > > >> > > >> Manu Jose > > >> -----Ursprüngliche Nachricht----- > > >> Von: Sathish Ponnusamy <sathishrp...@gmail.com> > > >> Gesendet: Mittwoch, 4. September 2024 15:12 > > >> An: solr-u...@lucene.apache.org > > >> Betreff: SolrCore failed to load on startup and not in cluster state > > >> > > >> We have created a collection and indexed the data into solr-9.6.0 > > version > > >> which is running in solr cloud mode. After a brief period the solr > > shards > > >> went down and it was throwing an error like below. Did anyone face > this > > >> problem earlier and what fix to be provided? > > >> > > >> > > >> > > >> *Solr config details:* > > >> > > >> - Solr running on 3 VMs. > > >> - ZK running on 3 VM’s. > > >> - Solr version - 9.6.0 > > >> - Zk version – 3.9.2 > > >> - Authentication enabled. > > >> > > >> > > >> > > >> > > >> > > >> *Error from Console Logging* > > >> > > >> > > >> > > >> ERROR false my_collection_shard1_replica_n14 > > >> CoreContainer SolrCore my_collection_shard1_replica_n14 > in > > >> /data/my_collection_shard1_replica_n14 is not in cluster state. > > >> > > >> ERROR false my_collection_shard1_replica_n14 > > >> CoreContainer SolrCore failed to load on startup > > >> > > >> > > >> > > >> ERROR false my_collection_shard3_replica_n32 > > >> CoreContainer SolrCore my_collection_shard3_replica_n32 > in > > >> /data/my_collection_shard3_replica_n32 is not in cluster state. > > >> > > >> ERROR false my_collection_shard3_replica_n32 > > >> CoreContainer SolrCore failed to load on startup > > >> > > >> > > >> > > >> ERROR false my_collection_shard4_replica_n56 > > >> CoreContainer SolrCore my_collection_shard4_replica_n56 > in > > >> /data/my_collection_shard4_replica_n56 is not in cluster state. > > >> > > >> > > >> > > >> ERROR false my_collection_shard4_replica_n56 > > >> CoreContainer SolrCore failed to load on startup > > >> > > >> > > >> > > >> ERROR false my_collection_shard6_replica_n10 > > >> CoreContainer SolrCore my_collection_shard6_replica_n10 > in > > >> /data/my_collection_shard6_replica_n10 is not in cluster state. > > >> > > >> > > >> > > >> ERROR false my_collection_shard6_replica_n10 > > >> CoreContainer SolrCore failed to load on startup > > >> > > >> > > >> > > >> ERROR false my_collection_shard8_replica_n62 > > >> CoreContainer SolrCore my_collection_shard8_replica_n62 > in > > >> /data/my_collection_shard8_replica_n62 is not in cluster state. > > >> > > >> > > >> > > >> ERROR false my_collection_shard8_replica_n62 > > >> CoreContainer SolrCore failed to load on startup > > >> > > >> > > >> Regards > > >> Sathish P > > >> > > > > > >