[JENKINS] Lucene-Solr-repro - Build # 1923 - Unstable

[Apache Jenkins Server]

Build: https://builds.apache.org/job/Lucene-Solr-repro/1923/

[...truncated 28 lines...]
[repro] Jenkins log URL: 
https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/1695/consoleText

[repro] Revision: 52998fa50e60ce9c7f49167b1ab107347c30d8d6

[repro] Ant options: -Dtests.multiplier=2 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
[repro] Repro line:  ant test  -Dtestcase=HdfsRestartWhileUpdatingTest 
-Dtests.method=test -Dtests.seed=632D3BDB9FC82BE0 -Dtests.multiplier=2 
-Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=uk -Dtests.timezone=Mexico/BajaSur -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] Repro line:  ant test  -Dtestcase=HdfsRestartWhileUpdatingTest 
-Dtests.seed=632D3BDB9FC82BE0 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=uk -Dtests.timezone=Mexico/BajaSur -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] Repro line:  ant test  -Dtestcase=MathExpressionTest 
-Dtests.method=testGammaDistribution -Dtests.seed=39D97E942341B2E 
-Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=he -Dtests.timezone=Asia/Shanghai -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[repro] git rev-parse --abbrev-ref HEAD
[repro] git rev-parse HEAD
[repro] Initial local git branch/revision: 
52998fa50e60ce9c7f49167b1ab107347c30d8d6
[repro] git fetch
[repro] git checkout 52998fa50e60ce9c7f49167b1ab107347c30d8d6

[...truncated 1 lines...]
[repro] git merge --ff-only

[...truncated 1 lines...]
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       HdfsRestartWhileUpdatingTest
[repro]    solr/solrj
[repro]       MathExpressionTest
[repro] ant compile-test

[...truncated 3568 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.HdfsRestartWhileUpdatingTest" -Dtests.showOutput=onerror 
-Dtests.multiplier=2 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.seed=632D3BDB9FC82BE0 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/test-data/enwiki.random.lines.txt
 -Dtests.locale=uk -Dtests.timezone=Mexico/BajaSur -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[...truncated 62056 lines...]
   [junit4]   2> 390447 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@34fb67cd 
(collection1_shard1_replica_n25) has a reference count of -1
   [junit4]   2> 390448 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@799e610f 
(collection1_shard1_replica_n23) has a reference count of -1
   [junit4]   2> 390448 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@2f87b289 
(collection1_shard1_replica_n21) has a reference count of -1
   [junit4]   2> 390448 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@7e70276f 
(collection1_shard1_replica_n25) has a reference count of -1
   [junit4]   2> 390448 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@4fa38346 
(collection1_shard1_replica_n23) has a reference count of -1
   [junit4]   2> 390449 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@202986fe 
(collection1_shard1_replica_n21) has a reference count of -1
   [junit4]   2> 390449 ERROR (Finalizer) [    ] o.a.s.c.SolrCore REFCOUNT 
ERROR: unreferenced org.apache.solr.core.SolrCore@7e78fbf9 
(control_collection_shard1_replica_n1) has a reference count of -1
   [junit4]   2> 391664 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 391664 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 394164 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 394165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 394165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 394168 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 394168 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 394168 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 394169 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 394169 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 394169 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 394170 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 103ms
   [junit4]   2> 394277 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 394277 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 394278 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 394279 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 13ms
   [junit4]   2> 394288 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 394288 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 394295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 394295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 394296 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 394297 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 396662 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 396662 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 398835 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 398835 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 398835 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 398835 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5452ms
   [junit4]   2> 399163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 399163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 399163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 399166 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 399166 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 399166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 399166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 399166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 399167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 399167 WARN  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 399167 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 105ms
   [junit4]   2> 399278 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 399278 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 399278 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 399279 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 12ms
   [junit4]   2> 399294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 399294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 399295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 399295 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2364ms
   [junit4]   2> 401670 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 401671 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 404171 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 404172 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 404172 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 404174 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 404175 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 404175 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 404175 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 404175 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 404176 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 404176 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 96ms
   [junit4]   2> 404276 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 404276 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 404276 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 404278 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 13ms
   [junit4]   2> 404288 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 404288 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 404294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 404294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 404295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 404295 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 406662 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 406662 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 408836 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 408836 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 408836 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 408836 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5450ms
   [junit4]   2> 409162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 409163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 409164 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 409166 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 409166 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 409167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 409167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 409167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 409167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 409168 WARN  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 409168 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 104ms
   [junit4]   2> 409276 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 409276 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 409277 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 409277 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 13ms
   [junit4]   2> 409294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 409294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 409295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 409295 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 411662 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 411662 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 414162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 414163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 414163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 414166 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 414166 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 414166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 414166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 414166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 414167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 414167 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 104ms
   [junit4]   2> 414275 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 414275 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 414275 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 414276 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 414287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 414287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 414294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 414294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 414295 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 414295 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 416661 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 416661 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 418836 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 418836 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 418836 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 418836 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5450ms
   [junit4]   2> 419161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 419162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 419162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 419164 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 419164 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 419165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 419165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 419165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 419166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 419166 WARN  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 419167 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 104ms
   [junit4]   2> 419274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 419274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 419275 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 419275 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 419293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 419294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 419294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 419295 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 421661 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 421661 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 424161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 424163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 424163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 424165 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 424165 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 424166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 424167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 424167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 424167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 424168 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 102ms
   [junit4]   2> 424274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 424274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 424275 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 424275 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 424287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 424287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 424293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 424293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 424294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 424294 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 426662 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 426662 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 428837 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 428837 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 428837 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 428837 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5449ms
   [junit4]   2> 429162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 429162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 429163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 429165 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 429165 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 429165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 429165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 429166 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 429167 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 429168 WARN  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 429168 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 102ms
   [junit4]   2> 429273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 429273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 429274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 429274 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 15ms
   [junit4]   2> 429293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 429293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 429294 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 429294 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 431660 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 431660 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 434161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 434162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 434162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 434164 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 434164 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 434165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 434165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 434165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 434165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 434166 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 104ms
   [junit4]   2> 434273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 434273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 434274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 434274 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 434287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 434287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 434292 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 434292 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 434292 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 434293 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2364ms
   [junit4]   2> 436660 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 436660 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 438831 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 438831 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 438831 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 438831 INFO  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5455ms
   [junit4]   2> 439160 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 439160 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 439161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 439163 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 439163 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 439163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 439163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 439163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 439164 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 439164 WARN  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 439164 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 105ms
   [junit4]   2> 439273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 439273 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 439274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 439275 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 13ms
   [junit4]   2> 439292 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 439292 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 439293 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 439293 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2364ms
   [junit4]   2> 440537 INFO  (qtp5328725-1099) [n:127.0.0.1:34699_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n25:QUERY./select.requests&key=solr.core.collection1.shard1.replica_n25:UPDATE./update.requests&key=solr.core.collection1.shard1.replica_n25:INDEX.sizeInBytes}
 status=0 QTime=1
   [junit4]   2> 440539 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used}
 status=0 QTime=0
   [junit4]   2> 440542 INFO  (qtp759213026-1035) [n:127.0.0.1:45696_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n21:UPDATE./update.requests&key=solr.core.collection1.shard1.replica_n21:INDEX.sizeInBytes&key=solr.core.collection1.shard1.replica_n21:QUERY./select.requests}
 status=0 QTime=0
   [junit4]   2> 440543 INFO  (qtp759213026-1034) [n:127.0.0.1:45696_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used}
 status=0 QTime=0
   [junit4]   2> 440548 INFO  (qtp2032738396-814) [n:127.0.0.1:32861_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:QUERY./select.requests&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.control_collection.shard1.replica_n1:UPDATE./update.requests}
 status=0 QTime=1
   [junit4]   2> 440549 INFO  (qtp2032738396-810) [n:127.0.0.1:32861_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used}
 status=0 QTime=0
   [junit4]   2> 440553 INFO  (qtp1870125832-1067) [n:127.0.0.1:44363_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n23:UPDATE./update.requests&key=solr.core.collection1.shard1.replica_n23:QUERY./select.requests&key=solr.core.collection1.shard1.replica_n23:INDEX.sizeInBytes}
 status=0 QTime=0
   [junit4]   2> 440554 INFO  (qtp1870125832-1070) [n:127.0.0.1:44363_    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used}
 status=0 QTime=0
   [junit4]   2> 441661 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 441661 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 444161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 444162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 444162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 444164 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 444164 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 444165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 444165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 444165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 444165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 444166 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 103ms
   [junit4]   2> 444272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 444272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 444272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 444273 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 444286 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 444287 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 444290 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 444290 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 444291 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 444291 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2365ms
   [junit4]   2> 446659 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 446659 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 448830 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy RecoveryStrategy has 
been closed
   [junit4]   2> 448830 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Finished recovery 
process, successful=[false]
   [junit4]   2> 448831 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 448831 INFO  
(updateExecutor-232-thread-2-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.ActionThrottle Throttling recovery 
attempts - waiting for 5455ms
   [junit4]   2> 449160 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 449160 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 449161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 449163 INFO  (qtp1870125832-1070) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 449163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 449163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 449163 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 449163 INFO  (qtp5328725-1102) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 449164 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 449164 WARN  
(updateExecutor-232-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Stopping recovery 
for core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 449165 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 104ms
   [junit4]   2> 449272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 449272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 449274 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 449274 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 13ms
   [junit4]   2> 449291 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 449291 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 449291 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 449293 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 2363ms
   [junit4]   2> 451660 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 451660 WARN  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.RecoveryStrategy Stopping recovery for 
core=[collection1_shard1_replica_n21] coreNodeName=[core_node22]
   [junit4]   2> 454160 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Sync replicas to 
https://127.0.0.1:45696/collection1_shard1_replica_n21/
   [junit4]   2> 454161 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 START 
replicas=[https://127.0.0.1:44363/collection1_shard1_replica_n23/, 
https://127.0.0.1:34699/collection1_shard1_replica_n25/] nUpdates=100
   [junit4]   2> 454162 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n21 
url=https://127.0.0.1:45696 DONE.  We have no versions.  sync failed.
   [junit4]   2> 454164 INFO  (qtp5328725-1100) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.S.Request [collection1_shard1_replica_n25]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 454164 INFO  (qtp1870125832-1066) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.S.Request [collection1_shard1_replica_n23]  webapp= path=/get 
params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2}
 status=0 QTime=0
   [junit4]   2> 454164 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the 
next candidate
   [junit4]   2> 454165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we 
can't sync in that case. But others have some versions, so we should not become 
leader
   [junit4]   2> 454165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 454165 INFO  (zkCallback-236-thread-1) [n:127.0.0.1:45696_ 
c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_n21] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 454166 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 103ms
   [junit4]   2> 454272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext Can't become leader, other replicas with 
higher term participated in leader election
   [junit4]   2> 454272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than 
us - going back into recovery
   [junit4]   2> 454272 INFO  (zkCallback-252-thread-1) [n:127.0.0.1:44363_ 
c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] 
o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader 
parent node, won't remove previous leader registration.
   [junit4]   2> 454273 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 14ms
   [junit4]   2> 454286 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy Starting recovery 
process. recoveringAfterStartup=true
   [junit4]   2> 454286 INFO  
(recoveryExecutor-233-thread-1-processing-n:127.0.0.1:45696_ 
x:collection1_shard1_replica_n21 c:collection1 s:shard1 r:core_node22) 
[n:127.0.0.1:45696_ c:collection1 s:shard1 r:core_node22 
x:collection1_shard1_replica_n21] o.a.s.c.RecoveryStrategy startupVersions is 
empty
   [junit4]   2> 454290 INFO  (zkCallback-268-thread-1) [n:127.0.0.1:34699_ 
c:collection1 s:shard1 r:core_node26 x:collection1_shard1_replica_n25] 
o.a.s.c.ShardLead

[...truncated too long message...]

testRankTransform
   [junit4] OK      0.19s J2 | MathExpressionTest.testCopyOf
   [junit4] OK      0.08s J2 | MathExpressionTest.testDotProduct
   [junit4] OK      0.12s J2 | MathExpressionTest.testPercentile
   [junit4] Completed [4/5] on J2 in 20.16s, 114 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.client.solrj.io.stream.MathExpressionTest
   [junit4] OK      0.10s J0 | MathExpressionTest.testEbeSubtract
   [junit4] OK      0.19s J0 | MathExpressionTest.testLength
   [junit4] OK      0.12s J0 | MathExpressionTest.testUniformIntegerDistribution
   [junit4] OK      0.08s J0 | MathExpressionTest.testConvexHull
   [junit4] OK      0.48s J0 | MathExpressionTest.testWeibullDistribution
   [junit4] OK      0.09s J0 | MathExpressionTest.testNormalizeSum
   [junit4] OK      0.09s J0 | MathExpressionTest.testLtrim
   [junit4] OK      0.08s J0 | MathExpressionTest.testBinomialCoefficient
   [junit4] OK      0.10s J0 | MathExpressionTest.testLerp
   [junit4] OK      0.06s J0 | MathExpressionTest.testStandardize
   [junit4] OK      0.09s J0 | MathExpressionTest.testMovingMedian
   [junit4] OK      0.14s J0 | MathExpressionTest.testKnnRegress
   [junit4] OK      0.09s J0 | MathExpressionTest.testGaussfit
   [junit4] OK      0.07s J0 | MathExpressionTest.testFFT
   [junit4] OK      0.16s J0 | MathExpressionTest.testTriangularDistribution
   [junit4] OK      0.11s J0 | MathExpressionTest.testZeros
   [junit4] OK      0.10s J0 | MathExpressionTest.testBicubicSpline
   [junit4] OK      0.08s J0 | MathExpressionTest.testOscillate
   [junit4] OK      0.14s J0 | MathExpressionTest.testTermVectors
   [junit4] OK      0.07s J0 | MathExpressionTest.testMean
   [junit4] OK      0.20s J0 | MathExpressionTest.testFinddelay
   [junit4] OK      0.11s J0 | MathExpressionTest.testSpline
   [junit4] OK      0.08s J0 | MathExpressionTest.testCorrMatrix
   [junit4] OK      0.08s J0 | MathExpressionTest.testAkima
   [junit4] OK      0.10s J0 | MathExpressionTest.testHist
   [junit4] OK      0.11s J0 | MathExpressionTest.testEnumeratedDistribution
   [junit4] OK      0.15s J0 | MathExpressionTest.testCopyOfRange
   [junit4] OK      0.08s J0 | MathExpressionTest.testLog10
   [junit4] OK      0.11s J0 | MathExpressionTest.testLatlonFunctions
   [junit4] OK      0.08s J0 | MathExpressionTest.testDistance
   [junit4] OK      0.10s J0 | MathExpressionTest.testProbabilityRange
   [junit4] OK      0.08s J0 | MathExpressionTest.testEbeDivide
   [junit4] OK      0.07s J0 | MathExpressionTest.testMinMaxScale
   [junit4] OK      0.07s J0 | MathExpressionTest.testMemsetSize
   [junit4] OK      0.07s J0 | MathExpressionTest.testPivot
   [junit4] OK      0.08s J0 | MathExpressionTest.testSetAndGetValue
   [junit4] OK      0.09s J0 | MathExpressionTest.testZipFDistribution
   [junit4] OK      0.08s J0 | MathExpressionTest.testMatrix
   [junit4] OK      0.23s J0 | MathExpressionTest.testBinomialDistribution
   [junit4] OK      0.08s J0 | MathExpressionTest.testSumSq
   [junit4] OK      0.07s J0 | MathExpressionTest.testPolyfit
   [junit4] OK      0.07s J0 | MathExpressionTest.testTranspose
   [junit4] OK      0.09s J0 | MathExpressionTest.testEbeAdd
   [junit4] OK      0.09s J0 | MathExpressionTest.testDistributions
   [junit4] OK      0.08s J0 | MathExpressionTest.testAddAll
   [junit4] OK      0.42s J0 | MathExpressionTest.testGammaDistribution
   [junit4] OK      0.06s J0 | MathExpressionTest.testUnitize
   [junit4] OK      0.07s J0 | MathExpressionTest.testExponentialMovingAverage
   [junit4] OK      0.08s J0 | MathExpressionTest.testHarmonicFit
   [junit4] OK      0.08s J0 | MathExpressionTest.testPlot
   [junit4] OK      0.09s J0 | MathExpressionTest.testRtrim
   [junit4] OK      0.09s J0 | MathExpressionTest.testGeometricDistribution
   [junit4] OK      0.09s J0 | MathExpressionTest.testMarkovChain
   [junit4] OK      0.17s J0 | MathExpressionTest.testConvolution
   [junit4] OK      0.10s J0 | MathExpressionTest.testMultiKmeans
   [junit4] OK      0.07s J0 | MathExpressionTest.testMannWhitney
   [junit4] OK      0.10s J0 | MathExpressionTest.testAscend
   [junit4] OK      0.18s J0 | MathExpressionTest.testDescribe
   [junit4] OK      0.08s J0 | MathExpressionTest.testLetWithNumericVariables
   [junit4] OK      0.09s J0 | MathExpressionTest.testTimeDifferencingDefaultLag
   [junit4] OK      0.08s J0 | MathExpressionTest.testGtestDataSet
   [junit4] OK      0.07s J0 | MathExpressionTest.testAnova
   [junit4] OK      0.06s J0 | MathExpressionTest.testValueAt
   [junit4] OK      0.18s J0 | MathExpressionTest.testScale
   [junit4] OK      0.09s J0 | MathExpressionTest.testNorms
   [junit4] OK      0.12s J0 | MathExpressionTest.testCosineSimilarity
   [junit4] OK      0.11s J0 | MathExpressionTest.testPairSort
   [junit4] OK      0.12s J0 | MathExpressionTest.testIntegrate
   [junit4] OK      0.07s J0 | MathExpressionTest.testKmeans
   [junit4] OK      0.12s J0 | 
MathExpressionTest.testSelectWithSequentialEvaluators
   [junit4] OK      0.19s J0 | MathExpressionTest.testConvertEvaluator
   [junit4] OK      0.08s J0 | MathExpressionTest.testTimeDifferencingDefinedLag
   [junit4] OK      0.22s J0 | MathExpressionTest.testCorrelationStream
   [junit4] OK      0.09s J0 | MathExpressionTest.testMatrixMath
   [junit4] OK      0.08s J0 | MathExpressionTest.testLoess
   [junit4] OK      0.07s J0 | MathExpressionTest.testKnn
   [junit4] OK      0.07s J0 | MathExpressionTest.testRecip
   [junit4] OK      0.07s J0 | MathExpressionTest.testCovMatrix
   [junit4] OK      0.08s J0 | MathExpressionTest.testOlsRegress
   [junit4] OK      0.09s J0 | MathExpressionTest.testMonteCarlo
   [junit4] OK      0.08s J0 | MathExpressionTest.testEnclosingDisk
   [junit4] OK      0.08s J0 | MathExpressionTest.testMeanDifference
   [junit4] OK      0.16s J0 | 
MathExpressionTest.testMultiVariateNormalDistribution
   [junit4] OK      0.14s J0 | MathExpressionTest.testPoissonDistribution
   [junit4] OK      0.06s J0 | MathExpressionTest.testPrecision
   [junit4] OK      0.08s J0 | MathExpressionTest.testPrimes
   [junit4] OK      0.08s J0 | MathExpressionTest.testSumDifference
   [junit4] OK      0.10s J0 | MathExpressionTest.testCumulativeProbability
   [junit4] OK      0.07s J0 | MathExpressionTest.testFreqTable
   [junit4] OK      0.07s J0 | MathExpressionTest.testMonteCarloWithVariables
   [junit4] OK      0.15s J0 | MathExpressionTest.testCovariance
   [junit4] OK      0.65s J0 | MathExpressionTest.testBetaDistribution
   [junit4] OK      0.08s J0 | MathExpressionTest.testPow
   [junit4] OK      0.14s J0 | MathExpressionTest.testMemsetTimeSeries
   [junit4] OK      0.09s J0 | MathExpressionTest.testChiSquareDataSet
   [junit4] OK      0.08s J0 | MathExpressionTest.testArray
   [junit4] OK      0.08s J0 | MathExpressionTest.testOnes
   [junit4] OK      0.07s J0 | MathExpressionTest.testMatrixMult
   [junit4] OK      0.08s J0 | MathExpressionTest.testMovingAverage
   [junit4] OK      0.09s J0 | MathExpressionTest.testEbeMultiply
   [junit4] OK      0.08s J0 | MathExpressionTest.testOutliers
   [junit4] OK      0.18s J0 | MathExpressionTest.testAnalyzeEvaluator
   [junit4] OK      0.12s J0 | MathExpressionTest.testTtest
   [junit4] OK      0.12s J0 | MathExpressionTest.testRegressAndPredict
   [junit4] OK      0.07s J0 | MathExpressionTest.testFuzzyKmeans
   [junit4] OK      0.07s J0 | MathExpressionTest.testMemset
   [junit4] OK      0.33s J0 | MathExpressionTest.testLogNormalDistribution
   [junit4] OK      0.15s J0 | MathExpressionTest.testReverse
   [junit4] OK      0.15s J0 | MathExpressionTest.testCache
   [junit4] OK      0.06s J0 | MathExpressionTest.testNestedDoubleTimeDifference
   [junit4] OK      0.14s J0 | MathExpressionTest.testRankTransform
   [junit4] OK      0.19s J0 | MathExpressionTest.testCopyOf
   [junit4] OK      0.15s J0 | MathExpressionTest.testDotProduct
   [junit4] OK      0.09s J0 | MathExpressionTest.testPercentile
   [junit4] Completed [5/5] on J0 in 20.63s, 114 tests
   [junit4] 
   [junit4] JVM J0:     1.06 ..    76.22 =    75.15s
   [junit4] JVM J1:     1.06 ..    56.91 =    55.85s
   [junit4] JVM J2:     1.04 ..    74.97 =    73.94s
   [junit4] Execution time total: 1 minute 16 seconds
   [junit4] Tests summary: 5 suites, 570 tests
   [junit4] Could not remove temporary path: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J1
 (java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J1/temp])
   [junit4] Could not remove temporary path: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J2
 (java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J2/temp])
   [junit4] Could not remove temporary path: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J0
 (java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-solrj/test/J0/temp])
     [echo] 5 slowest tests:
[junit4:tophints]  39.96s | 
org.apache.solr.client.solrj.io.stream.MathExpressionTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 1 minute 19 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.client.solrj.io.stream.MathExpressionTest
[repro]   2/5 failed: org.apache.solr.cloud.hdfs.HdfsRestartWhileUpdatingTest
[repro] git checkout 52998fa50e60ce9c7f49167b1ab107347c30d8d6
HEAD is now at 52998fa... SOLR-12965: Add facet support to JsonQueryRequest
[repro] Exiting with code 256
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-repro 
Repro-Lucene-Solr-NightlyTests-7.x#374 to compare, so performing full copy of 
artifacts
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org