These recent jenkins OverseerTest faiulres (seems to have started failing 
yesterday for the first time) all have seeds that reproduce 100% reliably 
for me...


5x...

ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerStatsReset 
-Dtests.seed=7B352AEEA690CBAB -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.locale=hu -Dtests.timezone=NET -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerStatsReset 
-Dtests.seed=DF592108C7E1C290 -Dtests.slow=true -Dtests.locale=sv_SE 
-Dtests.timezone=Africa/Maputo -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII


Trunk...

ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerStatsReset 
-Dtests.seed=7771E2C402B621D6 -Dtests.slow=true -Dtests.locale=en_AU 
-Dtests.timezone=Brazil/DeNoronha -Dtests.asserts=true 
-Dtests.file.encoding=Cp1252

ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerStatsReset 
-Dtests.seed=B3178102A7C387E9 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=cy_GB -Dtests.timezone=ECT -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1






: 
: 1 tests failed.
: FAILED:  org.apache.solr.cloud.OverseerTest.testOverseerStatsReset
: 
: Error Message:
: expected:<1> but was:<2>
: 
: Stack Trace:
: java.lang.AssertionError: expected:<1> but was:<2>
:       at 
__randomizedtesting.SeedInfo.seed([7B352AEEA690CBAB:D061CDD2334A68A5]:0)
:       at org.junit.Assert.fail(Assert.java:93)
:       at org.junit.Assert.failNotEquals(Assert.java:647)
:       at org.junit.Assert.assertEquals(Assert.java:128)
:       at org.junit.Assert.assertEquals(Assert.java:472)
:       at org.junit.Assert.assertEquals(Assert.java:456)
:       at 
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:722)
:       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
:       at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
:       at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
:       at java.lang.reflect.Method.invoke(Method.java:606)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1660)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:866)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:902)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:916)
:       at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
:       at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
:       at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
:       at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
:       at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
:       at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
:       at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
:       at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:875)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:777)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
:       at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:822)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
:       at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
:       at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
:       at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
:       at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
:       at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
:       at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
:       at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
:       at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
:       at java.lang.Thread.run(Thread.java:745)
: 
: 
: 
: 
: Build Log:
: [...truncated 9839 lines...]
:    [junit4] Suite: org.apache.solr.cloud.OverseerTest
:    [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_7B352AEEA690CBAB-001/init-core-data-001
:    [junit4]   2> 48955 INFO  
(SUITE-OverseerTest-seed#[7B352AEEA690CBAB]-worker) [    ] o.a.s.SolrTestCaseJ4 
Randomized ssl (false) and clientAuth (false)
:    [junit4]   2> 48956 INFO  
(SUITE-OverseerTest-seed#[7B352AEEA690CBAB]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore
:    [junit4]   2> 48956 INFO  
(SUITE-OverseerTest-seed#[7B352AEEA690CBAB]-worker) [    ] o.a.s.SolrTestCaseJ4 
####initCore end
:    [junit4]   2> 48962 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testDoubleAssignment
:    [junit4]   2> 48963 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
:    [junit4]   2> 48963 INFO  (Thread-85) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 48963 INFO  (Thread-85) [    ] o.a.s.c.ZkTestServer Starting 
server
:    [junit4]   2> 49063 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:51889
:    [junit4]   2> 49063 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49064 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49068 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@68781cb5 
name:ZooKeeperConnection Watcher:127.0.0.1:51889/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49068 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49069 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49069 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49070 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49072 INFO  (zkCallback-49-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4a44db2a 
name:ZooKeeperConnection Watcher:127.0.0.1:51889 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49073 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49073 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49076 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49077 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49079 INFO  (zkCallback-50-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6759c069 
name:ZooKeeperConnection Watcher:127.0.0.1:51889 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49079 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49079 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49079 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
:    [junit4]   2> 49085 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
:    [junit4]   2> 49088 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
:    [junit4]   2> 49090 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
:    [junit4]   2> 49092 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
:    [junit4]   2> 49094 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
:    [junit4]   2> 49095 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 49099 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49099 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49101 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@76ac9512 
name:ZooKeeperConnection Watcher:127.0.0.1:51889/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49101 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49102 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49105 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 49108 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
:    [junit4]   2> 49109 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 49109 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 49110 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49111 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49113 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@190452f0 
name:ZooKeeperConnection Watcher:127.0.0.1:51889/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49113 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49113 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49114 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
:    [junit4]   2> 49121 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
:    [junit4]   2> 49123 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
:    [junit4]   2> 49125 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
:    [junit4]   2> 49126 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94818801242931204-127.0.0.1:51889_solr-n_0000000000
:    [junit4]   2> 49126 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51889_solr
:    [junit4]   2> 49126 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
:    [junit4]   2> 49128 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801242931204-127.0.0.1:51889_solr-n_0000000000) starting
:    [junit4]   2> 49130 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
:    [junit4]   2> 49133 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
:    [junit4]   2> 49136 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
:    [junit4]   2> 49139 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
:    [junit4]   2> 49141 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
:    [junit4]   2> 49144 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
:    [junit4]   2> 49150 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
:    [junit4]   2> 49150 INFO  
(OverseerCollectionConfigSetProcessor-94818801242931204-127.0.0.1:51889_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
:    [junit4]   2> 49151 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
:    [junit4]   2> 49152 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 49157 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
:    [junit4]   2> 49158 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"}
:    [junit4]   2> 49158 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
:    [junit4]   2> 49158 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
:    [junit4]   2> 49161 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49161 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49161 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49654 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
:    [junit4]   2> 49656 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 49656 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 49656 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 49661 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94818801242931203-node1_core1-n_0000000000
:    [junit4]   2> 49662 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
:    [junit4]   2> 49665 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 49668 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 49669 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"}
:    [junit4]   2> 49673 INFO  (zkCallback-51-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 49673 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 49678 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 49678 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 49679 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 49680 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 49685 INFO  (zkCallback-54-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7c4f31de 
name:ZooKeeperConnection Watcher:127.0.0.1:51889/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 49686 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 49686 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 49695 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 49698 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
:    [junit4]   2> 49700 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 49700 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 49700 INFO  (zkCallback-54-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 49703 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
:    [junit4]   2> 49704 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 1
:    [junit4]   2> 49705 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"}
:    [junit4]   2> 49705 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
:    [junit4]   2> 49708 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94818801242931205-node1_core1-n_0000000001
:    [junit4]   2> 49710 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 49714 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 49715 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"}
:    [junit4]   2> 49722 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 49831 INFO  (zkCallback-52-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49831 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49831 INFO  (zkCallback-54-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 49836 INFO  (zkCallback-54-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 49836 INFO  (zkCallback-48-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 49845 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:51889 51889
:    [junit4]   2> 50045 INFO  (Thread-85) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:51889 51889
:    [junit4]   2> 50046 WARN  (Thread-85) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
:    [junit4]   2> Maximum concurrent create/delete watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      4       /solr/aliases.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent data watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      4       /solr/clusterstate.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent children watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      4       /solr/collections
:    [junit4]   2>      4       /solr/live_nodes
:    [junit4]   2> 
:    [junit4]   2> 50047 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testDoubleAssignment
:    [junit4]   2> 50047 INFO  
(TEST-OverseerTest.testDoubleAssignment-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801242931204-127.0.0.1:51889_solr-n_0000000000) closing
:    [junit4]   2> 50047 INFO  
(OverseerStateUpdate-94818801242931204-127.0.0.1:51889_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:51889_solr
:    [junit4]   2> 50057 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
:    [junit4]   2> 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect/leader
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2>      at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
:    [junit4]   2> 50060 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testOverseerStatsReset
:    [junit4]   2> 50061 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
:    [junit4]   2> 50061 INFO  (Thread-86) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 50061 INFO  (Thread-86) [    ] o.a.s.c.ZkTestServer Starting 
server
:    [junit4]   2> 50161 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:56334
:    [junit4]   2> 50161 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 50162 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 50165 INFO  (zkCallback-55-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4a4111b2 
name:ZooKeeperConnection Watcher:127.0.0.1:56334 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 50165 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 50165 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 50168 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 50168 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 50170 INFO  (zkCallback-56-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@51182c3c 
name:ZooKeeperConnection Watcher:127.0.0.1:56334 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 50170 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 50170 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 50170 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
:    [junit4]   2> 50174 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 50174 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 50180 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4f355f55 
name:ZooKeeperConnection Watcher:127.0.0.1:56334/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 50180 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 50181 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 50181 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
:    [junit4]   2> 50183 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
:    [junit4]   2> 50185 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
:    [junit4]   2> 50187 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
:    [junit4]   2> 50189 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
:    [junit4]   2> 50191 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 50193 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 50194 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 50196 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5336a302 
name:ZooKeeperConnection Watcher:127.0.0.1:56334/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 50196 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 50197 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 50200 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 50203 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/node1
:    [junit4]   2> 50205 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 50205 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 50205 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
:    [junit4]   2> 50208 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
:    [junit4]   2> 50210 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
:    [junit4]   2> 50211 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
:    [junit4]   2> 50212 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94818801314693122-127.0.0.1:56334_solr-n_0000000000
:    [junit4]   2> 50213 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56334_solr
:    [junit4]   2> 50213 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
:    [junit4]   2> 50215 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801314693122-127.0.0.1:56334_solr-n_0000000000) starting
:    [junit4]   2> 50217 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
:    [junit4]   2> 50220 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
:    [junit4]   2> 50224 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
:    [junit4]   2> 50227 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
:    [junit4]   2> 50230 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
:    [junit4]   2> 50233 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
:    [junit4]   2> 50238 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
:    [junit4]   2> 50238 INFO  
(OverseerCollectionConfigSetProcessor-94818801314693122-127.0.0.1:56334_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
:    [junit4]   2> 50240 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
:    [junit4]   2> 50244 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"} current state version: 0
:    [junit4]   2> 50244 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"recovering",
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://node1/solr/"}
:    [junit4]   2> 50244 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
:    [junit4]   2> 50244 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
:    [junit4]   2> 50246 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 50246 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 50741 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
:    [junit4]   2> 50743 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 50743 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 50749 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94818801314693123-node1_core1-n_0000000000
:    [junit4]   2> 50753 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
:    [junit4]   2> 50757 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 50761 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 50761 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "core_node_name":"core_node1",
:    [junit4]   2>   "core":"core1"}
:    [junit4]   2> 50764 INFO  (zkCallback-57-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 50764 INFO  (zkCallback-58-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 50764 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://node1/solr/";,
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 50785 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:56334 56334
:    [junit4]   2> 50887 INFO  (Thread-86) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:56334 56334
:    [junit4]   2> 50889 WARN  (Thread-86) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
:    [junit4]   2> Maximum concurrent create/delete watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/aliases.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent data watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/clusterstate.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent children watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/collections
:    [junit4]   2>      2       /solr/live_nodes
:    [junit4]   2> 
:    [junit4]   2> 50889 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testOverseerStatsReset
:    [junit4]   2> 50889 INFO  
(TEST-OverseerTest.testOverseerStatsReset-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801314693122-127.0.0.1:56334_solr-n_0000000000) closing
:    [junit4]   2> 50890 INFO  
(OverseerStateUpdate-94818801314693122-127.0.0.1:56334_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:56334_solr
:    [junit4]   2> 50897 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
:    [junit4]   2> 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect/leader
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2>      at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testOverseerStatsReset -Dtests.seed=7B352AEEA690CBAB 
-Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=NET 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
:    [junit4] FAILURE 0.85s J2 | OverseerTest.testOverseerStatsReset <<<
:    [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but 
was:<2>
:    [junit4]    >      at 
__randomizedtesting.SeedInfo.seed([7B352AEEA690CBAB:D061CDD2334A68A5]:0)
:    [junit4]    >      at 
org.apache.solr.cloud.OverseerTest.testOverseerStatsReset(OverseerTest.java:722)
:    [junit4]    >      at java.lang.Thread.run(Thread.java:745)
:    [junit4]   2> 50910 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testBadQueueItem
:    [junit4]   2> 50911 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
:    [junit4]   2> 50911 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 50911 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer Starting 
server
:    [junit4]   2> 51011 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:60811
:    [junit4]   2> 51011 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 51012 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 51015 INFO  (zkCallback-60-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3f19b154 
name:ZooKeeperConnection Watcher:127.0.0.1:60811 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 51015 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 51016 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 51018 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 51018 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 51020 INFO  (zkCallback-61-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@22e9d784 
name:ZooKeeperConnection Watcher:127.0.0.1:60811 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 51020 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 51021 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 51021 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
:    [junit4]   2> 51024 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 51024 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 51026 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6f0d6162 
name:ZooKeeperConnection Watcher:127.0.0.1:60811/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 51026 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 51027 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 51027 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
:    [junit4]   2> 51029 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
:    [junit4]   2> 51035 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
:    [junit4]   2> 51037 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
:    [junit4]   2> 51039 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
:    [junit4]   2> 51041 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 51041 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 51043 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7d0bfa0d 
name:ZooKeeperConnection Watcher:127.0.0.1:60811/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 51043 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 51044 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 51044 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
:    [junit4]   2> 51046 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect
:    [junit4]   2> 51048 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
:    [junit4]   2> 51050 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer (id=null) closing
:    [junit4]   2> 51051 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/overseer_elect/election/94818801370398723-127.0.0.1:60811_solr-n_0000000000
:    [junit4]   2> 51051 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60811_solr
:    [junit4]   2> 51052 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
:    [junit4]   2> 51053 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801370398723-127.0.0.1:60811_solr-n_0000000000) starting
:    [junit4]   2> 51055 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
:    [junit4]   2> 51058 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
:    [junit4]   2> 51060 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
:    [junit4]   2> 51063 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
:    [junit4]   2> 51065 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
:    [junit4]   2> 51068 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
:    [junit4]   2> 51072 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
:    [junit4]   2> 51073 INFO  
(OverseerCollectionConfigSetProcessor-94818801370398723-127.0.0.1:60811_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
:    [junit4]   2> 51073 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 51074 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
:    [junit4]   2> 51075 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 51076 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 51077 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 51081 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@286bb11a 
name:ZooKeeperConnection Watcher:127.0.0.1:60811/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 51081 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 51081 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 51083 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 51086 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1
:    [junit4]   2> 51090 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 51090 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 51091 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 0)
:    [junit4]   2> 51095 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 0
:    [junit4]   2> 51095 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 51096 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
:    [junit4]   2> 51096 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
:    [junit4]   2> 51098 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 51098 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 51098 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 51594 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard3/election
:    [junit4]   2> 51596 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 51596 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 51597 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 51603 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard3/election/94818801370398724-127.0.0.1_core1-n_0000000000
:    [junit4]   2> 51604 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard3
:    [junit4]   2> 51611 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 51615 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard3",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core1"} current state version: 1
:    [junit4]   2> 51618 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core2",
:    [junit4]   2>   "core_node_name":"node2",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 1
:    [junit4]   2> 51618 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core2",
:    [junit4]   2>   "core_node_name":"node2",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 51619 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
:    [junit4]   2> 51619 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
:    [junit4]   2> 51722 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 51722 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 51723 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52117 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard2/election
:    [junit4]   2> 52122 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard2/election/94818801370398724-127.0.0.1_core2-n_0000000000
:    [junit4]   2> 52123 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard2
:    [junit4]   2> 52126 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 52130 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard2",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core2"} current state version: 2
:    [junit4]   2> 52133 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core3",
:    [junit4]   2>   "core_node_name":"node3",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 2
:    [junit4]   2> 52134 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core3",
:    [junit4]   2>   "core_node_name":"node3",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 52134 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
:    [junit4]   2> 52134 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
:    [junit4]   2> 52238 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52238 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52238 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52631 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection1/leader_elect/shard1/election
:    [junit4]   2> 52638 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection1/leader_elect/shard1/election/94818801370398724-127.0.0.1_core3-n_0000000000
:    [junit4]   2> 52639 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/leaders/shard1
:    [junit4]   2> 52642 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 52646 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core3"} current state version: 3
:    [junit4]   2> 52750 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52750 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52750 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52799 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core0",
:    [junit4]   2>   "core_node_name":"node0",
:    [junit4]   2>   "collection":"",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 4
:    [junit4]   2> 52800 ERROR 
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has 
no collection specified: {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core0",
:    [junit4]   2>   "core_node_name":"node0",
:    [junit4]   2>   "collection":"",
:    [junit4]   2>   "numShards":"1",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 52802 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"deletecore",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core0",
:    [junit4]   2>   "core_node_name":"node0",
:    [junit4]   2>   "collection":""} current state version: 4
:    [junit4]   2> 52802 ERROR 
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.CollectionMutator Skipping invalid Overseer message because it has 
no collection specified: {
:    [junit4]   2>   "operation":"deletecore",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core0",
:    [junit4]   2>   "core_node_name":"node0",
:    [junit4]   2>   "collection":""}
:    [junit4]   2> 52804 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"node1",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 4
:    [junit4]   2> 52805 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "core_node_name":"node1",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 52805 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ClusterStateMutator building a new cName: collection2
:    [junit4]   2> 52805 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard3
:    [junit4]   2> 52909 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52909 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 52909 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53302 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard3/election
:    [junit4]   2> 53304 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 53304 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 53305 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections, has occurred - updating...
:    [junit4]   2> 53309 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard3/election/94818801370398724-127.0.0.1_core1-n_0000000000
:    [junit4]   2> 53310 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard3
:    [junit4]   2> 53313 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 53317 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard3",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core1"} current state version: 5
:    [junit4]   2> 53320 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core2",
:    [junit4]   2>   "core_node_name":"node2",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 5
:    [junit4]   2> 53321 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core2",
:    [junit4]   2>   "core_node_name":"node2",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 53321 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
:    [junit4]   2> 53321 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
:    [junit4]   2> 53426 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53426 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53426 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53819 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard2/election
:    [junit4]   2> 53826 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard2/election/94818801370398724-127.0.0.1_core2-n_0000000000
:    [junit4]   2> 53827 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard2
:    [junit4]   2> 53830 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 53833 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard2",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core2"} current state version: 6
:    [junit4]   2> 53836 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core3",
:    [junit4]   2>   "core_node_name":"node3",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state 
version: 6
:    [junit4]   2> 53837 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "state":"active",
:    [junit4]   2>   "node_name":"127.0.0.1",
:    [junit4]   2>   "core":"core3",
:    [junit4]   2>   "core_node_name":"node3",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "numShards":"3",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
:    [junit4]   2> 53837 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=3
:    [junit4]   2> 53837 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
:    [junit4]   2> 53941 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53941 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 53941 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 54335 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/collections/collection2/leader_elect/shard1/election
:    [junit4]   2> 54345 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.LeaderElector Joined leadership election with path: 
/collections/collection2/leader_elect/shard1/election/94818801370398724-127.0.0.1_core3-n_0000000000
:    [junit4]   2> 54347 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection2/leaders/shard1
:    [junit4]   2> 54350 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
:    [junit4]   2> 54355 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"leader",
:    [junit4]   2>   "shard":"shard1",
:    [junit4]   2>   "collection":"collection2",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr/";,
:    [junit4]   2>   "core":"core3"} current state version: 7
:    [junit4]   2> 54460 INFO  (zkCallback-62-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 54460 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 54460 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 1)
:    [junit4]   2> 54506 INFO  (zkCallback-63-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 54507 INFO  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live 
nodes size: 1)
:    [junit4]   2> 56007 WARN  (zkCallback-65-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
:    [junit4]   2> 56010 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:60811 60811
:    [junit4]   2> 56253 INFO  (Thread-87) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:60811 60811
:    [junit4]   2> 56256 WARN  (Thread-87) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
:    [junit4]   2> Maximum concurrent create/delete watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      3       /solr/aliases.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent data watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      3       /solr/clusterstate.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent children watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      3       /solr/collections
:    [junit4]   2>      3       /solr/live_nodes
:    [junit4]   2> 
:    [junit4]   2> 56256 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testBadQueueItem
:    [junit4]   2> 56256 INFO  
(TEST-OverseerTest.testBadQueueItem-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818801370398723-127.0.0.1:60811_solr-n_0000000000) closing
:    [junit4]   2> 56256 INFO  
(OverseerStateUpdate-94818801370398723-127.0.0.1:60811_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60811_solr
:    [junit4]   2> 56259 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
:    [junit4]   2> 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect/leader
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2>      at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
:    [junit4]   2> 56267 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReplay
:    [junit4]   2> 56268 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
:    [junit4]   2> 56268 INFO  (Thread-88) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 56268 INFO  (Thread-88) [    ] o.a.s.c.ZkTestServer Starting 
server
:    [junit4]   2> 56368 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:43766
:    [junit4]   2> 56368 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 56371 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 56376 INFO  (zkCallback-66-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@de91d1d name:ZooKeeperConnection 
Watcher:127.0.0.1:43766/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
:    [junit4]   2> 56376 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 56376 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 56377 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 56377 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 56379 INFO  (zkCallback-67-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@20a01f5b 
name:ZooKeeperConnection Watcher:127.0.0.1:43766 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 56379 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 56380 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 56381 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
:    [junit4]   2> 56382 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
:    [junit4]   2> 56383 INFO  (zkCallback-68-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6318cd44 
name:ZooKeeperConnection Watcher:127.0.0.1:43766 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 56383 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
:    [junit4]   2> 56384 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
:    [junit4]   2> 56384 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
:    [junit4]   2> 56387 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /live_nodes
:    [junit4]   2> 56389 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections
:    [junit4]   2> 56391 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /aliases.json
:    [junit4]   2> 56393 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
:    [junit4]   2> 56395 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /security.json
:    [junit4]   2> 56397 INFO  
(TEST-OverseerTest.testReplay-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 56401 INFO  (TEST-OverseerTest.testReplay-seed
: 
: [...truncated too long message...]
: 
: nit4]   2> 105808 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue
:    [junit4]   2> 105810 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
:    [junit4]   2> 105813 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
:    [junit4]   2> 105815 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
:    [junit4]   2> 105817 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
:    [junit4]   2> 105819 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
:    [junit4]   2> 105822 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
:    [junit4]   2> 105829 INFO  
(OverseerCollectionConfigSetProcessor-94818804959215619-127.0.0.1:40794_solr-n_0000000000)
 [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer 
operations
:    [junit4]   2> 105833 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.Overseer Starting to work on the main queue
:    [junit4]   2> 105834 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
:    [junit4]   2> 105837 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "roles":"",
:    [junit4]   2>   "state":"recovering"} current state version: 0
:    [junit4]   2> 105837 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "roles":"",
:    [junit4]   2>   "state":"recovering"}
:    [junit4]   2> 105838 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
:    [junit4]   2> 105840 INFO  (zkCallback-157-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
:    [junit4]   2> 105840 INFO  (zkCallback-154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
:    [junit4]   2> 105896 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "roles":"",
:    [junit4]   2>   "state":"active"} current state version: 1
:    [junit4]   2> 105897 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator Update state numShards=null message={
:    [junit4]   2>   "operation":"state",
:    [junit4]   2>   "base_url":"http://127.0.0.1/solr";,
:    [junit4]   2>   "node_name":"node1",
:    [junit4]   2>   "collection":"collection1",
:    [junit4]   2>   "core":"core1",
:    [junit4]   2>   "roles":"",
:    [junit4]   2>   "state":"active"}
:    [junit4]   2> 105897 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator node=core_node1 is already registered
:    [junit4]   2> 105897 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.o.ReplicaMutator shard=shard1 is already registered
:    [junit4]   2> 106000 INFO  (zkCallback-154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
:    [junit4]   2> 106000 INFO  (zkCallback-157-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred 
- updating... (live nodes size: 0)
:    [junit4]   2> 106053 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:40794 40794
:    [junit4]   2> 106225 INFO  (Thread-96) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:40794 40794
:    [junit4]   2> 106226 WARN  (Thread-96) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
:    [junit4]   2> Maximum concurrent create/delete watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/aliases.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent data watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/clusterstate.json
:    [junit4]   2> 
:    [junit4]   2> Maximum concurrent children watches above limit:
:    [junit4]   2> 
:    [junit4]   2>      2       /solr/collections
:    [junit4]   2>      2       /solr/live_nodes
:    [junit4]   2> 
:    [junit4]   2> 106226 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testStateChange
:    [junit4]   2> 106226 INFO  
(TEST-OverseerTest.testStateChange-seed#[7B352AEEA690CBAB]) [    ] 
o.a.s.c.Overseer Overseer 
(id=94818804959215619-127.0.0.1:40794_solr-n_0000000000) closing
:    [junit4]   2> 106227 INFO  
(OverseerStateUpdate-94818804959215619-127.0.0.1:40794_solr-n_0000000000) [    
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40794_solr
:    [junit4]   2> 106228 ERROR (OverseerExitThread) [    ] o.a.s.c.Overseer 
could not read the data
:    [junit4]   2> 
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = 
Session expired for /overseer_elect/leader
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2>      at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2>      at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
:    [junit4]   2>      at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:304)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:87)
:    [junit4]   2>      at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:265)
:    [junit4]   2> 109228 INFO  
(SUITE-OverseerTest-seed#[7B352AEEA690CBAB]-worker) [    ] o.a.s.SolrTestCaseJ4 
###deleteCore
:    [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.OverseerTest_7B352AEEA690CBAB-001
:    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {}, 
docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, 
locale=hu, timezone=NET
:    [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.7.0_80 (64-bit)/cpus=4,threads=1,free=198038552,total=343932928
:    [junit4]   2> NOTE: All tests run in this JVM: [HardAutoCommitTest, 
TestPerFieldSimilarity, FieldMutatingUpdateProcessorTest, 
VMParamsZkACLAndCredentialsProvidersTest, VersionInfoTest, 
LukeRequestHandlerTest, DeleteLastCustomShardedReplicaTest, ActionThrottleTest, 
OverseerTest]
:    [junit4] Completed [24/545] on J2 in 60.31s, 12 tests, 1 failure, 1 
skipped <<< FAILURES!
: 
: [...truncated 1651 lines...]
: BUILD FAILED
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:785: 
The following error occurred while executing this line:
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:729: 
The following error occurred while executing this line:
: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: 
The following error occurred while executing this line:
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233:
 The following error occurred while executing this line:
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526:
 The following error occurred while executing this line:
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1452:
 The following error occurred while executing this line:
: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1006:
 There were test failures: 545 suites (7 ignored), 2156 tests, 1 failure, 51 
ignored (37 assumptions) [seed: 7B352AEEA690CBAB]
: 
: Total time: 60 minutes 54 seconds
: Build step 'Invoke Ant' marked build as failure
: Archiving artifacts
: Recording test results
: Email was triggered for: Failure - Any
: Sending email for trigger: Failure - Any
: 
: 
: 

-Hoss
http://www.lucidworks.com/

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to