Hello! Can you provide logs from nodes which are considered OFFLINE by cluster?
Please note that it is advised to start one node and then start all other when first one is up, as opposed to starting them all at the same moment. Regards, -- Ilya Kasnacheev чт, 17 окт. 2019 г. в 17:54, shivakumar <[email protected]>: > Hi all, > I have Ignite deployment on Kubernetes and I wanted to restart all nodes so > I am using "kill -k" command from the visor shell. > after running this command it is restarting all nodes, once all nodes join > the topology sometimes few nodes are going into OFFLINE state [eventhough > the nodes are up and running] and it looks like it is causing split-brain > or > split cluster scenario. > > > [ignite@ignite-shiva-visor-68cb697b5-qbccr bin]$ ./control.sh --user > ignite > --password ignite --host ignite-service-br --baseline > Control utility [ver. 2.7.6#19700101-sha1:DEV] > 2019 Copyright(C) Apache Software Foundation > User: ignite > > -------------------------------------------------------------------------------- > Cluster state: inactive > Current topology version: 1 > > Baseline nodes: > ConsistentID=253094b4-877b-45ae-ad06-07e639befffc, STATE=ONLINE > ConsistentID=862e324b-f3d1-4198-92d0-0d1d2c4a2f88, STATE=OFFLINE > ConsistentID=86b5f451-ac4f-4479-9f6e-2db6ab5d11e7, STATE=OFFLINE > > -------------------------------------------------------------------------------- > Number of baseline nodes: 3 > > Other nodes not found. > [ignite@ignite-shiva-visor-68cb697b5-qbccr bin]$ ./control.sh --user > ignite > --password ignite --host ignite-service-br --baseline > Control utility [ver. 2.7.6#19700101-sha1:DEV] > 2019 Copyright(C) Apache Software Foundation > User: ignite > > -------------------------------------------------------------------------------- > Cluster state: inactive > Current topology version: 2 > > Baseline nodes: > ConsistentID=253094b4-877b-45ae-ad06-07e639befffc, STATE=OFFLINE > ConsistentID=862e324b-f3d1-4198-92d0-0d1d2c4a2f88, STATE=ONLINE > ConsistentID=86b5f451-ac4f-4479-9f6e-2db6ab5d11e7, STATE=ONLINE > > -------------------------------------------------------------------------------- > Number of baseline nodes: 3 > > Other nodes not found. > [ignite@ignite-shiva-visor-68cb697b5-qbccr bin]$ ./control.sh --user > ignite > --password ignite --host ignite-service-br --baseline > Control utility [ver. 2.7.6#19700101-sha1:DEV] > 2019 Copyright(C) Apache Software Foundation > User: ignite > > -------------------------------------------------------------------------------- > Cluster state: inactive > Current topology version: 2 > > Baseline nodes: > ConsistentID=253094b4-877b-45ae-ad06-07e639befffc, STATE=OFFLINE > ConsistentID=862e324b-f3d1-4198-92d0-0d1d2c4a2f88, STATE=ONLINE > ConsistentID=86b5f451-ac4f-4479-9f6e-2db6ab5d11e7, STATE=ONLINE > > -------------------------------------------------------------------------------- > Number of baseline nodes: 3 > > Other nodes not found. > [ignite@ignite-shiva-visor-68cb697b5-qbccr bin]$ ./control.sh --user > ignite > --password ignite --host ignite-service-br --baseline > Control utility [ver. 2.7.6#19700101-sha1:DEV] > 2019 Copyright(C) Apache Software Foundation > User: ignite > > -------------------------------------------------------------------------------- > Cluster state: inactive > Current topology version: 2 > > Baseline nodes: > ConsistentID=253094b4-877b-45ae-ad06-07e639befffc, STATE=OFFLINE > ConsistentID=862e324b-f3d1-4198-92d0-0d1d2c4a2f88, STATE=ONLINE > ConsistentID=86b5f451-ac4f-4479-9f6e-2db6ab5d11e7, STATE=ONLINE > > -------------------------------------------------------------------------------- > Number of baseline nodes: 3 > > Other nodes not found. > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
