Hi Gervais,
The engine doesn't need to be able to ping the IP address, just
needs to know what it is so adding them to the /etc/hosts file should work.
Also, I would check ovirt1, is it mounting the brick, what does "systemctl
status glusterd" show, what are the logs in /var/log/gluster ?
Regards,
Paul S.
________________________________
From: Gervais de Montbrun <[email protected]>
Sent: 24 November 2021 01:16
To: Staniforth, Paul <[email protected]>
Cc: Vojtech Juranek <[email protected]>; [email protected] <[email protected]>
Subject: Re: [ovirt-users] How to debug "Non Operational" host
Caution External Mail: Do not click any links or open any attachments unless
you trust the sender and know that the content is safe.
Hi Paul,
I don't quite get what you mean by this:
assuming you have a storage network for the gluster nodes the engine needs to
resolve be able to resolve the host addresses
The storage network is on 10GB network cards and plugged into a stand-alone
switch. The hosted-engine is not on the same network at all and can not ping
the IP's associated with those cards. Are you saying that it needs access to
that network, or that is needs to be able to resolve the IP's. I can add them
to the /etc/hosts file on the ovirt-engine or do I need to reconfigure my
setup? It was working as it currently configured before applying the update.
I have no idea why the ovirt1 server is not showing up with the fqdn. I set up
all the servers the same way. It's been like that since I set things up. I have
looked for where this might be corrected, but can't find it. Ideas?
The yellow bricks... I can force start them (and I have in the past), but now
it turns green for a few minutes and then returns to red.
Cheers,
Gervais
On Nov 23, 2021, at 12:57 PM, Staniforth, Paul
<[email protected]<mailto:[email protected]>> wrote:
Hello Gervais,
is the brick mounted on ovirt1 ? can you mount it using the
settings in /etc/fstab ?
The hostname is not using a FQDN for ovirt1
assuming you have a storage network for the gluster nodes the engine needs to
resolve be able to resolve the host addresses
ovirt1-storage.dgi
ovirt2-storage.dgi
ovirt3-storage.dgi
So that it can assign them to the correct network.
When the volume is showing yellow you can force restart them again from the GUI.
Regards,
Paul S.
________________________________
From: Gervais de Montbrun
<[email protected]<mailto:[email protected]>>
Sent: 23 November 2021 13:42
To: Vojtech Juranek <[email protected]<mailto:[email protected]>>
Cc: [email protected]<mailto:[email protected]>
<[email protected]<mailto:[email protected]>>
Subject: [ovirt-users] Re: How to debug "Non Operational" host
Caution External Mail: Do not click any links or open any attachments unless
you trust the sender and know that the content is safe.
Hi Vojta,
Thanks for the help.
I tried to activate my server this morning and captured the logs from vdsm.log
and engine.log. They are attached.
Something went awry with my gluster (I think) as it is showing that the bricks
on the affected server (ovirt1) are not mounted:
<PastedGraphic-2.png>
<PastedGraphic-3.png>
<PastedGraphic-4.png>
The networking looks fine.
Cheers,
Gervais
> On Nov 23, 2021, at 3:37 AM, Vojtech Juranek
> <[email protected]<mailto:[email protected]>> wrote:
>
> On Tuesday, 23 November 2021 03:36:07 CET Gervais de Montbrun wrote:
>> Hi Folks,
>>
>> I did a minor upgrade on the first host in my cluster and now it is
>> reporting "Non Operational"
>>
>> This is what yum showed as updatable. However, I did the update through the
>> ovirt-engine web interface.
>>
>> ovirt-node-ng-image-update.noarch
>> 4.4.9-1.el8
>> ovirt-4.4 Obsoleting Packages
>> ovirt-node-ng-image-update.noarch
>> 4.4.9-1.el8
>> ovirt-4.4 ovirt-node-ng-image-update.noarch
>> 4.4.8.3-1.el8
>> @System ovirt-node-ng-image-update.noarch
>> 4.4.9-1.el8
>> ovirt-4.4
>> ovirt-node-ng-image-update-placeholder.noarch
>> 4.4.8.3-1.el8
>> @System
>>
>> How do I start to debug this issue?
>
> Check engine log in /var/log/ovirt-engine/engine.log on the machine where
> engine runs
>
>>
>>
>> Also, it looks like the vmstore brick is not mounting on that host. I only
>> see the engine mounted.
>
>
> Could you also attach relevant part of vdsm log (/var/log/vdsm/vdsm.log) from
> the machine where mount failed? You should see some mount related error there.
> This could be also a reason why hosts become non-operational.
>
> Thanks
> Vojta
>
>> Broken server:
>> [email protected]<mailto:[email protected]> log]# mount | grep storage
>> ovirt1-storage.dgi:/engine on
>> /rhev/data-center/mnt/glusterSD/ovirt1-storage.dgi:_engine type
>> fuse.glusterfs
>> (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=
>> 131072) Working server:
>> [[email protected]<mailto:[email protected]> ~]# mount | grep storage
>> ovirt1-storage.dgi:/engine on
>> /rhev/data-center/mnt/glusterSD/ovirt1-storage.dgi:_engine type
>> fuse.glusterfs
>> (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=
>> 131072) ovirt1-storage.dgi:/vmstore on
>> /rhev/data-center/mnt/glusterSD/ovirt1-storage.dgi:_vmstore type
>> fuse.glusterfs
>> (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=
>> 131072)
>>
>>
>> I tried putting the server into maintenance mode and running a reinstall on
>> it. No change. I'de really appreciate some help sorting this our.
>>
>> Cheers,
>> Gervais
>
> _______________________________________________
> Users mailing list -- [email protected]<mailto:[email protected]>
> To unsubscribe send an email to
> [email protected]<mailto:[email protected]>
> Privacy Statement:
> https://www.ovirt.org/privacy-policy.html<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fprivacy-policy.html&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788437847%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2F3pnIPY7QWD4jDdzM6aze9UqNQ38YwDEtI55EVmHfhg%3D&reserved=0>
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788447840%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Ij6htDZOlrnUtb5c2YxjHekmihU0thUmKSmrKv6oNuU%3D&reserved=0>
> List Archives:
> https://lists.ovirt.org/archives/list/[email protected]/message/S6C7R6LUTJXFMG7WIODA53VEU4O7ZNHJ/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovirt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2FS6C7R6LUTJXFMG7WIODA53VEU4O7ZNHJ%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788457834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=TeVczdE4ufEWsOE%2BO6xCtuH%2BKCEq1hUSGvuZbMle12w%3D&reserved=0>
_______________________________________________
Users mailing list -- [email protected]<mailto:[email protected]>
To unsubscribe send an email to
[email protected]<mailto:[email protected]>
Privacy Statement:
https://www.ovirt.org/privacy-policy.html<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fprivacy-policy.html&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788457834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=AsVBpxVmoa88sGg7CEH8ZQjeiZRX41vvFxJYQdBKAe8%3D&reserved=0>
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788467829%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=wqpFmVZ%2FR8DNhEvwL9q%2F%2F7gr%2B2mi7M2cKDMQFfKu4JY%3D&reserved=0>
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/AWSWTXS6CEAYSAC3DUDNUTUZKPA7237E/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovirt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2FAWSWTXS6CEAYSAC3DUDNUTUZKPA7237E%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788467829%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=aub9dmg0jwjbtvJvw4sKh324ESVQ3xfQUtH8CxOY%2F2k%3D&reserved=0>
To view the terms under which this email is distributed, please go to:-
https://leedsbeckett.ac.uk/disclaimer/email<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fleedsbeckett.ac.uk%2Fdisclaimer%2Femail&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788477824%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=GsLbo5xNv7ateNhcyrvHqqX4%2B6UDdW9AiJwsvY2RCfc%3D&reserved=0>
_______________________________________________
Users mailing list -- [email protected]<mailto:[email protected]>
To unsubscribe send an email to
[email protected]<mailto:[email protected]>
Privacy Statement:
https://www.ovirt.org/privacy-policy.html<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fprivacy-policy.html&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788477824%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=iPG6Ce7TLF1FB8CXJEOoLYxqJbF4kOeOlJKh%2Br8sYV4%3D&reserved=0>
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ovirt.org%2Fcommunity%2Fabout%2Fcommunity-guidelines%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788487819%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Q9sXRA2CWFz6RuvZwgEIVJ1n8szkpaCKPs%2FbPacF1D4%3D&reserved=0>
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/4YYEHIXZCSQCNRUU3WO5KS4ILTGBMUTD/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.ovirt.org%2Farchives%2Flist%2Fusers%40ovirt.org%2Fmessage%2F4YYEHIXZCSQCNRUU3WO5KS4ILTGBMUTD%2F&data=04%7C01%7Cp.staniforth%40leedsbeckett.ac.uk%7C4d35e3e638364ecf178408d9aee81b1f%7Cd79a81124fbe417aa112cd0fb490d85c%7C0%7C0%7C637733134788487819%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=dkKxRI9TC7derx4ZvMT4BX4LOmwSeGMt2916oz170g4%3D&reserved=0>
To view the terms under which this email is distributed, please go to:-
https://leedsbeckett.ac.uk/disclaimer/email
_______________________________________________
Users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/[email protected]/message/H7SLDPRW6FJ5S4SBNICGFLHVKVD3F6OP/
