The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, it's what I use in my test environment. I really cannot explain why tcmu-runner is missing the rbd handler. I can only assume you have restarted the daemon after installing it. Any other log messages from tcmu-runner? Do you have a "/usr/lib64/tcmu-runner/handler_rbd.so" file? Perhaps enable debug-level logging in "/etc/tcmu/tcmu.conf" and see if that helps.
On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick <bernh...@bdick.de> wrote: > Am 29.06.2018 um 17:26 schrieb Jason Dillaman: > > OK, so your tcmu-runner doesn't have support for rbd images for some > > reason. Where did you get your copy of tcmu-runner? > hm originally I took it from the gluster40 repository from the Centos > Storage SIG. > > You should build it > > from upstream or pull a copy from here [1]. > > > > [1] https://shaman.ceph.com/repos/tcmu-runner/ > I tried the version: > > https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm > (because the version number from the storage SIG was a 1.3.0-rc4 which > seemed a bit low). That resulted also in the error above. > > Now I tried the version from > > https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/ > but the error persists. > > I am however able to map and unmap the image on the host using rbd map > and unmap commands. > > Regards > Bernhard > > > > On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick <bernh...@bdick.de > > <mailto:bernh...@bdick.de>> wrote: > > > > Hi, > > > > Am 29.06.2018 um 17:04 schrieb Jason Dillaman: > > > Is 'tcmu-runner' running on that node? > > yes it is running > > > > > Any errors in dmesg or > > here are no errors > > > /var/log/tcmu-runner.log? > > the following error is shown: > > [ERROR] add_device:436: could not find handler for uio0 > > > > Regards > > Bernhard > > > > > > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick <bernh...@bdick.de > > <mailto:bernh...@bdick.de> > > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>> wrote: > > > > > > Hi, > > > > > > Am 28.06.2018 um 18:09 schrieb Jason Dillaman: > > > > Do you have the ansible backtrace from the "ceph-iscsi-gw : > > > igw_lun | > > > > configureluns (create/map rbds and add to lio)]" step? > > > I assume you mean the following (from running with verbosity > > 3, after > > > running the purge-iscsi-gateways playbook beforehand) > > > > > > Using module file > /home/dick/git/ceph-ansible/library/igw_lun.py > > > <ovirt-test04> ESTABLISH SSH CONNECTION FOR USER: root > > > <ovirt-test04> SSH: EXEC ssh -o ControlMaster=auto -o > > > ControlPersist=600s -o StrictHostKeyChecking=no -o > > > KbdInteractiveAuthentication=no -o > > > PreferredAuthentications=gssapi-with-mic,g > > > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no > -o > > > User=root -o ConnectTimeout=30 -o > > > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04 > > '/bin/sh -c > > > '"'"'/usr/bin/p > > > ython && sleep 0'"'"'' > > > <ovirt-test04> (1, '', 'Traceback (most recent call last):\n > > File > > > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in > > > <module>\n > > > ansible_main()\n File "/tmp/ansible_F3 > > > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n > > > lun.manage(desired_state)\n File > > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > line 365, > > > in manage\n self.allocate()\n File "/u > > > sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > line 490, in > > > allocate\n lun = self.add_dev_to_lio()\n File > > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > line 683, > > > in add_dev_to_lio\n > > > wwn=in_wwn, control=control_string)\n File > > > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line > 818, in > > > __init__\n self._configure(config, size, wwn, > hw_max_sectors, > > > control)\n File "/usr/lib/pytho > > > n2.7/site-packages/rtslib_fb/tcm.py", line 836, in > _configure\n > > > self._enable()\n File > > > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line > 172, in > > > _enable\n fwrite(path, "1\\n")\n File "/usr/lib/pyt > > > hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n > > > file_fd.write(str(string))\nIOError: [Errno 2] No such file or > > > directory\n') > > > The full traceback is: > > > Traceback (most recent call last): > > > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", > > line 166, in > > > <module> > > > ansible_main() > > > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", > > line 135, in > > > ansible_main > > > lun.manage(desired_state) > > > File > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > > line 365, in manage > > > self.allocate() > > > File > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > > line 490, in allocate > > > lun = self.add_dev_to_lio() > > > File > > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py", > > > line 683, in add_dev_to_lio > > > wwn=in_wwn, control=control_string) > > > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", > > line 818, > > > in __init__ > > > self._configure(config, size, wwn, hw_max_sectors, > control) > > > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", > > line 836, > > > in _configure > > > self._enable() > > > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", > > line 172, > > > in _enable > > > fwrite(path, "1\n") > > > File > > "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line > > > 79, > > > in fwrite > > > file_fd.write(str(string)) > > > IOError: [Errno 2] No such file or directory > > > > > > failed: [ovirt-test04] (item={u'host': u'ovirt-test04', > u'image': > > > u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size': > > > u'1G'}) => { > > > "changed": false, > > > "item": { > > > "host": "ovirt-test04", > > > "image": "iscsi2342", > > > "pool": "rbd", > > > "size": "1G", > > > "state": "present" > > > }, > > > "module_stderr": "Traceback (most recent call last):\n > > File > > > \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, > in > > > <module>\n ansible_main()\n File > > > \"/tmp/ansible_F3sf6j/ansible_module_igw_lun. > > > py\", line 135, in ansible_main\n > > lun.manage(desired_state)\n File > > > > > \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line > > > 365, > > > in manage\n self.allocate()\n File > > \"/usr/lib/python2.7/site-pa > > > ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\n > > lun = > > > self.add_dev_to_lio()\n File > > > > > \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line > > > 683, > > > in add_dev_to_lio\n wwn=in_wwn, contr > > > ol=control_string)\n File > > > \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line > > 818, in > > > __init__\n self._configure(config, size, wwn, > hw_max_sectors, > > > control)\n File \"/usr/lib/python2.7/site-packages > > > /rtslib_fb/tcm.py\", line 836, in _configure\n > > self._enable()\n > > > File > > > \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line > > 172, in > > > _enable\n fwrite(path, \"1\\n\")\n File > > \"/usr/lib/python2.7/site- > > > packages/rtslib_fb/utils.py\", line 79, in fwrite\n > > > file_fd.write(str(string))\nIOError: [Errno 2] No such file or > > > directory\n", > > > "module_stdout": "", > > > "msg": "MODULE FAILURE", > > > "rc": 1 > > > } > > > > > > > Have you tried > > > > using the stock v4.16 kernel (no need to use the one on > > shaman)? > > > I have also used the v4.17.2-1.el7.elrepo.x86_64 elrepo > > kernel, having > > > the same result. > > > > > > Regards > > > Bernhard > > > > > > > > On Thu, Jun 28, 2018 at 11:29 AM Bernhard Dick > > <bernh...@bdick.de <mailto:bernh...@bdick.de> > > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>> > > > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de> > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>>> wrote: > > > > > > > > Hi Jason, > > > > > > > > Am 28.06.2018 um 14:33 schrieb Jason Dillaman: > > > > > You should have > > "/var/log/ansible-module-igw_config.log" > > > on the > > > > target > > > > > machine that hopefully includes more information > > about why the > > > > RBD image > > > > > is missing from the TCM backend. > > > > I have the logfile, however there everything seems > > fine. The last > > > > lines are: > > > > 2018-06-28 17:25:36,876 igw_lun.py DEBUG : Check > > the rbd > > > image size > > > > matches the request > > > > 2018-06-28 17:25:36,904 igw_lun.py DEBUG : rbd image > > > rbd.iscsi2342 > > > > size matches the configuration file request > > > > 2018-06-28 17:25:36,904 igw_lun.py DEBUG : Begin > > > processing LIO > > > > mapping > > > > 2018-06-28 17:25:36,905 igw_lun.py INFO : > > > (LUN.add_dev_to_lio) > > > > Adding image 'rbd.iscsi2342' to LIO > > > > 2018-06-28 17:25:36,905 igw_lun.py DEBUG : > > > > control="max_data_area_mb=8" > > > > > > > > Regards > > > > Bernhard > > > > > > > > > In the past, I've seen issues w/ image > > > > > features and image size mismatch causing the > > process to abort > > > > > > > > > > On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick > > > <bernh...@bdick.de <mailto:bernh...@bdick.de> > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>> > > > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de> > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>> > > > > > <mailto:bernh...@bdick.de > > <mailto:bernh...@bdick.de> <mailto:bernh...@bdick.de > > <mailto:bernh...@bdick.de>> > > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de> > > <mailto:bernh...@bdick.de <mailto:bernh...@bdick.de>>>>> wrote: > > > > > > > > > > Hi, > > > > > > > > > > I'm trying to setup iSCSI using ceph-ansible > > (stable-3.1) > > > > branch with > > > > > one iscsi gateway. The Host is a CentOS 7 host > > and I > > > use the > > > > packages > > > > > from the Centos Storage SIG for luminous. > > Additionally > > > I have > > > > installed: > > > > > ceph-iscsi-cli Version 2.7 Release > 13.gb9e48a7.el7 > > > > > ceph-iscsi-config Version 2.6 Release > > 15.ge016c6f.el7 > > > > > from the iscsi project at shaman.ceph.com > > <http://shaman.ceph.com> > > > <http://shaman.ceph.com> > > > > <http://shaman.ceph.com> <http://shaman.ceph.com>. > > > > > The python-rtslib version on the host is > > 2.1.fb67 Release > > > > 10.g7713d1e > > > > > also from shaman. The running kernel version is > > > > > 4.15.0-ceph-g1c778f43da52. > > > > > The ansible process stops at TASK > [ceph-iscsi-gw : > > > igw_lun | > > > > configure > > > > > luns (create/map rbds and add to lio)] > complaining > > > about file > > > > not found > > > > > while caused by the self._enable function in > > tcm.py. > > > That is > > > > due to the > > > > > directory > /sys/kernel/config/target/core/user_0/ is > > > > completely missing > > > > > at this step. > > > > > Do you have any ideas how to fix or debug this > > further? > > > > > > > > > > Regards > > > > > Bernhard > > > > > _______________________________________________ > > > > > ceph-users mailing list > > > > > ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com> > > > <mailto:ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com>> > > <mailto:ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > > > <mailto:ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com>>> > > > > <mailto:ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com> > > > <mailto:ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com>> > > <mailto:ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > > > <mailto:ceph-users@lists.ceph.com > > <mailto:ceph-users@lists.ceph.com>>>> > > > > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > > > > > > > > > > > > > > > > -- > > > > > Jason > > > > > > > > > > > > > > > > > > > > -- > > > Jason > > > > > > > > -- > > Jason > > > -- > Dipl.-Inf. Bernhard Dick > Auf dem Anger 24 > DE-46485 Wesel > www.BernhardDick.de > > jabber: bernh...@jabber.bdick.de > > Tel : +49.2812068620 > Mobil : +49.1747607927 > FAX : +49.2812068621 > USt-IdNr.: DE274728845 > -- Jason
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
