On Fri, Sep 28, 2018 at 2:28 PM Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > > Looks like that if I move files between different data pools of the > cephfs, something is still refering to the 'old location' and gives an > Input/output error. I assume this, because I am using different client > ids for authentication. > > With the same user as configured in ganesha, mounting (kernel) erasure > code cephfs m > can create file out4 > > At nfs4 client, same location m > I can read out4 > I can create out5 > I can read out5 > > Mounted root cephfs create file in folder t (test replicated 1) > I can create out6 > I can move out6 to a the folder m (erasure coded) > I can read out6 > > At nfs4 client, m location > [@m]# cat out6 > cat: out6: Input/output error
If it was due to permissions, I would expect to see EPERM rather than EIO. EIO suggests something more fundamentally broken, like a client version that doesn't understand the latest layout format. Assuming you're using the CephFS FSAL in Ganesha (rather than re-exporting a local mount of CephFS), it should be possible to create an /etc/ceph/ceph.conf file with a "[client]" section that enables debug logging (debug client = 10 or similar), and sets an output location ("log file = /tmp/client.log") -- that might give a bit more information about the nature of the error. John > > > > [client.cephfs.t] > key = xxx== > caps mds = "allow rw path=/t" > caps mgr = "allow r" > caps mon = "allow r" > caps osd = "allow rwx pool=fs_meta,allow rwx pool=fs_data, allow > rwx pool=fs_data.r1" > > [client.cephfs.m] > key = xxx== > caps mds = "allow rw path=/m" > caps mgr = "allow r" > caps mon = "allow r" > caps osd = "allow rwx pool=fs_meta,allow rwx pool=fs_data.ec" > > > [@ test]# cat /etc/redhat-release > CentOS Linux release 7.5.1804 (Core) > > [@ test]# rpm -qa | grep ceph | sort > ceph-12.2.8-0.el7.x86_64 > ceph-base-12.2.8-0.el7.x86_64 > ceph-common-12.2.8-0.el7.x86_64 > ceph-fuse-12.2.8-0.el7.x86_64 > ceph-mds-12.2.8-0.el7.x86_64 > ceph-mgr-12.2.8-0.el7.x86_64 > ceph-mon-12.2.8-0.el7.x86_64 > ceph-osd-12.2.8-0.el7.x86_64 > ceph-radosgw-12.2.8-0.el7.x86_64 > ceph-selinux-12.2.8-0.el7.x86_64 > collectd-ceph-5.8.0-2.el7.x86_64 > libcephfs2-12.2.8-0.el7.x86_64 > python-cephfs-12.2.8-0.el7.x86_64 > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com