Sorry about that. I re-attach the crash log files and the mds logs. The mds log shows that the client session timeout then mds close the socket right? I think this happend behind the ceph-fuse crash. So the root cause is the ceph-fuse crash . _usr_bin_ceph-fuse.0.crash.client1.tar.gz <https://drive.google.com/file/d/0Bw059OTYnFqAbDA2R0RlS3ZHNlU/view?usp=drive_web> _usr_bin_ceph-fuse.0.crash.client2.tar.gz <https://drive.google.com/file/d/0Bw059OTYnFqAMXVCWTV6UXVnRjg/view?usp=drive_web>
2015-09-12 19:10 GMT+08:00 Shinobu Kinjo <ski...@redhat.com>: > Thank you for log archives. > > I went to dentist -; > Please do not forget CCing ceph-users from the next because there is a > bunch of really **awesome** guys; > > Can you re-attach log files again so that they see? > > Shinobu > > ----- Original Message ----- > From: "谷枫" <feiche...@gmail.com> > To: "Shinobu Kinjo" <ski...@redhat.com> > Sent: Saturday, September 12, 2015 5:32:31 PM > Subject: Re: [ceph-users] ceph-fuse auto down > > The mds log shows that the client session timeout then mds close the socket > right? > I think this happend behind the ceph-fuse crash. So the root cause is the > ceph-fuse crash . > > 2015-09-12 15:09 GMT+08:00 谷枫 <feiche...@gmail.com>: > > > Hi,Shinobu > > I notice some useful message in the mds-log. > > > > 2015-09-12 14:29 GMT+08:00 谷枫 <feiche...@gmail.com>: > > > >> > >> _usr_bin_ceph-fuse.0.crash.client1.tar.gz > >> < > https://drive.google.com/file/d/0Bw059OTYnFqAbDA2R0RlS3ZHNlU/view?usp=drive_web > > > >> > >> _usr_bin_ceph-fuse.0.crash.client2.tar.gz > >> < > https://drive.google.com/file/d/0Bw059OTYnFqAMXVCWTV6UXVnRjg/view?usp=drive_web > > > >> Hi,Shinobu > >> I check the /var/log/dmesg carefully again, but not find the useful > >> message about ceph-fuse crash. > >> So i attach two _usr_bin_ceph-fuse.0.crash files on two clients to you. > >> Please let me know if you want more about other log. Thank you very > much! > >> > >> 2015-09-12 13:01 GMT+08:00 Shinobu Kinjo <ski...@redhat.com>: > >> > >>> Ah, you are using ubuntu, sorry for that. > >>> How about: > >>> > >>> /var/log/dmesg > >>> > >>> I believe you can attach file not paste. > >>> Pasting a bunch of logs would not be good for me -; > >>> > >>> And when did you notice that cephfs was hung? > >>> > >>> Shinobu > >>> > >>> ----- Original Message ----- > >>> From: "谷枫" <feiche...@gmail.com> > >>> To: "Shinobu Kinjo" <ski...@redhat.com> > >>> Cc: "ceph-users" <ceph-users@lists.ceph.com> > >>> Sent: Saturday, September 12, 2015 1:50:05 PM > >>> Subject: Re: [ceph-users] ceph-fuse auto down > >>> > >>> hi,Shinobu > >>> There is no /var/log/messages on my system but i saw the > /var/log/syslog > >>> and no useful messages be found. > >>> I discover the /var/crash/_usr_bin_ceph-fuse.0.crash with grep the > "fuse" > >>> on the system. > >>> Below is the message in it : > >>> ProcStatus: > >>> Name: ceph-fuse > >>> State: D (disk sleep) > >>> Tgid: 2903 > >>> Ngid: 0 > >>> Pid: 2903 > >>> PPid: 1 > >>> TracerPid: 0 > >>> Uid: 0 0 0 0 > >>> Gid: 0 0 0 0 > >>> FDSize: 64 > >>> Groups: 0 > >>> VmPeak: 7428552 kB > >>> VmSize: 6838728 kB > >>> VmLck: 0 kB > >>> VmPin: 0 kB > >>> VmHWM: 1175864 kB > >>> VmRSS: 343116 kB > >>> VmData: 6786232 kB > >>> VmStk: 136 kB > >>> VmExe: 5628 kB > >>> VmLib: 7456 kB > >>> VmPTE: 3404 kB > >>> VmSwap: 0 kB > >>> Threads: 37 > >>> SigQ: 1/64103 > >>> SigPnd: 0000000000000000 > >>> ShdPnd: 0000000000000000 > >>> SigBlk: 0000000000001000 > >>> SigIgn: 0000000000001000 > >>> SigCgt: 00000001c18040eb > >>> CapInh: 0000000000000000 > >>> CapPrm: 0000003fffffffff > >>> CapEff: 0000003fffffffff > >>> CapBnd: 0000003fffffffff > >>> Seccomp: 0 > >>> Cpus_allowed: ffff > >>> Cpus_allowed_list: 0-15 > >>> Mems_allowed: 00000000,00000001 > >>> Mems_allowed_list: 0 > >>> voluntary_ctxt_switches: 25 > >>> nonvoluntary_ctxt_switches: 2 > >>> Signal: 11 > >>> Uname: Linux 3.19.0-28-generic x86_64 > >>> UserGroups: > >>> CoreDump: base64 > >>> > >>> Is this useful infomations? > >>> > >>> > >>> 2015-09-12 12:33 GMT+08:00 Shinobu Kinjo <ski...@redhat.com>: > >>> > >>> > There should be some complains in /var/log/messages. > >>> > Can you attach? > >>> > > >>> > Shinobu > >>> > > >>> > ----- Original Message ----- > >>> > From: "谷枫" <feiche...@gmail.com> > >>> > To: "ceph-users" <ceph-users@lists.ceph.com> > >>> > Sent: Saturday, September 12, 2015 1:30:49 PM > >>> > Subject: [ceph-users] ceph-fuse auto down > >>> > > >>> > Hi,all > >>> > My cephfs cluster deploy on three nodes with Ceph Hammer 0.94.3 on > >>> Ubuntu > >>> > 14.04 the kernal version is 3.19.0. > >>> > > >>> > I mount the cephfs with ceph-fuse on 9 clients,but some of them > >>> (ceph-fuse > >>> > process) auto down sometimes and i can't find the reason seems like > >>> there > >>> > is no other logs can be found except this file > >>> > /var/log/ceph/ceph-client.admin.log that without useful messages for > >>> me. > >>> > > >>> > When the ceph-fuse down . The mount driver is gone. > >>> > How can i find the reason of this problem. Can some guys give me good > >>> > ideas? > >>> > > >>> > Regards > >>> > > >>> > > >>> > _______________________________________________ > >>> > ceph-users mailing list > >>> > ceph-users@lists.ceph.com > >>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >>> > > >>> > >> > >> > > >
ceph-mds.ceph04.tar.gz
Description: GNU Zip compressed data
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
