Hi all,
Today I tried to add a new OSD into the cluster and immediately it get the
monitors crashed.
Platform: RHEL6.4
Steps to add new monitor:
1. sudo ceph-disk zap /dev/sdh
2. sudo ceph-disk activate /dev/sdh
Then the monitor got crashed with the following logs:
013-10-30 02:17:14.252726 7f44395a9700 0 mon.ceph2@0(leader) e2 handle_command
mon_command({"prefix": "osd crush create-or-move", "args": ["root=default",
"host=ceph8"], "id": 24, "weight": 0.40999999999999998} v 0) v1
2013-10-30 02:17:14.252792 7f44395a9700 1 mon.ceph2@0(leader).paxos(paxos
active c 322285..323030) is_readable now=2013-10-30 02:17:14.252794
lease_expire=2013-10-30 02:17:19.063672 has v0 lc 323030
2013-10-30 02:17:14.252911 7f44395a9700 0 mon.ceph2@0(leader).osd e916
create-or-move crush item name 'osd.24' initial_weight 0.41 at location
{host=ceph8,root=default}
2013-10-30 02:17:14.255347 7f44395a9700 -1 crush/CrushWrapper.cc: In function
'int CrushWrapper::insert_item(CephContext*, int, float, std::string, const
std::map<std::basic_string<char, std::char_traits<char>, std::allocator<char>
>, std::basic_string<char, std::char_traits<char>, std::allocator<char> >,
std::less<std::basic_string<char, std::char_traits<char>, std::allocator<char>
> >, std::allocator<std::pair<const std::basic_string<char,
std::char_traits<char>, std::allocator<char> >, std::basic_string<char,
std::char_traits<char>, std::allocator<char> > > > >&)' thread 7f44395a9700
time 2013-10-30 02:17:14.253030
crush/CrushWrapper.cc: 413: FAILED assert(!r)
ceph version 0.67.3 (408cd61584c72c0d97b774b3d8f95c6b1b06341a)
1: (CrushWrapper::insert_item(CephContext*, int, float, std::string,
std::map<std::string, std::string, std::less<std::string>,
std::allocator<std::pair<std::string const, std::string> > > const&)+0x14b4)
[0x6b9514]
2: (CrushWrapper::create_or_move_item(CephContext*, int, float, std::string,
std::map<std::string, std::string, std::less<std::string>,
std::allocator<std::pair<std::string const, std::string> > > const&)+0x2d6)
[0x6ba0f6]
3: (OSDMonitor::prepare_command(MMonCommand*)+0x150a) [0x5aa89a]
4: (OSDMonitor::prepare_update(PaxosServiceMessage*)+0x20b) [0x5b2e2b]
5: (PaxosService::dispatch(PaxosServiceMessage*)+0xa20) [0x58bea0]
6: (Monitor::handle_command(MMonCommand*)+0xdec) [0x557ddc]
7: (Monitor::_ms_dispatch(Message*)+0xc2f) [0x5600af]
8: (Monitor::handle_forward(MForward*)+0x990) [0x55f0c0]
9: (Monitor::_ms_dispatch(Message*)+0xd53) [0x5601d3]
10: (Monitor::ms_dispatch(Message*)+0x32) [0x578742]
11: (DispatchQueue::entry()+0x5a2) [0x7bdcc2]
12: (DispatchQueue::DispatchThread::entry()+0xd) [0x7b690d]
13: /lib64/libpthread.so.0() [0x3208a07851]
14: (clone()+0x6d) [0x32086e890d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to
interpret this.
Anyone else came across the same issue? Or am I missing anything when add a new
OSD?
Thanks,
Guang
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
