Hi Mohamed,

> On Jan 22, 2020, at 10:05 AM, mohamed zayan <mohamed.zaya...@gmail.com 
> <mailto:mohamed.zaya...@gmail.com>> wrote:
> 
> Currently I have a cluster of 2 nodes on two raspberrypi 3 devices.
> pi1 is admin/mon/mgr/osd
> 
> pi2 is osd
> 
> I am currently trying to run radosgw on pi2. I have failed multiple times
> 
> /var/lib/ceph/radosgw# /usr/bin/radosgw -f --cluster ceph --name
> client.rgw.pi2 --setuser ceph --setgroup ceph
> Thread::try_create(): pthread_create failed with error
> 11/tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc
>  <http://thread.cc/>:
> In function 'void Thread::create(const char *, size_t)' thread
> 71114000 time 2020-01-22 14:58:13.793803
> /tmp/release/Raspbian/WORKDIR/ceph-12.2.9-38-gaeeb23362d/src/common/Thread.cc 
> <http://thread.cc/>:
> 152: FAILED assert(ret == 0)

I’m not too familiar with the Raspberry Pi platform or Raspbian. But there are 
some clues in the output you provided, specifically this text — “ 
Thread::try_create(): pthread_create failed with error 11”.

I assume these low valued error codes are consistent between Fedora and 
Raspbian, and so the code 11 means:

        #define EAGAIN          11      /* Try again */

I found the following:

        
https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain 
<https://stackoverflow.com/questions/47078106/pthread-create-fails-with-eagain>

So that seems to leave 3 possibilities:

1. RGW is asking for more resources that your platform is able to provide.
   a. There are limits as to the number of threads.
   b. There may be a memory limit, since each thread needs to maintain its own 
stack.
2. There is a bug in RGW where completed threads are not thread_join’d by their 
parents.
   a. This seems unlikely as this appears to happen during start-up before 
threads are likely done with their work.
3. Florian Weimer identifies a kernel bug.

I suspect it’s #1, so you might want to try reducing the number of threads rgw 
uses by lowering the value of rgw_thread_pool_size in your configuration.

Eric

--
J. Eric Ivancich
he / him / his
Red Hat Storage
Ann Arbor, Michigan, USA
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

Reply via email to