[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-21 Thread Hans van den Bogert
Perhaps not SBCs, but I have 4x HP 6300s and have been running Kubernetes together with Ceph/Rook for more than 3 years. The HPs can be picked up around 80-120eu. I learned so much in 3 years, last time I had that was when I started using Linux. This was money well spent and still is, it runs n

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-21 Thread Frank Schilder
gning 109, rum S14 From: Marc Roos Sent: 21 September 2020 11:08:55 To: ceph-users; lindsay.mathieson Subject: [ceph-users] Re: Setting up a small experimental CEPH network I tested something in the past[1] where I could notice that an osd staturated a bond

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-21 Thread Anthony D'Atri
eptember 2020 2:42 > To: ceph-users@ceph.io > Subject: [ceph-users] Re: Setting up a small experimental CEPH network > > On 21/09/2020 5:40 am, Stefan Kooman wrote: >> My experience with bonding and Ceph is pretty good (OpenvSwitch). Ceph > >> uses lots of tcp connections, a

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-21 Thread Marc Roos
] Sent: maandag 21 september 2020 2:42 To: ceph-users@ceph.io Subject: [ceph-users] Re: Setting up a small experimental CEPH network On 21/09/2020 5:40 am, Stefan Kooman wrote: > My experience with bonding and Ceph is pretty good (OpenvSwitch). Ceph > uses lots of tcp connections, and those c

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-21 Thread Anthony D'Atri
Depending what you’re looking to accomplish, setting up a cluster in VMs (VirtualBox, Fusion, cloud provider, etc) may meet your needs without having to buy anything. > > - Don't think having a few 1Gbit can replace a >10Gbit. Ceph doesn't use > such bonds optimal. I already asked about this y

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-20 Thread Lindsay Mathieson
On 21/09/2020 5:40 am, Stefan Kooman wrote: My experience with bonding and Ceph is pretty good (OpenvSwitch). Ceph uses lots of tcp connections, and those can get shifted (balanced) between interfaces depending on load. Same here - I'm running 4*1GB (LACP, Balance-TCP) on a 5 node cluster with

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-20 Thread Stefan Kooman
On 2020-09-20 12:19, Marc Roos wrote: > > > - pat yourself on the back for choosing ceph, there are a lot of > experts(not including me :)) here willing to help(during office hours) > - decide what you like to use ceph for, and how much storage you need. > - Running just an osd on a server has n

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-20 Thread Stefan Kooman
On 2020-09-20 10:25, Philip Rhoades wrote: > People, > > I am interested in experimenting with CEPH on say 4 or 8 small form > factor computers (SBCs?) - any suggestions about how to get started? What do you want to learn? What Ceph features are you interested in (RGW, CephFS, RBD)? The experienc

[ceph-users] Re: Setting up a small experimental CEPH network

2020-09-20 Thread Marc Roos
- pat yourself on the back for choosing ceph, there are a lot of experts(not including me :)) here willing to help(during office hours) - decide what you like to use ceph for, and how much storage you need. - Running just an osd on a server has not that many implications so you could rethink y