Re: [ceph-users] Creating new Pools - PG's

2017-03-15 Thread Mike Jacobacci
u > might have too few PGs in your cluster, but adding 1024 temporarily should > not be an issue. > > On Wed, Mar 15, 2017 at 1:26 PM Mike Jacobacci wrote: > >> I have a simple question I hope. >> >> I am moving our VM infrastructure from Xenserver to Proxmox. I onl

[ceph-users] Creating new Pools - PG's

2017-03-15 Thread Mike Jacobacci
I have a simple question I hope. I am moving our VM infrastructure from Xenserver to Proxmox. I only have one pool that has several RBD images that are mounted in Xen, that pool has 1024 PG's (30OSD's/3x replication). Question: I would like to create a new pool for Proxmox so I can have a clean s

Re: [ceph-users] Ceph on XenServer - RBD Image Size

2017-02-27 Thread Mike Jacobacci
Hi Michal, Yes I have considered that, but I felt it was easier to administer the VM's without having to interact with Ceph every time. I have a another smaller image that I backup VM configs/data to for cold storage... The VM's are for internal resources so they are expendable. I am totally open

Re: [ceph-users] Ceph on XenServer - Using RBDSR

2017-02-25 Thread Mike Jacobacci
Hi Max, I have a working Xenserver pool using Ceph RBD as a backend.. I got it working by using the RBDSR plugin here: https://github.com/mstarikov/rbdsr I don't have much time, but I just wanted to respond in case it's helpful... Here is how I got it working: On CEPH Set tunables to legacy #

Re: [ceph-users] Adding second interface to storage network - issue

2016-11-30 Thread Mike Jacobacci
pient is prohibited. If you received > this in error, please contact the sender and delete the material from any > computer. > > On Wed, Nov 30, 2016 at 1:01 PM, Mike Jacobacci wrote: > >> Hi John, >> >> Thanks that makes sense... So I take it if I use the sa

Re: [ceph-users] Adding second interface to storage network - issue

2016-11-30 Thread Mike Jacobacci
ial. Any review, retransmission, dissemination or other use of, or > taking of any action in reliance upon, this information by persons or > entities other than the intended recipient is prohibited. If you received > this in error, please contact the sender and delete the material from an

[ceph-users] Adding second interface to storage network - issue

2016-11-30 Thread Mike Jacobacci
I ran into an interesting issue last night when I tried to add a second storage interface. The original 10gb storage interface on the OSD node was only set at 1500 MTU, so the plan was to bump it to 9000 and configure the second interface the same way with a diff IP and reboot. Once I did that, fo

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
t version of ceph are you running and what are the details > of os version you updated to ? > > On Tue, Nov 29, 2016 at 7:12 PM, Mike Jacobacci wrote: > >> Found some more info, but getting weird... All three OSD nodes shows the >> same unknown cluster message on all the OSD d

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
d failed failedCeph disk activation: /dev/sdc3 ● ceph-disk@dev-sdc4.service loaded failed failedCeph disk activation: /dev/sdc4 >From my understanding, the disks have already been activated... Should these services even be running or enabled? Mike On Tue, Nov 29, 2016 at 6:33

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
-bea5-d103fe1fa9c9, osd.9 On Tue, Nov 29, 2016 at 6:32 PM, Mike Jacobacci wrote: > I forgot to add: > > > On Tue, Nov 29, 2016 at 6:28 PM, Mike Jacobacci wrote: > >> So it looks like the journal partition is mounted: >> >> ls -lah /var/lib/ceph/osd/ceph-0/journal

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
I forgot to add: On Tue, Nov 29, 2016 at 6:28 PM, Mike Jacobacci wrote: > So it looks like the journal partition is mounted: > > ls -lah /var/lib/ceph/osd/ceph-0/journal > lrwxrwxrwx. 1 ceph ceph 9 Oct 10 16:11 /var/lib/ceph/osd/ceph-0/journal > -> /dev/sdb1 > &g

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
9 My fsid in ceph.conf is: fsid = 75d6dba9-2144-47b1-87ef-1fe21d3c58a8 I don't know why the fsid would change or be different. I thought I had a basic cluster setup, I don't understand what's going wrong. Mike On Tue, Nov 29, 2016 at 5:15 PM, Mike Jacobacci wrote: >

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
> which it is addressed and may contain confidential and/or privileged >> material. Any review, retransmission, dissemination or other use of, or >> taking of any action in reliance upon, this information by persons or >> entities other than the intended recipient is prohib

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
umber > > On 29 Nov 2016 23:56, "Mike Jacobacci" wrote: > >> OK I am in some trouble now and would love some help! After updating >> none of the OSDs on the node will come back up: >> >> ● ceph-disk@dev-sdb1.service >> loaded failed failedC

Re: [ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
ectly again (note sdb and sdc are ssd for cache)? I am not sure which disk maps to ceph-osd@0 and so on. Also, can I add them to /etc/fstab to work around? Cheers, Mike On Tue, Nov 29, 2016 at 10:41 AM, Mike Jacobacci wrote: > Hello, > > I would like to install OS updates on the ce

[ceph-users] Ceph Maintenance

2016-11-29 Thread Mike Jacobacci
Hello, I would like to install OS updates on the ceph cluster and activate a second 10gb port on the OSD nodes, so I wanted to verify the correct steps to perform maintenance on the cluster. We are only using rbd to back our xenserver vm's at this point, and our cluster consists of 3 OSD nodes, 3

Re: [ceph-users] Map RBD Image with Kernel 3.10.0+10

2016-10-12 Thread Mike Jacobacci
ere a way to create rbd images with format 1 without having to convert from format 2? Cheers Mike On Wed, Oct 12, 2016 at 12:37 PM, Mike Jacobacci wrote: > Hi all, > > I need some help yet again... With my cluster backup and running Ceph > 10.2.3, I am having problems again moun

[ceph-users] Map RBD Image with Kernel 3.10.0+10

2016-10-12 Thread Mike Jacobacci
Hi all, I need some help yet again... With my cluster backup and running Ceph 10.2.3, I am having problems again mounting an RBD image under Xenserver. I had this working before I broke everything and started over (previously on Ceph 10.1), I made sure to set tunables to legacy and disabled choose

Re: [ceph-users] New OSD Nodes, pgs haven't changed state

2016-10-11 Thread Mike Jacobacci
sues are related to networking and > MTU sizes. Perhaps the HP 5400's or the managed switches did not have jumbo > frames enabled? > > Hope that helps you determine the issue in case you want to move the nodes > back to the other location. > > > > Chris > > > &

Re: [ceph-users] New OSD Nodes, pgs haven't changed state

2016-10-11 Thread Mike Jacobacci
> > -- > > ------ > *From:* ceph-users [ceph-users-boun...@lists.ceph.com] on behalf of Mike > Jacobacci [mi...@flowjo.com] > *Sent:* Tuesday, October 11, 2016 3:30 PM > *Cc:* ceph-us...@ceph.com > *Subject:* Re: [ceph-user

Re: [ceph-users] New OSD Nodes, pgs haven't changed state

2016-10-11 Thread Mike Jacobacci
ted and that you do not have > firewalls blocking traffic and so on. > > A pg query for one of those peering pgs may provide some further > information about what could be wrong. > > Looking to osd logs may also show a bit of light. > > Cheers > Goncalo > > > >

[ceph-users] New OSD Nodes, pgs haven't changed state

2016-10-09 Thread Mike Jacobacci
Hi, Yesterday morning I added two more OSD nodes and changed the crushmap from disk to node. It looked to me like everything went ok besides some disks missing that I can re-add later, but the cluster status hasn't changed since then. Here is the output of ceph -w: cluster 395fb046-0062-4252

[ceph-users] Adding OSD Nodes and Changing Crushmap

2016-10-05 Thread Mike Jacobacci
Hi, I just wanted to get a sanity check if possible, I apologize if my questions are stupid, I am still new to Ceph and I am feeling uneasy adding new nodes. Right now we have one OSD node with 10 OSD disks (plus 2 disks for caching) and this week we are going to add two more nodes with the same

Re: [ceph-users] RFQ for Flowjo

2016-09-07 Thread Mike Jacobacci
/316693?confirmation=608475029> > PDF: > http://www.siliconmechanics.com/quotes/316693.pdf?confirmation=608475029 > <http://www.siliconmechanics.com/quotes/316693.pdf?confirmation=608475029> > > > > On Wed, Sep 7, 2016 at 10:39 AM, Mike Jacobacci <mailto:mi.

Re: [ceph-users] Realistic Ceph Client OS

2016-07-12 Thread Mike Jacobacci
gt; > mon warn on legacy crush tunables = false in [mon] section in ceph.conf. > > Thanks > > On Tue, Jul 12, 2016 at 5:59 PM, Mike Jacobacci <mailto:mi...@flowjo.com>> wrote: > Thanks, Can I ignore this warning then? > > health HEALTH_WARN > crush m

Re: [ceph-users] Realistic Ceph Client OS

2016-07-12 Thread Mike Jacobacci
uld use a main line kernel from here (http://elrepo.org/tiki/kernel-ml > <http://elrepo.org/tiki/kernel-ml>) as 4.6 is available for CentOS7 > > Thanks > > On Tue, Jul 12, 2016 at 5:45 PM, Mike Jacobacci <mailto:mi...@flowjo.com>> wrote: > Hi Sean, > > T

Re: [ceph-users] Realistic Ceph Client OS

2016-07-12 Thread Mike Jacobacci
ean Redmond wrote: > > Hi, > > It should work for you with kernel 3.10 as long as turntables are set low > enough - Do you see anything in 'dmesg'? > > Thanks > > On Tue, Jul 12, 2016 at 5:37 PM, Mike Jacobacci <mailto:mi...@flowjo.com>> wrote: >

[ceph-users] Realistic Ceph Client OS

2016-07-12 Thread Mike Jacobacci
Hi All, Is mounting rbd only really supported in Ubuntu? All of our servers are CentOS 7 or RedHat 7 and since they are at Kernel 3.10, I can’t get rbd working. Even if I use legacy tunables or set tunables to 1/2/3… Nothing will mount the block device. The only answer I can find to get this

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-07-06 Thread Mike Jacobacci
So just to update, I decided to ditch XenServer and go with Openstack… Thanks for everyone’s help with this! Cheers, Mike > On Jul 1, 2016, at 1:29 PM, Mike Jacobacci wrote: > > Yes, I would like to know too… I decided nott to update the kernel as it > could possibly affect

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-07-01 Thread Mike Jacobacci
> under the impression that it's open source as well. > > Regards, > Josef > > > On Fri, 1 Jul 2016, 04:52 Mike Jacobacci, <mailto:mi...@flowjo.com>> wrote: > Thanks Somnath and Christian, > > Yes, it looks like the latest version of XenServer stil

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
. > > Thanks & Regards > Somnath > > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Mike > Jacobacci > Sent: Thursday, June 30, 2016 7:27 PM > To: Jake Young > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Mounting Ceph RBD image t

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
a042a42, missing 200 [35074.469178] libceph: mon0 192.168.10.187:6789 socket error on read > On Jun 30, 2016, at 6:15 PM, Jake Young wrote: > > See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html > <https://www.mail-archive.com/ceph-users@lists.ceph.co

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
So after adding the ceph repo and enabling the cents-7 repo… It fails trying to install ceph-common: Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirror.web-ster.com Resolving Dependencies --> Running transaction check ---> Package ceph-common.x86_64 1:10.2.2-

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
ttp://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html> > > Jake > > > On Thursday, June 30, 2016, Mike Jacobacci <mailto:mi...@flowjo.com>> wrote: > Hi Jake, > > Interesting… XenServer 7 does has rbd installed but trying to map the

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
/dev/sdc4) _read_bdev_label unable to decode label at offset 66: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end of struct encoding” Cheers, Mike > On Jun 30, 2016, at 10:55 AM, Mike Jacobacci wrote: > > I am not sure why the mapping

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
here… Cheers, Mike > On Jun 30, 2016, at 10:23 AM, Mike Jacobacci wrote: > > Hi Jake, > > Interesting… XenServer 7 does has rbd installed but trying to map the rbd > image with this command: > > # echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool}

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci
is OK, so I am hoping I didn’t miss a configuration or something. > On Jun 29, 2016, at 3:28 PM, Jake Young wrote: > > > > On Wednesday, June 29, 2016, Mike Jacobacci <mailto:mi...@flowjo.com>> wrote: > Hi all, > > Is there anyone using rbd for xenserver

[ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-29 Thread Mike Jacobacci
Hi all, Is there anyone using rbd for xenserver vm storage? I have XenServer 7 and the latest Ceph, I am looking for the the best way to mount the rbd volume under XenServer. There is not much recent info out there I have found except for this: http://www.mad-hacking.net/documentation/linux/h

[ceph-users] Mounting Ceph RBD under xenserver

2016-06-28 Thread Mike Jacobacci
Hi all, Is there anyone using rbd for xenserver vm storage? I have XenServer 7 and the latest Ceph, I am looking for the the best way to mount the rbd volume under XenServer. There is not much recent info out there I have found except for this: http://www.mad-hacking.net/documentation/linux/h

Re: [ceph-users] Starting a cluster with one OSD node

2016-05-14 Thread Mike Jacobacci
On Sat, 14 May 2016 09:46:23 -0700 Mike Jacobacci wrote: > > > Hello, > >> Hi Alex, >> >> Thank you for your response! Yes, this is for a production >> environment... Do you think the risk of data loss due to the single node >> be different than if it

Re: [ceph-users] Starting a cluster with one OSD node

2016-05-14 Thread Mike Jacobacci
> >> On Friday, May 13, 2016, Mike Jacobacci wrote: >> Hello, >> >> I have a quick and probably dumb question… We would like to use Ceph for our >> storage, I was thinking of a cluster with 3 Monitor and OSD nodes. I was >> wondering if it was a ba

[ceph-users] Starting a cluster with one OSD node

2016-05-13 Thread Mike Jacobacci
Hello, I have a quick and probably dumb question… We would like to use Ceph for our storage, I was thinking of a cluster with 3 Monitor and OSD nodes. I was wondering if it was a bad idea to start a Ceph cluster with just one OSD node (10 OSDs, 2 SSDs), then add more nodes as our budget allows