[ceph-users] Re: Lock errors in iscsi gateway

2020-04-27 Thread Mike Christie
On 4/27/20 10:43 AM, Simone Lazzaris wrote: > Hi; > > I've build two iscsi gateway for our (small) ceph cluster.The cluster is a > nautilus installation, 4 > nodes with 9x4TB each, and it's working fine. We mainly use it via s3 object > storage interface, > but I've deployed also some rbd bloc

[ceph-users] Re: Lock errors in iscsi gateway

2020-04-28 Thread Mike Christie
On 4/28/20 2:21 AM, Simone Lazzaris wrote: > In data lunedì 27 aprile 2020 18:46:09 CEST, Mike Christie ha scritto: > >   > > [snip] > >   > >> Are you using the ceph-iscsi tools with tcmu-runner or did you setup > >> tcmu-runner directly with targ

[ceph-users] Re: Lock errors in iscsi gateway

2020-04-29 Thread Mike Christie
On 4/29/20 2:11 AM, Simone Lazzaris wrote: > In data martedì 28 aprile 2020 18:41:27 CEST, Mike Christie ha scritto: > >   > >> Could you send me: > >> > >> 1. The /var/log/messages for the initiator when you do IO and see those > >> lock messages

[ceph-users] Re: iscsi issues with ceph (Nautilus) + tcmu-runner

2020-05-13 Thread Mike Christie
On 5/13/20 3:21 AM, Phil Regnauld wrote: > So, we've been running with iscsi enabled (tcmu-runner) on our Nautilus ceph > cluster for a couple of weeks, and started using it with our vsphere cluster. > Things looked good so we put it in production, but yesterday morning we > experienced a freeze of

[ceph-users] Re: Doubt about ceph-iscsi and Vmware

2019-09-20 Thread Mike Christie
On 09/20/2019 01:52 PM, Gesiel Galvão Bernardes wrote: > Hi, > I'm testing Ceph with Vmware, using Ceph-iscsi gateway. I reading > documentation* and have doubts some points: > > - If I understanded, in general terms, for each VMFS datastore in VMware > will match the an RBD image. (consequently

[ceph-users] Re: configuration of Ceph-ISCSI gateway

2019-09-24 Thread Mike Christie
On 09/24/2019 01:08 PM, Gesiel Galvão Bernardes wrote: > Hi everyone, > > I'm configurating ISCSI gateway in Ceph Mimic (13.2.6) using ceph manual: > > https://docs.ceph.com/docs/mimic/rbd/iscsi-target-cli/ > > But i stopped in this problem: In manual says: > "Set the client’s CHAP username to m

[ceph-users] Re: Doubt about ceph-iscsi and Vmware

2019-10-01 Thread Mike Christie
>> disk add pool1/vmware_iscsi1 > Warning: 'pool1/vmware_iscsi1' mapped to 1 other client(s) > ok > > It's a problem, or is correct? Normally you would do this in a host group. > > Regards > Gesiel > > > Em sex, 20 de set de 2019 às 20:13, Mik

[ceph-users] Re: iSCSI write performance

2019-10-24 Thread Mike Christie
On 10/24/2019 12:22 PM, Ryan wrote: > I'm in the process of testing the iscsi target feature of ceph. The > cluster is running ceph 14.2.4 and ceph-iscsi 3.3. It consists of 5 What kernel are you using? > hosts with 12 SSD OSDs per host. Some basic testing moving VMs to a ceph > backed datastore

[ceph-users] Re: iSCSI write performance

2019-10-25 Thread Mike Christie
eph backed datastore >>> io: >>> client: 344 MiB/s rd, 625 KiB/s wr, 5.54k op/s rd, 62 op/s wr >>> >>> I'm going to test bonnie++ with an rbd volume mounted directly on >>> the iscsi gateway. Also will test bonnie++ inside a VM

[ceph-users] Re: iSCSI write performance

2019-10-25 Thread Mike Christie
est bonnie++ inside a VM on a ceph backed > datastore. > > On Thu, Oct 24, 2019 at 7:15 PM Mike Christie <mailto:mchri...@redhat.com>> wrote: > > On 10/24/2019 12:22 PM, Ryan wrote: > > I'm in the process of testing the iscsi target feature of ceph. The

[ceph-users] Re: iSCSI write performance

2019-10-28 Thread Mike Christie
devices)". Maged and SUSE also have a special module but I am not sure where to get their kernels and manuals. Check out suse and petasan's sites for that. > Thanks, > Ryan > > > On Fri, Oct 25, 2019 at 11:29 AM Mike Christie <mailto:mchri...@redhat.com>>

[ceph-users] Re: iSCSI Gateway reboots and permanent loss

2019-12-03 Thread Mike Christie
I do not think it's going to do what you want when the node you want to delete is down. It looks like we only temporarily stop the gw from being exported. It does not update the gateway.cfg, because we do the config removal call on the node we want to delete. So gwcli would report success and the

[ceph-users] Re: Error in add new ISCSI gateway

2019-12-03 Thread Mike Christie
Also, I do not think we saw if the ceph-iscsi versions are the same. We saw the ceph versions are different which is ok. If you were using a old ceph-iscsi version which has different settings/values with a newer version then you could see this error. On 12/03/2019 06:47 PM, Jason Dillaman wrote:

[ceph-users] Re: iSCSI Gateway reboots and permanent loss

2019-12-03 Thread Mike Christie
ps run the > gateways more ephemerally, from a VM or container? > > Thanks again. > > Respectfully, > > *Wes Dillingham* > w...@wesdillingham.com <mailto:w...@wesdillingham.com> > LinkedIn <http://www.linkedin.com/in/wesleydillingham> > > > On Tue, Dec 3

[ceph-users] Re: iSCSI Gateway reboots and permanent loss

2019-12-04 Thread Mike Christie
On 12/04/2019 08:26 AM, Gesiel Galvão Bernardes wrote: > Hi, > > Em qua., 4 de dez. de 2019 às 00:31, Mike Christie <mailto:mchri...@redhat.com>> escreveu: > > On 12/03/2019 04:19 PM, Wesley Dillingham wrote: > > Thanks. If I am reading this correctly

[ceph-users] Re: Starting service rbd-target-api fails

2019-12-05 Thread Mike Christie
On 12/05/2019 03:16 AM, Thomas Schneider wrote: > Hi, > > I want to setup Ceph iSCSI Gateway and I follow this > documentation. > In step "Setup" of process "Configuring the iSCSI target using the > command line interface >

[ceph-users] Re: iSCSI Gateway reboots and permanent loss

2019-12-05 Thread Mike Christie
gt; w...@wesdillingham.com <mailto:w...@wesdillingham.com> > LinkedIn <http://www.linkedin.com/in/wesleydillingham> > > > On Wed, Dec 4, 2019 at 11:18 AM Mike Christie <mailto:mchri...@redhat.com>> wrote: > > On 12/04/2019 08:26 AM, Gesiel Galvão

[ceph-users] Re: Starting service rbd-target-api fails

2019-12-06 Thread Mike Christie
ave you used the pool before? Do you have some leftover auth/permissions that did not get setup on the gw nodes? If you are using ceph-iscsi 3 or newer, rename the pool back to iscsi or try a new one, and do: [config] pool = iscsi in /etc/ceph/iscsi-gateway.cfg on all gw nodes, does it start ok? >

[ceph-users] Re: Starting service rbd-target-api fails

2019-12-06 Thread Mike Christie
On 12/06/2019 12:10 PM, Mike Christie wrote: > On 12/06/2019 01:11 AM, Thomas Schneider wrote: >> Hi Mike, >> >> actually you point to the right log; I can find relevant information in >> this logfile /var/log/rbd-target-api/rbd-target-api.log: >> root@ld5505:~# ta

[ceph-users] Re: slow using ISCSI - Help-me

2019-12-26 Thread Mike Christie
On 12/24/2019 06:40 AM, Gesiel Galvão Bernardes wrote: > In addition: I turned off one of the GWs, and with just one it works > fine. When the two go up, one of the images is changing the "active / > optimized" all time (where generates the logs above) and everything is > extremely slow. Your mult

[ceph-users] Re: slow using ISCSI - Help-me

2020-01-20 Thread Mike Christie
the /var/log/vmkernel.log for when you stop a node and the image goes to the unavailable state. > > Nothing is recorded in the logs. Can you help me? > > Em qui., 26 de dez. de 2019 às 17:44, Mike Christie <mailto:mchri...@redhat.com>> escreveu: > > On 12/24/201

[ceph-users] Re: slow using ISCSI - Help-me

2020-02-06 Thread Mike Christie
On 02/05/2020 07:03 AM, Gesiel Galvão Bernardes wrote: > Em dom., 2 de fev. de 2020 às 00:37, Gesiel Galvão Bernardes > mailto:gesiel.bernar...@gmail.com>> escreveu: > > Hi, > > Just now was possible continue this. Below is the information > required. Thanks advan Hey, sorry for the

[ceph-users] Re: slow using ISCSI - Help-me

2020-02-09 Thread Mike Christie
On 02/08/2020 11:34 PM, Gesiel Galvão Bernardes wrote: > Hi, > > Em qui., 6 de fev. de 2020 às 18:56, Mike Christie <mailto:mchri...@redhat.com>> escreveu: > > On 02/05/2020 07:03 AM, Gesiel Galvão Bernardes wrote: > > Em dom., 2 de fev. de 2020 às

[ceph-users] Re: slow using ISCSI - Help-me

2020-02-14 Thread Mike Christie
On 02/13/2020 08:52 PM, Gesiel Galvão Bernardes wrote: > Hi > > Em dom., 9 de fev. de 2020 às 18:27, Mike Christie <mailto:mchri...@redhat.com>> escreveu: > > On 02/08/2020 11:34 PM, Gesiel Galvão Bernardes wrote: > > Hi, > > > >

[ceph-users] Re: slow using ISCSI - Help-me

2020-02-14 Thread Mike Christie
On 02/14/2020 10:25 AM, Mike Christie wrote: > On 02/13/2020 08:52 PM, Gesiel Galvão Bernardes wrote: >> Hi >> >> Em dom., 9 de fev. de 2020 às 18:27, Mike Christie > <mailto:mchri...@redhat.com>> escreveu: >> >> On 02/08/2020 11:34 P

[ceph-users] Re: Very bad performance on a ceph rbd pool via iSCSI to VMware esx

2020-02-14 Thread Mike Christie
On 02/13/2020 09:56 AM, Salsa wrote: > I have a 3 hosts, 10 4TB HDDs per host ceph storage set up. I deined a 3 > replica rbd pool and some images and presented them to a Vmware host via > ISCSI, but the write performance is so bad the I managed to freeze a VM doing > a big rsync to a datastore

[ceph-users] Re: slow using ISCSI - Help-me

2020-02-19 Thread Mike Christie
On 02/16/2020 04:51 AM, Gesiel Galvão Bernardes wrote: > > > Em sex., 14 de fev. de 2020 às 13:25, Mike Christie <mailto:mchri...@redhat.com>> escreveu: > > On 02/13/2020 08:52 PM, Gesiel Galvão Bernardes wrote: > > Hi > > > > Em dom.,

[ceph-users] Re: Unable to use iscsi gateway with https | iscsi-gateway-add returns errors

2020-03-30 Thread Mike Christie
On 03/29/2020 04:43 PM, givemeone wrote: > Hi all, > I am installing ceph Nautilus and getting constantly errors while adding > iscsi gateways > It was working using http schema but after moving to https with wildcard > certs gives API errors > > Below some of my configurations > Thanks for you