Just an update - maybe will help others I've downloaded and ran Intel firmware update ISO Although the tool confirmed firmware was current ( no update necessary) , after I rebooted, the performance was similar with the other 3 servers
Odd but.. nothing is/was making sense Steven On Thu, 25 Oct 2018 at 12:32, Steven Vacaroaia <ste...@gmail.com> wrote: > Thanks for suggestion > However same "bad"server was working fine until I updated firmware > Now, all 4 server have the same firmware but one has lower performance > > I will try what you suggested though although, as I said, same server with > same NVME had good performance before updating server firmware > > Thanks > > On Thu, 25 Oct 2018 at 12:20, Martin Verges <martin.ver...@croit.io> > wrote: > >> Hello Steven, >> >> You could swap the SSDs from the hosts to see if the error is migrating. >> >> If it migrates, I would appreciate that the affected SSD simply offers >> less performance than the others. Possibly an RMA reason depending on >> what the manufacturer guarantees. >> If not, the system must be further searched for possible sources of error. >> >> -- >> Martin Verges >> Managing director >> >> Mobile: +49 174 9335695 >> E-Mail: martin.ver...@croit.io >> Chat: https://t.me/MartinVerges >> >> croit GmbH, Freseniusstr. 31h, 81247 Munich >> CEO: Martin Verges - VAT-ID: DE310638492 >> Com. register: Amtsgericht Munich HRB 231263 >> >> Web: https://croit.io >> YouTube: https://goo.gl/PGE1Bx >> >> >> 2018-10-25 18:06 GMT+02:00 Steven Vacaroaia <ste...@gmail.com>: >> > Hi Martin, >> > >> > Yes, they are in the same slot - also I checked >> > the BIOS and the PCI speed and type is properly negotiated >> > system profile ( performance) >> > >> > note >> > This happened after I upgrade firmware on the servers - however they all >> > have the same firmware >> > >> > BAD server >> > lspci | grep -i Optane >> > 04:00.0 Non-Volatile memory controller: Intel Corporation Optane DC >> P4800X >> > Series SSD >> > >> > GOOD server >> > lspci | grep -i Optane >> > 04:00.0 Non-Volatile memory controller: Intel Corporation Optane DC >> P4800X >> > Series SSD >> > >> > >> > >> > On Thu, 25 Oct 2018 at 11:59, Martin Verges <martin.ver...@croit.io> >> wrote: >> >> >> >> Hello Steven, >> >> >> >> are you sure that the systems are exact the same? Sometimes vendors >> >> place extension cards into different PCIe slots. >> >> >> >> -- >> >> Martin Verges >> >> Managing director >> >> >> >> Mobile: +49 174 9335695 >> >> E-Mail: martin.ver...@croit.io >> >> Chat: https://t.me/MartinVerges >> >> >> >> croit GmbH, Freseniusstr. 31h, 81247 Munich >> >> CEO: Martin Verges - VAT-ID: DE310638492 >> >> Com. register: Amtsgericht Munich HRB 231263 >> >> >> >> Web: https://croit.io >> >> YouTube: https://goo.gl/PGE1Bx >> >> >> >> >> >> 2018-10-25 17:46 GMT+02:00 Steven Vacaroaia <ste...@gmail.com>: >> >> > Hi, >> >> > I have 4 x DELL R630 servers with exact same specs >> >> > I installed Intel Optane SSDPED1K375GA in all >> >> > >> >> > When comparing fio performance ( both read and write), when is lower >> >> > than >> >> > the other 3 >> >> > ( see below - just read) >> >> > >> >> > Any suggestions as to what to check/fix ? >> >> > >> >> > BAD server >> >> > [root@osd04 ~]# fio --filename=/dev/nvme0n1 --direct=1 --sync=1 >> >> > --rw=read >> >> > --bs=4k --numjobs=100 --iodepth=1 --runtime=60 --time_based >> >> > --group_reporting --name=journal-test >> >> > journal-test: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, >> (T) >> >> > 4096B-4096B, ioengine=psync, iodepth=1 >> >> > ... >> >> > fio-3.1 >> >> > Starting 100 processes >> >> > Jobs: 100 (f=100): [R(100)][100.0%][r=2166MiB/s,w=0KiB/s][r=554k,w=0 >> >> > IOPS][eta 00m:00s] >> >> > >> >> > >> >> > GOOD server >> >> > [root@osd02 ~]# fio --filename=/dev/nvme0n1 --direct=1 --sync=1 >> >> > --rw=read >> >> > --bs=4k --numjobs=100 --iodepth=1 --runtime=60 --time_based >> >> > --group_reporting --name=journal-test >> >> > journal-test: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, >> (T) >> >> > 4096B-4096B, ioengine=psync, iodepth=1 >> >> > ... >> >> > fio-3.1 >> >> > Starting 100 processes >> >> > Jobs: 100 (f=100): [R(100)][100.0%][r=2278MiB/s,w=0KiB/s][r=583k,w=0 >> >> > IOPS][eta 00m:00s] >> >> > >> >> > >> >> > many thanks >> >> > steven >> >> > >> >> > _______________________________________________ >> >> > ceph-users mailing list >> >> > ceph-users@lists.ceph.com >> >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> >> > >> >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com