Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-20 Thread Lukas Hejtmanek
Hello, so final working solution for 8-NUMA node configuration is: With this configuration, virtualized Debian 9 even slightly outperforms the same Debian 9 on the bare metal. As of io

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-18 Thread Michal Privoznik
On 09/17/2018 04:59 PM, Lukas Hejtmanek wrote: > Hello, > > so the current domain configuration: > threads='1'/> memory='6200' /> memory='6200' /> memory='6200' /> memory='6200' /> > /> vcpu='4' cpuset='4' /> cpuset='6' /> /> vcpu='11' cpuset='11' /> cpuset='13' /> /> vcpu='18' c

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-17 Thread Lukas Hejtmanek
Hello, so the current domain configuration: hopefully, I got it right. Good news is, that spec benchmark looks promising. The first test bwaves finished in 1003 seconds compared to 1700 seconds in the previous wrong case. So far so good. Bad news is, that iozone is still the same.

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-17 Thread Michal Privoznik
On 09/14/2018 03:36 PM, Lukas Hejtmanek wrote: > Hello, > > ok, I found that cpu pinning was wrong, so I corrected it to be 1:1. The issue > with iozone remains the same. > > The spec is running, however, it runs slower than 1-NUMA case. > > The corrected XML looks like follows: [Reformated XML

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-17 Thread Lukas Hejtmanek
Hello, I did some performance measurements with SpecCPU 2017 in variant fp rate (i.e., utilize all cpu cores). It looks like this: 8-NUMA Hypervizor specfp2017 - 124 1-NUMA Hypervizor specfp2017 - 103 2-NUMA Hypervizor specfp2017 - 120 8-NUMA Virtual (on 8N Hypervizor) specfp2017 - 92 1-NUMA V

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-14 Thread Lukas Hejtmanek
Hello again, when the iozone writes slow. This is how slabtop looks like: 62476752 62476728 0%0.10K 1601968 39 6407872K buffer_head 1000678 999168 0%0.56K 1429547571816K radix_tree_node 132184 125911 0%0.03K 1066 124 4264K kmalloc-32 118496 118224

Re: [libvirt-users] NUMA issues on virtualized hosts

2018-09-14 Thread Lukas Hejtmanek
Hello, ok, I found that cpu pinning was wrong, so I corrected it to be 1:1. The issue with iozone remains the same. The spec is running, however, it runs slower than 1-NUMA case. The corrected XML looks like follows: In this case, the first part took more than 1700 seconds. 1-NUMA config fi

[libvirt-users] NUMA issues on virtualized hosts

2018-09-14 Thread Lukas Hejtmanek
Hello, I have cluster with AMD EPYC 7351 cpu. Two CPUs per node. I have performance 8-NUMA configuration: This is from hypervizor: [root@hde10 ~]# lscpu Architecture: x86_64 CPU op-mode(s):32-bit, 64-bit Byte Order:Little Endian CPU(s):64 On-line CPU(s