[PATCH v6 9/9] tests/vm: Add workaround to consume console

2020-05-12 Thread Robert Foley
characters to be consumed. We also add the option of logging the console to a file. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- python/qemu/console_socket.py | 162 ++ python/qemu/machine.py| 23 - tests/vm/Makefile.include | 4 + tests/vm

[PATCH v6 8/9] tests/vm: change scripts to use self._config

2020-05-12 Thread Robert Foley
This change converts existing scripts to using for example self.ROOT_PASS, to self._config['root_pass']. We made similar changes for GUEST_USER, and GUEST_PASS. This allows us also to remove the change in basevm.py, which adds __getattr__ for backwards compatibility. Signed-off-by: Ro

[Bug 1866892] Re: guest OS catches a page fault bug when running dotnet

2020-03-16 Thread Robert Henry
A simpler case seems to produce the same error. See https://bugs.launchpad.net/qemu/+bug/1824344 -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1866892 Title: guest OS catches a page fault bug whe

[Bug 1824344] Re: x86: retf or iret pagefault sets wrong error code

2020-03-16 Thread Robert Henry
This appears to be similar to https://bugs.launchpad.net/qemu/+bug/1866892 (and much simpler) -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1824344 Title: x86: retf or iret pagefault sets wrong err

[Bug 1866892] Re: guest OS catches a page fault bug when running dotnet

2020-03-19 Thread Robert Henry
I have confirmed that the dotnet guest application is executing a "iretq" instruction when this guest kernel bug is hit. A first round of analysis shows nothing unreasonable at the point the iretq is executed. The $rsp points into the middle of a mapped in page, the returned-to $rip looks reasonabl

[Bug 1866892] Re: guest OS catches a page fault bug when running dotnet

2020-03-19 Thread Robert Henry
yes, it is intentional. I don't yet understand why, but am talking to those who do. https://github.com/dotnet/runtime/blob/1b02665be501b695b9c22c1ebd69148c07a225f6/src/coreclr/src/pal/src/arch/amd64/context2.S#L183 -- You received this bug notification because you are a member of qemu- devel-ml,

Re: [PATCH v1 0/2] some fixes for genisoimage usage

2020-05-15 Thread Robert Foley
On Fri, 15 May 2020 at 13:28, Alex Bennée wrote: > > Hi Robert, > > Here are a couple of patches you might want to add to the start of > your vm build series that deal with the fact genisoimage might not > exist or have a different name. Hi Alex, Sounds good. I will add them t

Re: [PATCH v6 6/9] tests/vm: Added a new script for ubuntu.aarch64.

2020-05-15 Thread Robert Foley
Hi Alex, These are all good points. I will make these changes. Thanks & Regards, -Rob On Fri, 15 May 2020 at 11:42, Alex Bennée wrote: > > > Robert Foley writes: > > > ubuntu.aarch64 provides a script to create an Ubuntu 18.04 VM. > > Another new file is also ad

Re: [PATCH v6 1/9] tests/vm: Add configuration to basevm.py

2020-05-15 Thread Robert Foley
On Fri, 15 May 2020 at 13:23, Alex Bennée wrote: > > > Robert Foley writes: > > > Added use of a configuration to tests/vm/basevm.py. > > The configuration provides parameters used to configure a VM. > > This allows for providing alternate configurations to the VM b

Re: [PATCH v8 74/74] cputlb: queue async flush jobs without the BQL

2020-05-18 Thread Robert Foley
with the final two results (unix bench and boot times). Regards, -Rob On Tue, 12 May 2020 at 15:26, Robert Foley wrote: > > On Tue, 12 May 2020 at 12:27, Alex Bennée wrote: > > Robert Foley writes: > > > > > From: "Emilio G. Cota" > > > > >

[PATCH v7 02/12] tests/vm: pass --genisoimage to basevm script

2020-05-19 Thread Robert Foley
: Robert Foley --- tests/vm/Makefile.include | 1 + tests/vm/basevm.py| 16 ++-- 2 files changed, 11 insertions(+), 6 deletions(-) diff --git a/tests/vm/Makefile.include b/tests/vm/Makefile.include index 1bf9693d19..74ab522c55 100644 --- a/tests/vm/Makefile.include +++ b/tests/vm

[PATCH v7 01/12] configure: add alternate binary for genisoimage

2020-05-19 Thread Robert Foley
From: Alex Bennée Not all distros ship genisoimage which is a Debian fork from the original cdrtools. As the options are pretty much the same support it as a fallback binary. Signed-off-by: Alex Bennée Signed-off-by: Robert Foley --- configure | 2 +- 1 file changed, 1 insertion(+), 1

[PATCH v7 00/12] tests/vm: Add support for aarch64 VMs

2020-05-19 Thread Robert Foley
genisoimage. Alex Bennée (2): configure: add alternate binary for genisoimage tests/vm: pass --genisoimage to basevm script Robert Foley (10): tests/vm: pass args through to BaseVM's __init__ tests/vm: Add configuration to basevm.py tests/vm: Added configuration file support tes

[PATCH v7 04/12] tests/vm: Add configuration to basevm.py

2020-05-19 Thread Robert Foley
to vary on the VM being created or launched. This will for example allow for creating an aarch64 vm. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- tests/vm/basevm.py | 170 ++--- 1 file changed, 131 insertions(+), 39 deletions(-) diff --git a

[PATCH v7 03/12] tests/vm: pass args through to BaseVM's __init__

2020-05-19 Thread Robert Foley
Signed-off-by: Robert Foley --- tests/vm/basevm.py | 13 ++--- 1 file changed, 6 insertions(+), 7 deletions(-) diff --git a/tests/vm/basevm.py b/tests/vm/basevm.py index a2d4054d72..fbefda0595 100644 --- a/tests/vm/basevm.py +++ b/tests/vm/basevm.py @@ -61,9 +61,9 @@ class BaseVM(object

[PATCH v7 05/12] tests/vm: Added configuration file support

2020-05-19 Thread Robert Foley
.yml. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- configure | 9 ++ tests/vm/Makefile.include | 6 tests/vm/basevm.py| 40 +++- tests/vm/conf_example_aarch64.yml | 51 +++ tests

[PATCH v7 09/12] tests/vm: Added a new script for ubuntu.aarch64.

2020-05-19 Thread Robert Foley
ubuntu.aarch64 provides a script to create an Ubuntu 18.04 VM. Another new file is also added aarch64vm.py, which is a module with common methods used by aarch64 VMs, such as how to create the flash images. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- configure

[PATCH v7 06/12] tests/vm: Pass --debug through for vm-boot-ssh.

2020-05-19 Thread Robert Foley
This helps debug issues that occur during the boot sequence. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- tests/vm/Makefile.include | 1 + 1 file changed, 1 insertion(+) diff --git a/tests/vm/Makefile.include b/tests/vm/Makefile.include index d9b34eae63..e22c391a2a 100644 --- a

[PATCH v7 07/12] tests/vm: Add ability to select QEMU from current build.

2020-05-19 Thread Robert Foley
Added a new special variable QEMU_LOCAL=1, which will indicate to take the QEMU binary from the current build. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- tests/vm/Makefile.include | 4 tests/vm/basevm.py| 25 ++--- 2 files changed, 26 insertions

[PATCH v7 10/12] tests/vm: Added a new script for centos.aarch64.

2020-05-19 Thread Robert Foley
centos.aarch64 creates a CentOS 8 image. Also added a new kickstart script used to build the centos.aarch64 image. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- tests/vm/Makefile.include| 3 +- tests/vm/centos-8-aarch64.ks | 51 tests/vm/centos.aarch64 | 227

[PATCH v7 12/12] tests/vm: Add workaround to consume console

2020-05-19 Thread Robert Foley
characters to be consumed. We also add the option of logging the console to a file. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov --- python/qemu/console_socket.py | 162 ++ python/qemu/machine.py| 23 - tests/vm/Makefile.include | 4 + tests/vm

[PATCH v7 11/12] tests/vm: change scripts to use self._config

2020-05-19 Thread Robert Foley
This change converts existing scripts to using for example self.ROOT_PASS, to self._config['root_pass']. We made similar changes for GUEST_USER, and GUEST_PASS. This allows us also to remove the change in basevm.py, which adds __getattr__ for backwards compatibility. Signed-off-by: Ro

[PATCH v7 08/12] tests/vm: allow wait_ssh() to specify command

2020-05-19 Thread Robert Foley
This allows for waiting for completion of arbitrary commands. Signed-off-by: Robert Foley Reviewed-by: Peter Puhov Reviewed-by: Alex Bennée --- tests/vm/basevm.py | 14 +++--- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/tests/vm/basevm.py b/tests/vm/basevm.py index

Re: [PATCH v8 74/74] cputlb: queue async flush jobs without the BQL

2020-05-20 Thread Robert Foley
On Wed, 20 May 2020 at 00:46, Emilio G. Cota wrote: > > On Mon, May 18, 2020 at 09:46:36 -0400, Robert Foley wrote: > > Thanks for doing these tests. I know from experience that benchmarking > is hard and incredibly time consuming, so please do not be discouraged by > my com

Re: [PATCH v4 5/5] target/i386: remove Icelake-Client CPU model

2020-05-20 Thread Robert Hoo
On Wed, 2020-05-20 at 10:17 +0100, Daniel P. Berrangé wrote: > On Wed, May 20, 2020 at 10:10:07AM +0800, Chenyi Qiang wrote: > > There are no Icelake Desktop products in the market. Remove the > > Icelake-Client CPU model. > > QEMU has been shipping this CPU model for 2 years now. Regardless > of

Re: [PATCH v8 74/74] cputlb: queue async flush jobs without the BQL

2020-05-21 Thread Robert Foley
152025 3035 Guest vCPUs https://drive.google.com/file/d/1ASg5XyP9hNfN9VysXC3qe5s9QSJlwFAt/view?usp=sharing Thanks & Regards, -Rob On Wed, 20 May 2020 at 11:01, Robert Foley wrote: > >

Re: [PATCH v1 8/9] plugins: new hwprofile plugin

2020-06-02 Thread Robert Foley
GIN_MEM_R; > +} else if (g_strcmp0(opt, "write") == 0) { > +rw = QEMU_PLUGIN_MEM_W; > + } else if (g_strcmp0(opt, "detail") == 0) { When testing out the options, I noticed that if we supply arguments of "read", and &quo

[PATCH 2/2] Mark Icelake-Client CPU models deprecated

2020-06-03 Thread Robert Hoo
Going to obsolete Icelake-Client CPU models in the future. Signed-off-by: Robert Hoo --- target/i386/cpu.c | 10 +- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/target/i386/cpu.c b/target/i386/cpu.c index d7ac22f..6c34ea3 100644 --- a/target/i386/cpu.c +++ b/target/i386

[PATCH 1/2] Introduce (x86) CPU model deprecation API

2020-06-03 Thread Robert Hoo
x86_cpu_list_entry(), e.g. '-cpu help'. QMP 'query-cpu-definitions' will also return a bool value indicating the deprecation status. Signed-off-by: Robert Hoo --- exec.c | 3 +++ include/hw/core/cpu.h| 1 + qapi/machine-target.json | 3 ++- target/i3

Re: [PATCH v1 8/9] plugins: new hwprofile plugin

2020-06-03 Thread Robert Foley
On Wed, 3 Jun 2020 at 07:43, Alex Bennée wrote: > > > Robert Foley writes: > > > > > When testing out the options, I noticed that > > if we supply arguments of "read", and "write", then we will only get > > the last one set, "write&

Re: [PATCH v1 09/12] tests/docker: Added docker build support for TSan.

2020-06-03 Thread Robert Foley
On Tue, 2 Jun 2020 at 16:21, Alex Bennée wrote: > > > Robert Foley writes: > > > > configure_qemu() > > { > > +if test -z "$TSAN"; then > > +requires clang tsan > > +echo "Including TSan Support" > >

Re: [PATCH v1 01/12] configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext

2020-06-03 Thread Robert Foley
On Tue, 2 Jun 2020 at 15:22, Alex Bennée wrote: > > > Robert Foley writes: > > > From: Lingfeng Yang > > > > +# Thread sanitizer is, for now, much noisier than the other sanitizers; > > +# keep it separate until that is not the case. > > I think we al

Re: [PATCH 1/2] Introduce (x86) CPU model deprecation API

2020-06-04 Thread Robert Hoo
On Wed, 2020-06-03 at 09:11 -0500, Eric Blake wrote: > On 6/3/20 6:47 AM, Robert Hoo wrote: > > Complement versioned CPU model framework with the ability of > > marking some > > versions deprecated. When that CPU model is chosen, get some > > warning. The > > w

Re: [PATCH 1/2] Introduce (x86) CPU model deprecation API

2020-06-04 Thread Robert Hoo
On Thu, 2020-06-04 at 06:59 -0500, Eric Blake wrote: > On 6/4/20 3:07 AM, Robert Hoo wrote: > > > > > +++ b/qapi/machine-target.json > > > > @@ -309,7 +309,8 @@ > > > >'static': 'bool', > > > >

[PATCH v2 00/13] Add Thread Sanitizer support to QEMU

2020-06-05 Thread Robert Foley
tions to QemuSpin Lingfeng Yang (1): configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext Robert Foley (5): tests/docker: Added docker build support for TSan. include/qemu: Added tsan.h for annotations. util: Added tsan annotate for thread name. docs: Added de

[PATCH v2 01/13] configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext

2020-06-05 Thread Robert Foley
+-9 --disable-werror' configure flags. Signed-off-by: Lingfeng Yang Signed-off-by: Emilio G. Cota [cota: minor modifications + configure changes] Signed-off-by: Robert Foley [RF: configure changes for warnings, erorr handling + minor modifications] --- configure | 47 ++

[PATCH v2 02/13] cpu: convert queued work to a QSIMPLEQ

2020-06-05 Thread Robert Foley
Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 25 - cpus.c| 14 -- hw/core/cpu.c | 1 + include/hw/core/cpu.h | 6 +++--- 4 files changed, 24 insertions(+), 22 deletions(-) diff --git a/cpus-

[PATCH v2 12/13] docs: Added details on TSan to testing.rst

2020-06-05 Thread Robert Foley
Adds TSan details to testing.rst. This includes background and reference details on TSan, and details on how to build and test with TSan both with and without docker. Signed-off-by: Robert Foley Reviewed-by: Emilio G. Cota --- docs/devel/testing.rst | 107

[PATCH v2 04/13] cputlb: destroy CPUTLB with tlb_destroy

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" I was after adding qemu_spin_destroy calls, but while at it I noticed that we are leaking some memory. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- accel/tcg/cputlb.c | 15 +++ exec.c

[PATCH v2 10/13] include/qemu: Added tsan.h for annotations.

2020-06-05 Thread Robert Foley
These annotations will allow us to give tsan additional hints. For example, we can inform tsan about reads/writes to ignore to silence certain classes of warnings. We can also annotate threads so that the proper thread naming shows up in tsan warning results. Signed-off-by: Robert Foley

[PATCH v2 03/13] thread: add qemu_spin_destroy

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" It will be used for TSAN annotations. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- include/qemu/thread.h | 3 +++ 1 file changed, 3 insertions(+) diff --git a/include/qemu/thread.h b/include/qemu/thread.h index

[PATCH v2 13/13] tests: Disable select tests under TSan, which hit TSan issue.

2020-06-05 Thread Robert Foley
Disable a few tests under CONFIG_TSAN, which run into a known TSan issue that results in a hang. https://github.com/google/sanitizers/issues/1116 The disabled tests under TSan include all the qtests as well as the test-char, test-qga, and test-qdev-global-props. Signed-off-by: Robert Foley

[PATCH v2 05/13] qht: call qemu_spin_destroy for head buckets

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- util/qht.c | 1 + 1 file changed, 1 insertion(+) diff --git a/util/qht.c b/util/qht.c index aa51be3c52..67e5d5b916 100644 --- a/util/qht.c +++ b/util/qht.c @@ -348,6 +348,7 @@ static inline void qht_cha

[PATCH v2 11/13] util: Added tsan annotate for thread name.

2020-06-05 Thread Robert Foley
This allows us to see the name of the thread in tsan warning reports such as this: Thread T7 'CPU 1/TCG' (tid=24317, running) created by main thread at: Signed-off-by: Robert Foley Reviewed-by: Emilio G. Cota --- util/qemu-thread-posix.c | 2 ++ 1 file changed, 2 insertions(+) di

[PATCH v2 07/13] translate-all: call qemu_spin_destroy for PageDesc

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" The radix tree is append-only, but we can fail to insert a PageDesc if the insertion races with another thread. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- accel/tcg/translate-all.c | 9 + 1 file changed, 9 insertions(+) diff --g

[PATCH v2 06/13] tcg: call qemu_spin_destroy for tb->jmp_lock

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley [RF: Minor changes to fix some checkpatch errors] --- accel/tcg/translate-all.c | 10 +- include/tcg/tcg.h | 3 ++- tcg/tcg.c | 19 --- 3 files c

[PATCH v2 08/13] thread: add tsan annotations to QemuSpin

2020-06-05 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- include/qemu/thread.h | 39 --- 1 file changed, 36 insertions(+), 3 deletions(-) diff --git a/include/qemu/thread.h b/include/qemu/thre

[PATCH v2 09/13] tests/docker: Added docker build support for TSan.

2020-06-05 Thread Robert Foley
suppresion file to disable certain cases of TSAN warnings. Cc: Fam Zheng Cc: Philippe Mathieu-Daudé Signed-off-by: Robert Foley --- tests/docker/dockerfiles/ubuntu2004.docker | 65 ++ tests/docker/test-tsan | 44 +++ tests/tsan/blacklist.tsan

Re: [PATCH 1/2] Introduce (x86) CPU model deprecation API

2020-06-05 Thread Robert Hoo
On Fri, 2020-06-05 at 08:47 -0500, Eric Blake wrote: > On 6/4/20 9:47 PM, Robert Hoo wrote: > > On Thu, 2020-06-04 at 06:59 -0500, Eric Blake wrote: > > > On 6/4/20 3:07 AM, Robert Hoo wrote: > > > > > > > > > +++ b/qapi/mac

Re: [PATCH v2 01/13] configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext

2020-06-08 Thread Robert Foley
On Mon, 8 Jun 2020 at 09:39, Alex Bennée wrote: > > -static void finish_switch_fiber(void *fake_stack_save) > > +/* QEMU_ALWAYS_INLINE only does so if __OPTIMIZE__, so we cannot use it. */ > > +static inline __attribute__((always_inline)) > > +void on_new_fiber(CoroutineUContext *co) > > +{ > > W

Re: [PATCH v2 06/13] tcg: call qemu_spin_destroy for tb->jmp_lock

2020-06-08 Thread Robert Foley
On Mon, 8 Jun 2020 at 10:44, Alex Bennée wrote: > > +static void tcg_region_tree_reset_all(tb_destroy_func tb_destroy) > > { > > size_t i; > > > > @@ -510,6 +519,10 @@ static void tcg_region_tree_reset_all(void) > > for (i = 0; i < region.n; i++) { > > struct tcg_region_tree *

[PATCH v3 00/13] Add Thread Sanitizer support to QEMU

2020-06-09 Thread Robert Foley
or tb->jmp_lock translate-all: call qemu_spin_destroy for PageDesc thread: add tsan annotations to QemuSpin Lingfeng Yang (1): configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext Robert Foley (5): tests/docker: Added docker build support for TSan. include/qem

[PATCH v3 01/13] configure: add --enable-tsan flag + fiber annotations for coroutine-ucontext

2020-06-09 Thread Robert Foley
+-9 --disable-werror' configure flags. Signed-off-by: Lingfeng Yang Signed-off-by: Emilio G. Cota [cota: minor modifications + configure changes] Signed-off-by: Robert Foley [RF: configure changes, coroutine fix + minor modifications] Reviewed-by: Alex Bennée --- confi

[PATCH v3 03/13] thread: add qemu_spin_destroy

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" It will be used for TSAN annotations. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- include/qemu/thread.h | 3 +++ 1 file changed, 3 insertions(+) diff --git a/include/qemu/thread.h b/include/qemu/thread.h index

[PATCH v3 08/13] thread: add tsan annotations to QemuSpin

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- include/qemu/thread.h | 39 --- 1 file changed, 36 insertions(+), 3 deletions(-) diff --git a/include/qemu/thread.h b/include/qemu/thre

[PATCH v3 07/13] translate-all: call qemu_spin_destroy for PageDesc

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" The radix tree is append-only, but we can fail to insert a PageDesc if the insertion races with another thread. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- accel/tcg/translate-all.c | 9 + 1 file changed, 9

[PATCH v3 02/13] cpu: convert queued work to a QSIMPLEQ

2020-06-09 Thread Robert Foley
Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 25 - cpus.c| 14 -- hw/core/cpu.c | 1 + include/hw/core/cpu.h | 6 +++--- 4 files changed, 24 insertions(+), 22 deletions(-) diff --git a/cpus-

[PATCH v3 09/13] tests/docker: Added docker build support for TSan.

2020-06-09 Thread Robert Foley
suppresion file to disable certain cases of TSAN warnings. Cc: Fam Zheng Cc: Philippe Mathieu-Daudé Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- tests/docker/dockerfiles/ubuntu2004.docker | 65 ++ tests/docker/test-tsan | 44

[PATCH v3 04/13] cputlb: destroy CPUTLB with tlb_destroy

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" I was after adding qemu_spin_destroy calls, but while at it I noticed that we are leaking some memory. Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- accel/tcg/cputlb.c | 15 +++ exec.c

[PATCH v3 13/13] tests: Disable select tests under TSan, which hit TSan issue.

2020-06-09 Thread Robert Foley
Disable a few tests under CONFIG_TSAN, which run into a known TSan issue that results in a hang. https://github.com/google/sanitizers/issues/1116 The disabled tests under TSan include all the qtests as well as the test-char, test-qga, and test-qdev-global-props. Signed-off-by: Robert Foley

[PATCH v3 05/13] qht: call qemu_spin_destroy for head buckets

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Robert Foley Reviewed-by: Alex Bennée --- util/qht.c | 1 + 1 file changed, 1 insertion(+) diff --git a/util/qht.c b/util/qht.c index aa51be3c52..67e5d5b916 100644 --- a/util/qht.c +++ b/util/qht.c @@ -348,6 +348,7 @@ static inline void qht_cha

[PATCH v3 06/13] tcg: call qemu_spin_destroy for tb->jmp_lock

2020-06-09 Thread Robert Foley
From: "Emilio G. Cota" Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley [RF: minor changes + remove tb_destroy_func] --- accel/tcg/translate-all.c | 8 include/tcg/tcg.h | 1 + tcg/tcg.c | 9 + 3 files changed, 18 insertions(+) di

[PATCH v3 10/13] include/qemu: Added tsan.h for annotations.

2020-06-09 Thread Robert Foley
These annotations will allow us to give tsan additional hints. For example, we can inform tsan about reads/writes to ignore to silence certain classes of warnings. We can also annotate threads so that the proper thread naming shows up in tsan warning results. Signed-off-by: Robert Foley

[PATCH v3 11/13] util: Added tsan annotate for thread name.

2020-06-09 Thread Robert Foley
This allows us to see the name of the thread in tsan warning reports such as this: Thread T7 'CPU 1/TCG' (tid=24317, running) created by main thread at: Signed-off-by: Robert Foley Reviewed-by: Emilio G. Cota --- util/qemu-thread-posix.c | 2 ++ 1 file changed, 2 insertions(+) di

[PATCH v3 12/13] docs: Added details on TSan to testing.rst

2020-06-09 Thread Robert Foley
Adds TSan details to testing.rst. This includes background and reference details on TSan, and details on how to build and test with TSan both with and without docker. Signed-off-by: Robert Foley Reviewed-by: Emilio G. Cota Reviewed-by: Alex Bennée --- docs/devel/testing.rst | 107

Failure of test 'basic gdbstub support'

2020-06-10 Thread Robert Henry
The newish test 'basic gdbstub support' fails for me on an out-of-the-box build on a host x86_64. (See below for the config.log head.) Is this failure expected? If so, where can I see that in the various CI engines you have running them? In digging through the test driver python code in tes

[PATCH v2 1/2] Introduce (x86) CPU model deprecation API

2020-06-10 Thread Robert Hoo
Add qapi new member documentation. Thanks Eric for comment and guidance on qapi. Signed-off-by: Robert Hoo --- hw/core/machine.c| 11 +-- include/hw/core/cpu.h| 1 + qapi/machine-target.json | 7 ++- target/i386/cpu.c| 45 +++--

[PATCH v2 2/2] Mark Icelake-Client CPU models deprecated

2020-06-10 Thread Robert Hoo
Going to obsolete Icelake-Client CPU models in the future. (No changes in v2) Signed-off-by: Robert Hoo --- target/i386/cpu.c | 10 +- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/target/i386/cpu.c b/target/i386/cpu.c index 0d8638a..47a11b5 100644 --- a/target/i386

Re: [PATCH 3/8] tests/vm: change wait_ssh to optionally wait for root.

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 06:06, Alex Bennée wrote: > > Allow wait_ssh to wait for root user to be ready. > > This solves the issue where we perform a wait_ssh() > > successfully, but the root user is not yet ready > > to be logged in. > > So in the case it's the root user we care about... We care ab

Re: [PATCH 4/8] tests/vm: Add configuration to basevm.py

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 07:26, Alex Bennée wrote: > > -SSH_KEY = open(os.path.join(os.path.dirname(__file__), > > - "..", "keys", "id_rsa")).read() > > -SSH_PUB_KEY = open(os.path.join(os.path.dirname(__file__), > > - "..", "keys", "id_rsa.pub")).read() > > - > > +SS

Re: [PATCH 6/8] tests/vm: add --boot-console switch

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 07:56, Alex Bennée wrote: > > @@ -523,6 +525,10 @@ def main(vmcls, config=None): > > if args.snapshot: > > img += ",snapshot=on" > > vm.boot(img) > > +wait_boot = getattr(vm, "wait_boot", None) > > Didn't we add a __getattr method, so w

Re: [PATCH 5/8] tests/vm: Added configuration file support

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 07:38, Alex Bennée wrote: > > +if 'password' in target_dict: > > +config['root_pass'] = target_dict['password'] > > +config['guest_pass'] = target_dict['password'] > > This seems like impedance matching between two dictionaries. Surely it > wo

Re: [PATCH 7/8] tests/vm: Added a new script for ubuntu.aarch64.

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 10:01, Alex Bennée wrote: > > vm-boot-ssh-%: $(IMAGES_DIR)/%.img > > $(call quiet-command, \ > > - $(SRC_PATH)/tests/vm/$* \ > > + $(PYTHON) $(SRC_PATH)/tests/vm/$* \ > > This seems like it should be in a different patch. Good point, will move

Re: [PATCH 7/8] tests/vm: Added a new script for ubuntu.aarch64.

2020-01-27 Thread Robert Foley
Hi Drew, On Mon, 27 Jan 2020 at 12:27, Andrew Jones wrote: > > > > I suppose we could check the version of QEMU and use the above > > defaults only for earlier versions of QEMU. > > This is something we will probably move to aarch64vm.py since it is common. > > What versions of QEMU do these tes

Re: [PATCH 7/8] tests/vm: Added a new script for ubuntu.aarch64.

2020-01-27 Thread Robert Foley
On Mon, 27 Jan 2020 at 15:07, Alex Bennée wrote: > Robert Foley writes: > > > Hi Drew, > > > > On Mon, 27 Jan 2020 at 12:27, Andrew Jones wrote: > > > >> > > >> > I suppose we could check the version of QEMU and use the above > >&g

Re: [EXTERNAL] Re: QEMU for aarch64 with plugins seems to fail basic consistency checks

2020-01-27 Thread Robert Henry
or 3 days on qemu+plugins and only observed a tolerable growth in qemu's memory consumption. From: Alex Bennée Sent: Friday, January 24, 2020 11:44 AM To: Robert Henry Cc: Laurent Desnogues ; qemu-devel@nongnu.org Subject: Re: [EXTERNAL] Re: QEMU for aarch

Re: [PATCH 0/8] tests/vm: Add support for aarch64 VMs

2020-01-29 Thread Robert Foley
Thanks for the details on the failure. I have not been able to reproduce it yet, but digging into it further. On Tue, 28 Jan 2020 at 12:52, Alex Bennée wrote: > > > Robert Foley writes: > > > This patch adds support for 2 aarch64 VMs. > > - Ubuntu 18.04 aarch64 VM &g

Re: [PATCH v2 02/12] tests/docker: better handle symlinked libs

2020-01-30 Thread Robert Foley
Hi, I was looking at this patch and have a comment about the number of groups that are expected to be found by this regex. It seems like the old code expected two groups to be found otherwise it will not append the library to the found libs. def _get_so_libs(executable): libs = [] ldd_re =

[Bug 1860610] Re: cap_disas_plugin leaks memory

2020-01-31 Thread Robert Henry
I run git blame in the capstone repository, and cs_free has been around for at least 4 years in the capstone ABI. I can not tell if the need to call cs_free is a (new) requirement. Documentation capstone is a little informal... -- You received this bug notification because you are a member of qem

Re: [PATCH 2/2] util: add util function buffer_zero_avx512()

2020-02-23 Thread Robert Hoo
Thanks Richard:-) Sorry for late reply. On Thu, 2020-02-13 at 10:20 -0800, Richard Henderson wrote: > On 2/12/20 11:52 PM, Robert Hoo wrote: > > And initialize buffer_is_zero() with it, when Intel AVX512F is > > available on host. > > > > This function utiliz

Re: [PATCH 2/2] util: add util function buffer_zero_avx512()

2020-02-24 Thread Robert Hoo
On Mon, 2020-02-24 at 08:13 -0800, Richard Henderson wrote: > On 2/23/20 11:07 PM, Robert Hoo wrote: > > Inspired by your suggestion, I'm thinking go further: use immediate > > rather than a global variable, so that saves 1 memory(/cache) > > access. > >

Re: [PATCH v3 08/19] tests/iotests: be a little more forgiving on the size test

2020-02-25 Thread Robert Foley
is not bigger than before and > also dump the values in the report. > > Signed-off-by: Alex Bennée Reviewed-by: Robert Foley

[PATCH v2 0/2] Add AVX512F optimization option and buffer_zero_avx512()

2020-02-25 Thread Robert Hoo
: handle the case in select_accel_fn(), and have a global variable alongside buffer_accel) 3. Changes avx512f configuration option's default status to disabled. 4. Ran 'make check-unit' on this patch, on both a Ivybridge machine and a CascadeLake machine. Robert Hoo (2): configur

[PATCH v2 1/2] configure: introduce configure option avx512f

2020-02-25 Thread Robert Hoo
/sites/default/files/managed/c5/15/architecture-instruction-set-extensions-programming-reference.pdf Signed-off-by: Robert Hoo --- configure | 41 + 1 file changed, 41 insertions(+) diff --git a/configure b/configure index d57261e..a0b41ce 100755 --- a

[PATCH v2 2/2] util: add util function buffer_zero_avx512()

2020-02-25 Thread Robert Hoo
. buffer_zero_avx2()). Signed-off-by: Robert Hoo --- include/qemu/cpuid.h | 3 +++ util/bufferiszero.c | 64 2 files changed, 58 insertions(+), 9 deletions(-) diff --git a/include/qemu/cpuid.h b/include/qemu/cpuid.h index 6930170..09fc245

[PATCH v3 0/2] Add AVX512F optimization option and buffer_zero_avx512()

2020-02-27 Thread Robert Hoo
anges avx512f configuration option's default status to disabled. 4. Ran 'make check-unit' on this patch, on both a Ivybridge machine and a CascadeLake machine. Robert Hoo (2): configure: add configure option avx512f_opt util: add util function buffer_zero_avx512()

[PATCH v3 1/2] configure: add configure option avx512f_opt

2020-02-27 Thread Robert Hoo
-programming-reference.pdf Signed-off-by: Robert Hoo --- configure | 41 + 1 file changed, 41 insertions(+) diff --git a/configure b/configure index d57261e..a0b41ce 100755 --- a/configure +++ b/configure @@ -1395,6 +1395,11 @@ for opt do ;; --enable-avx2

[PATCH v3 2/2] util: add util function buffer_zero_avx512()

2020-02-27 Thread Robert Hoo
. buffer_zero_avx2()). Signed-off-by: Robert Hoo --- include/qemu/cpuid.h | 3 +++ util/bufferiszero.c | 67 +--- 2 files changed, 61 insertions(+), 9 deletions(-) diff --git a/include/qemu/cpuid.h b/include/qemu/cpuid.h index 6930170..09fc245 100644 --- a

[PATCH v9 01/74] cpu: convert queued work to a QSIMPLEQ

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" Instead of open-coding it. While at it, make sure that all accesses to the list are performed while holding the list's lock. Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley ---

[PATCH v9 06/74] cpu: introduce process_queued_cpu_work_locked

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" This completes the conversion to cpu_mutex_lock/unlock in the file. Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 17 +++-- 1 file changed, 11 insert

[PATCH v9 00/74] per-CPU locks

2020-05-21 Thread Robert Foley
_reset_interrupt s390x: use cpu_reset_interrupt openrisc: use cpu_reset_interrupt Robert Foley (1): hw/semihosting: convert to cpu_halted_set accel/tcg/cpu-exec.c| 40 ++- accel/tcg/cputlb.c | 10 +- accel/tcg/tcg-all.c | 12 +- accel/tcg/tcg-runtime.

[PATCH v9 02/74] cpu: rename cpu->work_mutex to cpu->lock

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" This lock will soon protect more fields of the struct. Give it a more appropriate name. Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 14 +++-

[PATCH v9 03/74] cpu: introduce cpu_mutex_lock/unlock

2020-05-21 Thread Robert Foley
vCPUs are locked by the same thread, which explains why the bitmap is introduced here. Reviewed-by: Richard Henderson Signed-off-by: Emilio G. Cota [RF: Add assert in smp_parse. Make cpu_mutex_lock stub empty] Signed-off-by: Robert Foley --- cpus.c

[PATCH v9 05/74] cpu: move run_on_cpu to cpus-common

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" We don't pass a pointer to qemu_global_mutex anymore. Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 2 +- cpus.c| 5 - include/hw/

[PATCH v9 07/74] cpu: make per-CPU locks an alias of the BQL in TCG rr mode

2020-05-21 Thread Robert Foley
ex_destroy, and call from cpu_common_finalize, to avoid destroying qemu_global_mutex, when cpu mutex is destroyed. Reviewed-by: Alex Bennée Reviewed-by: Richard Henderson Signed-off-by: Emilio G. Cota [RF: Fixed destroy issue, added cpu_mutex_destroy.] Signed-off-by: Robert Foley ---

[PATCH v9 04/74] cpu: make qemu_work_cond per-cpu

2020-05-21 Thread Robert Foley
f-by: Emilio G. Cota Signed-off-by: Robert Foley --- cpus-common.c | 72 ++- cpus.c| 2 +- hw/core/cpu.c | 1 + include/hw/core/cpu.h | 6 ++-- 4 files changed, 63 insertions(+), 18 deletions(-) diff --git a/cpus-comm

[PATCH v9 16/74] tcg-runtime: convert to cpu_halted_set

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- accel/tcg/tcg-runtime.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/accel/tcg/tcg-runtime.c b/accel/tcg/tcg-runti

[PATCH v9 11/74] hppa: convert to helper_cpu_halted_set

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- target/hppa/translate.c | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/target/hppa/translate.c b/target/hppa/transla

[PATCH v9 08/74] tcg-runtime: define helper_cpu_halted_set

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- accel/tcg/tcg-runtime.c | 7 +++ accel/tcg/tcg-runtime.h | 2 ++ 2 files changed, 9 insertions(+) diff --git a/accel/tcg/tcg-runtime

[PATCH v9 10/74] cris: convert to helper_cpu_halted_set

2020-05-21 Thread Robert Foley
From: "Emilio G. Cota" And fix the temp leak along the way. Cc: "Edgar E. Iglesias" Reviewed-by: Richard Henderson Reviewed-by: Alex Bennée Signed-off-by: Emilio G. Cota Signed-off-by: Robert Foley --- target/cris/translate.c | 5 +++-- 1 file changed, 3 insert

<    3   4   5   6   7   8   9   10   11   >