Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Jan Beulich
>>> On 03.09.15 at 22:58, wrote: > On 03/09/2015 21:01, Julien Grall wrote: >> On 27/08/2015 09:37, Jan Beulich wrote: >>> On NUMA systems, where we try to use node local memory for the basic >>> control structures of the buddy allocator, this special case needs to >>> take into consideration a po

Re: [Xen-devel] [PATCH] xen/p2m: fix extra memory regions accounting

2015-09-04 Thread Roger Pau Monné
Hello, El 04/09/15 a les 7.07, Juergen Gross ha escrit: > Could you try the attached patch? It should do the job. It is booting > fine on my laptop, but I think you should try it on the machine with > the memory ranges not at page boundary. > > > Juergen > > > extramem.patch > > > commit 3d0

Re: [Xen-devel] xhci_hcd intterrupt affinity in Dom0/DomU limited to single interrupt

2015-09-04 Thread Jan Beulich
>>> On 03.09.15 at 18:52, wrote: > On Thu, 2015-09-03 at 09:04 -0600, Jan Beulich wrote: >> >>> On 03.09.15 at 14:04, wrote: >> > I am still confused as to whether any device, or in this case >> > xhci_hcd, >> > can use more than one cpu at any given time. My understanding based on >>

Re: [Xen-devel] Commit moratorium

2015-09-04 Thread Jan Beulich
>>> On 03.09.15 at 18:25, wrote: > Xen tree is going to branch at 4.6 RC3. I don't want to branch when > master != staging, so please avoid committing new patches to staging now > to let master catch up with staging. Another announcement will be made > when the moratorium is lifted. Hmm, I think

Re: [Xen-devel] [PATCH] xen/p2m: fix extra memory regions accounting

2015-09-04 Thread Juergen Gross
On 09/04/2015 09:37 AM, Roger Pau Monné wrote: Hello, El 04/09/15 a les 7.07, Juergen Gross ha escrit: Could you try the attached patch? It should do the job. It is booting fine on my laptop, but I think you should try it on the machine with the memory ranges not at page boundary. Juergen e

Re: [Xen-devel] [PATCH] xen/p2m: fix extra memory regions accounting

2015-09-04 Thread Roger Pau Monné
El 04/09/15 a les 9.47, Juergen Gross ha escrit: > On 09/04/2015 09:37 AM, Roger Pau Monné wrote: >> Hello, >> >> El 04/09/15 a les 7.07, Juergen Gross ha escrit: >>> Could you try the attached patch? It should do the job. It is booting >>> fine on my laptop, but I think you should try it on the ma

Re: [Xen-devel] [PATCH] xen/p2m: fix extra memory regions accounting

2015-09-04 Thread Juergen Gross
On 09/04/2015 09:57 AM, Roger Pau Monné wrote: El 04/09/15 a les 9.47, Juergen Gross ha escrit: On 09/04/2015 09:37 AM, Roger Pau Monné wrote: Hello, El 04/09/15 a les 7.07, Juergen Gross ha escrit: Could you try the attached patch? It should do the job. It is booting fine on my laptop, but I

Re: [Xen-devel] [PATCH 15/16] xen/vtd: prevent from assign the device with shared rmrr

2015-09-04 Thread Jan Beulich
>>> On 03.09.15 at 21:39, wrote: > So this change in 4.6 prevents me from passing through devices that have > worked previously with VT-d: > > (XEN) [VT-D] cannot assign :00:1a.0 with shared RMRR at ae8a9000 for > Dom30. > (XEN) [VT-D] cannot assign :00:1d.0 with shared RMRR at ae8a9000 f

Re: [Xen-devel] [libvirt] [PATCH V2] libxl: don't overwrite error from virNetSocketNewConnectTCP()

2015-09-04 Thread Michal Privoznik
On 03.09.2015 22:55, John Ferlan wrote: > > > On 09/03/2015 01:40 PM, Jim Fehlig wrote: >> Remove redundant error reporting in libxlDomainMigrationPerform(). >> virNetSocketNewConnectTCP() is perfectly capable of reporting >> sensible errors. >> >> Signed-off-by: Jim Fehlig >> --- >> >> V2: >> A

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 01:37 -0600, Jan Beulich wrote: > > > > > > On 03.09.15 at 22:58, wrote: > > On 03/09/2015 21:01, Julien Grall wrote: > > > On 27/08/2015 09:37, Jan Beulich wrote: > > > > On NUMA systems, where we try to use node local memory for the > > > > basic > > > > control structure

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 05:38, wrote: > On 09/04/2015 02:40 AM, Wei Liu wrote: >> This issue is exposed by the introduction of migration v2. The symptom is >> that >> a guest with 32 bit 4.1 kernel can't be restored because it's asking for too >> many pages. >> >> Note that all guests have 512MB memor

Re: [Xen-devel] [PATCH RFC v2 0/4] HVM x86 deprivileged mode operations

2015-09-04 Thread Jan Beulich
>>> On 03.09.15 at 18:01, wrote: > I performed 10 writes to a single I/O port on an Intel 2.2GHz Xeon > E5-2407 0 processor and an AMD Opteron 2376. This was done from a python > script > within the HVM guest using time.time() and running Debian Jessie. Each write > was > trapped to cause a

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 10:27, wrote: > On Fri, 2015-09-04 at 01:37 -0600, Jan Beulich wrote: >> > > > On 03.09.15 at 22:58, wrote: >> > And found why! The last xenheap_bits changed from 39 to 38. >> > >> > On x-gene the last max mfn used for the xenheap is 0x440, which the >> > new computation,

[Xen-devel] Nested Virtualisation and UEFI

2015-09-04 Thread James Dingwall
Hi, I am trying to get a nested virtualisation environment working where it is started with bios='ovmf'. When my hvm configuration is bios='seabios' and I use the xen.gz everything starts correctly. Using the xen.efi from the same build when bios='ovmf' causesthe guest Linux kernel to block

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 02:39 -0600, Jan Beulich wrote: > > > > > > On 04.09.15 at 10:27, wrote: > > On Fri, 2015-09-04 at 01:37 -0600, Jan Beulich wrote: > > > > > > On 03.09.15 at 22:58, wrote: > > > > And found why! The last xenheap_bits changed from 39 to 38. > > > > > > > > On x-gene the las

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 01:40 +0100, Wei Liu wrote: > Hi David > > This issue is exposed by the introduction of migration v2. The symptom is that > a guest with 32 bit 4.1 kernel can't be restored because it's asking for too > many pages. FWIW my adhoc tests overnight gave me: 37858: b953c0d234bc7

[Xen-devel] [linux-3.4 test] 61301: regressions - FAIL

2015-09-04 Thread osstest service owner
flight 61301 linux-3.4 real [real] http://logs.test-lab.xenproject.org/osstest/logs/61301/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-xl-qemut-win7-amd64 6 xen-boot fail REGR. vs. 30511 Tests which are failing

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 10:52, wrote: > On Fri, 2015-09-04 at 02:39 -0600, Jan Beulich wrote: >> > >> > > > On 04.09.15 at 10:27, wrote: >> > On Fri, 2015-09-04 at 01:37 -0600, Jan Beulich wrote: >> > > > > > On 03.09.15 at 22:58, wrote: >> > > > And found why! The last xenheap_bits changed from 39

Re: [Xen-devel] [PATCH RFC v2 0/4] HVM x86 deprivileged mode operations

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 02:33 -0600, Jan Beulich wrote: > > > > > > On 03.09.15 at 18:01, wrote: > > I performed 10 writes to a single I/O port on an Intel 2.2GHz Xeon > > E5-2407 0 processor and an AMD Opteron 2376. This was done from a > > python > > script > > within the HVM guest using ti

Re: [Xen-devel] Nested Virtualisation and UEFI

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 10:47, wrote: > I am trying to get a nested virtualisation environment working where it is > started with bios='ovmf'. When my > hvm configuration is bios='seabios' and I use the xen.gz everything starts > correctly. Using the xen.efi from > the same build when bios='ovmf'

[Xen-devel] netback grant copying issues

2015-09-04 Thread Jan Beulich
Ian, Wei, I seem to be seeing two issues in the grant copy handling of netback, solely from code inspection: 1) Shouldn't MAX_GRANT_COPY_OPS, to take care of the copying the header may require, be ((MAX_SKB_FRAGS + 1) * XEN_NETIF_RX_RING_SIZE)? 2) xenvif_gop_frag_copy() may set up any number of

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 09:53 +0100, Ian Campbell wrote: > I have set the adhoc bisector working on the ~200 commits between rc3 and > rc4. It's running in the Citrix instance (which is quieter) so the interim > results are only visible within our network at http://osstest.xs.citrite.ne > t/~osstest/

Re: [Xen-devel] [PATCH RFC v2 0/4] HVM x86 deprivileged mode operations

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 11:16, wrote: > On Fri, 2015-09-04 at 02:33 -0600, Jan Beulich wrote: >> > >> > > > On 03.09.15 at 18:01, wrote: >> > I performed 10 writes to a single I/O port on an Intel 2.2GHz Xeon >> > E5-2407 0 processor and an AMD Opteron 2376. This was done from a >> > python >>

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Andrew Cooper
On 04/09/15 09:28, Jan Beulich wrote: On 04.09.15 at 05:38, wrote: On 09/04/2015 02:40 AM, Wei Liu wrote: This issue is exposed by the introduction of migration v2. The symptom is that a guest with 32 bit 4.1 kernel can't be restored because it's asking for too many pages. Note that all guest

[Xen-devel] [linux-next test] 61302: regressions - trouble: broken/fail/pass

2015-09-04 Thread osstest service owner
flight 61302 linux-next real [real] http://logs.test-lab.xenproject.org/osstest/logs/61302/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-armhf-armhf-xl-qcow2 8 leak-check/basis(8) fail REGR. vs. 61119 test-armhf-armhf-xl-ra

[Xen-devel] Kernel crash with "xen: avoid early crash of memory limited dom0"

2015-09-04 Thread Roger Pau Monné
Hello, The following commit: commit fa84f27e21200dbe7d18c21af424d1de703b7567 Author: Juergen Gross Date: Wed Aug 19 18:52:34 2015 +0200 xen: avoid early crash of memory limited dom0 Which is queued in: git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip.git for-linus-4.3 Is giving me the

[Xen-devel] [distros-debian-sid test] 37873: regressions - FAIL

2015-09-04 Thread Platform Team regression test user
flight 37873 distros-debian-sid real [real] http://osstest.xs.citrite.net/~osstest/testlogs/logs/37873/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-i386-sid-netboot-pvgrub 10 guest-startfail REGR. vs. 37845 Tests whic

[Xen-devel] [PATCH] xen-blkback: free requests on disconnection

2015-09-04 Thread Roger Pau Monne
Request allocation has been moved to connect_ring, which is called every time blkback connects to the frontend (this can happen multiple times during a blkback instance life cycle). On the other hand, request freeing has not been moved, so it's only called when destroying the backend instance. Due

Re: [Xen-devel] Kernel crash with "xen: avoid early crash of memory limited dom0"

2015-09-04 Thread Juergen Gross
On 09/04/2015 11:48 AM, Roger Pau Monné wrote: Hello, The following commit: commit fa84f27e21200dbe7d18c21af424d1de703b7567 Author: Juergen Gross Date: Wed Aug 19 18:52:34 2015 +0200 xen: avoid early crash of memory limited dom0 Which is queued in: git://git.kernel.org/pub/scm/linux/kerne

Re: [Xen-devel] Kernel crash with "xen: avoid early crash of memory limited dom0"

2015-09-04 Thread David Vrabel
On 04/09/15 10:48, Roger Pau Monné wrote: > Hello, > > The following commit: > > commit fa84f27e21200dbe7d18c21af424d1de703b7567 > Author: Juergen Gross > Date: Wed Aug 19 18:52:34 2015 +0200 > > xen: avoid early crash of memory limited dom0 > > Which is queued in: > > git://git.kernel.org/

Re: [Xen-devel] [PATCH RFC v2 0/4] HVM x86 deprivileged mode operations

2015-09-04 Thread Fabio Fantoni
Il 03/09/2015 18:01, Ben Catterall ha scritto: Hi all, I have made requested changes and reworked the patch series based on the comments recieved. Thank you to all of the contributors to those discussions! The next step will be to provide an example of usage of this system which will follow in a

[Xen-devel] [OSSTEST PATCH 2/4] adhoc-revtuple-generator: Honour OSSTEST_AHRTG_SETX elsewhere

2015-09-04 Thread Ian Jackson
Find all the places where adhoc-revtuple-generator runs subprograms and have it add set -x (either by adding $OSSTEST_AHRTG_SETX to an existing set -e, or using $setx which is either : or `set -x'). Signed-off-by: Ian Jackson --- adhoc-revtuple-generator | 17 ++--- 1 file changed,

[Xen-devel] [OSSTEST PATCH 3/4] cs-bisection-step: Print our command line at the start

2015-09-04 Thread Ian Jackson
The usual approach for debugging the cs-bisection-step is to repro the problem (with --max-flight), which is most easily done by copying the command line provided during a run which did the wrong thing. Print the command line at startup, so that it appears in the report. This will save us grobblin

[Xen-devel] [OSSTEST PATCH 0/4] A few more bisector fixes

2015-09-04 Thread Ian Jackson
This contains one bugfix to a bug reported to me by Ian Campbell, and three useful cleanups prompted by annoyances I tripped over on the way. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel

[Xen-devel] [OSSTEST PATCH 1/4] adhoc-revtuple-generator: Turn off a set -x

2015-09-04 Thread Ian Jackson
This set -x uglified the output. Provide a way (OSSTEST_AHRTG_SETX) to turn it on again. Signed-off-by: Ian Jackson --- adhoc-revtuple-generator |4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/adhoc-revtuple-generator b/adhoc-revtuple-generator index 2b04c11..5a44d63

[Xen-devel] [OSSTEST PATCH 4/4] cs-bisection-step: Properly handle external job refs in template

2015-09-04 Thread Ian Jackson
cs-bisection-step has had, for a long time, code which is supposed to handle the situation where the template flight contains build job references to other flights. However: - The regexp to spot these other-flight job reference runvars would never match because it said \s where \S was probabl

Re: [Xen-devel] Kbuild and Kconfig

2015-09-04 Thread Andrew Cooper
On 03/09/15 10:56, Ian Campbell wrote: On Wed, 2015-09-02 at 19:29 +0100, Andrew Cooper wrote: On 02/09/15 18:50, Doug Goldstein wrote: I just wanted to bring this to a top level post since Jonathan Creekmore and myself have talked with a few maintainers in different threads and on IRC about po

Re: [Xen-devel] [OSSTEST PATCH 4/4] cs-bisection-step: Properly handle external job refs in template

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 11:56 +0100, Ian Jackson wrote: > cs-bisection-step has had, for a long time, code which is supposed to > handle the situation where the template flight contains build job > references to other flights. > > However: > > - The regexp to spot these other-flight job reference

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Julien Grall
Hi Jan, On 04/09/15 10:09, Jan Beulich wrote: >> "create_xen_entries: L2 failed" tells me, through code inspection rather >> than usefulness of the logging, that alloc_xenheap_page has returned NULL. >> >> I think this is simply because all RAM on Mustang is at physical address >> 128GB onwards or

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 10:35:52AM +0100, Andrew Cooper wrote: > On 04/09/15 09:28, Jan Beulich wrote: > On 04.09.15 at 05:38, wrote: > >>On 09/04/2015 02:40 AM, Wei Liu wrote: > >>>This issue is exposed by the introduction of migration v2. The symptom is > >>>that > >>>a guest with 32 bit 4.

Re: [Xen-devel] Nested Virtualisation and UEFI

2015-09-04 Thread James Dingwall
On Fri, Sep 04, 2015 at 03:17:38AM -0600, Jan Beulich wrote: > >>> On 04.09.15 at 10:47, wrote: > > I am trying to get a nested virtualisation environment working where it is > > started with bios='ovmf'. When my > > hvm configuration is bios='seabios' and I use the xen.gz everything starts >

Re: [Xen-devel] Kbuild and Kconfig

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 11:59 +0100, Andrew Cooper wrote: > On 03/09/15 10:56, Ian Campbell wrote: > > On Wed, 2015-09-02 at 19:29 +0100, Andrew Cooper wrote: > > > On 02/09/15 18:50, Doug Goldstein wrote: > > > > I just wanted to bring this to a top level post since Jonathan > > > > Creekmore > > >

Re: [Xen-devel] Linux 4.1 reports wrong number of pages to toolstack

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 02:28:41AM -0600, Jan Beulich wrote: > >>> On 04.09.15 at 05:38, wrote: > > On 09/04/2015 02:40 AM, Wei Liu wrote: > >> This issue is exposed by the introduction of migration v2. The symptom is > >> that > >> a guest with 32 bit 4.1 kernel can't be restored because it's as

Re: [Xen-devel] Commit moratorium

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 01:44:24AM -0600, Jan Beulich wrote: > >>> On 03.09.15 at 18:25, wrote: > > Xen tree is going to branch at 4.6 RC3. I don't want to branch when > > master != staging, so please avoid committing new patches to staging now > > to let master catch up with staging. Another anno

[Xen-devel] [linux-mingo-tip-master test] 61303: regressions - FAIL

2015-09-04 Thread osstest service owner
flight 61303 linux-mingo-tip-master real [real] http://logs.test-lab.xenproject.org/osstest/logs/61303/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs

Re: [Xen-devel] Kernel crash with "xen: avoid early crash of memory limited dom0"

2015-09-04 Thread Juergen Gross
On 09/04/2015 12:10 PM, David Vrabel wrote: On 04/09/15 10:48, Roger Pau Monné wrote: Hello, The following commit: commit fa84f27e21200dbe7d18c21af424d1de703b7567 Author: Juergen Gross Date: Wed Aug 19 18:52:34 2015 +0200 xen: avoid early crash of memory limited dom0 Which is queued in:

Re: [Xen-devel] Kbuild and Kconfig

2015-09-04 Thread Stefano Stabellini
On Wed, 2 Sep 2015, Doug Goldstein wrote: > Long term, yes we can tackle tools and stubdoms as well but initially I > was trying to eat the elephant one bite at a time. My idea was that we > would do xen/ first and you would have to go into that directory and run > "make defconfig/menuconfig/config

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 13:29, wrote: > Anyway, I tried your suggestion to dropped the call to xenheap_max_mfn when > Xen > setups the xenheap for arm64 and it allows me to boot correctly Xen on > X-gene. > See patch below, I can send the patch in a separate thread if necessary. That would depend on

Re: [Xen-devel] Kernel crash with "xen: avoid early crash of memory limited dom0"

2015-09-04 Thread David Vrabel
On 04/09/15 12:54, Juergen Gross wrote: > On 09/04/2015 12:10 PM, David Vrabel wrote: >> On 04/09/15 10:48, Roger Pau Monné wrote: >>> Hello, >>> >>> The following commit: >>> >>> commit fa84f27e21200dbe7d18c21af424d1de703b7567 >>> Author: Juergen Gross >>> Date: Wed Aug 19 18:52:34 2015 +0200 >

[Xen-devel] [PATCH] xen: switch extra memory accounting to use pfns

2015-09-04 Thread Juergen Gross
Instead of using physical addresses for accounting of extra memory areas available for ballooning switch to pfns as this is much less error prone regarding partial pages. Reported-by: Roger Pau Monné Signed-off-by: Juergen Gross --- arch/x86/xen/setup.c | 80 ---

Re: [Xen-devel] Nested Virtualisation and UEFI

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 13:35, wrote: > I was worried about spamming the list by sending the full logs but if that > is likely to have the most useful > information then here we go... And indeed not all of it would have been needed: > FS0:\EFI\Xen\> xen-4.5.1.efi > Xen 4.5.1 (c/s ) EFI loader > Usi

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 06:02:28AM -0600, Jan Beulich wrote: > >>> On 04.09.15 at 13:29, wrote: > > Anyway, I tried your suggestion to dropped the call to xenheap_max_mfn when > > Xen > > setups the xenheap for arm64 and it allows me to boot correctly Xen on > > X-gene. > > See patch below, I ca

Re: [Xen-devel] Commit moratorium

2015-09-04 Thread Jan Beulich
>>> On 04.09.15 at 13:52, wrote: > On Fri, Sep 04, 2015 at 01:44:24AM -0600, Jan Beulich wrote: >> >>> On 03.09.15 at 18:25, wrote: >> > Xen tree is going to branch at 4.6 RC3. I don't want to branch when >> > master != staging, so please avoid committing new patches to staging now >> > to let ma

[Xen-devel] [PATCH v6 05/29] libxc: make arch_setup_meminit a xc_dom_arch hook

2015-09-04 Thread Roger Pau Monne
This allows having different arch_setup_meminit implementations based on the guest type. It should not introduce any functional changes. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu --- Change

[Xen-devel] [PATCH v6 03/29] libxc: introduce the notion of a container type

2015-09-04 Thread Roger Pau Monne
Introduce the notion of a container type into xc_dom_image. This will be needed by later changes that will also use xc_dom_image in order to build HVM guests. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell C

[Xen-devel] [PATCH v6 04/29] libxc: introduce a domain loader for HVM guest firmware

2015-09-04 Thread Roger Pau Monne
Introduce a very simple (and dummy) domain loader to be used to load the firmware (hvmloader) into HVM guests. Since hmvloader is just a 32bit elf executable the loader is fairly simple. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Sta

[Xen-devel] [PATCH v6 06/29] libxc: make arch_setup_boot{init/late} xc_dom_arch hooks

2015-09-04 Thread Roger Pau Monne
This should not introduce any functional change. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu --- Changes since v3: - Add Andrew Cooper Reviewed-by. - Add Wei Acked-by. --- tools/libxc/incl

[Xen-devel] [PATCH v6 11/29] xen/x86: add bitmap of enabled emulated devices

2015-09-04 Thread Roger Pau Monne
Introduce a bitmap in x86 xen_arch_domainconfig that allows enabling or disabling specific devices emulated inside of Xen for HVM guests. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu Cc: Jan Beulich Cc: Andrew

[Xen-devel] [PATCH v6 08/29] libxc: introduce a xc_dom_arch for hvm-3.0-x86_32 guests

2015-09-04 Thread Roger Pau Monne
This xc_dom_arch will be used in order to build HVM domains. The code is based on the existing xc_hvm_populate_memory and xc_hvm_populate_params functions. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc:

[Xen-devel] [PATCH v6 16/29] xen/x86: allow disabling the emulated IO APIC

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/vioapic.c | 14 ++ 1 file changed, 14 insertions(+) diff --git a/xen/arch/x86/hvm/vioapic.c b/xen/arch/x86/hvm/vioapic

[Xen-devel] [PATCH v6 00/29] Introduce HVM without dm and new boot ABI

2015-09-04 Thread Roger Pau Monne
This series is split in the following order: - Patches from 1 to 10 switch HVM domain contruction to use the xc_dom_* family of functions, like they are used to build PV domains. This batch of patches can go in regardless of the status of the rest of the series IMHO, and in fact would he

[Xen-devel] [PATCH v6 24/29] xen/x86: allow HVM guests to use hypercalls to bring up vCPUs

2015-09-04 Thread Roger Pau Monne
Allow the usage of the VCPUOP_initialise, VCPUOP_up, VCPUOP_down and VCPUOP_is_up hypercalls from HVM guests. This patch introduces a new structure (vcpu_hvm_context) that should be used in conjuction with the VCPUOP_initialise hypercall in order to initialize vCPUs for HVM guests. Signed-off-by:

[Xen-devel] [PATCH v6 21/29] xen/x86: allow disabling all emulated devices inside of Xen

2015-09-04 Thread Roger Pau Monne
Only allow enabling or disabling all the emulated devices inside of Xen, right now Xen doesn't support enabling specific emulated devices only. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v5: - Add Andrew Cooper Reviewed-by. --

[Xen-devel] [PATCH v6 17/29] xen/x86: allow disabling the emulated PIC

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/vpic.c | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/xen/arch/x86/hvm/vpic.c b/xen/arch/x86/hvm/v

[Xen-devel] [PATCH v6 07/29] libxc: rework BSP initialization

2015-09-04 Thread Roger Pau Monne
Place the calls to xc_vcpu_setcontext and the allocation of the hypercall buffer into the arch-specific vcpu hooks. This is needed in order to introduce a new builder, so x86 HVM guests can initialize the BSP using XEN_DOMCTL_sethvmcontext instead of XEN_DOMCTL_setvcpucontext. This patch should no

[Xen-devel] [PATCH v6 14/29] xen/x86: allow disabling the pmtimer

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/pmtimer.c | 13 + 1 file changed, 13 insertions(+) diff --git a/xen/arch/x86/hvm/pmtimer.c b/xen/arch/x86/hvm/pmtimer.

[Xen-devel] [PATCH v6 12/29] xen/x86: allow disabling the emulated local apic

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Reviewed-by: Boris Ostrovsky Cc: Boris Ostrovsky Cc: Suravee Suthikulpanit Cc: Aravind Gopalakrishnan Cc: Jan Beulich Cc: Andrew Cooper Cc: Jun Nakajima Cc: Eddie Dong Cc: Kevin Tian --- Changes since v5: - Add Boris Ostrovsky Revie

[Xen-devel] [PATCH v6 19/29] xen/x86: allow disabling the emulated VGA

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/stdvga.c | 6 ++ 1 file changed, 6 insertions(+) diff --git a/xen/arch/x86/hvm/stdvga.c b/xen/arch/x86/hvm/stdvga.c index f50b

[Xen-devel] [PATCH v6 23/29] libxc: allow creating domains without emulated devices.

2015-09-04 Thread Roger Pau Monne
Introduce a new flag in xc_dom_image that turns on and off the emulated devices. This prevents creating the VGA hole, the hvm_info page and the ioreq server pages. libxl unconditionally sets it to true for all HVM domains at the moment. Signed-off-by: Roger Pau Monné Acked-by: Wei Liu Reviewed-b

[Xen-devel] [PATCH v6 09/29] libxl: switch HVM domain building to use xc_dom_* helpers

2015-09-04 Thread Roger Pau Monne
Now that we have all the code in place HVM domain building in libxl can be switched to use the xc_dom_* family of functions, just like they are used in order to build PV guests. Signed-off-by: Roger Pau Monné Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Li

[Xen-devel] [PATCH v6 01/29] libxc: split x86 HVM setup_guest into smaller logical functions

2015-09-04 Thread Roger Pau Monne
This is just a preparatory change to clean up the code in setup_guest. Should not introduce any functional changes. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu --- Changes since v3: - Add An

[Xen-devel] [PATCH v6 29/29] libxl: add support for migrating HVM guests without a device model

2015-09-04 Thread Roger Pau Monne
Only some minor libxl changes are needed in order to be able to migrate HVM guests without a device model, no hypervisor changes are needed. This change adds support for LIBXL_DEVICE_MODEL_VERSION_NONE into the migration code. Signed-off-by: Roger Pau Monné Cc: Ian Jackson Cc: Ian Campbell Cc:

[Xen-devel] [PATCH v6 20/29] xen/x86: allow disabling the emulated IOMMU

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Suravee Suthikulpanit Cc: Aravind Gopalakrishnan --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/drivers/passthrough/amd/iommu_guest.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/xen/drivers/passt

[Xen-devel] [PATCH v6 18/29] xen/x86: allow disabling the emulated pmu

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/cpu/vpmu.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/xen/arch/x86/cpu/vpmu.c b/xen/arch/x86/cpu/vpmu.c index 8af3df1..d5bb

[Xen-devel] [PATCH v6 27/29] libxc: switch xc_dom_elfloader to be used with HVMlite domains

2015-09-04 Thread Roger Pau Monne
Allow xc_dom_elfloader to report a guest type as hvm-3.0-x86_32 if it's running inside of a HVM container and has the PHYS32_ENTRY elfnote set. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu ---

[Xen-devel] [PATCH v6 25/29] xenconsole: try to attach to PV console if HVM fails

2015-09-04 Thread Roger Pau Monne
HVM guests have always used the emulated serial console by default, but if the emulated serial pty cannot be fetched from xenstore try to use the PV console instead. Signed-off-by: Roger Pau Monné Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu --- Chang

[Xen-devel] [PATCH v6 15/29] xen/x86: allow disabling the emulated RTC

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes since v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/rtc.c | 16 1 file changed, 16 insertions(+) diff --git a/xen/arch/x86/hvm/rtc.c b/xen/arch/x86/hvm/rtc.c index a

[Xen-devel] [PATCH v6 02/29] libxc: unify xc_dom_p2m_{host/guest}

2015-09-04 Thread Roger Pau Monne
Unify both functions into xc_dom_p2m. Should not introduce any functional change. Signed-off-by: Roger Pau Monné Reviewed-by: Andrew Cooper Acked-by: Wei Liu Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu Cc: Samuel Thibault --- Changes since v3: - Add Andrew Cooper R

[Xen-devel] [PATCH v6 22/29] elfnotes: intorduce a new PHYS_ENTRY elfnote

2015-09-04 Thread Roger Pau Monne
This new elfnote contains the 32bit entry point into the kernel. Xen will use this entry point in order to launch the guest kernel in 32bit protected mode with paging disabled. Signed-off-by: Roger Pau Monné Acked-by: Wei Liu Reviewed-by: Andrew Cooper Cc: Ian Jackson Cc: Stefano Stabellini C

[Xen-devel] [PATCH v6 10/29] libxc: remove dead HVM building code

2015-09-04 Thread Roger Pau Monne
Remove xc_hvm_build_x86.c and xc_hvm_build_arm.c since xc_hvm_build is not longer used in order to create HVM guests. Signed-off-by: Roger Pau Monné Acked-by: Wei Liu Reviewed-by: Andrew Cooper Cc: Ian Jackson Cc: Stefano Stabellini Cc: Ian Campbell Cc: Wei Liu --- Changes since v4: - Add

[Xen-devel] [PATCH v6 26/29] libxc/xen: introduce a start info structure for HVMlite guests

2015-09-04 Thread Roger Pau Monne
This structure contains the physical address of the command line, as well as the physical address of the list of loaded modules. The physical address of this structure is passed to the guest at boot time in the %ebx register. Signed-off-by: Roger Pau Monné Cc: Ian Jackson Cc: Stefano Stabellini

[Xen-devel] [PATCH v6 13/29] xen/x86: allow disabling the emulated HPET

2015-09-04 Thread Roger Pau Monne
Signed-off-by: Roger Pau Monné Acked-by: Andrew Cooper Cc: Jan Beulich Cc: Andrew Cooper --- Changes in v4: - Add Andrew Cooper Acked-by. --- xen/arch/x86/hvm/hpet.c | 13 + xen/arch/x86/hvm/hvm.c | 1 - 2 files changed, 13 insertions(+), 1 deletion(-) diff --git a/xen/arch/x86

[Xen-devel] [PATCH v6 28/29] libxl: allow the creation of HVM domains without a device model.

2015-09-04 Thread Roger Pau Monne
Replace the firmware loaded into HVM guests with an OS kernel. Since the HVM builder now uses the PV xc_dom_* set of functions this kernel will be parsed and loaded inside the guest like on PV, but the container is a pure HVM guest. Also, if device_model_version is set to none or a device model fo

Re: [Xen-devel] Commit moratorium

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 06:08:18AM -0600, Jan Beulich wrote: > >>> On 04.09.15 at 13:52, wrote: > > On Fri, Sep 04, 2015 at 01:44:24AM -0600, Jan Beulich wrote: > >> >>> On 03.09.15 at 18:25, wrote: > >> > Xen tree is going to branch at 4.6 RC3. I don't want to branch when > >> > master != stagin

[Xen-devel] [Draft C] Boot ABI for HVM guests without a device-model

2015-09-04 Thread Roger Pau Monné
Hello, The discussion in [1] lead to an agreement of the missing pieces in PVH (or HVM without a device-model) in order to progress with it's implementation. One of the missing pieces is a new boot ABI, that replaces the PV boot ABI. The aim of this new boot ABI is to remove the limitations of th

[Xen-devel] [PATCH] xen: limit memory to architectural maximum

2015-09-04 Thread Juergen Gross
When a pv-domain (including dom0) is started it tries to size it's p2m list according to the maximum possible memory amount it ever can achieve. Limit the initial maximum memory size to the architectural limit of the hardware in order to avoid overflows during remapping of memory. This problem wil

Re: [Xen-devel] [PATCH v6 11/29] xen/x86: add bitmap of enabled emulated devices

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 02:08:50PM +0200, Roger Pau Monne wrote: > Introduce a bitmap in x86 xen_arch_domainconfig that allows enabling or > disabling specific devices emulated inside of Xen for HVM guests. > > Signed-off-by: Roger Pau Monné > Reviewed-by: Andrew Cooper > Cc: Ian Jackson > Cc:

[Xen-devel] [PATCH] xen: use correct type for HYPERVISOR_memory_op()

2015-09-04 Thread Juergen Gross
HYPERVISOR_memory_op() is defined to return an "int" value. This is wrong, as the Xen hypervisor will return "long". The sub-function XENMEM_maximum_reservation returns the maximum number of pages for the current domain. An int will overflow for a domain configured with 8TB of memory or more. Cor

[Xen-devel] XEN_NETIF_NR_SLOTS_MIN

2015-09-04 Thread Jan Beulich
Wei, coming back to commit 723a375f4e introducing this constant along with some commentary: First of all - why 18 when in old Linux kernels MAX_SKB_FRAGS is 18 and the head usually requires another slot? And then - why mostly/only for the (guest) TX path? Don't we have two compatibility issues: 1)

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Julien Grall
On 04/09/15 13:02, Jan Beulich wrote: On 04.09.15 at 13:29, wrote: >> Anyway, I tried your suggestion to dropped the call to xenheap_max_mfn when >> Xen >> setups the xenheap for arm64 and it allows me to boot correctly Xen on >> X-gene. >> See patch below, I can send the patch in a separat

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Ian Campbell
> commit b11ab8e4982228d7944e11010f5b8eec890caf30 > Author: Julien Grall > Date: Thu Sep 3 21:49:31 2015 +0100 > > xen: pagealloc: Correctly calculate the number of xenheap bits More accurate would be xen: arm64: do not (incorrectly) limit size of xenheap Or some such? With that:

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Julien Grall
On 04/09/15 13:52, Ian Campbell wrote: >> commit b11ab8e4982228d7944e11010f5b8eec890caf30 >> Author: Julien Grall >> Date: Thu Sep 3 21:49:31 2015 +0100 >> >> xen: pagealloc: Correctly calculate the number of xenheap bits > > More accurate would be > > xen: arm64: do not (incorrectly)

Re: [Xen-devel] Commit moratorium

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 13:12 +0100, Wei Liu wrote: > > But this point is moot since I said in the other email I was happy with > that one-liner applied today. I will do so. If we are having a push to staging anyway then I also have these candidates in my folder: tools/xen-access: use PRI_xen

Re: [Xen-devel] [PATCH] x86/NUMA: make init_node_heap() respect Xen heap limit

2015-09-04 Thread Ian Campbell
On Fri, 2015-09-04 at 13:50 +0100, Julien Grall wrote: > On 04/09/15 13:02, Jan Beulich wrote: > > > > > On 04.09.15 at 13:29, wrote: > > > Anyway, I tried your suggestion to dropped the call to > > > xenheap_max_mfn when > > > Xen > > > setups the xenheap for arm64 and it allows me to boot corr

[Xen-devel] [PATCH] xen/arm64: do not (incorrectly) limit size of xenheap

2015-09-04 Thread Julien Grall
The commit 88e3ed61642bb393458acc7a9bd2f96edc337190 "x86/NUMA: make init_node_heap() respect Xen heap limit" breaks boot on the arm64 board X-Gene. The xenheap bits variable is used to know the last RAM MFN always mapped in Xen virtual memory. If the value is 0, it means that all the memory is alw

Re: [Xen-devel] Nested Virtualisation and UEFI

2015-09-04 Thread James Dingwall
On Fri, Sep 04, 2015 at 06:06:30AM -0600, Jan Beulich wrote: > >>> On 04.09.15 at 13:35, wrote: > > I was worried about spamming the list by sending the full logs but if that > > is likely to have the most useful > > information then here we go... > > And indeed not all of it would have been ne

[Xen-devel] [PATCH 3.16.y-ckt 024/130] x86/xen: Probe target addresses in set_aliased_prot() before the hypercall

2015-09-04 Thread Luis Henriques
3.16.7-ckt17 -stable review patch. If anyone has any objections, please let me know. -- From: Andy Lutomirski commit aa1acff356bbedfd03b544051f5b371746735d89 upstream. The update_va_mapping hypercall can fail if the VA isn't present in the guest's page tables. Under certain

[Xen-devel] [PATCH 3.16.y-ckt 095/130] x86/ldt: Make modify_ldt synchronous

2015-09-04 Thread Luis Henriques
3.16.7-ckt17 -stable review patch. If anyone has any objections, please let me know. -- From: Andy Lutomirski commit 37868fe113ff2ba814b3b4eb12df214df555f8dc upstream. modify_ldt() has questionable locking and does not synchronize threads. Improve it: redesign the locking an

[Xen-devel] [libvirt test] 61304: tolerable FAIL - PUSHED

2015-09-04 Thread osstest service owner
flight 61304 libvirt real [real] http://logs.test-lab.xenproject.org/osstest/logs/61304/ Failures :-/ but no regressions. Tests which did not succeed, but are not blocking: test-armhf-armhf-libvirt-vhd 9 debian-di-installfail never pass test-armhf-armhf-libvirt-qcow2 9 debian-di

Re: [Xen-devel] [PATCH] xen/arm64: do not (incorrectly) limit size of xenheap

2015-09-04 Thread Wei Liu
On Fri, Sep 04, 2015 at 01:57:00PM +0100, Julien Grall wrote: > The commit 88e3ed61642bb393458acc7a9bd2f96edc337190 "x86/NUMA: make > init_node_heap() respect Xen heap limit" breaks boot on the arm64 board > X-Gene. > > The xenheap bits variable is used to know the last RAM MFN always mapped > in

  1   2   3   >