Re: [Xen-devel] Cannot get mini-os to compile with LWIP

2015-04-15 Thread Andrew Stuart
Please ignore my previous post. Of course after a day of trying to get it to work, the moment I send an email asking for help I appear to have made it work. Sorry for the noise. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.

[Xen-devel] [v2 04/11] vmx: add PML definition and feature detection.

2015-04-15 Thread Kai Huang
The patch adds PML definition and feature detection. Note PML won't be detected if PML is disabled from boot parameter. PML is also disabled in construct_vmcs, as it will only be enabled when domain is switched to log dirty mode. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmcs.c|

[Xen-devel] [v2 00/11] PML (Paging Modification Logging) support

2015-04-15 Thread Kai Huang
This v2 patch series was rebased on latest upstream code. v1->v2: Firstly the sequence of this patch series were adjusted addressing Andrew and Tim's comments: - Put v1 patch 2 (new boot parameter for PML) to be patch 1. - Added a new patch to patch the doc change of new added boot param

[Xen-devel] [v2 05/11] vmx: add new data structure member to support PML

2015-04-15 Thread Kai Huang
A new 4K page pointer is added to arch_vmx_struct as PML buffer for vcpu. And a new 'status' field is added to vmx_domain to indicate whether PML is enabled for the domain or not. The 'status' field also can be used for further similiar purpose. Note both new members don't have to be initialized t

[Xen-devel] [v2 07/11] vmx: handle PML buffer full VMEXIT

2015-04-15 Thread Kai Huang
We need to flush PML buffer when it's full. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmx.c | 4 1 file changed, 4 insertions(+) diff --git a/xen/arch/x86/hvm/vmx/vmx.c b/xen/arch/x86/hvm/vmx/vmx.c index 2ac1492..279e745 100644 --- a/xen/arch/x86/hvm/vmx/vmx.c +++ b/xen/arch/x86/hv

[Xen-devel] [v2 03/11] log-dirty: add new paging_mark_gfn_dirty

2015-04-15 Thread Kai Huang
PML logs GPA in PML buffer. Original paging_mark_dirty takes MFN as parameter but it gets guest pfn internally and use guest pfn to as index for looking up radix log-dirty tree. In flushing PML buffer, calling paging_mark_dirty directly introduces redundant p2m lookups (gfn->mfn->gfn), therefore we

[Xen-devel] [v2 02/11] doc: add description for new PML boot parameter

2015-04-15 Thread Kai Huang
This patch adds doc description for new boot parameter 'ept=pml'. Signed-off-by: Kai Huang --- docs/misc/xen-command-line.markdown | 14 ++ 1 file changed, 14 insertions(+) diff --git a/docs/misc/xen-command-line.markdown b/docs/misc/xen-command-line.markdown index 1dda1f0..ae30d02

[Xen-devel] [v2 01/11] vmx: add new boot parameter to control PML enabling

2015-04-15 Thread Kai Huang
A top level EPT parameter "ept=" and a sub boolean "opt_pml_enabled" are added to control PML. Other booleans can be further added for any other EPT related features. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmcs.c | 31 +++ 1 file changed, 31 insertions(+)

[Xen-devel] [v2 09/11] vmx: disable PML in vmx_vcpu_destroy

2015-04-15 Thread Kai Huang
It's possible domain still remains in log-dirty mode when it is about to be destroyed, in which case we should manually disable PML for it. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmx.c | 8 1 file changed, 8 insertions(+) diff --git a/xen/arch/x86/hvm/vmx/vmx.c b/xen/arch/x8

[Xen-devel] [v2 08/11] vmx: handle PML enabling in vmx_vcpu_initialise

2015-04-15 Thread Kai Huang
It's possible domain has already been in log-dirty mode when creating vcpu, in which case we should enable PML for this vcpu if PML has been enabled for the domain. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmx.c | 23 +++ 1 file changed, 23 insertions(+) diff --git

[Xen-devel] [v2 10/11] log-dirty: refine common code to support PML

2015-04-15 Thread Kai Huang
Using PML, it's possible there are dirty GPAs logged in vcpus' PML buffers when userspace peek/clear dirty pages, therefore we need to flush them befor reporting dirty pages to userspace. This applies to both video ram tracking and paging_log_dirty_op. This patch adds new p2m layer functions to en

[Xen-devel] [v2 06/11] vmx: add help functions to support PML

2015-04-15 Thread Kai Huang
This patch adds help functions to enable/disable PML, and flush PML buffer for single vcpu and particular domain for further use. Signed-off-by: Kai Huang --- xen/arch/x86/hvm/vmx/vmcs.c| 178 + xen/include/asm-x86/hvm/vmx/vmcs.h | 9 ++ 2 files chan

[Xen-devel] [v2 11/11] p2m/ept: enable PML in p2m-ept for log-dirty

2015-04-15 Thread Kai Huang
This patch firstly enables EPT A/D bits if PML is used, as PML depends on EPT A/D bits to work. A bit is set for all present leaf p2m types, D bit is set for all writable types, except log-dirty type. With PML, for 4K pages, instead of setting EPT entry to read-only, we just need to clear D bit in

[Xen-devel] [xen-devel] Q:xen/dom0: Use host E820 map

2015-04-15 Thread ????
Hi ALL, Environment VMM: Xen-4.1.6.1 dom0: 3.0.101 Quesition: Set dom0 mem using the kernel cmdline: dom0_mem=3072M,max:3072M, after booting, the dom0 mem is 1914M. the others (3072M-1914M) has returned to xen vmm. maybe it is the e820 hole issue. can you help me to fix this is

Re: [Xen-devel] [PATCH 1/8] Add core.sh and wrapper function

2015-04-15 Thread Ian Campbell
On Tue, 2015-04-14 at 15:44 +0100, George Dunlap wrote: > On 04/14/2015 02:55 PM, Ian Campbell wrote: > > On Mon, 2015-04-13 at 17:13 +0100, Stefano Stabellini wrote: > >> I think it might be OK to have something like 5) just for the command > >> line parsing in raise, for the sake of giving more f

Re: [Xen-devel] [PATCHv2 3/6] xen: generic xadd() for ticket locks

2015-04-15 Thread Ian Campbell
On Tue, 2015-04-14 at 17:37 +0100, David Vrabel wrote: > On 14/04/15 14:17, Ian Campbell wrote: > > On Fri, 2015-04-10 at 15:19 +0100, David Vrabel wrote: > >> This is only temporary until arm/arm64 provides an xadd() > >> implementation. > > > > I'll assume that you aren't planning on doing this

Re: [Xen-devel] [PATCH v5] libxl: provide libxl_bitmap_{or,and}

2015-04-15 Thread Wei Liu
Hmm... You only changed the subject line but missed all other changes I asked for. Please have a look at my comments on V4 and address them properly. Wei. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel

Re: [Xen-devel] Question. Inject virq to Domain on Xen ARM.

2015-04-15 Thread Ian Campbell
On Mon, 2015-04-13 at 17:08 +0900, 신정섭 wrote: > HI > > I have a question about Inject virq to Domain on Xen ARM. > > > > Function 'vgic_vcpu_inject_irq' is inject virq to target vcpu. > > At the end of vgic_vcpu_inject_irq, like below > > -

Re: [Xen-devel] Xen 4.6 Development Update (three months reminder)

2015-04-15 Thread Ian Campbell
On Tue, 2015-04-14 at 11:37 +0100, Wei Liu wrote: > On Tue, Apr 14, 2015 at 01:34:45PM +0300, Razvan Cojocaru wrote: > > On 04/14/2015 01:27 PM, wei.l...@citrix.com wrote: > > > * VM event patches (none) > > >Add support for XSETBV vm_events, > > >Support hybernating guests > > >Suppor

Re: [Xen-devel] Xen 4.6 Development Update (three months reminder)

2015-04-15 Thread Ian Campbell
On Tue, 2015-04-14 at 14:52 +0100, Wei Liu wrote: > On Tue, Apr 14, 2015 at 02:48:06PM +0100, Jan Beulich wrote: > > >>> On 14.04.15 at 15:35, wrote: > > > On Tue, Apr 14, 2015 at 12:27 PM, wrote: > > > > Tamas (and others not doing so) - please trim your quotes in replies. > > > > Wei - could

[Xen-devel] [xen-4.3-testing test] 50409: regressions - FAIL

2015-04-15 Thread osstest service user
flight 50409 xen-4.3-testing real [real] http://logs.test-lab.xenproject.org/osstest/logs/50409/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: build-i386-rumpuserxen4 capture-logs!broken in 50358 [st=!broken!] build-amd64-rumpu

Re: [Xen-devel] [xen-4.4-testing test] 50407: FAIL

2015-04-15 Thread Jan Beulich
>>> On 15.04.15 at 03:39, wrote: > flight 50407 xen-4.4-testing real [real] > http://logs.test-lab.xenproject.org/osstest/logs/50407/ > > Failures and problems with tests :-( > > Tests which did not succeed and are blocking, > including tests which could not be run: > build-armhf

Re: [Xen-devel] memaccess: skipping mem_access_send_req

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 16:23 +0100, Julien Grall wrote: > Hi Razvan, > > On 10/04/15 16:11, Razvan Cojocaru wrote: > > It's not entirely clear to me what you're trying to do, but if I > > understand it correctly, there's always the third option of simply using > > the vm_event system as it is now,

Re: [Xen-devel] Xen 4.6 Development Update (three months reminder)

2015-04-15 Thread Jan Beulich
>>> On 15.04.15 at 11:11, wrote: > On Tue, 2015-04-14 at 14:52 +0100, Wei Liu wrote: >> On Tue, Apr 14, 2015 at 02:48:06PM +0100, Jan Beulich wrote: >> > >>> On 14.04.15 at 15:35, wrote: >> > > On Tue, Apr 14, 2015 at 12:27 PM, wrote: >> > >> > Tamas (and others not doing so) - please trim your

Re: [Xen-devel] memaccess: skipping mem_access_send_req

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 16:04 +0100, Gareth Stockwell wrote: > We would like to use memaccess to perform (1) - but rather than > pausing the VCPU in (2), instead simply directly inject the exception > into the VCPU. That is, into the VCPUs whose permissions have been modified behind its back and no

Re: [Xen-devel] [OSSTEST Nested PATCH v7 4/6] Add new script to custmize nested test configuration

2015-04-15 Thread Ian Campbell
On Thu, 2015-04-09 at 07:12 +, Pang, LongtaoX wrote: > I have modified and updated the v7 patches that according to your > reply. It seems that your patchs[v4 04,05,06] has not been pushed into > OSSTest master tree, should I waiting for that till these patches > pushed or release my v8 nested

Re: [Xen-devel] Zir Blazer's guide to install Arch Linux and Xen - need feedback

2015-04-15 Thread Ian Campbell
On Wed, 2015-04-08 at 12:53 -0300, Zir Blazer wrote: > Zir Blazer's "Me too" guide for Arch Linux: > http://pastebin.com/rzqw6Vfa I'm not an Arch linux user, but this sort of thing is IMHO rather useful. Perhaps consider publishing it somewhere more permanent and adding a link from http://wiki.x

Re: [Xen-devel] [PATCH 1/1] xc_domain_restore: Allow QEMU to increase memory

2015-04-15 Thread Stefano Stabellini
On Tue, 14 Apr 2015, Don Slutz wrote: > On 04/14/15 04:53, Wei Liu wrote: > > Is there a way to know how much more memory each option rom needs? If > > so, you can correctly account for the extra memory you need. This would > > be an ideal fix to this problem. > > I do not know of a way to get thi

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread Andrew Cooper
On 14/04/15 23:06, Don Slutz wrote: > This fixes an issue where "xl save" followed by "xl restore" reports: > "xc: error: Failed to allocate memory for batch.!: Internal error" > > One of the ways to get into this state is to have more then 4 e1000 > nics configured. > > Signed-off-by: Don Slutz

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread Stefano Stabellini
On Wed, 15 Apr 2015, Andrew Cooper wrote: > On 14/04/15 23:06, Don Slutz wrote: > > This fixes an issue where "xl save" followed by "xl restore" reports: > > "xc: error: Failed to allocate memory for batch.!: Internal error" > > > > One of the ways to get into this state is to have more then 4 e100

Re: [Xen-devel] linux-next: build failure after merge of the xen-tip tree

2015-04-15 Thread David Vrabel
On 13/04/15 09:36, Bob Liu wrote: > Hi Stephen, > > On 04/13/2015 04:09 PM, Stephen Rothwell wrote: >> Hi all, >> >> After merging the xen-tip tree, today's linux-next build (x86_64 >> allmodconfig) >> failed like this: >> >> drivers/char/tpm/xen-tpmfront.c: In function 'setup_ring': >> drivers/ch

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread Andrew Cooper
On 15/04/15 10:57, Stefano Stabellini wrote: > On Wed, 15 Apr 2015, Andrew Cooper wrote: >> On 14/04/15 23:06, Don Slutz wrote: >>> This fixes an issue where "xl save" followed by "xl restore" reports: >>> "xc: error: Failed to allocate memory for batch.!: Internal error" >>> >>> One of the ways to

[Xen-devel] [PATCH OSSTEST v2 3/5] cambridge: Add a crontab

2015-04-15 Thread Ian Campbell
Right now all it does is keep osstest itself up to date. Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- crontab-cambridge | 5 + 1 file changed, 5 insertions(+) create mode 100644 crontab-cambridge diff --git a/crontab-cambridge b/crontab-cambridge new file mode 100644 index 00

[Xen-devel] [PATCH OSSTEST v2 0/5] Tweaks to allow running non-master production instances

2015-04-15 Thread Ian Campbell
Now that the Cambridge osstest instance is no longer the XenProject master instance it needs some tweaks to allow us to keep using it for local testing. Since v2 I have now tested this in as close to how the osstest user in Cambridge would, but in my own $HOME/testing.git and it appears to do the

[Xen-devel] [PATCH OSSTEST v2 5/5] cambridge: Stop publishing logs to chiark

2015-04-15 Thread Ian Campbell
http://osstest.cam.xci-test.com/~osstest/testlogs already exists and points to the live logs directory, so switch PubBaseUrl to that in the Cambridge config such that email reports etc contain it. This won't be externally accessible but I think that won't matter now that the master production insta

[Xen-devel] [PATCH OSSTEST v2 2/5] Handle osstest's own local push gate in non-master production instances

2015-04-15 Thread Ian Campbell
We want to arrange that the master XenProject instance continues to test its own pretest branch while any downstream instances will pickup changes from the master instance's production (i.e. tested) branch, which is published at git://xenbits.xen.org/osstest.git#master. Add a new configuration opt

[Xen-devel] [PATCH OSSTEST v2 1/5] cri-args-hostslists: allow instance specific settings

2015-04-15 Thread Ian Campbell
In particular this new $HOME/.xen-osstest/cri-args-hostslists.settings can contain things like "export OSSTEST_CONFIG=production-config-cambridge" to tailor things for a particular instance of osstest running in production mode. Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- cri-args-hos

[Xen-devel] [PATCH OSSTEST v2 4/5] cambridge: Do not try to push harness to XenProject instance output

2015-04-15 Thread Ian Campbell
By arranging for cr-publish-flight-logs to ignore --push-harness if either of HarnessPublishGitRepoDir or HarnessPublishGitUserHost are not specified Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- v2: - Avoid logm which isn't available here, wasn't saying much of use anyway. - Syntax

Re: [Xen-devel] [PATCH 1/1] xc_domain_restore: Allow QEMU to increase memory

2015-04-15 Thread Ian Campbell
On Wed, 2015-04-15 at 10:46 +0100, Stefano Stabellini wrote: > On Tue, 14 Apr 2015, Don Slutz wrote: > > On 04/14/15 04:53, Wei Liu wrote: > > > Is there a way to know how much more memory each option rom needs? If > > > so, you can correctly account for the extra memory you need. This would > > >

Re: [Xen-devel] [v2 01/11] vmx: add new boot parameter to control PML enabling

2015-04-15 Thread Andrew Cooper
On 15/04/15 08:03, Kai Huang wrote: > A top level EPT parameter "ept=" and a sub boolean "opt_pml_enabled" > are added to control PML. Other booleans can be further added for any other > EPT > related features. > > Signed-off-by: Kai Huang Reviewed-by: Andrew Cooper > --- > xen/arch/x86/hvm/v

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread George Dunlap
On Wed, Apr 15, 2015 at 10:53 AM, Andrew Cooper wrote: > On 14/04/15 23:06, Don Slutz wrote: >> This fixes an issue where "xl save" followed by "xl restore" reports: >> "xc: error: Failed to allocate memory for batch.!: Internal error" >> >> One of the ways to get into this state is to have more t

Re: [Xen-devel] [v2 02/11] doc: add description for new PML boot parameter

2015-04-15 Thread Andrew Cooper
On 15/04/15 08:03, Kai Huang wrote: > This patch adds doc description for new boot parameter 'ept=pml'. > > Signed-off-by: Kai Huang Personally, I would fold this patch into the previous so the documentation is in the same patch as introduces the parameter. > --- > docs/misc/xen-command-line.ma

Re: [Xen-devel] [libvirt] [libvirt test] 50401: regressions - FAIL

2015-04-15 Thread Ian Campbell
On Tue, 2015-04-14 at 10:37 +0100, Daniel P. Berrange wrote: > On Tue, Apr 14, 2015 at 10:33:45AM +0100, Ian Campbell wrote: > > On Tue, 2015-04-14 at 02:27 +, osstest service user wrote: > > > flight 50401 libvirt real [real] > > > http://logs.test-lab.xenproject.org/osstest/logs/50401/ > > >

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread George Dunlap
On Wed, Apr 15, 2015 at 11:03 AM, Andrew Cooper wrote: > On 15/04/15 10:57, Stefano Stabellini wrote: >> On Wed, 15 Apr 2015, Andrew Cooper wrote: >>> On 14/04/15 23:06, Don Slutz wrote: This fixes an issue where "xl save" followed by "xl restore" reports: "xc: error: Failed to allocate

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread George Dunlap
On Wed, Apr 15, 2015 at 11:16 AM, George Dunlap wrote: > Without having actually reviewed the patch, I think this solution is a > decent one. But if we could update it in the libxl domain config in a > way that was backwards-compatible, that would be fine too. I don't > think we should change ma

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread Andrew Cooper
On 15/04/15 11:25, George Dunlap wrote: > On Wed, Apr 15, 2015 at 11:16 AM, George Dunlap wrote: >> Without having actually reviewed the patch, I think this solution is a >> decent one. But if we could update it in the libxl domain config in a >> way that was backwards-compatible, that would be f

[Xen-devel] [PATCH OSSTEST v5 01/24] TestSupport: Add helper to fetch a URL on a host

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell --- v5: Support http_proxy via $c{HttpProxy} v3: Make sure wget is installed --- Osstest/Debian.pm | 2 +- Osstest/TestSupport.pm | 10 +- 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/Osstest/Debian.pm b/Osstest/Debian.pm index 69530fb.

[Xen-devel] [PATCH OSSTEST v5 06/24] Debian: Refactor installation of overlays, so it can be used for guests too

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell Acked-by: Ian Jackson Cc: longtaox.p...@intel.com --- v5: OverLay local now handled preseed_base since all callers called it v3: New patch fixup: Move OverlayLocal to preseed_base --- Osstest/Debian.pm | 58 --- 1 f

[Xen-devel] [PATCH OSSTEST v5 05/24] Debian: refactor preseeding of .ssh directories

2015-04-15 Thread Ian Campbell
Causes known_hosts to be consistently created as well as ~osstest/.ssh to be consistently populated (it previsouly wasn't for HVM guests). Signed-off-by: Ian Campbell Cc: longtaox.p...@intel.com --- v5: Call preseed_ssh from preseed_base v3: New patch --- Osstest/Debian.pm | 105

[Xen-devel] [PATCH OSSTEST v5 24/24] ts-debian-di-install: Use ftp.debian.org directly

2015-04-15 Thread Ian Campbell
The local proxy seems to serve stale packages for Jessie etc, I blame the intercepting cache on the way out of our network, similar to b5f15136900d "mg-debian-installer-update: workaround caching proxies", except it is between the apt-cache and the world not the osstest vm and the world. Since the

[Xen-devel] [PATCH OSSTEST v5 02/24] TestSupport: allow caller of prepareguest_part_xencfg to specify viftype

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell Acked-by: Ian Jackson -- v3: Use CamelCase for xopts, use the correct condition --- Osstest/TestSupport.pm | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/Osstest/TestSupport.pm b/Osstest/TestSupport.pm index fc2e406..f374f9c 100644 --- a/Osstes

[Xen-devel] [PATCH OSSTEST v5 14/24] distros: add branch infrastructure

2015-04-15 Thread Ian Campbell
Since the distro nightlies are not version controlled we cannot use the usual mechanisms for detecting regressions. Special case things appropriately. We use an OLD_REVISION of "flight-NNN" to signify that the old revision is another flight and not a tree revision. A grep over $NEW_REVISION needed

[Xen-devel] [PATCH OSSTEST v5 10/24] distros: support booting Debian PV (d-i installed) guests with pvgrub.

2015-04-15 Thread Ian Campbell
This requires the use of the pv-grub-menu package which is in Jessie onwards. (it is in wheezy-backports which is the subject of a subsequent patch). The bootloader to use is specified via a runvar {Guest}_bootloader. Adjust make-distros-flight to use pvgrub for some subset of i386 and amd64 gue

[Xen-devel] [PATCH OSSTEST v5 03/24] create_webfile: Support use with guests as well as hosts.

2015-04-15 Thread Ian Campbell
In particular make the path unique by ensuring it includes the host and guest name in the guest case. Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- v4: Dropped redundant -> from $ho->{Host}->{Name}. v3: New patch --- Osstest/TestSupport.pm | 2 ++ 1 file changed, 2 insertions(+) diff -

[Xen-devel] [PATCH OSSTEST v5 15/24] distros: Run a flight over the weekend.

2015-04-15 Thread Ian Campbell
Once a week should be sufficient for this test. It involves quite a large number of jobs so schedule it to start early on Saturday so it can run over the weekend when, in theory, things should be quieter. Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- crontab | 1 + 1 file changed, 1 ins

[Xen-devel] [PATCH OSSTEST v5 11/24] distros: Support pvgrub for Wheezy too.

2015-04-15 Thread Ian Campbell
This requires us to install pv-grub-menu from backports, which we do using a late_command. Signed-off-by: Ian Campbell --- v3: - Remove spurious () from <<(END) (and the prexisting "" too) - Remove $xopts{EnableBackports} and automatically handle the need to add backports in preseed_base.

[Xen-devel] [PATCH OSSTEST v5 13/24] Test pygrub and pvgrub on the regular flights

2015-04-15 Thread Ian Campbell
Since we now have the ability to test these drop one of each of pygrub, pvgrub-32 and pvgrub-64 into the standard flights. Omitting the {Guest}_diver runvar causes ts-debian-di-install to use the d-i images in the location configured via TftpDiVersion, so they are Version Controlled along with the

[Xen-devel] [PATCH OSSTEST v5 08/24] make-flight: Handle $BUILD_LVEXTEND_MAX in mfi-common:create_build_jobs()

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- v3: New patch --- make-flight | 4 mfi-common | 4 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/make-flight b/make-flight index cc8ecdb..ec0a20c 100755 --- a/make-flight +++ b/make-flight @@ -36,10 +36,6 @@ defgue

[Xen-devel] [PATCH OSSTEST v5 18/24] ts-debian-di-install: Refactor root_disk specification

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell --- v4: new patch --- ts-debian-di-install | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/ts-debian-di-install b/ts-debian-di-install index 56b6ad8..281e7cb 100755 --- a/ts-debian-di-install +++ b/ts-debian-di-install @@ -205,12 +205,14 @@ EN

[Xen-devel] [PATCH OSSTEST v5 19/24] make-flight: refactor PV debian tests

2015-04-15 Thread Ian Campbell
No functional change, standalong-generate-dump-flight-runvars confirms no change to the runvars. Includes a hook which is not used yet, $recipe_sfx. Signed-off-by: Ian Campbell --- v4: new patch --- make-flight | 24 ++-- 1 file changed, 14 insertions(+), 10 deletions(-) di

[Xen-devel] [PATCH OSSTEST v5 22/24] make-distros-flight: don't bother building for XSM.

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell --- make-distros-flight | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/make-distros-flight b/make-distros-flight index 2724dd2..62c527b 100755 --- a/make-distros-flight +++ b/make-distros-flight @@ -34,7 +34,10 @@ defsuite=`getconfig DebianSuit

[Xen-devel] [PATCH OSSTEST v5 20/24] Add testing of non-LVM/phy disk backends.

2015-04-15 Thread Ian Campbell
xen-create-image makes this tricky to do since it is rather LVM centric. Now that we have the ability to install from d-i it's possible to arrange fairly easily that they use non-LVM disk backend arrangements. Here we add support to the test script and infra and create a bunch of new jobs testing

[Xen-devel] [PATCH OSSTEST v5 16/24] Debian: Handle lack of bootloader support in d-i on ARM.

2015-04-15 Thread Ian Campbell
Debian doesn't currently know what bootloader to install in a Xen guest on ARM. We install pv-grub-menu above which actually does what we need, but the installer doesn't treat that as a "bootloader". Most ARM platforms end up installing a u-boot boot.scr, based on a platform whitelist. This doesn'

[Xen-devel] [PATCH OSSTEST v5 09/24] distros: add support for installing Debian PV guests via d-i, flight and jobs

2015-04-15 Thread Ian Campbell
This patch introduces ts-debian-di-install which can install Debian from a netboot (PXE) debian installer image. By default it installs from the d-i image used by osstest (using the special Xen PV guest enabled flavour where necessary) but it can also install the current release versions from Squee

[Xen-devel] [PATCH OSSTEST v5 17/24] standalone: propagate result of command from with_logging

2015-04-15 Thread Ian Campbell
Such that the overall script gets the return code of the test/job which was run. Signed-off-by: Ian Campbell --- standalone | 1 + 1 file changed, 1 insertion(+) diff --git a/standalone b/standalone index d8113e4..4564cf4 100755 --- a/standalone +++ b/standalone @@ -159,6 +159,7 @@ with_logging

[Xen-devel] [PATCH OSSTEST v5 00/24] add distro domU testing flight

2015-04-15 Thread Ian Campbell
Hi, It's been a long time since v3 of this series, which was http://article.gmane.org/gmane.comp.emulators.xen.devel/224415. That contains the background which I won't repeat here. v4 was http://article.gmane.org/gmane.comp.emulators.xen.devel/238558 Since v4 I've addressed the review feedback an

[Xen-devel] [PATCH OSSTEST v5 23/24] distros: email only me on play flights

2015-04-15 Thread Ian Campbell
Signed-off-by: Ian Campbell --- daily-cron-email-play--distros | 1 + 1 file changed, 1 insertion(+) create mode 100644 daily-cron-email-play--distros diff --git a/daily-cron-email-play--distros b/daily-cron-email-play--distros new file mode 100644 index 000..0d82e65 --- /dev/null +++ b/dai

[Xen-devel] [PATCH OSSTEST v5 21/24] mfi-common: Allow make-*flight to filter the set of build jobs to include

2015-04-15 Thread Ian Campbell
By using the same job_create_build(_filter_callback) scheme used for the test jobs. Will be used in make-distros-flight. Signed-off-by: Ian Campbell --- make-distros-flight | 4 make-flight | 4 mfi-common | 21 +++-- 3 files changed, 23 insertions(+

[Xen-devel] [PATCH OSSTEST v5 04/24] Debian: refactor code to add preseed commands to the preseed file

2015-04-15 Thread Ian Campbell
Call it from ts-debian-hvm-install. This means that, in future, ts-debian-di-install can use preseed_hook_command and preseed_hook_installscript. No functional change for now. Signed-off-by: Ian Campbell Cc: longtaox.p...@intel.com --- v5: Extended commit message v3: New patch --- Osstest/Debi

[Xen-devel] [PATCH OSSTEST v5 12/24] distros: support PV guest install from Debian netinst media.

2015-04-15 Thread Ian Campbell
The netinst media are iso images containing a base Debian install and some (image size dependent) additional tasks. On x86 the "multiarch" iso flavour contains a Xen capable kernel for both i386 and amd64 so use that. This adds support for two classes of ISO, the CD sized ones which are built nig

Re: [Xen-devel] [PATCH v2 2/2] xen/grant: introduce func gnttab_unmap_refs_sync()

2015-04-15 Thread Roger Pau Monné
El 03/04/15 a les 8.42, Bob Liu ha escrit: > There are several place using gnttab async unmap and wait for > completion, so move the common code to a function > gnttab_unmap_refs_sync(). > > v2: Rename to gnttab_unmap_refs_sync() > > Signed-off-by: Bob Liu For the blkback bits: Acked-by: Roger

Re: [Xen-devel] [PATCH v9 01/15] tools/libxc: Implement writev_exact() in the same style as write_exact()

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > This implementation of writev_exact() will cope with an iovcnt greater than > IOV_MAX because glibc will actually let this work anyway, and it is very > useful not to have to work about this in the caller of writev_exact(). The > caller is

Re: [Xen-devel] tg3 NIC driver bug in 3.14.x under Xen [and 3 more messages]

2015-04-15 Thread Ian Jackson
Prashant writes ("Re: tg3 NIC driver bug in 3.14.x under Xen [and 3 more messages]"): > I tried to reproduce the problem on 32 bit 3.14.34 stable kernel > baremetal, with iommu=soft swiotlb=force but no luck, no drops or > errors. I did not try with Xen 64 bit yet. Btw I need a pcie analyzer >

Re: [Xen-devel] [PATCH v9 02/15] libxc/progress: Extend the progress interface

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > Not everything which needs reporting as progress comes with a range. Extend > the interface to allow reporting of a single statement. > > The programming interface now looks like: > xc_set_progress_prefix() > set the prefix string to

Re: [Xen-devel] [PATCH v9 03/15] tools/libxc: Migration v2 framework

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > For testing purposes, the environmental variable "XG_MIGRATION_V2" allows the > two save/restore codepaths to coexist, and have a runtime switch. > > Signed-off-by: Andrew Cooper Acked-by: Ian Campbell Ian. ___

Re: [Xen-devel] [PATCH v9 04/15] tools/libxc: C implementation of stream format

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > Provide the C structures matching the binary (wire) format of the new > stream format. All header/record fields are naturally aligned and > explicit padding fields are used to ensure the correct layout (i.e., > there is no need for any non-

Re: [Xen-devel] [PATCH v9 05/15] tools/libxc: noarch common code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > Add the context structure used to keep state during the save/restore > process. > > Define the set of architecture or domain type specific operations with a > set of callbacks (save_ops, and restore_ops). > > Add common functions for writi

Re: [Xen-devel] [PATCH v9 07/15] tools/libxc: x86 PV common code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:15 +0100, Andrew Cooper wrote: > Add functions common to save and restore of x86 PV guests. This includes > functions for dealing with the P2M and M2P and the VCPU context. > > Signed-off-by: Andrew Cooper Acked-by: Ian Campbell _

Re: [Xen-devel] [[PATCH v4]] new functions libxl_bitmap_{or,and}

2015-04-15 Thread Linda
Not ignored. Sorry. I shouldn't have read from my iPhone. I didn't see the others. I'll take care of them. Linda On 4/14/2015 10:33 AM, Wei Liu wrote: Urgh... I think I made a mistake in the rune I gave you, sorry. The --subject-prefix= doesn't need to include "[]". And you forgot to cha

Re: [Xen-devel] [PATCH 1/1] xc_domain_restore: Allow QEMU to increase memory

2015-04-15 Thread Hongyang Yang
On 04/15/2015 06:09 PM, Ian Campbell wrote: On Wed, 2015-04-15 at 10:46 +0100, Stefano Stabellini wrote: On Tue, 14 Apr 2015, Don Slutz wrote: On 04/14/15 04:53, Wei Liu wrote: Is there a way to know how much more memory each option rom needs? If so, you can correctly account for the extra m

Re: [Xen-devel] [PATCH v9 08/15] tools/libxc: x86 PV save code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Save the x86 PV specific parts of a domain. This is the X86_PV_INFO record, > the P2M_FRAMES, the X86_PV_SHARED_INFO, the three different VCPU context > records, and the MSR records. > > The normalise_page callback used by the common code

Re: [Xen-devel] [PATCH v9 09/15] tools/libxc: x86 PV restore code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Restore the x86 PV specific parts. The X86_PV_INFO, the P2M_FRAMES, > +/* > + * Set a pfn as populated, expanding the tracking structures if needed. To > + * avoid realloc()ing too excessivly, the size increased to the nearest power excess

Re: [Xen-devel] [PATCH 1/1] xc_domain_restore: Allow QEMU to increase memory

2015-04-15 Thread Stefano Stabellini
On Wed, 15 Apr 2015, Hongyang Yang wrote: > On 04/15/2015 06:09 PM, Ian Campbell wrote: > > On Wed, 2015-04-15 at 10:46 +0100, Stefano Stabellini wrote: > > > On Tue, 14 Apr 2015, Don Slutz wrote: > > > > On 04/14/15 04:53, Wei Liu wrote: > > > > > Is there a way to know how much more memory each o

Re: [Xen-devel] [PATCH v9 10/15] tools/libxc: x86 HVM save code

2015-04-15 Thread Ian Campbell
On Mon, 2015-04-13 at 14:21 +0100, Andrew Cooper wrote: > >> +static int write_hvm_params(struct xc_sr_context *ctx) > >> +{ > >> +static const unsigned int params[] = { [...] > > While reviewing my 'soft reset' series Ian C raised a question about the > > unsafeness of sequential get/set of HV

Re: [Xen-devel] [PATCH OSSTEST v2 2/5] Handle osstest's own local push gate in non-master production instances

2015-04-15 Thread Ian Jackson
Ian Campbell writes ("[PATCH OSSTEST v2 2/5] Handle osstest's own local push gate in non-master production instances"): > We want to arrange that the master XenProject instance continues to > test its own pretest branch while any downstream instances will pickup > changes from the master instance'

Re: [Xen-devel] [PATCH v9 10/15] tools/libxc: x86 HVM save code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Save the x86 HVM specific parts of the domain. This is considerably simpler > than an x86 PV domain. Only the HVM_CONTEXT and HVM_PARAMS records are > needed. > > There is no need for any page normalisation. > > Signed-off-by: Andrew Coo

Re: [Xen-devel] [PATCH OSSTEST v2 5/5] cambridge: Stop publishing logs to chiark

2015-04-15 Thread Ian Jackson
Ian Campbell writes ("[PATCH OSSTEST v2 5/5] cambridge: Stop publishing logs to chiark"): > http://osstest.cam.xci-test.com/~osstest/testlogs already exists and > points to the live logs directory, so switch PubBaseUrl to that in the > Cambridge config such that email reports etc contain it. This

Re: [Xen-devel] [PATCH v9 11/15] tools/libxc: x86 HVM restore code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Restore the x86 HVM specific parts of a domain. This is the HVM_CONTEXT and > HVM_PARAMS records. > > There is no need for any page localisation. > > This also includes writing the trailing qemu save record to a file because > this is wha

Re: [Xen-devel] [PATCH OSSTEST v2 1/5] cri-args-hostslists: allow instance specific settings

2015-04-15 Thread Ian Jackson
Ian Campbell writes ("[PATCH OSSTEST v2 1/5] cri-args-hostslists: allow instance specific settings"): > In particular this new $HOME/.xen-osstest/cri-args-hostslists.settings > can contain things like "export > OSSTEST_CONFIG=production-config-cambridge" to tailor things for a > particular instanc

Re: [Xen-devel] [PATCH OSSTEST v2 0/5] Tweaks to allow running non-master production instances

2015-04-15 Thread Ian Jackson
Ian Campbell writes ("[PATCH OSSTEST v2 0/5] Tweaks to allow running non-master production instances"): > WRT applying this I think normally we should apply such changes to the > upstream production instance and let them filter through, but in this > case I think it would be better to push my ad-h

Re: [Xen-devel] [PATCH v9 12/15] tools/libxc: noarch save code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Save a domain, calling domain type specific function at the appropriate > points. This implements the xc_domain_save2() API function which is > equivalent to the existing xc_domain_save(). > > This writes the image and domain headers, and

Re: [Xen-devel] [Linaro-uefi] [PATCH 0/5]arm64: Add multiboot support (via fdt) for Xen boot

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 10:32 +0800, Fu Wei wrote: > Hi everybody, > any suggestion for my patchset? Your CC list contains grub-devel, some other lists and a bunch of individuals who are not actually grub developers, who are the ones I think you actually need to be pinging. Perhaps try addressing s

Re: [Xen-devel] [PATCH v9 13/15] tools/libxc: noarch restore code

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > +/** > + * Reads a record from the stream, and fills in the record structure. Doesn't look to be a structured comment of any sort, so only one * needed on the opening. > + * Given a list of pfns, their types, and a block of page data from

Re: [Xen-devel] [PATCH v9 08/15] tools/libxc: x86 PV save code

2015-04-15 Thread Andrew Cooper
On 15/04/15 12:13, Ian Campbell wrote: > On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: >> Save the x86 PV specific parts of a domain. This is the X86_PV_INFO record, >> the P2M_FRAMES, the X86_PV_SHARED_INFO, the three different VCPU context >> records, and the MSR records. >> >> The nor

[Xen-devel] [PATCH v6] libxl: provide libxl_bitmap_{or,and}

2015-04-15 Thread Linda Jacobson
There are new functions to provide logical and and or of two bitmaps. Signed-off-by: Linda Jacobson --- v.1 The new functions were added. v.2 The comments and format were corrected. v.3 The bitmap functions were rewritten to manipulate bytes not bits. v.4 Several non-modified parameters, and lo

Re: [Xen-devel] [PATCH v9 14/15] docs: libxc migration stream specification

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > Add the specification for a new migration stream format. The document > includes all the details but to summarize: > > The existing (legacy) format is dependant on the word size of the > toolstack. This prevents domains from migrating fro

Re: [Xen-devel] [PATCH v9 13/15] tools/libxc: noarch restore code

2015-04-15 Thread Andrew Cooper
On 15/04/15 12:42, Ian Campbell wrote: > On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: >> +/** >> + * Reads a record from the stream, and fills in the record structure. > Doesn't look to be a structured comment of any sort, so only one * > needed on the opening. > >> + * Given a list of p

Re: [Xen-devel] [PATCH v2 1/1] tools: Handle xc_maxmem adjustments

2015-04-15 Thread Stefano Stabellini
On Wed, 15 Apr 2015, Andrew Cooper wrote: > On 15/04/15 10:57, Stefano Stabellini wrote: > > On Wed, 15 Apr 2015, Andrew Cooper wrote: > >> On 14/04/15 23:06, Don Slutz wrote: > >>> This fixes an issue where "xl save" followed by "xl restore" reports: > >>> "xc: error: Failed to allocate memory for

[Xen-devel] wating for backend changes (was Re: [PATCH v3 4/4] libxl: add support for vscsi)

2015-04-15 Thread Ian Jackson
Olaf Hering writes ("wating for backend changes (was Re: [PATCH v3 4/4] libxl: add support for vscsi)"): > How is new code supposed to wait for backend changes? > > Right now there are two APIs for that: > - libxl__wait_for_backend loops for a while until it returns an error. This is deprecated.

Re: [Xen-devel] [PATCH v9 15/15] tools/libxc: Migration v2 compatibility for unmodified libxl

2015-04-15 Thread Ian Campbell
On Fri, 2015-04-10 at 18:16 +0100, Andrew Cooper wrote: > These changes cause migration v2 to behave similarly enough to legacy > migration to function for HVM guests under an unmodified xl/libxl. > > The migration v2 work for libxl will fix the layering issues with the > toolstack and qemu record

  1   2   3   4   >