Re: [Xen-devel] FW: VT-d async invalidation for Device-TLB.

2015-06-15 Thread Jan Beulich
>>> On 13.06.15 at 16:44, wrote: >> On 12.06.15 at 14:47, wrote: >> >>> On 12.06.15 at 04:40, wrote: >> >> > >>> On 10.06.15 at 16:05, wrote: >> >> >>> On 03.06.15 at 09:49, wrote: >> >> > For Context Invalidation and IOTLB invalidation without >> >> > Device-TLB invalidation, Invalidation

[Xen-devel] [rumpuserxen test] 58573: regressions - FAIL

2015-06-15 Thread osstest service user
flight 58573 rumpuserxen real [real] http://logs.test-lab.xenproject.org/osstest/logs/58573/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: build-amd64-rumpuserxen 5 rumpuserxen-build fail REGR. vs. 33866 build-i386-rumpuserxe

Re: [Xen-devel] [v3][PATCH 04/16] xen/passthrough: extend hypercall to support rdm reservation policy

2015-06-15 Thread Chen, Tiejun
On 2015/6/12 17:20, Chen, Tiejun wrote: On 2015/6/12 16:45, Jan Beulich wrote: On 12.06.15 at 08:31, wrote: On 2015/6/11 17:28, Tian, Kevin wrote: From: Chen, Tiejun Sent: Thursday, June 11, 2015 9:15 AM @@ -1940,7 +1942,8 @@ static int intel_iommu_remove_device(u8 devfn, struct pci_dev *pdev

Re: [Xen-devel] [PATCH OSSTEST 0/5] Debian Jessie patches

2015-06-15 Thread Wei Liu
On Fri, Jun 12, 2015 at 09:43:11PM +0100, Wei Liu wrote: > On Wed, Jun 10, 2015 at 10:50:33AM +0100, Ian Campbell wrote: > > On Wed, 2015-05-20 at 19:04 +0100, Wei Liu wrote: > > > On Wed, May 20, 2015 at 06:56:23PM +0100, Wei Liu wrote: > > > > I worked a little bit on upgrading Osstest to Jessie

[Xen-devel] [PATCH OSSTEST v3] Arrange to upgrade microcode on x86 test hosts.

2015-06-15 Thread Ian Campbell
Both Xen and Linux support extracting a microcode update from an initramfs early during boot. This requires prepending a suitable uncompressed cpio archive containing the necessary files to the initrd. Xen also supports loading the microcode cpio from any multiboot module, but for in order to allo

[Xen-devel] [PATCH OSSTEST] Disable proxy for all preseeded wget

2015-06-15 Thread Ian Campbell
At least in some contexts scripts can be run with http_proxy pointing to the apt proxy (I noticed it in /usr/lib/base-installer.d/ hook used for ucode installation). Since all of these particular fetches are from a known to be local webserver just disable proxying altogether. With busybox wget in

Re: [Xen-devel] [PATCH OSSTEST 0/5] Debian Jessie patches

2015-06-15 Thread Ian Campbell
On Mon, 2015-06-15 at 09:29 +0100, Wei Liu wrote: > On Fri, Jun 12, 2015 at 09:43:11PM +0100, Wei Liu wrote: > > On Wed, Jun 10, 2015 at 10:50:33AM +0100, Ian Campbell wrote: > > > On Wed, 2015-05-20 at 19:04 +0100, Wei Liu wrote: > > > > On Wed, May 20, 2015 at 06:56:23PM +0100, Wei Liu wrote: > >

Re: [Xen-devel] [PATCH OSSTEST 0/5] Debian Jessie patches

2015-06-15 Thread Ian Campbell
On Mon, 2015-06-15 at 09:37 +0100, Ian Campbell wrote: > > > ---8<--- > > From 756cb022b4273c75878d4b446ca19b69661ebcb6 Mon Sep 17 00:00:00 2001 > > From: Wei Liu > > Date: Fri, 12 Jun 2015 23:50:55 +0100 > > Subject: [PATCH OSSTEST] ts-kernel-build: enable CONFIG_FHANDLE > > Cc: ian.campb...@ci

Re: [Xen-devel] [xen-unstable test] 57852: regressions - FAIL

2015-06-15 Thread Ian Campbell
On Thu, 2015-06-11 at 09:45 +0100, Ian Campbell wrote: > On Thu, 2015-06-11 at 08:02 +0100, Jan Beulich wrote: > > >>> On 10.06.15 at 16:08, wrote: > > > On Wed, 2015-06-10 at 14:45 +0100, Jan Beulich wrote: > > >> So if we're going to approach Intel with this - will you or should I? > > > > > >

Re: [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-xl-xsm

2015-06-15 Thread Ian Campbell
Jan, Andy: FYI, relates to the failure in 58420 I think. On Sun, 2015-06-14 at 20:54 +, osstest service user wrote: > branch xen-unstable > xen branch xen-unstable > job test-amd64-amd64-xl-xsm > test xen-boot > > Tree: linux git://xenbits.xen.org/linux-pvops.git > Tree: linuxfirmware git://x

Re: [Xen-devel] [xen-unstable test] 57852: regressions - FAIL

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 10:57, wrote: > So 3/20 = 15% failure rate (fiano0: 1/11=9%; fiano1: 2/9=22%). Which is > better than the ~50% seen at the start of this thread, so it is worth > applying the ucode update I think (and it would have been regardless the > right thing to do), > > I do think a 15-

[Xen-devel] Vm_event memory introspection helpers

2015-06-15 Thread Razvan Cojocaru
Hello, Since the first version of the series, which consisted of five patches, the following major changes have happened: 1. The first patch in the previous series has already been accepted, under the name "xen/vm_event: Clean up control-register-write vm_events and add XCR0 event". The patch was

[Xen-devel] [PATCH V2 2/3] xen/vm_event: Support for guest-requested events

2015-06-15 Thread Razvan Cojocaru
Added support for a new class of vm_events: VM_EVENT_REASON_REQUEST, sent via HVMOP_request_vm_event. The guest can request that a generic vm_event (containing only the vm_event-filled guest registers as information) be sent to userspace by setting up the correct registers and doing a VMCALL. For e

[Xen-devel] [PATCH V2 3/3] xen/vm_event: Deny register writes if refused by vm_event reply

2015-06-15 Thread Razvan Cojocaru
Deny register writes if a vm_client subscribed to mov_to_msr events forbids them. Currently supported for MSR, CR0, CR3 and CR4 events. Signed-off-by: Razvan Cojocaru --- Changes since V1: - Renamed MEM_ACCESS_SKIP_MSR_WRITE to MEM_ACCESS_DENY, to be used as a generic deny flag for whatever

[Xen-devel] [PATCH V2 1/3] xen/vm_access: Support for memory-content hiding

2015-06-15 Thread Razvan Cojocaru
This patch adds support for memory-content hiding, by modifying the value returned by emulated instructions that read certain memory addresses that contain sensitive data. The patch only applies to cases where MEM_ACCESS_EMULATE or MEM_ACCESS_EMULATE_NOWRITE have been set to a vm_event response. S

Re: [Xen-devel] [PATCH 07/12] x86/virt/guest/xen: Remove use of pgd_list from the Xen guest code

2015-06-15 Thread Ian Campbell
On Sat, 2015-06-13 at 11:49 +0200, Ingo Molnar wrote: > xen_mm_pin_all()/unpin_all() are used to implement full guest instance > suspend/restore. It's a stop-all method that needs to iterate through > all allocated pgds in the system to fix them up for Xen's use. > > This code uses pgd_list, proba

Re: [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-xl-xsm

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 11:01, wrote: > Jan, Andy: FYI, relates to the failure in 58420 I think. I'll take a look. Jan > On Sun, 2015-06-14 at 20:54 +, osstest service user wrote: >> branch xen-unstable >> xen branch xen-unstable >> job test-amd64-amd64-xl-xsm >> test xen-boot >> >> Tree: linux

Re: [Xen-devel] [OSSTEST Nested PATCH v11 6/7] Compose the main recipe of nested test job

2015-06-15 Thread Ian Campbell
On Sun, 2015-06-14 at 20:51 +0800, Robert Hu wrote: > On Fri, 2015-06-12 at 16:27 +0100, Ian Jackson wrote: > > Pang, LongtaoX writes ("RE: [OSSTEST Nested PATCH v11 6/7] Compose the main > > recipe of nested test job"): > > > > From: Ian Jackson [mailto:ian.jack...@eu.citrix.com] > > ... > > > >

Re: [Xen-devel] [PATCH v3 06/11] x86/intel_pstate: the main boby of the intel_pstate driver

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 02:30, wrote: > On 12/06/2015 19:30, Julien Grall wrote: >> On 11/06/2015 21:41, Wang, Wei W wrote: >> > On 11/06/2015 22:02, Julien Grall wrote: >> >> On 11/06/2015 04:27, Wei Wang wrote: >> >>> diff --git a/xen/include/acpi/cpufreq/cpufreq.h >> >> b/xen/include/acpi/cpufreq/cp

Re: [Xen-devel] [PATCH v3 07/11] x86/intel_pstate: changes in cpufreq_del_cpu for CPU offline

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 02:31, wrote: > On 12/06/2015 19:40, Julien Grall wrote: >> On 11/06/2015 22:01, Wang, Wei W wrote: >> > On 11/06/2015 22:06, Julien Grall wrote: >> >> On 11/06/2015 04:28, Wei Wang wrote: >> >>> cpufreq_cpu_policy is used in intel_pstate_set_pstate(), so we >> >>> change to NUL

Re: [Xen-devel] [PATCH v3 10/11] x86/intel_pstate: support the use of intel_pstate in pmstat.c

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 02:30, wrote: > On 12/06/2015 19:14, Julien Grall wrote: >> On 11/06/2015 23:03, Wang, Wei W wrote: >> > On 11/06/2015 22:02, Julien Grall wrote: >> >> On 11/06/2015 04:31, Wei Wang wrote: >> >>> -list_for_each(pos, &cpufreq_governor_list) >> >>> +if (policy->policy) >>

Re: [Xen-devel] [RFC v2 08/15] Update IRTE according to guest interrupt config changes

2015-06-15 Thread Wu, Feng
> -Original Message- > From: Jan Beulich [mailto:jbeul...@suse.com] > Sent: Friday, June 12, 2015 6:41 PM > To: Wu, Feng > Cc: andrew.coop...@citrix.com; george.dun...@eu.citrix.com; Tian, Kevin; > Zhang, Yang Z; xen-devel@lists.xen.org; k...@xen.org > Subject: RE: [RFC v2 08/15] Update I

Re: [Xen-devel] [RFC v2 07/15] vt-d: Add API to update IRTE when VT-d PI is used

2015-06-15 Thread Wu, Feng
> -Original Message- > From: Jan Beulich [mailto:jbeul...@suse.com] > Sent: Friday, June 12, 2015 6:35 PM > To: Wu, Feng > Cc: andrew.coop...@citrix.com; george.dun...@eu.citrix.com; Tian, Kevin; > Zhang, Yang Z; xen-devel@lists.xen.org; k...@xen.org > Subject: RE: [RFC v2 07/15] vt-d: Ad

Re: [Xen-devel] [RFC v2 14/15] Suppress posting interrupts when 'SN' is set

2015-06-15 Thread Wu, Feng
> -Original Message- > From: Jan Beulich [mailto:jbeul...@suse.com] > Sent: Friday, June 12, 2015 6:47 PM > To: Wu, Feng > Cc: andrew.coop...@citrix.com; george.dun...@eu.citrix.com; Tian, Kevin; > Zhang, Yang Z; xen-devel@lists.xen.org; k...@xen.org > Subject: RE: [RFC v2 14/15] Suppress

Re: [Xen-devel] [PATCH v4 0/9] add xenalyze to staging

2015-06-15 Thread George Dunlap
On 06/10/2015 12:21 AM, Julien Grall wrote: > Hi George, > > On 09/06/2015 07:38, George Dunlap wrote: >> On 06/09/2015 12:31 PM, Julien Grall wrote: >>> Hi Olaf, >>> >>> On 09/06/2015 06:18, Olaf Hering wrote: On Wed, Jun 03, Julien Grall wrote: > xentrace is not working as we don't

Re: [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-xl-xsm

2015-06-15 Thread Jan Beulich
>>> On 14.06.15 at 22:54, wrote: > branch xen-unstable > xen branch xen-unstable > job test-amd64-amd64-xl-xsm > test xen-boot > > Tree: linux git://xenbits.xen.org/linux-pvops.git > Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git > Tree: qemu git://xenbits.xen.org/staging/qe

Re: [Xen-devel] [RFC v2 07/15] vt-d: Add API to update IRTE when VT-d PI is used

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 11:20, wrote: > >> -Original Message- >> From: Jan Beulich [mailto:jbeul...@suse.com] >> Sent: Friday, June 12, 2015 6:35 PM >> To: Wu, Feng >> Cc: andrew.coop...@citrix.com; george.dun...@eu.citrix.com; Tian, Kevin; >> Zhang, Yang Z; xen-devel@lists.xen.org; k...@xen.

Re: [Xen-devel] [xen-unstable bisection] complete test-amd64-amd64-xl-xsm

2015-06-15 Thread Andrew Cooper
On 15/06/15 10:30, Jan Beulich wrote: On 14.06.15 at 22:54, wrote: >> branch xen-unstable >> xen branch xen-unstable >> job test-amd64-amd64-xl-xsm >> test xen-boot >> >> Tree: linux git://xenbits.xen.org/linux-pvops.git >> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git

Re: [Xen-devel] [PATCH v2] xen/pciif: Clarify what values go in op->err and op->result.

2015-06-15 Thread Jan Beulich
>>> On 12.06.15 at 22:57, wrote: > The earlier comment says that errno values go in op->err. > However all implementations (NetBSD, Linux) of the most > common operations use XEN_PCI_ERR_* instead of -EXX values. > > The exception is the xen-pciback in Linux (upstream & XenClassic) > code when do

[Xen-devel] minios-devel list is now live

2015-06-15 Thread Lars Kurth
Hi all, as requested, we created a new mailing list for minios development. You can subscribe via http://lists.xenproject.org/cgi-bin/mailman/listinfo/minios-devel or by sending an email with subject line "subscribe" to minio

Re: [Xen-devel] [PATCHv12 1/5] gnttab: per-active entry locking

2015-06-15 Thread Jan Beulich
>>> On 12.06.15 at 15:33, wrote: > Introduce a per-active entry spin lock to protect active entry state > The grant table lock must be locked before acquiring (locking) an > active entry. > > This is a step in reducing contention on the grant table lock, but > will only do so once the grant table

Re: [Xen-devel] [PATCH v2 for Xen 4.6 3/4] libxl: enabling XL to set per-VCPU parameters of a domain for RTDS scheduler

2015-06-15 Thread Dario Faggioli
On Fri, 2015-06-12 at 15:48 -0500, Chong Li wrote: > If no more feedbacks, let me summarize the design for the next version. > > For "get" operations, we will implement the following features: > > 1) Use " xl sched-rtds -v all " to output the per-dom parameters of > all domains. And use, e.g., "

[Xen-devel] [PATCH v3] tools/libxc: Batch memory allocations for PV guests

2015-06-15 Thread Ross Lagerwall
The current code for allocating memory for PV guests batches the hypercalls to allocate memory by allocating 1024*1024 extents of order 0 at a time. To make this faster, first try allocating extents of order 9 (2 MiB) before falling back to the order 0 allocating if the order 9 allocation fails. O

Re: [Xen-devel] [PATCH 07/12] x86/virt/guest/xen: Remove use of pgd_list from the Xen guest code

2015-06-15 Thread David Vrabel
On 15/06/15 10:05, Ian Campbell wrote: > On Sat, 2015-06-13 at 11:49 +0200, Ingo Molnar wrote: >> xen_mm_pin_all()/unpin_all() are used to implement full guest instance >> suspend/restore. It's a stop-all method that needs to iterate through >> all allocated pgds in the system to fix them up for Xe

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread George Dunlap
On Fri, Jun 12, 2015 at 4:22 PM, Lars Kurth wrote: > Hi all, > > following up from > http://lists.xenproject.org/archives/html/xen-devel/2015-06/msg01775.html I > wanted to propose the following convention related to feature classification > as a proposal for discussion. I tried to pretty much

Re: [Xen-devel] [RFC v2 07/15] vt-d: Add API to update IRTE when VT-d PI is used

2015-06-15 Thread Wu, Feng
> -Original Message- > From: Jan Beulich [mailto:jbeul...@suse.com] > Sent: Monday, June 15, 2015 5:35 PM > To: Wu, Feng > Cc: andrew.coop...@citrix.com; george.dun...@eu.citrix.com; Tian, Kevin; > Zhang, Yang Z; xen-devel@lists.xen.org; k...@xen.org > Subject: RE: [RFC v2 07/15] vt-d: Ad

Re: [Xen-devel] [PATCHv12 5/5] [RFC] gnttab: steal maptrack entries from other VCPUs

2015-06-15 Thread Jan Beulich
>>> On 12.06.15 at 15:33, wrote: > +static int steal_maptrack_handle(struct grant_table *t, struct vcpu *v) > +{ > +struct domain *d = v->domain; > +unsigned int first, i; > + > +/* Find an initial victim. */ > +first = i = NOW() % d->max_vcpus; > + > +do { > +unsigned

[Xen-devel] [xen-4.2-testing test] 58540: regressions - FAIL

2015-06-15 Thread osstest service user
flight 58540 xen-4.2-testing real [real] http://logs.test-lab.xenproject.org/osstest/logs/58540/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-xl-qemuu-winxpsp3 15 guest-localmigrate/x10 fail REGR. vs. 58411 test-amd64-am

Re: [Xen-devel] [PATCH OSSTEST v4 2/2] Stubdom test case

2015-06-15 Thread Ian Jackson
Wei Liu writes ("Re: [PATCH OSSTEST v3] Stubdom test case"): > On Wed, Jun 10, 2015 at 12:10:41PM +0100, Ian Jackson wrote: > > If you do that then you end up with > >$stubdom = guest_var_boolean($gho,'stubdom') > > (assuming guest_var_boolean returns undef for unset runvar if no > > default su

[Xen-devel] [PATCH v2 0/6] gnttab: XSA-134 follow-up

2015-06-15 Thread Jan Beulich
1: eliminate several explicit version checks 2: limit mapcount() looping 3: simplify shared entry v1 vs v2 handling 4: simplify page copying/clearing 5: fix/adjust gnttab_transfer() 6: make struct grant_mapping private Signed-off-by: Jan Beulich --- v2: Re-base on top of David's locking changes t

Re: [Xen-devel] [PATCH OSSTEST v3] Arrange to upgrade microcode on x86 test hosts.

2015-06-15 Thread Ian Jackson
Ian Campbell writes ("[PATCH OSSTEST v3] Arrange to upgrade microcode on x86 test hosts."): > --- > v3: > - iucode-tool is iucode_tool in Wheezy, Jessie has both names > - This exact version mg-cpu-microcode-update has been run in colo, > updated production-config* > - Avoid proxy with wget, sin

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Ian Jackson
Lars Kurth writes ("Proposal: Feature Maturity Lifecycle"): > following up from > http://lists.xenproject.org/archives/html/xen-devel/2015-06/msg01775.html I > wanted to propose the following convention related to feature classification > as a proposal for discussion. I tried to pretty much desc

Re: [Xen-devel] [PATCH OSSTEST v3] Arrange to upgrade microcode on x86 test hosts.

2015-06-15 Thread Ian Campbell
On Mon, 2015-06-15 at 13:14 +0100, Ian Jackson wrote: > Ian Campbell writes ("[PATCH OSSTEST v3] Arrange to upgrade microcode on x86 > test hosts."): > > --- > > v3: > > - iucode-tool is iucode_tool in Wheezy, Jessie has both names > > - This exact version mg-cpu-microcode-update has been run in c

[Xen-devel] [PATCH v2 1/6] gnttab: eliminate several explicit version checks

2015-06-15 Thread Jan Beulich
By having nr_grant_entries() return zero when the grant table version is still unset we can reduce the number of error paths and at once fix grant_map_exists() running into the being removed ASSERT() when called for a page owned by a domain not having its grant table set up yet. Signed-off-by: Jan

[Xen-devel] [PATCH v2 2/6] gnttab: limit mapcount() looping

2015-06-15 Thread Jan Beulich
The function doesn't need to return counts in the first place; all its callers are after is whether at least one entry of a certain kind exists. With that there's no point for that loop to continue once the looked for condition was found to be met by one entry. Rename the function to match the chan

[Xen-devel] [PATCH v2 3/6] gnttab: simplify shared entry v1 vs v2 handling

2015-06-15 Thread Jan Beulich
In a number of places both v1 and v2 pointers are being obtained when none or just one suffices. Additionally in __acquire_grant_for_copy() the flow of if/else-if can be slightly improved by re-ordering. Signed-off-by: Jan Beulich --- a/xen/common/grant_table.c +++ b/xen/common/grant_table.c @@

[Xen-devel] [PATCH v2 4/6] gnttab: simplify page copying/clearing

2015-06-15 Thread Jan Beulich
... by making {copy,clear}_domain_page() available also on other than x86. Signed-off-by: Jan Beulich --- a/xen/arch/x86/domain_page.c +++ b/xen/arch/x86/domain_page.c @@ -230,24 +230,6 @@ void unmap_domain_page(const void *ptr) local_irq_restore(flags); } -void clear_domain_page(unsigne

[Xen-devel] [PATCH v2 5/6] gnttab: fix/adjust gnttab_transfer()

2015-06-15 Thread Jan Beulich
- don't update shared entry's frame number for translated domains (as MFNs shouldn't be exposed to such guests) - for v1 grant table format, force copying of the page also when the intended MFN doesn't fit in 32 bits (and the domain isn't translated) - fix an apparent off-by-one error (it's unc

Re: [Xen-devel] [PATCH v3 10/11] x86/intel_pstate: support the use of intel_pstate in pmstat.c

2015-06-15 Thread Wang, Wei W
On 15/06/2015 17:15, Jan Beulich wrote: > >>> On 15.06.15 at 02:30, wrote: > > On 12/06/2015 19:14, Julien Grall wrote: > >> On 11/06/2015 23:03, Wang, Wei W wrote: > >> > On 11/06/2015 22:02, Julien Grall wrote: > >> >> On 11/06/2015 04:31, Wei Wang wrote: > >> >>> -list_for_each(pos, &cpufre

[Xen-devel] [PATCH v2 6/6] gnttab: make struct grant_mapping private

2015-06-15 Thread Jan Beulich
This documents that no entity outside of gnttab.c actually accesses objects of that type, which is particularly important with the now more fine grained locking in place. Signed-off-by: Jan Beulich --- a/xen/common/grant_table.c +++ b/xen/common/grant_table.c @@ -113,6 +113,16 @@ struct gnttab_u

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Lars Kurth
> On 15 Jun 2015, at 13:21, Ian Jackson wrote: > > Lars Kurth writes ("Proposal: Feature Maturity Lifecycle"): >> following up from >> http://lists.xenproject.org/archives/html/xen-devel/2015-06/msg01775.html I >> wanted to propose the following convention related to feature classification >>

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Ian Jackson
George Dunlap writes ("Re: [Xen-devel] Proposal: Feature Maturity Lifecycle"): > So if we accept these definitions, it would would officially make > adding functionality to osstest a requirement for everybody > contributing new functionality. I think at the moment, that may be > too high a barrier

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Ian Jackson
Lars Kurth writes ("Re: Proposal: Feature Maturity Lifecycle"): > However, I do also believe that the time evolution view in > http://wiki.xenproject.org/wiki/Xen_Project_Release_Features is valuable and > it is probably too hard to do this in an automated fashion, at least > initially. So my of

Re: [Xen-devel] [PATCH v3 10/11] x86/intel_pstate: support the use of intel_pstate in pmstat.c

2015-06-15 Thread Jan Beulich
>>> On 15.06.15 at 14:28, wrote: > On 15/06/2015 17:15, Jan Beulich wrote: >> >>> On 15.06.15 at 02:30, wrote: >> > We actually want it be intel_pstate specific. If maintainers agree, I >> > think renaming it to intel_pstate_policy is a good option. >> >> No, this name is just ugly. If you need

Re: [Xen-devel] [PATCH v4 0/9] add xenalyze to staging

2015-06-15 Thread Julien Grall
Hi George, On 15/06/2015 10:23, George Dunlap wrote: On 06/10/2015 12:21 AM, Julien Grall wrote: On 09/06/2015 07:38, George Dunlap wrote: On 06/09/2015 12:31 PM, Julien Grall wrote: On 09/06/2015 06:18, Olaf Hering wrote: On Wed, Jun 03, Julien Grall wrote: xentrace is not working as we d

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Lars Kurth
> On 15 Jun 2015, at 12:26, George Dunlap wrote: > > On Fri, Jun 12, 2015 at 4:22 PM, Lars Kurth wrote: >> Hi all, >> >> >> 4. Supported >>- Intended functionality is fully implemented >>- Feature is *maintained* >>- Feature is *tested* >>- Feature is *sta

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Lars Kurth
> On 15 Jun 2015, at 13:31, Ian Jackson wrote: > > George Dunlap writes ("Re: [Xen-devel] Proposal: Feature Maturity Lifecycle"): >> So if we accept these definitions, it would would officially make >> adding functionality to osstest a requirement for everybody >> contributing new functionality.

Re: [Xen-devel] Proposal: Feature Maturity Lifecycle

2015-06-15 Thread Ian Jackson
Lars Kurth writes ("Re: [Xen-devel] Proposal: Feature Maturity Lifecycle"): > PCI passthrough is interesting, because am not convinced we do > handle security issues for it. Or are we? We do handle PCI passthrough security issues, yes. A large proportion of XSAs are due to PCI passthrough. Ian.

Re: [Xen-devel] [PATCH v2 1/6] gnttab: eliminate several explicit version checks

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:24, Jan Beulich wrote: > @@ -1977,10 +1969,6 @@ __acquire_grant_for_copy( > > read_lock(&rgt->lock); > > -if ( rgt->gt_version == 0 ) > -PIN_FAIL(gt_unlock_out, GNTST_general_error, > - "remote grant table not ready\n"); > - > if ( unlikely(g

Re: [Xen-devel] [PATCH OSSTEST v4 2/2] Stubdom test case

2015-06-15 Thread Wei Liu
On Mon, Jun 15, 2015 at 01:05:50PM +0100, Ian Jackson wrote: > Wei Liu writes ("Re: [PATCH OSSTEST v3] Stubdom test case"): > > On Wed, Jun 10, 2015 at 12:10:41PM +0100, Ian Jackson wrote: > > > If you do that then you end up with > > >$stubdom = guest_var_boolean($gho,'stubdom') > > > (assumin

Re: [Xen-devel] [PATCH v2 2/6] gnttab: limit mapcount() looping

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:26, Jan Beulich wrote: > The function doesn't need to return counts in the first place; all its > callers are after is whether at least one entry of a certain kind > exists. With that there's no point for that loop to continue once the > looked for condition was found to be met by on

Re: [Xen-devel] [PATCH v2 3/6] gnttab: simplify shared entry v1 vs v2 handling

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:26, Jan Beulich wrote: > In a number of places both v1 and v2 pointers are being obtained when > none or just one suffices. Additionally in __acquire_grant_for_copy() > the flow of if/else-if can be slightly improved by re-ordering. > > Signed-off-by: Jan Beulich Reviewed-by: Andre

Re: [Xen-devel] [PATCH v2 4/6] gnttab: simplify page copying/clearing

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:27, Jan Beulich wrote: > ... by making {copy,clear}_domain_page() available also on other than > x86. > > Signed-off-by: Jan Beulich Reviewed-by: Andrew Cooper ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-

[Xen-devel] [PATCH OSSTEST v2 09/11] ts-xen-build-prep: install libc6-dev-i386 for jessie

2015-06-15 Thread Wei Liu
Signed-off-by: Wei Liu --- ts-xen-build-prep | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/ts-xen-build-prep b/ts-xen-build-prep index 4fdc37e..c348dad 100755 --- a/ts-xen-build-prep +++ b/ts-xen-build-prep @@ -232,7 +232,7 @@ END if ($ho->{Suite} !~ m/lenny|squeeze/) {

[Xen-devel] [PATCH OSSTEST v2 06/11] Cope with Jessie's d-i vg name

2015-06-15 Thread Wei Liu
In Jessie the default vg name is changed to "$hostname-vg". Make that default case and check for wheezy, squeeze and lenny for backward compatibility. Signed-off-by: Wei Liu --- Changes in v2: 1. Make Jessie case default. --- ts-host-install | 7 +-- ts-xen-build-prep | 8 +--- 2 files

[Xen-devel] [PATCH OSSTEST v2 02/11] mg-debian-installer-update: updates to better handle Jessie onwards.

2015-06-15 Thread Wei Liu
From: Ian Campbell In mg-debian-installer-update: - Expand the list of (suite,arch) combinations which don't exist and move it to the top. - Tweak the backports.org handling to allow it to be specified on a per (suite,arch) basis, and specify it only for (wheezy,armhf) since it

[Xen-devel] [PATCH OSSTEST v2 03/11] mg-debian-installer-update: Also collect DTBs for standard kernels

2015-06-15 Thread Wei Liu
From: Ian Campbell For armhf and arm64 for Jessie we will need these in the normal case as well as in the backports case. Arrange to download. Signed-off-by: Ian Campbell --- mg-debian-installer-update | 13 - 1 file changed, 12 insertions(+), 1 deletion(-) diff --git a/mg-debian-

[Xen-devel] [PATCH OSSTEST v2 05/11] Debian.pm: install grub to default device

2015-06-15 Thread Wei Liu
Debian installer used to have the behaviour to install grub on the default device. But it's changed in Jessie. See https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=759737. Signed-off-by: Wei Liu >From Weis v1 Jessie series --- Osstest/Debian.pm | 2 ++ 1 file changed, 2 insertions(+) diff --g

[Xen-devel] [PATCH OSSTEST v2 01/11] More flexible handling of need-kernel-deb-$flavour host flag

2015-06-15 Thread Wei Liu
From: Ian Campbell The current behaviour does not account for the need to apply this workaround only for particular Debian releases, i.e. Midway will be supported just fine in Jessie. It also does not allow for kernels from alternative sources other than backports (e.g. experimental, although th

[Xen-devel] [PATCH OSSTEST v2 07/11] Debian: grub2: Allow submenu and menuentry items to be indented.

2015-06-15 Thread Wei Liu
From: Ian Campbell Signed-off-by: Ian Campbell --- Osstest/Debian.pm | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/Osstest/Debian.pm b/Osstest/Debian.pm index 5463fd0..50730f5 100644 --- a/Osstest/Debian.pm +++ b/Osstest/Debian.pm @@ -444,12 +444,12 @@ sub setupboot_gr

[Xen-devel] [PATCH OSSTEST v2 08/11] ts-xen-build-prep: install libnl-route-3-dev on Jessie

2015-06-15 Thread Wei Liu
There is no package called libnl-dev on Jessie. To build remus, use libnl-route-3-dev instead. Signed-off-by: Wei Liu --- ts-xen-build-prep | 30 ++ 1 file changed, 18 insertions(+), 12 deletions(-) diff --git a/ts-xen-build-prep b/ts-xen-build-prep index befb7d4..4

[Xen-devel] [PATCH OSSTEST v2 00/11] Upgrade to Debian Jessie

2015-06-15 Thread Wei Liu
This is a collection of patches from Ian and me to upgrade osstest to Debian Jessie. I've run build-amd64 build-amd64-pvops test-amd64-amd64-xl test-amd64-amd64-xl-qemuu-debianhvm-amd64 all worked fine. I can't test the arm patches though. Wei. Ian Campbell (5): More flexible handli

Re: [Xen-devel] [PATCH v2 5/6] gnttab: fix/adjust gnttab_transfer()

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:28, Jan Beulich wrote: > - don't update shared entry's frame number for translated domains (as > MFNs shouldn't be exposed to such guests) > - for v1 grant table format, force copying of the page also when the > intended MFN doesn't fit in 32 bits (and the domain isn't translated

Re: [Xen-devel] [PATCH v2 6/6] gnttab: make struct grant_mapping private

2015-06-15 Thread Andrew Cooper
On 15/06/15 13:29, Jan Beulich wrote: > This documents that no entity outside of gnttab.c actually accesses > objects of that type, which is particularly important with the now more > fine grained locking in place. > > Signed-off-by: Jan Beulich Reviewed-by: Andrew Cooper __

[Xen-devel] [PATCH 15/27] tools/libxl: Migration v2 stream format

2015-06-15 Thread Andrew Cooper
From: Ross Lagerwall C structures describing the Libxl migration v2 stream format Signed-off-by: Ross Lagerwall Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_sr_stream_format.h | 57 ++ 1 file changed, 57 i

[Xen-devel] [PATCH 07/27] libxl: cancellation: Handle SIGTERM in save/restore helper

2015-06-15 Thread Andrew Cooper
From: Ian Jackson During startup of the save/restore helper, set the disposition of SIGTERM appropriately. For restore, we can simply die immediately - there is no point trying to do any kind of cleanup on what is now going to be a trashed domain. For save, we want to arrange that libxc's clean

[Xen-devel] [PATCH 00/27] Libxl migration v2

2015-06-15 Thread Andrew Cooper
This series adds support for the libxl migration v2 stream, and untangles the existing layering violations of the toolstack and qemu records. At the end of the series, legacy migration is no longer used. Note: Remus support is broken and (RFC) fixed in separate patches in this series. It was too

[Xen-devel] [PATCH 01/27] tools/libxl: Fix libxl__ev_child_inuse() check for not-yet-initialised children

2015-06-15 Thread Andrew Cooper
Shortly, libxl will be juggling multiple parallel operations, and will possibly have to take error decisions before some tasks have been set up. No child process of libxl will ever have a pid of 0, so gate libxl__ev_child_inuse() on a pid strictly greater than 0. This makes it safe to use on a ze

[Xen-devel] [PATCH 03/27] tools/libxl: Stash all restore parameters in domain_create_state

2015-06-15 Thread Andrew Cooper
Shortly more parameters will appear, and this saves unboxing each one. No functional change. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_create.c | 12 ++-- tools/libxl/libxl_internal.h |2 +- tools/libxl/libxl_save_

[Xen-devel] [PATCH 04/27] tools/xl: Mandatory flag indicating the format of the migration stream

2015-06-15 Thread Andrew Cooper
Introduced at this point so the python stream conversion code has a concrete ABI to use. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/xl_cmdimpl.c |1 + 1 file changed, 1 insertion(+) diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdi

[Xen-devel] [PATCH 06/27] libxl: cancellation: Preparations for save/restore cancellation

2015-06-15 Thread Andrew Cooper
From: Ian Jackson Two unrelated non-functional changes, broken out into a pre-patch for easier review: Break out a function sendsig() in libxl_save_callout.c. Move io_fd to be a global variable in libxl_save_helper.c. Signed-off-by: Ian Jackson Alter sendsig() to being libxl__kill() as it is

[Xen-devel] [PATCH 05/27] tools/libxl: Introduce ROUNDUP()

2015-06-15 Thread Andrew Cooper
This is the same as is used by libxc. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_internal.h |3 +++ 1 file changed, 3 insertions(+) diff --git a/tools/libxl/libxl_internal.h b/tools/libxl/libxl_internal.h index 796bd21..a4636ca 100644

[Xen-devel] [PATCH 02/27] tools/libxc: Always compile the compat qemu variables into xc_sr_context

2015-06-15 Thread Andrew Cooper
This is safe (as the variable will simply be unused), and is required for correct compilation when midway through untangling the libxc/libxl interaction. The #define is left in place to highlight that the variables can be removed once the untangling is complete. Signed-off-by: Andrew Cooper CC:

[Xen-devel] [PATCH 09/27] tools/libxl: Pass restore_fd as a parameter to libxl__xc_domain_restore()

2015-06-15 Thread Andrew Cooper
If a conversion of a legacy stream is needed, libxl__xc_domain_restore() will need to use an fd other to the one found in the domain_create_state. No functional change. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_create.c |2 +- t

[Xen-devel] [PATCH 08/27] tools/libxl: Extra APIs for the save helper

2015-06-15 Thread Andrew Cooper
With libxl migration v2, there will be other moving parts which might fail, requiring the helper to be stopped for reasons which are not its fault. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_internal.h |8 tools/libxl/libxl

[Xen-devel] [PATCH OSSTEST v2 04/11] Force sysvinit with Jessie

2015-06-15 Thread Wei Liu
From: Ian Campbell Systemd has some issues: 1. It doesn't honor osstest-confirm-booted service, which breaks ts-leak-check. 2. It kills the ssh connection before 'init 6' has a chance return, which breaks ts-host-reboot. Fall back to SysV init for now. Signed-off-by: Ian Campbell [wei:

[Xen-devel] [PATCH OSSTEST v2 11/11] ts-kernel-build: enable CONFIG_FHANDLE

2015-06-15 Thread Wei Liu
According to Debian bug #764539, systemd needs this kernel feature to be able to mount disks. Complete list of required kernel features can be found in /usr/share/doc/systemd/README.gz. Signed-off-by: Wei Liu --- ts-kernel-build | 2 ++ 1 file changed, 2 insertions(+) diff --git a/ts-kernel-bui

[Xen-devel] [PATCH 17/27] tools/libxl: Support converting a legacy stream to a v2 stream

2015-06-15 Thread Andrew Cooper
When a legacy stream is found, it needs to be converted to a v2 stream for the reading logic. This is done by exec()ing the python conversion utility. One complication is that the caller of this interface needs to assume ownership of the output fd, to prevent it being closed while still in use in

[Xen-devel] [PATCH 25/27] tools/libxl: [RFC] Handle checkpoint records in a libxl migration v2 stream

2015-06-15 Thread Andrew Cooper
This is the final bit of untangling for Remus. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_create.c | 25 tools/libxl/libxl_internal.h|6 tools/libxl/libxl_stream_read.c | 62 +++

[Xen-devel] [PATCH 22/27] docs/libxl: [RFC] Introduce CHECKPOINT_END to support migration v2 remus streams

2015-06-15 Thread Andrew Cooper
In a remus senario, libxc will write a CHECKPOINT record, then hand ownership of the fd to libxl. Libxl then writes any records required and finishes with a CHECKPOINT_END record, then hands ownership of the fd back to libxc. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: We

[Xen-devel] [PATCH 18/27] tools/libxl: Convert a legacy stream if needed

2015-06-15 Thread Andrew Cooper
For backwards compatibility, a legacy stream needs converting before it can be read by the v2 stream logic. This causes the v2 stream logic to need to juggle two parallel tasks. check_stream_finished() is introduced for the purpose of joining the tasks in both success and error cases. Signed-off-

[Xen-devel] [PATCH 11/27] tools/python: Libxc migration v2 infrastructure

2015-06-15 Thread Andrew Cooper
Contains: * Python implementation of the libxc migration v2 records * Verification code for spec compliance * Unit tests Signed-off-by: Andrew Cooper --- tools/python/setup.py|1 + tools/python/xen/migration/libxc.py | 446 ++ tools/python

[Xen-devel] [PATCH 19/27] tools/libxc+libxl+xl: Restore v2 streams

2015-06-15 Thread Andrew Cooper
This is a complicated set of changes which must be done together for bisectability. * libxl-save-helper is updated to unconditionally use libxc migration v2. * libxl compatibility workarounds in libxc are disabled for restore operations. * libxl__stream_read_start() is logically spliced into th

[Xen-devel] [PATCH 21/27] tools/libxc+libxl+xl: Save v2 streams

2015-06-15 Thread Andrew Cooper
This is a complicated set of changes which must be done together for bisectability. * libxl-save-helper is updated to unconditionally use libxc migration v2. * libxl compatibility workarounds in libxc are disabled for save operations. * libxl__stream_write_start() is logically spliced into the

[Xen-devel] [PATCH 20/27] tools/libxl: Infrastructure for writing a v2 stream

2015-06-15 Thread Andrew Cooper
From: Ross Lagerwall Signed-off-by: Ross Lagerwall Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/Makefile |2 +- tools/libxl/libxl_internal.h | 33 +++ tools/libxl/libxl_stream_write.c | 536 +

[Xen-devel] [PATCH 13/27] tools/python: Verification utility for v2 stream spec compliance

2015-06-15 Thread Andrew Cooper
Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- This is exceedingly useful for development, but not of practical use being installed into a production dom0. --- tools/python/scripts/verify-stream-v2.py | 174 ++ 1 file changed, 174 in

[Xen-devel] [PATCH 16/27] tools/libxl: Infrastructure for reading a libxl migration v2 stream

2015-06-15 Thread Andrew Cooper
From: Ross Lagerwall Signed-off-by: Ross Lagerwall Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/Makefile|1 + tools/libxl/libxl_internal.h| 39 tools/libxl/libxl_stream_read.c | 485

[Xen-devel] [PATCH 27/27] tools/libxl: Drop all knowledge of toolstack callbacks

2015-06-15 Thread Andrew Cooper
Libxl has now been fully adjusted not to need them. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_dom.c|1 - tools/libxl/libxl_internal.h |2 -- tools/libxl/libxl_save_callout.c | 39 +-

[Xen-devel] [PATCH 23/27] tools/libxl: [RFC] Write checkpoint records into the stream

2015-06-15 Thread Andrew Cooper
when signalled to do so by libxl__remus_domain_checkpoint_callback() Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxl/libxl_dom.c | 16 +++--- tools/libxl/libxl_internal.h |7 +++ tools/libxl/libxl_stream_write.c | 111 +

[Xen-devel] [PATCH 14/27] tools/python: Conversion utility for legacy migration streams

2015-06-15 Thread Andrew Cooper
This utility will take a legacy stream as in input, and produce a v2 stream as an output. It is exec()'d by libxl to provide backwards compatibility. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/python/Makefile |4 + tools/py

  1   2   3   >