Re: [Xen-devel] [PATCH Remus v2 02/10] tools/libxc: introduce setup() and cleanup() on save

2015-05-12 Thread Yang Hongyang
On 05/11/2015 07:49 PM, Ian Campbell wrote: On Mon, 2015-05-11 at 12:47 +0100, Ian Campbell wrote: Actually this is another trick that I need to deal with those hypercall macros. DECLARE_HYPERCALL_BUFFER_SHADOW will define a user pointer "dirty_bitmap" and a shadow buffer, although xc_hypercall_

Re: [Xen-devel] [PATCH Remus v2 04/10] tools/libxc: introduce DECLARE_HYPERCALL_BUFFER_USER_POINTER

2015-05-12 Thread Yang Hongyang
On 05/11/2015 07:53 PM, Ian Campbell wrote: On Fri, 2015-05-08 at 17:33 +0800, Yang Hongyang wrote: Define a user pointer that can access the hypercall buffer data Useful when you only need to access the hypercall buffer data Can you expand on this please, I think the context is a hypercall

Re: [Xen-devel] [ovmf test] 55270: regressions - FAIL

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 04:42 +, osstest service user wrote: > flight 55270 ovmf real [real] > http://logs.test-lab.xenproject.org/osstest/logs/55270/ > > Regressions :-( > > Tests which did not succeed and are blocking, > including tests which could not be run: > test-amd64-i386-freebsd10-amd

[Xen-devel] [xen-unstable test] 55274: regressions - FAIL

2015-05-12 Thread osstest service user
flight 55274 xen-unstable real [real] http://logs.test-lab.xenproject.org/osstest/logs/55274/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-freebsd10-amd64 13 guest-localmigrate fail REGR. vs. 50405 test-amd64-amd64-xl-

[Xen-devel] [PATCH] make-flight: Drop pointless jobs from seabios and ovmf flights

2015-05-12 Thread Ian Campbell
These are both firmware which is used only with qemuu tests. There is no point testing either PV guets or HVM with qemut (which always uses rombios). Comparing before and after of: ./standalone-generate-dump-flight-runvars | \ awk '// {printf "%-32s %s\n", $1, $2}' | \ sort -u Results in:

Re: [Xen-devel] [PATCH Remus v2 00/10] Remus support for Migration-v2

2015-05-12 Thread Yang Hongyang
On 05/11/2015 07:01 PM, Andrew Cooper wrote: On 11/05/15 11:48, Hongyang Yang wrote: On 05/11/2015 05:00 PM, Andrew Cooper wrote: On 11/05/15 07:28, Hongyang Yang wrote: On 05/09/2015 02:12 AM, Andrew Cooper wrote: On 08/05/15 10:33, Yang Hongyang wrote: This patchset implement the Remus

Re: [Xen-devel] [PATCH Remus v2 04/10] tools/libxc: introduce DECLARE_HYPERCALL_BUFFER_USER_POINTER

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 15:18 +0800, Yang Hongyang wrote: > > On 05/11/2015 07:53 PM, Ian Campbell wrote: > > On Fri, 2015-05-08 at 17:33 +0800, Yang Hongyang wrote: > >> Define a user pointer that can access the hypercall buffer data > >> Useful when you only need to access the hypercall buffer dat

Re: [Xen-devel] Does Xen unstable tree work?

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 00:47 +, Hao, Xudong wrote: > Xen unstable tree doesn't update for about one month, I saw staging > tree has many new commit these days, how often does it merging? Does > unstable tree still work? There have been some teething troubles with the push gates since osstest mo

Re: [Xen-devel] [win-pv-devel] Question about windows domU long boot time in xen and help for update libxl virtio patch (for a test)

2015-05-12 Thread Fabio Fantoni
Il 11/05/2015 16:13, Wei Liu ha scritto: On Mon, May 11, 2015 at 03:53:44PM +0200, Fabio Fantoni wrote: [...] Can someone help me to complete/fix it please? Can someone help me about virtio disks support in libxl please? After this reply about seabios seems can be useful try virtio: http://l

Re: [Xen-devel] [PATCH v2 1/8] xenalyze: add to tools/xentrace/xenalyze

2015-05-12 Thread Ian Campbell
On Mon, 2015-05-11 at 15:33 +0100, George Dunlap wrote: > On 05/11/2015 03:23 PM, Ian Campbell wrote: > > On Mon, 2015-05-11 at 16:15 +0200, Olaf Hering wrote: > >> On Thu, May 07, George Dunlap wrote: > >> > >>> On Thu, May 7, 2015 at 11:35 AM, Olaf Hering wrote: > >> > tools/xentrace/xenal

Re: [Xen-devel] [PATCH v2 1/8] xenalyze: add to tools/xentrace/xenalyze

2015-05-12 Thread George Dunlap
On 05/12/2015 09:45 AM, Ian Campbell wrote: > On Mon, 2015-05-11 at 15:33 +0100, George Dunlap wrote: >> On 05/11/2015 03:23 PM, Ian Campbell wrote: >>> On Mon, 2015-05-11 at 16:15 +0200, Olaf Hering wrote: On Thu, May 07, George Dunlap wrote: > On Thu, May 7, 2015 at 11:35 AM, Olaf H

[Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Stefano Stabellini
Signed-off-by: Stefano Stabellini --- defconfig |8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/defconfig b/defconfig index b4ed94d..c2bc251 100644 --- a/defconfig +++ b/defconfig @@ -22,7 +22,7 @@ DESTDIR=dist #GRUB_URL="http://git.savannah.gnu.org/r/grub.git"; #

[Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Stefano Stabellini
Signed-off-by: Stefano Stabellini --- Changes in v4: - introduce enable_raisin in mfi-common: only build raisin when building xen-unstable - start off from the default raisin config, then append osstest config options to it - do not write variable to the raisin config if the conrresponding runva

Re: [Xen-devel] Regression: qemu crash of hvm domUs with spice (backtrace included)

2015-05-12 Thread Fabio Fantoni
Il 11/05/2015 17:04, Fabio Fantoni ha scritto: Il 21/04/2015 14:53, Stefano Stabellini ha scritto: On Tue, 21 Apr 2015, Fabio Fantoni wrote: Il 21/04/2015 12:49, Stefano Stabellini ha scritto: On Mon, 20 Apr 2015, Fabio Fantoni wrote: I updated xen and qemu from xen 4.5.0 with its upstream qem

Re: [Xen-devel] [PATCH Remus v2 04/10] tools/libxc: introduce DECLARE_HYPERCALL_BUFFER_USER_POINTER

2015-05-12 Thread Yang Hongyang
On 05/12/2015 04:19 PM, Ian Campbell wrote: On Tue, 2015-05-12 at 15:18 +0800, Yang Hongyang wrote: On 05/11/2015 07:53 PM, Ian Campbell wrote: On Fri, 2015-05-08 at 17:33 +0800, Yang Hongyang wrote: Define a user pointer that can access the hypercall buffer data Useful when you only need t

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread George Dunlap
On 05/12/2015 10:16 AM, Stefano Stabellini wrote: > Signed-off-by: Stefano Stabellini What's the purpose of doing this? In particular it seems like having to manually update the changesets as we go along is going to be a big pain in the neck. There shouldn't be a need to keep raisin.git and xen

Re: [Xen-devel] 答复: 答复: 答复: about xenalyze

2015-05-12 Thread George Dunlap
On Tue, May 12, 2015 at 3:18 AM, 蒋雄伟(蒋冲) wrote: > I try again with "-e 0xaf000", and run xenalyze --summary. The attached is > the output. Again, please don't top-post: configure your mailer to quote properly, and reply in-line (as I am doing now). So it looks like now it works. :-) You can fi

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Stefano Stabellini
On Tue, 12 May 2015, George Dunlap wrote: > On 05/12/2015 10:16 AM, Stefano Stabellini wrote: > > Signed-off-by: Stefano Stabellini > > What's the purpose of doing this? In particular it seems like having to > manually update the changesets as we go along is going to be a big pain > in the neck.

[Xen-devel] [PATCH v3 1/6] libxc/migration: Be rather stricter with illformed callers

2015-05-12 Thread Andrew Cooper
The migration code itself should be able to validly assume all mandatory callbacks are set up. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Yang Hongyang --- tools/libxc/xc_sr_save.c |4 tools/libxc/xc_sr_save_x86_hvm.c |7 --- 2 file

[Xen-devel] [PATCH v3 6/6] [RFC] [INCOMPLETE] libxc/restore: Remus

2015-05-12 Thread Andrew Cooper
Some basic infrastructure. CC: Yang Hongyang --- I started attempting to explain this in text, but concluded that pseudocode would be easier. My design for the restore side handling was always based around a single "do { } while ( not end )" loop, and specifically not to split into two phases.

[Xen-devel] [PATCH v3 4/6] tools/libxc: introduce process_record()

2015-05-12 Thread Andrew Cooper
From: Yang Hongyang Move record handle codes into a function process_record(). It will be used multiple times by Remus. No functional change. Signed-off-by: Yang Hongyang Reviewed-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxc/xc_sr_restore.c | 77

[Xen-devel] [PATCH v3 0/6] Misc patches to aid migration v2 Remus support

2015-05-12 Thread Andrew Cooper
See individual patches for details. Git tree available at: git://xenbits.xen.org/people/andrewcoop/xen.git remus-migv2-v3 ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel

[Xen-devel] [PATCH v3 2/6] libxc/save: Adjust stream-position callbacks for checkpointed streams

2015-05-12 Thread Andrew Cooper
There are some records which should only be sent once in the stream, and not repeated for each checkpoint. {start,end}_of_stream() become per-checkpoint, and a new start_of_stream() is introduced. There is no resulting change record order, but the X86_PV_INFO record is identified as once per stre

[Xen-devel] [PATCH v3 5/6] libxc/migration: Pass checkpoint information into the save algorithm.

2015-05-12 Thread Andrew Cooper
Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Yang Hongyang --- tools/libxc/include/xenguest.h |1 + tools/libxc/xc_sr_common.h |3 +++ tools/libxc/xc_sr_save.c |3 +++ tools/libxl/libxl_dom.c|1 + 4 files changed, 8 insertions

[Xen-devel] [PATCH v3 3/6] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Andrew Cooper
Checkpointed streams need to signal the end of a consistent view of VM state, and the start of the libxl data. Signed-off-by: Andrew Cooper CC: David Vrabel CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Yang Hongyang --- After discusions with David, we have come to the conclusion that a

Re: [Xen-devel] [PATCH Remus v2 00/10] Remus support for Migration-v2

2015-05-12 Thread Andrew Cooper
On 12/05/15 09:12, Yang Hongyang wrote: > That sounds like COLO wants a should_checkpoint() callback which separates the decision to make a checkpoint from the logic of implementing a checkpoint. >>> >>> We use checkpoint callback to do should_checkpoint() thing currently. >>> libxc

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 10:25 +0100, George Dunlap wrote: > On 05/12/2015 10:16 AM, Stefano Stabellini wrote: > > Signed-off-by: Stefano Stabellini > > What's the purpose of doing this? In particular it seems like having to > manually update the changesets as we go along is going to be a big pain

Re: [Xen-devel] [PATCH v3 3/6] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Yang Hongyang
On 05/12/2015 05:35 PM, Andrew Cooper wrote: Checkpointed streams need to signal the end of a consistent view of VM state, and the start of the libxl data. Ah, now I know what's CHECKPOINT record mean, the name is OK for me then. Signed-off-by: Andrew Cooper CC: David Vrabel CC: Ian Camp

Re: [Xen-devel] [PATCH Remus v2 04/10] tools/libxc: introduce DECLARE_HYPERCALL_BUFFER_USER_POINTER

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 17:24 +0800, Yang Hongyang wrote: > > On 05/12/2015 04:19 PM, Ian Campbell wrote: > > On Tue, 2015-05-12 at 15:18 +0800, Yang Hongyang wrote: > >> > >> On 05/11/2015 07:53 PM, Ian Campbell wrote: > >>> On Fri, 2015-05-08 at 17:33 +0800, Yang Hongyang wrote: > Define a us

Re: [Xen-devel] [PATCH] x86: don't clear high 32 bits of RAX on sub-word guest I/O port reads

2015-05-12 Thread Jan Beulich
>>> On 11.05.15 at 17:15, wrote: > On Fri, May 08, 2015 at 01:08:05PM +0100, Jan Beulich wrote: >> 1- or 2-byte operations never alter the high halves of registers. >> > > That is impressive. How possibly did you spot this? > > Was it due to reviewing some other code that got you looking > at t

Re: [Xen-devel] [PATCH Remus v2 04/10] tools/libxc: introduce DECLARE_HYPERCALL_BUFFER_USER_POINTER

2015-05-12 Thread Yang Hongyang
On 05/12/2015 05:43 PM, Ian Campbell wrote: On Tue, 2015-05-12 at 17:24 +0800, Yang Hongyang wrote: On 05/12/2015 04:19 PM, Ian Campbell wrote: On Tue, 2015-05-12 at 15:18 +0800, Yang Hongyang wrote: On 05/11/2015 07:53 PM, Ian Campbell wrote: On Fri, 2015-05-08 at 17:33 +0800, Yang Hongy

Re: [Xen-devel] [PATCH v3 3/6] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread David Vrabel
On 12/05/15 10:35, Andrew Cooper wrote: > Checkpointed streams need to signal the end of a consistent view of VM state, > and the start of the libxl data. [...] > --- a/docs/specs/libxc-migration-stream.pandoc > +++ b/docs/specs/libxc-migration-stream.pandoc [...] > @@ -578,6 +578,23 @@ The verify

Re: [Xen-devel] [PATCH v3 6/6] [RFC] [INCOMPLETE] libxc/restore: Remus

2015-05-12 Thread Yang Hongyang
I will try to implement the restore side as you proposed. The save side was a single do{}while loop already. I use ctx.save.live to differentiate the two phases. On 05/12/2015 05:35 PM, Andrew Cooper wrote: Some basic infrastructure. CC: Yang Hongyang --- I started attempting to explain this

Re: [Xen-devel] [PATCH Remus v2 00/10] Remus support for Migration-v2

2015-05-12 Thread Yang Hongyang
On 05/12/2015 05:40 PM, Andrew Cooper wrote: On 12/05/15 09:12, Yang Hongyang wrote: That sounds like COLO wants a should_checkpoint() callback which separates the decision to make a checkpoint from the logic of implementing a checkpoint. We use checkpoint callback to do should_checkpoint(

Re: [Xen-devel] [PATCH v1 3/4] libxl: enabling XL to set per-VCPU parameters of a domain for RTDS scheduler

2015-05-12 Thread Dario Faggioli
[Adjusting the Cc list: - removing hypervisor only people - adding more tools maintainers - adding George] On Thu, 2015-05-07 at 12:05 -0500, Chong Li wrote: > Change sched_rtds_domain_get/set functions to support per-VCPU settings for > RTDS scheduler. > More on this patch (I had to run y

Re: [Xen-devel] [linux-linus test] 55255: regressions - FAIL

2015-05-12 Thread Ian Campbell
On Mon, 2015-05-11 at 18:09 +, osstest service user wrote: > flight 55255 linux-linus real [real] > http://logs.test-lab.xenproject.org/osstest/logs/55255/ > > Regressions :-( > > Tests which did not succeed and are blocking, > including tests which could not be run: > test-armhf-armhf-xl-ar

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread George Dunlap
On 05/12/2015 10:42 AM, Ian Campbell wrote: > On Tue, 2015-05-12 at 10:25 +0100, George Dunlap wrote: >> On 05/12/2015 10:16 AM, Stefano Stabellini wrote: >>> Signed-off-by: Stefano Stabellini >> >> What's the purpose of doing this? In particular it seems like having to >> manually update the cha

Re: [Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 10:20 +0100, Stefano Stabellini wrote: > Signed-off-by: Stefano Stabellini > > --- > > Changes in v4: > - introduce enable_raisin in mfi-common: only build raisin when building > xen-unstable > - start off from the default raisin config, then append osstest config > options

Re: [Xen-devel] 答复: 答复: 答复: about xenalyze

2015-05-12 Thread Dario Faggioli
On Tue, 2015-05-12 at 14:29 +0800, 蒋雄伟(蒋冲) wrote: > > Again, don't top-post, reply inline, don't use HTML emails and (and that's new) avoid posting images on the mailing list, please. > Each number means what ? > Have you looked at the xenalyze.html file, as George said in his last email (and a

Re: [Xen-devel] Regression: qemu crash of hvm domUs with spice (backtrace included)

2015-05-12 Thread Fabio Fantoni
Il 12/05/2015 11:23, Fabio Fantoni ha scritto: Il 11/05/2015 17:04, Fabio Fantoni ha scritto: Il 21/04/2015 14:53, Stefano Stabellini ha scritto: On Tue, 21 Apr 2015, Fabio Fantoni wrote: Il 21/04/2015 12:49, Stefano Stabellini ha scritto: On Mon, 20 Apr 2015, Fabio Fantoni wrote: I updated x

Re: [Xen-devel] [linux-linus test] 55255: regressions - FAIL

2015-05-12 Thread Julien Grall
Hi, On 12/05/15 11:07, Ian Campbell wrote: > On Mon, 2015-05-11 at 18:09 +, osstest service user wrote: >> flight 55255 linux-linus real [real] >> http://logs.test-lab.xenproject.org/osstest/logs/55255/ >> >> Regressions :-( >> >> Tests which did not succeed and are blocking, >> including test

Re: [Xen-devel] about xenalyze

2015-05-12 Thread Lars Kurth
George, given that this question is coming up occasionally, I was going to create a wiki page. I can't find xenalyze.html and xenalyse on xenbuts though I can find * https://github.com/nikmis/xentrace-analysis - but that does not contain the html file and is probably a different tool * https:/

Re: [Xen-devel] [PATCH v3 3/6] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Yang Hongyang
Hi Andrew, David, Would you mind if I fix the comments, and combine this series with mine prepare patches for Remus, and then send it out together? On 05/12/2015 05:54 PM, David Vrabel wrote: On 12/05/15 10:35, Andrew Cooper wrote: Checkpointed streams need to signal the end of a consistent

Re: [Xen-devel] [PATCH v3 3/6] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Andrew Cooper
On 12/05/15 11:49, Yang Hongyang wrote: > Hi Andrew, David, > > Would you mind if I fix the comments, and combine this series with mine > prepare patches for Remus, and then send it out together? Go for it. I am happy with Davids corrections. ~Andrew > > On 05/12/2015 05:54 PM, David Vrabel w

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Stefano Stabellini
On Tue, 12 May 2015, Ian Campbell wrote: > On Tue, 2015-05-12 at 10:25 +0100, George Dunlap wrote: > > On 05/12/2015 10:16 AM, Stefano Stabellini wrote: > > > Signed-off-by: Stefano Stabellini > > > > What's the purpose of doing this? In particular it seems like having to > > manually update the

[Xen-devel] [PATCH] xen: blkif.h: document linux xen-block multi-page ring implementation

2015-05-12 Thread Bob Liu
After commit 1b1586eeeb8c ("xenbus_client: Extend interface to support multi-page ring"), Linux xenbus driver can support multi-page ring. Based on this interface, we got some impressive improvements by using multi-page ring in xen-block driver. If using 64 pages as the ring, the IOPS increased ab

Re: [Xen-devel] [PATCHv7 3/3] gnttab: use per-VCPU maptrack free lists

2015-05-12 Thread David Vrabel
On 05/05/15 13:34, Jan Beulich wrote: On 30.04.15 at 15:28, wrote: >> From: Malcolm Crossley >> >> Performance analysis of aggregate network throughput with many VMs >> shows that performance is signficantly limited by contention on the >> maptrack lock when obtaining/releasing maptrack hand

[Xen-devel] [PATCH 1/2] driver: xen-blkfront: move talk_to_blkback to the correct place

2015-05-12 Thread Bob Liu
The right place for talk_to_blkback() to query backend features and transport parameters is after backend entered XenbusStateInitWait. There is no problem with this yet, but it is an violation of the design and furthermore it would not allow frontend/backend to negotiate 'multi-page' and 'multi-que

[Xen-devel] [PATCH v3 2/2] xen/block: add multi-page ring support

2015-05-12 Thread Bob Liu
Extend xen/block to support multi-page ring, so that more requests can be issued by using more than one pages as the request ring between blkfront and backend. As a result, the performance can get improved significantly. We got some impressive improvements on our highend iscsi storage cluster bac

[Xen-devel] [OSSTEST PATCH 4/5] cr-disk-report: New script

2015-05-12 Thread Ian Jackson
This generates a report on the disk usage in the logs directory. --- .gitignore |2 + cr-disk-report | 336 2 files changed, 338 insertions(+) create mode 100755 cr-disk-report diff --git a/.gitignore b/.gitignore index 8dad470..5

[Xen-devel] [OSSTEST PATCH 0/6] Miscellaneous infrastructure fixes

2015-05-12 Thread Ian Jackson
This series contains a set of changes which probably ought to be force pushed; none of them would be properly tested by the self-push-gate. The most important one is: 2/5 cs-bisection-step: Detect flailing There's also a new doc: 1/5 README.planner: Document the resource planning And a new scr

[Xen-devel] [OSSTEST PATCH 1/5] README.planner: Document the resource planning system

2015-05-12 Thread Ian Jackson
Signed-off-by: Ian Jackson --- README.planner | 181 +++- 1 file changed, 180 insertions(+), 1 deletion(-) diff --git a/README.planner b/README.planner index de8b962..ec4dce8 100644 --- a/README.planner +++ b/README.planner @@ -1,4 +1,183 @@ -

[Xen-devel] [OSSTEST PATCH 2/5] cs-bisection-step: Detect flailing

2015-05-12 Thread Ian Jackson
Specifically, search for previous identical flights (on the same branch with the relevant blessings). Here `identical' means it has exactly the same set of runvars (and, hence, the same set of jobs, assuming each job has at least one runvar). This detects various forms of looping which aren't sto

[Xen-devel] [OSSTEST PATCH 3/5] Logs: Break out logs_select etc. into new Osstest::Management

2015-05-12 Thread Ian Jackson
We are going to want to reuse these minor bits of cr-ensure-disk-space. Break them out into a new perl module. We also need to rename some things to make them have names more suitable for a wider namespace, even if only selectively exported: * @logsshopts from @sshopts (it is not the same variab

[Xen-devel] [OSSTEST PATCH 5/5] Docs (in new Docs directory) for cr-disk-report

2015-05-12 Thread Ian Jackson
The PDF is automatically generated and linked to, when applicable. Signed-off-by: Ian Jackson --- .gitignore |2 + .../diskusage-LogsPublish_build=2damd64_.png | Bin 0 -> 154 bytes Docs/cr-disk-report/graph-meaning.fig | 40 +

Re: [Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Ian Jackson
Ian Campbell writes ("Re: [PATCH v4] OSSTEST: introduce a raisin build test"): > More generally this now ties everything together into one build job. I hadn't spotted that. I think this is very undesirable. > Currently while bisecting osstest can try and reuse e.g. the xen job > with a different

Re: [Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Stefano Stabellini
On Tue, 12 May 2015, Ian Campbell wrote: > On Tue, 2015-05-12 at 10:20 +0100, Stefano Stabellini wrote: > > Signed-off-by: Stefano Stabellini > > > > --- > > > > Changes in v4: > > - introduce enable_raisin in mfi-common: only build raisin when building > > xen-unstable > > - start off from the

[Xen-devel] [PATCH v4 04/14] libxc/migration: Pass checkpoint information into the save algorithm.

2015-05-12 Thread Yang Hongyang
From: Andrew Cooper Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Yang Hongyang --- tools/libxc/include/xenguest.h | 1 + tools/libxc/xc_sr_common.h | 3 +++ tools/libxc/xc_sr_save.c | 3 +++ tools/libxl/libxl_dom.c| 1 + 4 files changed, 8

[Xen-devel] [PATCH v4 13/14] libxc/restore: introduce process_record()

2015-05-12 Thread Yang Hongyang
Move record handle codes into a function process_record(). It will be used multiple times by Remus. No functional change. Signed-off-by: Yang Hongyang Reviewed-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxc/xc_sr_restore.c | 77 +---

[Xen-devel] [PATCH v4 11/14] libxc/save: rename send_some_pages to send_dirty_pages

2015-05-12 Thread Yang Hongyang
rename send_some_pages to send_dirty_pages, no functional change. Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Andrew Cooper --- tools/libxc/xc_sr_save.c | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/tools/libxc/xc_sr_save.c b/to

[Xen-devel] [PATCH v4 09/14] libxc/save: adjust the memory allocation for migration

2015-05-12 Thread Yang Hongyang
Move the memory allocation before the concrete live/nolive save in order to avoid the free/alloc memory loop when using Remus. Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Andrew Cooper --- tools/libxc/xc_sr_common.h | 1 + tools/libxc/xc_sr_save.c | 61 ++

[Xen-devel] [PATCH v4 05/14] tools/libxc: unused attribute in DECLARE_HYPERCALL_BUFFER_SHADOW

2015-05-12 Thread Yang Hongyang
There are cases that we only need to use the hypercall buffer data, and do not use the xc_hypercall_buffer_t struct. DECLARE_HYPERCALL_BUFFER_SHADOW define a user pointer that can allow us to access the hypercall buffer data but it also define a xc_hypercall_buffer_t that we don't use, the compiler

[Xen-devel] [PATCH v4 08/14] libxc/save: rename to_send to dirty_bitmap

2015-05-12 Thread Yang Hongyang
rename to_send to dirty_bitmap. Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Andrew Cooper --- tools/libxc/xc_sr_save.c | 22 +++--- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/tools/libxc/xc_sr_save.c b/tools/libxc/xc_sr_s

[Xen-devel] [PATCH v4 10/14] libxc/save: remove bitmap param from send_some_pages

2015-05-12 Thread Yang Hongyang
In last patch we added dirty bitmap to the save context, we no longer need to pass this param to send_some_pages. We can get dirty bitmap from the save context. 'entries' should stay as it is a useful sanity check. Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: A

[Xen-devel] [PATCH v4 07/14] libxc/save: introduce setup() and cleanup() on save

2015-05-12 Thread Yang Hongyang
introduce setup() and cleanup() which subsume the ctx->save.ops.{setup,cleanup}() calls. The SHADOW_OP_OFF hypercall also included in the cleanup(). Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Andrew Cooper --- tools/libxc/xc_sr_save.c | 35 +

[Xen-devel] [PATCH v4 06/14] tools/libxc: add a check in xc_hypercall_buffer_free_pages macro

2015-05-12 Thread Yang Hongyang
When we use a DECLARE_HYPERCALL_BUFFER_SHADOW define a user pointer '_name' and a shadow xc_hypercall_buffer_t. then call xc_hypercall_buffer_free_pages(_xch, _name, _nr), the complier will report '_name' unused error, it's because xc_hypercall_buffer_free_pages() is a MACRO and '_name' transparent

[Xen-devel] [PATCH v4 12/14] libxc/save: reuse send_dirty_pages() in send_all_pages()

2015-05-12 Thread Yang Hongyang
introduce bitmap_set() to set the entire bitmap. in send_all_pages(), set the entire bitmap and call send_dirty_pages(). Signed-off-by: Yang Hongyang Reviewed-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- tools/libxc/xc_bitops.h | 5 + tools/libxc/xc_sr_save.c | 44

[Xen-devel] [PATCH v4 00/14] Misc patches to aid migration v2 Remus support

2015-05-12 Thread Yang Hongyang
This is the combination of Andrew Cooper's misc patches and mine to aid migration v2 Remus support. See individual patches for details. Git tree available at: https://github.com/macrosheep/xen/tree/misc-remus-v4 Andrew Cooper (4): libxc/migration: Be rather stricter with illformed callers

[Xen-devel] [PATCH v4 01/14] libxc/migration: Be rather stricter with illformed callers

2015-05-12 Thread Yang Hongyang
From: Andrew Cooper The migration code itself should be able to validly assume all mandatory callbacks are set up. Signed-off-by: Andrew Cooper CC: Ian Campbell CC: Ian Jackson CC: Wei Liu CC: Yang Hongyang --- tools/libxc/xc_sr_save.c | 4 tools/libxc/xc_sr_save_x86_hvm.c | 7

[Xen-devel] [PATCH v4 03/14] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Yang Hongyang
From: Andrew Cooper Checkpointed streams need to signal the end of a consistent view of VM state, and the start of the libxl data. Signed-off-by: Andrew Cooper Signed-off-by: David Vrabel Signed-off-by: Yang Hongyang CC: Ian Campbell CC: Ian Jackson CC: Wei Liu --- docs/specs/libxc-migrat

[Xen-devel] [PATCH v4 02/14] libxc/save: Adjust stream-position callbacks for checkpointed streams

2015-05-12 Thread Yang Hongyang
From: Andrew Cooper There are some records which should only be sent once in the stream, and not repeated for each checkpoint. {start,end}_of_stream() become per-checkpoint, and a new start_of_stream() is introduced. There is no resulting change record order, but the X86_PV_INFO record is ident

[Xen-devel] [PATCH v4 14/14] libxc/restore: split read/handle qemu info

2015-05-12 Thread Yang Hongyang
Split read/handle qemu info. The receiving of qemu info should be done while we receive the migration stream, handle_qemu will be called when the stream complete. Otherwise, it will break Remus because read_record() won't read qemu info and stream_complete will be called at failover. Signed-off-by

[Xen-devel] [seabios test] 55291: tolerable FAIL - PUSHED

2015-05-12 Thread osstest service user
flight 55291 seabios real [real] http://logs.test-lab.xenproject.org/osstest/logs/55291/ Failures :-/ but no regressions. Regressions which are regarded as allowable (not blocking): test-amd64-i386-libvirt 11 guest-start fail REGR. vs. 52630 test-amd64-i386-xl-qemuu-win7-amd6

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Stefano Stabellini
On Tue, 12 May 2015, George Dunlap wrote: > On 05/12/2015 10:42 AM, Ian Campbell wrote: > > On Tue, 2015-05-12 at 10:25 +0100, George Dunlap wrote: > >> On 05/12/2015 10:16 AM, Stefano Stabellini wrote: > >>> Signed-off-by: Stefano Stabellini > >> > >> What's the purpose of doing this? In particu

Re: [Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 12:20 +0100, Stefano Stabellini wrote: > > We currently have build jobs for both normal and the XSM case. > > Duplicating the raisin jobs is also going to duplicate the build for > > everything else it builds, which might be wasteful? > > We could disable the raisin build if

Re: [Xen-devel] [PATCHv7 3/3] gnttab: use per-VCPU maptrack free lists

2015-05-12 Thread Jan Beulich
>>> On 12.05.15 at 13:01, wrote: > On 05/05/15 13:34, Jan Beulich wrote: > On 30.04.15 at 15:28, wrote: >>> @@ -1430,6 +1456,17 @@ gnttab_setup_table( >>> gt = d->grant_table; >>> write_lock(>->lock); >>> >>> +/* Tracking of mapped foreign frames table */ >>> +if ( (gt->ma

Re: [Xen-devel] [V4] x86/cpuidle: get accurate C0 value with xenpm tool

2015-05-12 Thread Jan Beulich
>>> On 11.05.15 at 16:12, wrote: > On Mon, 2015-05-11 at 12:10 +0100, Jan Beulich wrote: >> >>> On 11.05.15 at 11:34, wrote: >> > @@ -1203,16 +1226,18 @@ int pmstat_get_cx_stat(uint32_t cpuid, struct >> > pm_cx_stat *stat) >> > >> > stat->nr = power->count; >> > >> > +spin_l

Re: [Xen-devel] about xenalyze

2015-05-12 Thread Dario Faggioli
On Tue, 2015-05-12 at 11:37 +0100, Lars Kurth wrote: > George, > > given that this question is coming up occasionally, I was going to create a > wiki page. I can't find xenalyze.html and xenalyse on xenbuts though > > I can find > * https://github.com/nikmis/xentrace-analysis - but that does no

Re: [Xen-devel] [PATCH v4] OSSTEST: introduce a raisin build test

2015-05-12 Thread Stefano Stabellini
On Tue, 12 May 2015, Ian Campbell wrote: > On Tue, 2015-05-12 at 12:20 +0100, Stefano Stabellini wrote: > > > > We currently have build jobs for both normal and the XSM case. > > > Duplicating the raisin jobs is also going to duplicate the build for > > > everything else it builds, which might be

Re: [Xen-devel] [PATCH v4 07/14] libxc/save: introduce setup() and cleanup() on save

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > introduce setup() and cleanup() which subsume the > ctx->save.ops.{setup,cleanup}() calls. > The SHADOW_OP_OFF hypercall also included in the cleanup(). > > Signed-off-by: Yang Hongyang > CC: Ian Campbell > CC: Ian Jackson > CC: Wei Liu > CC: Andrew Coo

Re: [Xen-devel] [PATCH v4 06/14] tools/libxc: add a check in xc_hypercall_buffer_free_pages macro

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > When we use a DECLARE_HYPERCALL_BUFFER_SHADOW define a user > pointer '_name' and a shadow xc_hypercall_buffer_t. > then call xc_hypercall_buffer_free_pages(_xch, _name, _nr), > the complier will report '_name' unused error, it's because > xc_hypercall_buff

Re: [Xen-devel] [PATCH v4 08/14] libxc/save: rename to_send to dirty_bitmap

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > rename to_send to dirty_bitmap. > > Signed-off-by: Yang Hongyang > CC: Ian Campbell > CC: Ian Jackson > CC: Wei Liu > CC: Andrew Cooper Reviewed-by: Andrew Cooper > --- > tools/libxc/xc_sr_save.c | 22 +++--- > 1 file changed, 11 in

Re: [Xen-devel] [PATCH v4 03/14] libxc/migration: Specification update for CHECKPOINT records

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > From: Andrew Cooper > > Checkpointed streams need to signal the end of a consistent view of VM state, > and the start of the libxl data. > > Signed-off-by: Andrew Cooper > Signed-off-by: David Vrabel > Signed-off-by: Yang Hongyang > CC: Ian Campbell >

Re: [Xen-devel] [PATCH v4 09/14] libxc/save: adjust the memory allocation for migration

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > Move the memory allocation before the concrete live/nolive save > in order to avoid the free/alloc memory loop when using Remus. > > Signed-off-by: Yang Hongyang > CC: Ian Campbell > CC: Ian Jackson > CC: Wei Liu > CC: Andrew Cooper > --- > tools/libx

Re: [Xen-devel] [PATCH v4 11/14] libxc/save: rename send_some_pages to send_dirty_pages

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > rename send_some_pages to send_dirty_pages, no functional change. > > Signed-off-by: Yang Hongyang > CC: Ian Campbell > CC: Ian Jackson > CC: Wei Liu > CC: Andrew Cooper Reviewed-by: Andrew Cooper > --- > tools/libxc/xc_sr_save.c | 8 > 1

Re: [Xen-devel] [PATCH v4 10/14] libxc/save: remove bitmap param from send_some_pages

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > In last patch we added dirty bitmap to the save context, > we no longer need to pass this param to send_some_pages. > We can get dirty bitmap from the save context. > 'entries' should stay as it is a useful sanity check. > > Signed-off-by: Yang Hongyang >

Re: [Xen-devel] [PATCH v4 12/14] libxc/save: reuse send_dirty_pages() in send_all_pages()

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > introduce bitmap_set() to set the entire bitmap. > in send_all_pages(), set the entire bitmap and call send_dirty_pages(). > > Signed-off-by: Yang Hongyang > Reviewed-by: Andrew Cooper > CC: Ian Campbell > CC: Ian Jackson > CC: Wei Liu > --- > tools/l

Re: [Xen-devel] [PATCH v4 14/14] libxc/restore: split read/handle qemu info

2015-05-12 Thread Andrew Cooper
On 12/05/15 12:25, Yang Hongyang wrote: > Split read/handle qemu info. The receiving of qemu info > should be done while we receive the migration stream, > handle_qemu will be called when the stream complete. > Otherwise, it will break Remus because read_record() > won't read qemu info and stream_c

Re: [Xen-devel] [PATCH] raisin: update defaults according to the current content of Config.mk

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 12:31 +0100, Stefano Stabellini wrote: > > But wrt raisin, does it make sense to have the specific changesets we're > > looking at mixed in with the updates to raisin itself, particularly in > > its infancy, where the functionality will be in flux quite a bit? > > > > If xenp

Re: [Xen-devel] [linux-linus test] 55255: regressions - FAIL

2015-05-12 Thread Julien Grall
On 12/05/15 11:07, Ian Campbell wrote: > On Mon, 2015-05-11 at 18:09 +, osstest service user wrote: >> flight 55255 linux-linus real [real] >> http://logs.test-lab.xenproject.org/osstest/logs/55255/ >> >> Regressions :-( >> >> Tests which did not succeed and are blocking, >> including tests whi

Re: [Xen-devel] [PATCHv7 3/3] gnttab: use per-VCPU maptrack free lists

2015-05-12 Thread David Vrabel
On 12/05/15 12:37, Jan Beulich wrote: On 12.05.15 at 13:01, wrote: >> On 05/05/15 13:34, Jan Beulich wrote: >> On 30.04.15 at 15:28, wrote: @@ -1430,6 +1456,17 @@ gnttab_setup_table( gt = d->grant_table; write_lock(>->lock); +/* Tracking of mapped

Re: [Xen-devel] [linux-linus test] 55255: regressions - FAIL

2015-05-12 Thread Ian Campbell
On Tue, 2015-05-12 at 13:35 +0100, Julien Grall wrote: > On 12/05/15 11:07, Ian Campbell wrote: > > On Mon, 2015-05-11 at 18:09 +, osstest service user wrote: > >> flight 55255 linux-linus real [real] > >> http://logs.test-lab.xenproject.org/osstest/logs/55255/ > >> > >> Regressions :-( > >> >

Re: [Xen-devel] [PATCHv7 3/3] gnttab: use per-VCPU maptrack free lists

2015-05-12 Thread Jan Beulich
>>> On 12.05.15 at 14:37, wrote: > On 12/05/15 12:37, Jan Beulich wrote: > On 12.05.15 at 13:01, wrote: >>> On 05/05/15 13:34, Jan Beulich wrote: >>> On 30.04.15 at 15:28, wrote: > @@ -1430,6 +1456,17 @@ gnttab_setup_table( > gt = d->grant_table; > write_lock(>->loc

[Xen-devel] [PATCH v2] xen: cpupools: avoid crashing if shutting down with free CPUs

2015-05-12 Thread Dario Faggioli
in fact, before this change, shutting down or suspending the system with some CPUs not assigned to any cpupool, would crash as follows: (XEN) Xen call trace: (XEN)[] disable_nonboot_cpus+0xb5/0x138 (XEN)[] enter_state_helper+0xbd/0x369 (XEN)[] continue_hypercall_tasklet_handler

Re: [Xen-devel] [linux-linus test] 55255: regressions - FAIL

2015-05-12 Thread Julien Grall
On 12/05/15 13:53, Ian Campbell wrote: > On Tue, 2015-05-12 at 13:35 +0100, Julien Grall wrote: >> On 12/05/15 11:07, Ian Campbell wrote: >>> On Mon, 2015-05-11 at 18:09 +, osstest service user wrote: flight 55255 linux-linus real [real] http://logs.test-lab.xenproject.org/osstest/log

Re: [Xen-devel] [PATCH v7 0/6] xen/arm: Add support for non-PCI passthrough

2015-05-12 Thread Andrii Anisov
Julien, You did miss the libxl_libfdt_compat.h file in this patch series. Andrii Anisov | Team Lead GlobalLogic Kyiv, 03038, Protasov Business Park, M.Grinchenka, 2/1 P +38.044.492.9695x3664 M +380505738852 S andriyanisov www.globallogic.com http://www.globallog

Re: [Xen-devel] Regression: qemu crash of hvm domUs with spice (backtrace included)

2015-05-12 Thread Fabio Fantoni
Il 12/05/2015 12:26, Fabio Fantoni ha scritto: Il 12/05/2015 11:23, Fabio Fantoni ha scritto: Il 11/05/2015 17:04, Fabio Fantoni ha scritto: Il 21/04/2015 14:53, Stefano Stabellini ha scritto: On Tue, 21 Apr 2015, Fabio Fantoni wrote: Il 21/04/2015 12:49, Stefano Stabellini ha scritto: On Mo

Re: [Xen-devel] [PATCH] xen-netfront: reset skb transport header before checksum

2015-05-12 Thread Venkat Venkatsubra
> > This looks bogus for IPv6. > > I would rather fix skb_checksum_setup_ip() and > skb_checksum_setup_ipv6(), since you already use correctly > skb_maybe_pull_tail() there. > > In general, setting network and transport header at this point seems > extra work. > Yes, I missed the IPv6 case. ;-

[Xen-devel] [PATCH v4] xen: sched_rt: print useful affinity info when dumping

2015-05-12 Thread Dario Faggioli
In fact, printing the cpupool's CPU online mask for each vCPU is just redundant, as that is the same for all the vCPUs of all the domains in the same cpupool, while hard affinity is already part of the output of dumping domains info. Instead, print the intersection between hard affinity and online

Re: [Xen-devel] [PATCH v7 0/6] xen/arm: Add support for non-PCI passthrough

2015-05-12 Thread Julien Grall
On 12/05/15 14:46, Andrii Anisov wrote: > Julien, Hi Andrii, > > You did miss the libxl_libfdt_compat.h file in this patch series. Hmmm... I though I did a git add on the file but apparently not. I've copy the content of the file below. I will resend a new version quickly. Regards, /* * Cop

  1   2   3   >