[Xen-devel] [ovmf baseline-only test] 38276: regressions - FAIL
This run is configured for baseline tests only. flight 38276 ovmf real [real] http://osstest.xs.citrite.net/~osstest/testlogs/logs/38276/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-xl-qemuu-ovmf-amd64 16 guest-localmigrate/x10 fail REGR. vs. 38273 version targeted for testing: ovmf 0c9a522f28772049ae37c85b8ae589a98d2d3b81 baseline version: ovmf d6cc284e6f9d2e303a81b3ee8a167eb7252ca54c Last test of basis38273 2015-11-13 05:20:25 Z1 days Testing same since38276 2015-11-14 06:21:16 Z0 days1 attempts People who touched revisions under test: Ard Biesheuvel Leif Lindholm Ruiyu Ni Tim He jobs: build-amd64-xsm pass build-i386-xsm pass build-amd64 pass build-i386 pass build-amd64-libvirt pass build-i386-libvirt pass build-amd64-pvopspass build-i386-pvops pass test-amd64-amd64-xl-qemuu-ovmf-amd64 pass test-amd64-i386-xl-qemuu-ovmf-amd64 fail sg-report-flight on osstest.xs.citrite.net logs: /home/osstest/logs images: /home/osstest/images Logs, config files, etc. are available at http://osstest.xs.citrite.net/~osstest/testlogs/logs Test harness code can be found at http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary Push not applicable. commit 0c9a522f28772049ae37c85b8ae589a98d2d3b81 Author: Ard Biesheuvel Date: Thu Nov 12 11:40:57 2015 + ArmPkg/ArmLib: mark all cached mappings as (inner) shareable Mark all cached memory mappings as shareable (or inner shareable on AArch64) so that our view of memory is kept coherent by the hardware. This is relevant for things like coherent DMA and virtualization (where a guest may migrate to another core) but in general, since UEFI on ARM is mostly used in a context where the secure firmware and possibly a secure OS are already up and running, it is best to refrain from using any non-shareable mappings. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel Reviewed-by: Leif Lindholm git-svn-id: https://svn.code.sf.net/p/edk2/code/trunk/edk2@18778 6f19259b-4bc3-4df7-8a09-765794883524 commit 83586b5d50f10a57d02233c066a92cb88718f5a1 Author: Tim He Date: Thu Nov 12 08:33:12 2015 + Vlv2TbltDevicePkg: Sync the branch changes to Trunk, Add 'yL' build option to enable SPI lock for MinnowBoard Max. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Tim He Reviewed-by: David Wei git-svn-id: https://svn.code.sf.net/p/edk2/code/trunk/edk2@18777 6f19259b-4bc3-4df7-8a09-765794883524 commit 0ce8410ed7f1a1537707e87198cfc2460ec1fecb Author: Ard Biesheuvel Date: Thu Nov 12 07:29:21 2015 + ArmPlatformPkg: bring DS-5 scripts in line with linker script changes The ARM and AARCH64 linker scripts have recently been updated so that the memory layouts of the ELF and PE/COFF versions of each module are identical. In particular, this means that the ELF images now have a hole before the first section rather than starting at offset 0x0, which means we no longer have to correct for this difference when loading the ELF image into the debugger. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel Acked-by: Leif Lindholm git-svn-id: https://svn.code.sf.net/p/edk2/code/trunk/edk2@18775 6f19259b-4bc3-4df7-8a09-765794883524 commit b3535ab4ef6e7d05ac9ffbb0bda8bade4e15a3d4 Author: Ruiyu Ni Date: Thu Nov 12 07:14:40 2015 + MdeModulePkg/BmpImageDecoderLib: Support ImageFormatUnknown type Enhance the library to handle unknown image format. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ruiyu Ni Reviewed-by: Feng Tian git-svn-id: https://svn.code.sf.net/p/edk2/code/trunk/edk2@18774 6f19259b-4bc3-4df7-8a09-765794883524 commit 859e75c4fc42260fdd405141d8a3b909d03809f7 Author: Ruiyu Ni Date: Thu Nov 12 05:39:39 2015 + Nt32Pkg: Use BootLogoLib for logo and progress bar drawing. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ruiyu Ni Reviewed-by: Jordan Justen Reviewed-by: Eric Dong git-svn-id: https://sv
[Xen-devel] [distros-debian-stretch test] 38277: tolerable FAIL
flight 38277 distros-debian-stretch real [real] http://osstest.xs.citrite.net/~osstest/testlogs/logs/38277/ Failures :-/ but no regressions. Tests which did not succeed, but are not blocking: test-armhf-armhf-armhf-stretch-netboot-pygrub 12 saverestore-support-check fail never pass test-armhf-armhf-armhf-stretch-netboot-pygrub 11 migrate-support-check fail never pass test-amd64-amd64-amd64-stretch-netboot-pvgrub 13 guest-saverestore fail never pass test-amd64-i386-amd64-stretch-netboot-pygrub 13 guest-saverestore fail never pass baseline version: flight 38258 jobs: build-amd64 pass build-armhf pass build-i386 pass build-amd64-pvopspass build-armhf-pvopspass build-i386-pvops pass test-amd64-amd64-amd64-stretch-netboot-pvgrubfail test-amd64-i386-i386-stretch-netboot-pvgrub pass test-amd64-i386-amd64-stretch-netboot-pygrub fail test-armhf-armhf-armhf-stretch-netboot-pygrubpass test-amd64-amd64-i386-stretch-netboot-pygrub pass sg-report-flight on osstest.xs.citrite.net logs: /home/osstest/logs images: /home/osstest/images Logs, config files, etc. are available at http://osstest.xs.citrite.net/~osstest/testlogs/logs Test harness code can be found at http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary Push not applicable. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
[Xen-devel] [linux-3.4 test] 64184: regressions - FAIL
flight 64184 linux-3.4 real [real] http://logs.test-lab.xenproject.org/osstest/logs/64184/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-xl-qemuu-debianhvm-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-rumpuserxen-i386 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-qemuu-rhel6hvm-intel 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-qemut-rhel6hvm-intel 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-freebsd10-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-qemuu-debianhvm-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-xl6 xen-boot fail REGR. vs. 62277 test-amd64-i386-xl-qemuu-ovmf-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-multivcpu 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-qemuu-ovmf-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-xl-qemut-debianhvm-amd64 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-xsm 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-xl-qemut-winxpsp3 6 xen-bootfail REGR. vs. 62277 test-amd64-i386-xl-qemuu-winxpsp3 6 xen-boot fail REGR. vs. 62277 Tests which are failing intermittently (not blocking): test-amd64-amd64-amd64-pvgrub 3 host-install(3) broken in 63294 pass in 64184 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 3 host-install(3) broken in 63294 pass in 64184 test-amd64-i386-qemuu-rhel6hvm-amd 3 host-install(3) broken in 63294 pass in 64184 test-amd64-amd64-xl-qemuu-winxpsp3 3 host-install(3) broken in 63294 pass in 64184 test-amd64-amd64-xl-qcow2 3 host-install(3) broken in 63310 pass in 64184 test-amd64-i386-xl-xsm3 host-install(3) broken in 63310 pass in 64184 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 3 host-install(3) broken in 63310 pass in 64184 test-amd64-amd64-xl-qemut-winxpsp3 3 host-install(3) broken in 63310 pass in 64184 test-amd64-i386-xl-raw3 host-install(3) broken in 63324 pass in 64184 test-amd64-amd64-xl-credit2 3 host-install(3) broken in 63324 pass in 64184 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 3 host-install(3) broken in 63324 pass in 64184 test-amd64-i386-qemut-rhel6hvm-amd 3 host-install(3) broken in 63324 pass in 64184 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail in 63310 pass in 63997 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail in 63997 pass in 63294 test-amd64-amd64-xl-rtds 6 xen-bootfail pass in 63228 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 6 xen-boot fail pass in 63228 test-amd64-amd64-i386-pvgrub 6 xen-bootfail pass in 63294 test-amd64-i386-pair 10 xen-boot/dst_host fail pass in 63310 test-amd64-i386-pair 9 xen-boot/src_host fail pass in 63310 test-amd64-amd64-libvirt-pair 10 xen-boot/dst_host fail pass in 63310 test-amd64-amd64-libvirt-pair 9 xen-boot/src_host fail pass in 63310 test-amd64-amd64-amd64-pvgrub 6 xen-boot fail pass in 63324 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail pass in 63324 test-amd64-amd64-xl-qcow2 6 xen-bootfail pass in 63338 test-amd64-i386-libvirt-pair 10 xen-boot/dst_host fail pass in 63374 test-amd64-i386-libvirt-pair 9 xen-boot/src_host fail pass in 63374 test-amd64-amd64-pair10 xen-boot/dst_host fail pass in 63404 test-amd64-amd64-pair 9 xen-boot/src_host fail pass in 63404 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 63997 Regressions which are regarded as allowable (not blocking): test-amd64-i386-libvirt-xsm 6 xen-boot fail REGR. vs. 62277 test-amd64-amd64-libvirt-xsm 6 xen-boot fail REGR. vs. 62277 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail in 63228 blocked in 62277 test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail in 63228 like 62277 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 62277 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail like 62277 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail like 62277 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 62277 Tests which did not succeed, but are not blocking: test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail in 63228 never pass test-amd64-amd64-xl-pvh-amd 11 guest-start
[Xen-devel] [linux-3.10 test] 64187: regressions - FAIL
flight 64187 linux-3.10 real [real] http://logs.test-lab.xenproject.org/osstest/logs/64187/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: build-armhf-pvops 5 kernel-build fail REGR. vs. 62642 Tests which are failing intermittently (not blocking): test-amd64-amd64-xl-qemuu-ovmf-amd64 9 debian-hvm-install fail in 64136 pass in 64187 test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail pass in 64001 test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail pass in 64136 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 64136 Regressions which are regarded as allowable (not blocking): test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail in 64136 like 62642 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 62642 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail like 62642 Tests which did not succeed, but are not blocking: test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass test-amd64-amd64-libvirt 12 migrate-support-checkfail never pass test-amd64-i386-libvirt 12 migrate-support-checkfail never pass test-amd64-i386-libvirt-xsm 12 migrate-support-checkfail never pass test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass test-amd64-amd64-libvirt-xsm 12 migrate-support-checkfail never pass test-amd64-amd64-libvirt-vhd 11 migrate-support-checkfail never pass test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail never pass test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass version targeted for testing: linuxbdf8cfb859e9cd265ec1696d9e007fac66e7aea7 baseline version: linuxf5552cd830e58c46dffae3617b3ce0c839771981 Last test of basis62642 2015-10-03 17:59:45 Z 42 days Failing since 63224 2015-10-22 22:20:05 Z 22 days 17 attempts Testing same since64001 2015-11-10 00:11:01 Z4 days3 attempts People who touched revisions under test: "Eric W. Biederman" Aaron Conole Adam Radford Al Viro Alexander Couzens Alexey Klimov Andi Kleen Andreas Schwab Andrew Morton Ard Biesheuvel Arnaldo Carvalho de Melo Ben Hutchings Ben Skeggs Cathy Avery Charles Keepax Christoph Biedl Christoph Hellwig cov...@ccs.covici.com Daniel Vetter Daniel Vetter Dave Kleikamp David S. Miller David Vrabel David Woodhouse David Woodhouse Ding Tianhong dingtianhong Dirk Mueller Dirk Müller Doron Tsur Doug Ledford DÄvis MosÄns Eric Dumazet Eric W. Biederman Felix Fietkau G. Richard Bellamy Geert Uytterhoeven Greg Kroah-Hartman Guenter Roeck Guillaume Nault H. Peter Anvin Herbert Xu Ian Abbott Ilia Mirkin Ilya Dryomov Ingo Molnar James Bottomley James Chapman James Hogan Jan Kara Jan Kara Jann Horn Jarkko Nikula Jeff Mahoney Jes Sorensen Jiri Slaby Joe Perches Joe Stringer Joe Thornber Joe Thornber Joerg Roedel Johan Hovold Johannes Berg John Covici Julian Anastasov Kalle Valo Kees Cook Konrad Rzeszutek Wilk Linus Torvalds Liu.Zhao Luca Coelho Mark Brown Mark Salyzyn Matan Barak Mathias Nyman Mel Gorman Michael Ellerman Michal Hocko Michel Stam Mike Marciniszyn Mike Snitzer Mikulas Patocka Namhyung Kim NeilBrown Nicolas Pitre Nikolay Aleksandrov Oleksii Berezhniak Pablo Neira Ayuso Paolo Bonzini Paul Bolle Paul Mackerras Paul Mackerras Peter Zijlstra (Intel) Peter Zijlstra Pravin B Shelar Ralf Baechle Reyad Attiyat Richard Weinberger Riku Voipio Riley Andrews Robert Jarzmik Roger Quadros Roland Dreier Ronny Hegewald Russell King Rusty Russell Samuel Thibault Shaohua Li Sheng Yong shengyong Simon Horman Stephen Smalley Steve French Steve French Takashi Iwai Tan, Jui Nee Tejun Heo Thomas Gleixner Tom Herbert Tóth Attila Vasant Hegde Vincent Palatin Vitaly Kuznetsov Will Deacon Wolfram Sang Wolfram Sang Yao-Wen Mao Yitian Bu Yitian Bu Zhang Zhen jobs: build-amd64-xsm pass build-armhf-xsm pass build-i386-xsm pass build-amd64 pass build-armhf
Re: [Xen-devel] HVM domains crash after upgrade from XEN 4.5.1 to 4.5.2
On 14/11/2015 00:16, Atom2 wrote: > Am 13.11.15 um 11:09 schrieb Andrew Cooper: >> On 13/11/15 07:25, Jan Beulich wrote: >> On 13.11.15 at 00:00, wrote: Am 12.11.15 um 17:43 schrieb Andrew Cooper: > On 12/11/15 14:29, Atom2 wrote: >> Hi Andrew, >> thanks for your reply. Answers are inline further down. >> >> Am 12.11.15 um 14:01 schrieb Andrew Cooper: >>> On 12/11/15 12:52, Jan Beulich wrote: >>> On 12.11.15 at 02:08, wrote: > After the upgrade HVM domUs appear to no longer work - regardless > of the > dom0 kernel (tested with both 3.18.9 and 4.1.7 as the dom0 kernel); PV > domUs, however, work just fine as before on both dom0 kernels. > > xl dmesg shows the following information after the first crashed HVM > domU which is started as part of the machine booting up: > [...] > (XEN) Failed vm entry (exit reason 0x8021) caused by invalid guest > state (0). > (XEN) * VMCS Area ** > (XEN) *** Guest State *** > (XEN) CR0: actual=0x0039, shadow=0x0011, > gh_mask= > (XEN) CR4: actual=0x2050, shadow=0x, > gh_mask= > (XEN) CR3: actual=0x0080, target_count=0 > (XEN) target0=, target1= > (XEN) target2=, target3= > (XEN) RSP = 0x6fdc (0x6fdc) RIP = > 0x0001 (0x0001) Other than RIP looking odd for a guest still in non-paged protected mode I can't seem to spot anything wrong with guest state. >>> odd? That will be the source of the failure. >>> >>> Out of long mode, the upper 32bit of %rip should all be zero, and it >>> should not be possible to set any of them. >>> >>> I suspect that the guest has exited for emulation, and there has been a >>> bad update to %rip. The alternative (which I hope is not the case) is >>> that there is a hardware errata which allows the guest to accidentally >>> get it self into this condition. >>> >>> Are you able to rerun with a debug build of the hypervisor? >> [snip] >> Another question is whether prior to enabling the debug USE flag it >> might make sense to re-compile with gcc-4.8.5 (please see my previous >> list reply) to rule out any compiler related issues. Jan, Andrew - >> what are your thoughts? > First of all, check whether the compiler makes a difference on 4.5.2 Hi Andrew, I changed the compiler and there was no change to the better: Unfortunately the HVM domU is still crashing with a similar error message as soon as it is being started. > If both compiles result in a guest crashing in that manner, test a debug > Xen to see if any assertions/errors are encountered just before the > guest crashes. > As the compiler did not make any difference, I enabled the debug USE flag, re-compiled (using gcc-4.9.3), and rebooted using a serial console to capture output. Unfortunately I did not get very far and things become even stranger: This time the system did not even finnish the boot process, but rather hard-stopped pretty early with a message reading "Panic on CPU 3: DOUBLE FAULT -- system shutdown". The captured logfile is attached as "serial log.txt". As this happened immediately after the CPU microcode update, I thought there might be a connection and disabled the microcode update. After the next reboot it seemed as if the boot process got a bit further as evidenced by a few more lines in the log file (those between lines 136 and 197 in the second log file named "serial log no ucode.txt"), but in the end it finnished off with an identical error message (only the CPU # was different this time, but that number seems to change between boots anyways). I hope that makes some sense to you. >>> Not really, other than now even more suspecting bad hardware or >>> something fundamentally wrong with your build. Did you retry with >>> a freshly built 4.5.1? Could you alternatively try with a known good >>> build of 4.5.2 (e.g. from osstest)? > Andrew, > many thanks again for your help. >> Agreed. Double faults indicate that the exception handing entry points >> are not set up in an appropriate state. Something is definitely wrong >> with either the compiled binary or the hardware. > The hardware (it's a SandyBridge XEON processor with ECC RAM and > Enterprise SATA disks) has worked for almost two years together with > XEN and other than this issue there's also currently nothing strange > (i.e. if I boot with a standard linux kernel, the system boots and > works without any issues and is very stable and there are also no
[Xen-devel] [linux-next test] 64194: regressions - FAIL
flight 64194 linux-next real [real] http://logs.test-lab.xenproject.org/osstest/logs/64194/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-xl-pvh-amd 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-multivcpu 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-pygrub 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-i386-pvgrub 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemuu-debianhvm-amd64 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemuu-ovmf-amd64 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemut-debianhvm-amd64 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-rumpuserxen-amd64 6 xen-bootfail REGR. vs. 64026 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qcow2 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemuu-win7-amd64 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemut-win7-amd64 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-qemuu-winxpsp3 6 xen-bootfail REGR. vs. 64026 test-amd64-amd64-amd64-pvgrub 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-xl-credit2 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-pair10 xen-boot/dst_host fail REGR. vs. 64026 test-amd64-amd64-pair 9 xen-boot/src_host fail REGR. vs. 64026 test-amd64-amd64-xl-qemut-winxpsp3 6 xen-bootfail REGR. vs. 64026 test-amd64-amd64-xl-pvh-intel 6 xen-boot fail REGR. vs. 64026 Regressions which are regarded as allowable (not blocking): test-amd64-amd64-libvirt-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-libvirt 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-libvirt-vhd 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64026 test-amd64-amd64-libvirt-pair 10 xen-boot/dst_hostfail REGR. vs. 64026 test-amd64-amd64-libvirt-pair 9 xen-boot/src_hostfail REGR. vs. 64026 test-amd64-amd64-xl-rtds 6 xen-boot fail REGR. vs. 64026 test-armhf-armhf-xl-rtds 11 guest-start fail blocked in 64026 test-amd64-i386-xl6 xen-boot fail like 64026 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail like 64026 test-amd64-i386-libvirt-xsm 6 xen-boot fail like 64026 test-amd64-i386-freebsd10-amd64 6 xen-bootfail like 64026 test-amd64-i386-qemut-rhel6hvm-intel 6 xen-boot fail like 64026 test-amd64-i386-xl-qemut-debianhvm-amd64 6 xen-boot fail like 64026 test-amd64-i386-xl-raw6 xen-boot fail like 64026 test-amd64-i386-freebsd10-i386 6 xen-boot fail like 64026 test-amd64-i386-xl-qemut-winxpsp3 6 xen-boot fail like 64026 test-amd64-i386-xl-qemut-winxpsp3-vcpus1 6 xen-boot fail like 64026 test-amd64-i386-xl-qemuu-win7-amd64 6 xen-bootfail like 64026 test-amd64-i386-xl-qemuu-debianhvm-amd64 6 xen-boot fail like 64026 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail like 64026 test-amd64-i386-xl-qemuu-ovmf-amd64 6 xen-bootfail like 64026 test-amd64-i386-xl-qemut-win7-amd64 6 xen-bootfail like 64026 test-amd64-i386-libvirt 6 xen-boot fail like 64026 test-amd64-i386-rumpuserxen-i386 6 xen-boot fail like 64026 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 6 xen-boot fail like 64026 test-amd64-i386-xl-xsm6 xen-boot fail like 64026 test-amd64-i386-qemut-rhel6hvm-amd 6 xen-boot fail like 64026 test-amd64-i386-qemuu-rhel6hvm-amd 6 xen-boot fail like 64026 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 6 xen-boot fail like 64026 test-amd64-i386-libvirt-pair 10 xen-boot/dst_hostfail like 64026 test-amd64-i386-libvirt-pair 9 xen-boot/src_hostfail like 64026 test-amd64-i386-pair 10 xen-boot/dst_hostfail like 64026 test-amd64-i386-pair 9 xen-boot/src_hostfail like 64026 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 6 xen-boot fail like 64026 test-amd64-i386-qemuu-rhel6hvm-intel 6 xen-boot fail like 64026 test-am
Re: [Xen-devel] HVM domains crash after upgrade from XEN 4.5.1 to 4.5.2
Am 14.11.15 um 21:32 schrieb Andrew Cooper: On 14/11/2015 00:16, Atom2 wrote: Am 13.11.15 um 11:09 schrieb Andrew Cooper: On 13/11/15 07:25, Jan Beulich wrote: On 13.11.15 at 00:00, wrote: Am 12.11.15 um 17:43 schrieb Andrew Cooper: On 12/11/15 14:29, Atom2 wrote: Hi Andrew, thanks for your reply. Answers are inline further down. Am 12.11.15 um 14:01 schrieb Andrew Cooper: On 12/11/15 12:52, Jan Beulich wrote: On 12.11.15 at 02:08, wrote: After the upgrade HVM domUs appear to no longer work - regardless of the dom0 kernel (tested with both 3.18.9 and 4.1.7 as the dom0 kernel); PV domUs, however, work just fine as before on both dom0 kernels. xl dmesg shows the following information after the first crashed HVM domU which is started as part of the machine booting up: [...] (XEN) Failed vm entry (exit reason 0x8021) caused by invalid guest state (0). (XEN) * VMCS Area ** (XEN) *** Guest State *** (XEN) CR0: actual=0x0039, shadow=0x0011, gh_mask= (XEN) CR4: actual=0x2050, shadow=0x, gh_mask= (XEN) CR3: actual=0x0080, target_count=0 (XEN) target0=, target1= (XEN) target2=, target3= (XEN) RSP = 0x6fdc (0x6fdc) RIP = 0x0001 (0x0001) Other than RIP looking odd for a guest still in non-paged protected mode I can't seem to spot anything wrong with guest state. odd? That will be the source of the failure. Out of long mode, the upper 32bit of %rip should all be zero, and it should not be possible to set any of them. I suspect that the guest has exited for emulation, and there has been a bad update to %rip. The alternative (which I hope is not the case) is that there is a hardware errata which allows the guest to accidentally get it self into this condition. Are you able to rerun with a debug build of the hypervisor? [big snip] Now _without_ the debug USE flag, but with debug information in the binary (I used splitdebug), all is back to where the problem started off (i.e. the system boots without issues until such time it starts a HVM domU which then crashes; PV domUs are working). I have attached the latest "xl dmesg" output with the timing information included. I hope any of this makes sense to you. Again many thanks and best regards Right - it would appear that the USE flag is definitely not what you wanted, and causes bad compilation for Xen. The do_IRQ disassembly you sent is a the result of disassembling a whole block of zeroes. Sorry for leading you on a goose chase - the double faults will be the product of bad compilation, rather than anything to do with your specific problem. Hi Andrew, there's absolutely no need to appologize as it is me who asked for help and you who generously stepped in and provided it. I really do appreciate your help and it is for me, as the one seeking help, to provide all the information you deem necessary and you ask for. However, the final log you sent (dmesg) is using a debug Xen, which is what I was attempting to get you to do originally. Next time I know better how to arrive at a debug XEN. It's all about learning. We still observe that the VM ends up in 32bit non-paged mode but with an RIP with bit 32 set, which is an invalid state to be in. However, there was nothing particularly interesting in the extra log information. Please can you rerun with "hvm_debug=0xc3f", which will cause far more logging to occur to the console while the HVM guest is running. That might show some hints. I haven't done that yet - but please see my next paragraph. If you are still interested in this, for whatever reason, I am clearly more than happy to rerun with your suggested option and provide that information as well. Also, the fact that this occurs just after starting SeaBIOS is interesting. As you have switched versions of Xen, you have also switched hvmloader, which contains the SeaBIOS binary embedded in it. Would you be able to compile both 4.5.1 and 4.5.2 and switch the hvmloader binaries in use. It would be very interesting to see whether the failure is caused by the hvmloader binary or the hypervisor. (With `xl`, you can use firmware_override="/full/path/to/firmware" to override the default hvmloader). Your analysis was absolutely spot on. After re-thinking this for a moment, I thought going down that route first would make a lot of sense as PV guests still do work and one of the differences to HVM domUs is that the former do _not_ require SeaBIOS. Looking at my log files of installed packages confirmed an upgrade from SeaBIOS 1.7.5 to 1.8.2 in the relevant timeframe which obviously had not made it to the hvmloader of xen-4.5.1 as I did not re-compile xen after the upgrade of SeaBIOS. So I re-compiled xen-4.5.1 (obviously now usin
[Xen-devel] [linux-linus test] 64197: regressions - FAIL
flight 64197 linux-linus real [real] http://logs.test-lab.xenproject.org/osstest/logs/64197/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-rumpuserxen-i386 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl6 xen-boot fail REGR. vs. 59254 test-amd64-i386-qemut-rhel6hvm-intel 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-qemuu-rhel6hvm-intel 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-qemut-rhel6hvm-amd 6 xen-bootfail REGR. vs. 59254 test-amd64-i386-xl-xsm6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemuu-ovmf-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemut-debianhvm-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemuu-debianhvm-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-qemuu-rhel6hvm-amd 6 xen-bootfail REGR. vs. 59254 test-amd64-i386-xl-qemuu-win7-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-pair 10 xen-boot/dst_host fail REGR. vs. 59254 test-amd64-i386-pair 9 xen-boot/src_host fail REGR. vs. 59254 test-amd64-i386-xl-qemut-win7-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-freebsd10-i386 6 xen-bootfail REGR. vs. 59254 test-amd64-i386-xl-qemut-winxpsp3 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-freebsd10-amd64 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemut-winxpsp3-vcpus1 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-xl-qemuu-winxpsp3 6 xen-boot fail REGR. vs. 59254 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail REGR. vs. 59254 Regressions which are regarded as allowable (not blocking): test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 59254 test-amd64-i386-libvirt-xsm 6 xen-boot fail REGR. vs. 59254 test-amd64-i386-libvirt 6 xen-boot fail REGR. vs. 59254 test-armhf-armhf-xl-rtds 11 guest-start fail REGR. vs. 59254 test-amd64-i386-xl-raw6 xen-bootfail baseline untested test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 6 xen-boot fail baseline untested test-amd64-i386-libvirt-pair 10 xen-boot/dst_host fail baseline untested test-amd64-i386-libvirt-pair 9 xen-boot/src_host fail baseline untested test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 59254 Tests which did not succeed, but are not blocking: test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass test-amd64-amd64-xl-pvh-intel 14 guest-saverestorefail never pass test-armhf-armhf-libvirt 14 guest-saverestorefail never pass test-armhf-armhf-libvirt 12 migrate-support-checkfail never pass test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass test-armhf-armhf-xl-multivcpu 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-multivcpu 12 migrate-support-checkfail never pass test-amd64-amd64-libvirt 12 migrate-support-checkfail never pass test-amd64-amd64-libvirt-vhd 11 migrate-support-checkfail never pass test-armhf-armhf-libvirt-raw 9 debian-di-installfail never pass test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail never pass test-armhf-armhf-libvirt-qcow2 9 debian-di-installfail never pass test-armhf-armhf-libvirt-xsm 12 migrate-support-checkfail never pass test-armhf-armhf-libvirt-xsm 14 guest-saverestorefail never pass test-amd64-amd64-libvirt-xsm 12 migrate-support-checkfail never pass test-armhf-armhf-xl 12 migrate-support-checkfail never pass test-armhf-armhf-xl 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-xsm 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-xsm 12 migrate-support-checkfail never pass test-armhf-armhf-xl-cubietruck 12 migrate-support-checkfail never pass test-armhf-armhf-xl-cubietruck 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-vhd 9 debian-di-installfail never pass test-armhf-armhf-xl-credit2 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-credit2 12 migrate-support-checkfail never pass test-armhf-armhf-xl-arndale 12 migrate-support-check
[Xen-devel] [xen-unstable test] 64205: regressions - FAIL
flight 64205 xen-unstable real [real] http://logs.test-lab.xenproject.org/osstest/logs/64205/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-amd64-pvgrub 6 xen-boot fail REGR. vs. 64035 test-amd64-i386-freebsd10-i386 6 xen-bootfail REGR. vs. 64035 test-amd64-i386-xl-qemuu-ovmf-amd64 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-rumpuserxen-amd64 6 xen-bootfail REGR. vs. 64035 test-armhf-armhf-xl-xsm 5 xen-install fail REGR. vs. 64035 test-amd64-amd64-xl-qemuu-debianhvm-amd64 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-xl-credit2 6 xen-boot fail REGR. vs. 64035 test-amd64-i386-xl6 xen-boot fail REGR. vs. 64035 test-armhf-armhf-xl-multivcpu 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-xl-qemut-winxpsp3 6 xen-bootfail REGR. vs. 64035 test-amd64-i386-xl-qemut-winxpsp3 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-pair 9 xen-boot/src_host fail REGR. vs. 64035 Regressions which are regarded as allowable (not blocking): test-amd64-amd64-libvirt-xsm 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 6 xen-boot fail REGR. vs. 64035 test-armhf-armhf-libvirt-xsm 4 host-ping-check-nativefail REGR. vs. 64035 test-armhf-armhf-xl-rtds 15 guest-start.2 fail REGR. vs. 64035 test-amd64-amd64-libvirt 6 xen-boot fail REGR. vs. 64035 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail like 64035 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 64035 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail like 64035 Tests which did not succeed, but are not blocking: test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass test-armhf-armhf-libvirt-raw 9 debian-di-installfail never pass test-armhf-armhf-xl-arndale 12 migrate-support-checkfail never pass test-armhf-armhf-xl-arndale 13 saverestore-support-checkfail never pass test-armhf-armhf-xl 12 migrate-support-checkfail never pass test-armhf-armhf-xl 13 saverestore-support-checkfail never pass test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass test-amd64-amd64-libvirt-vhd 11 migrate-support-checkfail never pass test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail never pass test-armhf-armhf-xl-vhd 9 debian-di-installfail never pass test-armhf-armhf-libvirt 14 guest-saverestorefail never pass test-armhf-armhf-libvirt 12 migrate-support-checkfail never pass test-armhf-armhf-xl-cubietruck 12 migrate-support-checkfail never pass test-armhf-armhf-xl-cubietruck 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-rtds 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-rtds 12 migrate-support-checkfail never pass test-amd64-i386-libvirt-xsm 12 migrate-support-checkfail never pass test-armhf-armhf-xl-credit2 13 saverestore-support-checkfail never pass test-armhf-armhf-xl-credit2 12 migrate-support-checkfail never pass test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass test-armhf-armhf-libvirt-qcow2 9 debian-di-installfail never pass test-amd64-i386-libvirt 12 migrate-support-checkfail never pass version targeted for testing: xen b7e7ad8795ab6d8a37e89d7188dcf14052dbdc20 baseline version: xen 22a1fbb575df3a3a7726cdeb5ddf19cc8f60827c Last test of basis64035 2015-11-10 08:01:11 Z4 days Failing since 64149 2015-11-11 19:15:29 Z3 days2 attempts Testing same since64205 2015-11-13 11:58:55 Z1 days1 attempts People who touched revisions under test: Andrew Cooper Aravind Gopalakrishnan Jan Beulich Razvan Cojocaru Riku Voipio Roger Pau Monné Shannon Zhao Wei Liu jobs: build-amd64-xsm pass build-armhf-xsm pass build-i386-xsm pass build-amd64 pass build-armhf pass build-i386 pass build-amd64-libvirt pass build-armhf-libvirt