On Mon, Jun 10, 2013 at 04:32:37PM -0700, Chris Cappuccio wrote:
> I'm trying to use ldom on a few sun fire t1000s. The host system
> tells me "ERROR: Physical resources required by LDoms configuration: openbsd
> not available. Falling back to default set" after I "ldomctl download" and
> then "reset -c" at ALOM.
>
> I upgraded from factory 2005 firmware to this one
> ftp://ftp.gl.umbc.edu/syscore/t1000/139435-09.zip just to get the
> hypervisor functionality at all. OpenBSD itself seems to work fine under
> both firmwares.
>
> A sample error message, ldom config and dmesg are below.
>
> It even happens when I delete everything but the first domain "one".
There's a bug somewhere that computes the left-over memory for the
primary wrong.
Take the mem printed by OpenBoot (8064M), subtract the mem taken by
your guests and assign that to the primary.
primary {
memory ..
}
-Otto
>
> ---
> # halt
> /etc/rc.shutdown in progress...
> /etc/rc.shutdown complete.
> syncing disks... done
> halted
>
> Program terminated
> {0} ok sc> reset -c
> Are you sure you want to reset the system [y/n]? y
> Enter #. to return to ALOM.
>
> SC Alert: SC Request to Reset Host.
>
> SC Alert: Host System has Reset
> JUN 10 21:42:00 ERROR: Physical resources required by LDoms configuration:
> openbsd
> not available. Falling back to default set
> /
>
> Sun Fire(TM) T1000, No Keyboard
> Copyright (c) 1998, 2011, Oracle and/or its affiliates. All rights reserved.
> OpenBoot 4.30.4.d, 8064 MB memory available, Serial #70050376.
> Ethernet address 0:14:4f:2c:e2:48, Host ID: 842ce248.
>
>
>
> Boot device: disk File and args:
> OpenBSD IEEE 1275 Bootblock 1.3
> ..>> OpenBSD BOOT 1.4
> Trying bsd...
> ...
> # cat ldom.conf
> domain one {
> vcpu 1
> memory 2G
> vdisk "/home/one/vdisk0"
> vdisk "/home/one/vdisk1"
> vnet
> }
>
> domain two {
> vcpu 1
> memory 1G
> vdisk "/home/two/vdisk0"
> vdisk "/home/two/vdisk1"
> vnet
> }
>
> domain three {
> vcpu 1
> memory 1G
> vdisk "/home/three/vdisk0"
> vdisk "/home/three/vdisk1"
> vnet
> }
>
> domain four {
> vcpu 1
> memory 1G
> vdisk "/home/four/vdisk0"
> vdisk "/home/four/vdisk1"
> vnet
> }
>
> domain five {
> vcpu 1
> memory 1G
> vdisk "/home/five/vdisk0"
> vdisk "/home/five/vdisk1"
> vnet
> }
> # dmesg
> console is /virtual-devices@100/console@1
> Copyright (c) 1982, 1986, 1989, 1991, 1993
> The Regents of the University of California. All rights reserved.
> Copyright (c) 1995-2013 OpenBSD. All rights reserved. http://www.OpenBSD.org
>
> OpenBSD 5.3-current (GENERIC.MP) #118: Wed Jun 5 18:28:38 MDT 2013
> dera...@sparc64.openbsd.org:/usr/src/sys/arch/sparc64/compile/GENERIC.MP
> real mem = 8455716864 (8064MB)
> avail mem = 8305139712 (7920MB)
> mainbus0 at root: Sun Fire(TM) T1000
> cpu0 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu1 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu2 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu3 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu4 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu5 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu6 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu7 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu8 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu9 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu10 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu11 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu12 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu13 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu14 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu15 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu16 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu17 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu18 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu19 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu20 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu21 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu22 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu23 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> vbus0 at mainbus0
> "flashprom" at vbus0 not configured
> cbus0 at vbus0
> vldc0 at cbus0
> vldcp0 at vldc0 chan 0x0: ivec 0x200, 0x201 channel "hvctl"
> "ldom-primary" at vldc0 chan 0x1 not configured
> "fmactl" at vldc0 chan 0x3 not configured
> vldc1 at cbus0
> "ldmfma" at vldc1 chan 0x4 not configured
> vldc2 at cbus0
> vldcp1 at vldc2 chan 0x14: ivec 0x228, 0x229 channel "spds"
> "system-management" at vldc2 chan 0xd not configured
> vcons0 at vbus0: ivec 0x111, console
> vrtc0 at vbus0
> "fma" at vbus0 not configured
> "sunvts" at vbus0 not configured
> "sunmc" at vbus0 not configured
> "explorer" at vbus0 not configured
> "led" at vbus0 not configured
> "flashupdate" at vbus0 not configured
> "ncp" at vbus0 not configured
> vpci0 at mainbus0: bus 2 to 2, dvma map 80000000-ffffffff
> pci0 at vpci0
> ebus0 at mainbus0
> com0 at ebus0 addr c2c000-c2c007 ivec 0xa: st16650, 32 byte fifo
> vpci1 at mainbus0: bus 2 to 4, dvma map 80000000-ffffffff
> pci1 at vpci1
> ppb0 at pci1 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xb3
> pci2 at ppb0 bus 3
> bge0 at pci2 dev 4 function 0 "Broadcom BCM5714" rev 0xa2, BCM5715 A1
> (0x9001): ivec 0x7d4, address 00:14:4f:2c:e2:48
> brgphy0 at bge0 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
> bge1 at pci2 dev 4 function 1 "Broadcom BCM5714" rev 0xa2, BCM5715 A1
> (0x9001): ivec 0x7d5, address 00:14:4f:2c:e2:49
> brgphy1 at bge1 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
> ppb1 at pci2 dev 8 function 0 "ServerWorks HT-1000 PCIX" rev 0xb3
> pci3 at ppb1 bus 4
> bge2 at pci3 dev 1 function 0 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
> (0x2100): ivec 0x7c2, address 00:14:4f:2c:e2:4a
> brgphy2 at bge2 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
> bge3 at pci3 dev 1 function 1 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
> (0x2100): ivec 0x7c1, address 00:14:4f:2c:e2:4b
> brgphy3 at bge3 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
> mpi0 at pci3 dev 2 function 0 "Symbios Logic SAS1064" rev 0x02: msi
> scsibus0 at mpi0: 63 targets
> sd0 at scsibus0 targ 0 lun 0: <ATA, ST31000524AS, JC4B> SCSI3 0/direct fixed
> naa.5000c50045e761c2
> sd0: 953869MB, 512 bytes/sector, 1953525168 sectors
> vscsi0 at root
> scsibus1 at vscsi0: 256 targets
> softraid0 at root
> scsibus2 at softraid0: 256 targets
> bootpath: /pci@7c0,0/pci@0,0/pci@8,0/scsi@2,0/disk@0,0
> root on sd0a (6f7f7705c7253071.a) swap on sd0b dump on sd0b
