On Mon, Jan 29, 2018 at 03:07:49PM -0700, Scott Seekamp wrote:
> I'm attempting to set up an OpenBSD virtualized environment and running into
> issues.
>
> OpenBSD 6.2 AMD64 hypervisor
>
> vm.conf:
>
> vm "vm1" {
> disable
> memory 1g
> disk "/vmm/vm1.img"
> interface { switch "uplink" }
> }
>
> vm "vm2" {
> disable
> memory 1g
> disk "/vmm/vm2.img"
> interface { switch "uplink" }
> }
>
> vm "vm3" {
> disable
> memory 1g
> disk "/vmm/vm3.img"
> interface { switch "uplink" }
> }
>
> switch "uplink" {
> interface switch0
> add vlan50
> }
>
>
> I let vmd bring up the switch and once up it shows:
>
> switch0: flags=41<UP,RUNNING>
> description: switch1-uplink
> index 108 llprio 3
> groups: switch
> datapath 0x6393eae0ca8447fb maxflow 10000 maxgroup 1000
> vlan50 flags=0<>
> port 10 ifpriority 0 ifcost 0
> tap3 flags=0<>
> port 112 ifpriority 0 ifcost 0
> vether0 flags=1000<LOCAL>
> port 4294967294 ifpriority 0 ifcost 0
> tap1 flags=0<>
> port 115 ifpriority 0 ifcost 0
> tap2 flags=0<>
> port 116 ifpriority 0 ifcost 0
>
> vether0 defined as:
>
> vether0: flags=41<UP,RUNNING> mtu 1500
> lladdr fe:e1:ba:df:57:3b
> index 113 priority 0 llprio 3
> groups: vether egress
> media: Ethernet autoselect
> status: active
> inet 172.50.7.254 netmask 0xfffff800
>
> vlan50 is a vlan on top of a trunk (2 em's LACP to a switch):
>
> vlan50: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
> lladdr 00:25:90:0c:78:42
> description: Lab
> index 10 priority 0 llprio 3
> encap: vnetid 50 parent trunk0
> groups: vlan
> media: Ethernet autoselect
> status: active
>
> I have 3 vm's as defined above:
>
> ID PID VCPUS MAXMEM CURMEM TTY OWNER NAME
> 2 11840 1 1.0G 450M ttyp6 root vm1
> 1 14496 1 1.0G 560M ttyp2 root vm2
> 3 48053 1 1.0G 450M ttyp7 root vm3
>
> The vm's are configured with sequential IP's in the vlan50 network such as:
>
> vio0: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
> mtu 1500
> lladdr fe:e1:bb:d1:58:82
> index 1 priority 0 llprio 3
> groups: egress
> media: Ethernet autoselect
> status: active
> inet 172.50.0.6 netmask 0xfffff800 broadcast 172.50.7.255
>
> The problem:
>
> I can ping from vm -> vm
> I can ping from vm -> vether0 IP
> I can ping from vether0 to vm
>
> I cannot communicate out of the VM to the rest of the environment reliably.
>
> tcpdump on the tap interface shows:
>
> tcpdump -i tap2
> tcpdump: listening on tap2, link-type EN10MB
> 14:58:54.507948 172.50.0.6 > 172.50.0.1: icmp: echo request
> 14:58:56.527958 172.50.0.6 > 172.50.0.1: icmp: echo request
>
> tcpdump on the vlan interface shows the traffic gets out and tries to come
> back:
>
> tcpdump -i vlan50
> tcpdump: listening on vlan50, link-type EN10MB
> 15:02:23.657480 172.50.0.6 > 172.50.0.1: icmp: echo request
> 15:02:23.657656 172.50.0.1 > 172.50.0.6: icmp: echo reply
> 15:02:25.667671 172.50.0.6 > 172.50.0.1: icmp: echo request
> 15:02:25.667864 172.50.0.1 > 172.50.0.6: icmp: echo reply
>
> I'm using the out of the box pf rules on both the hypervisor box and vm's.
>
> I can see the macs of the vm's in the switch table:
>
> switchctl show sum
> Switch Port Type Name Info
> 1 switch /dev/switch0
> 1 10 mac 00:0d:b9:42:d0:fc age 135s
> 1 115 mac fe:e1:bb:d1:1c:f5 age 135s
> 1 116 mac fe:e1:bb:d1:58:82 age 201s
> 1 112 mac fe:e1:bb:d1:6d:f4 age 201s
>
> What am I missing? What would block the incoming traffic from getting back
> to the vm from the host level?
>
> Thanks
> Scott
Can you try adding pass rules for the tapX interfaces to /etc/pf.conf (don't
forget to reload the rules). And maybe the vether too. (Mine contains a
sequence of "pass on tap0" "pass on tap1" , etc, lines).
I was having similar issues until I did that; I could never figure out what
rule was blocking it but that seemed to fix it.
Also, not sure if you need net.inet.ip.forwarding=1 in your sysctl config
in this environment?
-ml
> OpenBSD 6.2 (GENERIC.MP) #2: Sun Dec 10 21:14:42 CET 2017
>
> r...@syspatch-62-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 85873721344 (81895MB)
> avail mem = 83264139264 (79406MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.6 @ 0x99c00 (81 entries)
> bios0: vendor American Megatrends Inc. version "2.1c" date 08/03/2012
> bios0: Supermicro X8DTU
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP APIC MCFG SLIT OEMB SRAT HPET DMAR SSDT
> acpi0: wakeup devices NPE1(S4) NPE2(S4) NPE3(S4) NPE4(S4) NPE5(S4) NPE6(S4)
> NPE7(S4) NPE8(S4) NPE9(S4) NPEA(S4) P0P1(S4) USB0(S4) USB1(S4) USB2(S4)
> USB5(S4) EUSB(S4) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.40 MHz
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu0: 256KB 64b/line 8-way L2 cache
> cpu0: TSC frequency 2400404120 Hz
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 133MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu1: 256KB 64b/line 8-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 18 (application processor)
> cpu2: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu2: 256KB 64b/line 8-way L2 cache
> cpu2: smt 0, core 9, package 0
> cpu3 at mainbus0: apid 20 (application processor)
> cpu3: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu3: 256KB 64b/line 8-way L2 cache
> cpu3: smt 0, core 10, package 0
> cpu4 at mainbus0: apid 32 (application processor)
> cpu4: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu4:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu4: 256KB 64b/line 8-way L2 cache
> cpu4: smt 0, core 0, package 1
> cpu5 at mainbus0: apid 34 (application processor)
> cpu5: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2416.51 MHz
> cpu5:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu5: 256KB 64b/line 8-way L2 cache
> cpu5: smt 0, core 1, package 1
> cpu6 at mainbus0: apid 50 (application processor)
> cpu6: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu6:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu6: 256KB 64b/line 8-way L2 cache
> cpu6: smt 0, core 9, package 1
> cpu7 at mainbus0: apid 52 (application processor)
> cpu7: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu7:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu7: 256KB 64b/line 8-way L2 cache
> cpu7: smt 0, core 10, package 1
> cpu8 at mainbus0: apid 1 (application processor)
> cpu8: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu8:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu8: 256KB 64b/line 8-way L2 cache
> cpu8: smt 1, core 0, package 0
> cpu9 at mainbus0: apid 3 (application processor)
> cpu9: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu9:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu9: 256KB 64b/line 8-way L2 cache
> cpu9: smt 1, core 1, package 0
> cpu10 at mainbus0: apid 19 (application processor)
> cpu10: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu10:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu10: 256KB 64b/line 8-way L2 cache
> cpu10: smt 1, core 9, package 0
> cpu11 at mainbus0: apid 21 (application processor)
> cpu11: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu11:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu11: 256KB 64b/line 8-way L2 cache
> cpu11: smt 1, core 10, package 0
> cpu12 at mainbus0: apid 33 (application processor)
> cpu12: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu12:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu12: 256KB 64b/line 8-way L2 cache
> cpu12: smt 1, core 0, package 1
> cpu13 at mainbus0: apid 35 (application processor)
> cpu13: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu13:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu13: 256KB 64b/line 8-way L2 cache
> cpu13: smt 1, core 1, package 1
> cpu14 at mainbus0: apid 51 (application processor)
> cpu14: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu14:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu14: 256KB 64b/line 8-way L2 cache
> cpu14: smt 1, core 9, package 1
> cpu15 at mainbus0: apid 53 (application processor)
> cpu15: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
> cpu15:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
> cpu15: 256KB 64b/line 8-way L2 cache
> cpu15: smt 1, core 10, package 1
> ioapic0 at mainbus0: apid 6 pa 0xfec00000, version 20, 24 pins
> , remapped to apid 6
> ioapic1 at mainbus0: apid 7 pa 0xfec8a000, version 20, 24 pins
> , remapped to apid 7
> acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
> acpihpet0 at acpi0: 14318179 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (NPE1)
> acpiprt2 at acpi0: bus 2 (NPE3)
> acpiprt3 at acpi0: bus -1 (NPE4)
> acpiprt4 at acpi0: bus 3 (NPE5)
> acpiprt5 at acpi0: bus -1 (NPE6)
> acpiprt6 at acpi0: bus 4 (NPE7)
> acpiprt7 at acpi0: bus -1 (NPE8)
> acpiprt8 at acpi0: bus 5 (NPE9)
> acpiprt9 at acpi0: bus -1 (NPEA)
> acpiprt10 at acpi0: bus 6 (P0P1)
> acpiprt11 at acpi0: bus -1 (P0P4)
> acpiprt12 at acpi0: bus -1 (P0P5)
> acpiprt13 at acpi0: bus -1 (P0P6)
> acpiprt14 at acpi0: bus -1 (P0P7)
> acpiprt15 at acpi0: bus -1 (P0P8)
> acpiprt16 at acpi0: bus -1 (P0P9)
> acpicpu0 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu1 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu2 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu3 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu4 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu5 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu6 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu7 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu8 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu9 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu10 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu11 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu12 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu13 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu14 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpicpu15 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
> C1(1000@3 halt), PSS
> acpibtn0 at acpi0: PWRB
> ipmi at mainbus0 not configured
> cpu0: Enhanced SpeedStep 2400 MHz: speeds: 2401, 2400, 2267, 2133, 2000,
> 1867, 1733, 1600 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 5520 Host" rev 0x22
> ppb0 at pci0 dev 1 function 0 "Intel X58 PCIE" rev 0x22: msi
> pci1 at ppb0 bus 1
> em0 at pci1 dev 0 function 0 "Intel 82576" rev 0x01: msi, address
> 00:25:90:0c:78:42
> em1 at pci1 dev 0 function 1 "Intel 82576" rev 0x01: msi, address
> 00:25:90:0c:78:43
> ppb1 at pci0 dev 3 function 0 "Intel X58 PCIE" rev 0x22: msi
> pci2 at ppb1 bus 2
> ppb2 at pci0 dev 5 function 0 "Intel X58 PCIE" rev 0x22: msi
> pci3 at ppb2 bus 3
> ppb3 at pci0 dev 7 function 0 "Intel X58 PCIE" rev 0x22: msi
> pci4 at ppb3 bus 4
> ppb4 at pci0 dev 9 function 0 "Intel X58 PCIE" rev 0x22: msi
> pci5 at ppb4 bus 5
> "Intel X58 IOxAPIC" rev 0x22 at pci0 dev 19 function 0 not configured
> "Intel X58 Misc" rev 0x22 at pci0 dev 20 function 0 not configured
> "Intel X58 GPIO" rev 0x22 at pci0 dev 20 function 1 not configured
> "Intel X58 RAS" rev 0x22 at pci0 dev 20 function 2 not configured
> "Intel X58 Throttle" rev 0x22 at pci0 dev 20 function 3 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 0 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 1 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 2 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 3 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 4 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 5 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 6 not configured
> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 7 not configured
> uhci0 at pci0 dev 26 function 0 "Intel 82801JI USB" rev 0x00: apic 6 int 16
> uhci1 at pci0 dev 26 function 1 "Intel 82801JI USB" rev 0x00: apic 6 int 21
> uhci2 at pci0 dev 26 function 2 "Intel 82801JI USB" rev 0x00: apic 6 int 19
> ehci0 at pci0 dev 26 function 7 "Intel 82801JI USB" rev 0x00: apic 6 int 18
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
> addr 1
> uhci3 at pci0 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 6 int 23
> uhci4 at pci0 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 6 int 19
> uhci5 at pci0 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 6 int 18
> ehci1 at pci0 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 6 int 23
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00
> addr 1
> ppb5 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90
> pci6 at ppb5 bus 6
> vga1 at pci6 dev 1 function 0 "Matrox MGA G200eW" rev 0x0a
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> pcib0 at pci0 dev 31 function 0 "Intel 82801JIR LPC" rev 0x00
> ahci0 at pci0 dev 31 function 2 "Intel 82801JI AHCI" rev 0x00: msi, AHCI 1.2
> ahci0: port 0: 1.5Gb/s
> ahci0: port 1: 3.0Gb/s
> scsibus1 at ahci0: 32 targets
> cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, DVDRAM GT20N, CQ02> ATAPI 5/cdrom
> removable
> sd0 at scsibus1 targ 1 lun 0: <ATA, INTEL SSDSA2M160, 2CV1> SCSI3 0/direct
> fixed naa.500151795947ee3e
> sd0: 152627MB, 512 bytes/sector, 312581808 sectors, thin
> ichiic0 at pci0 dev 31 function 3 "Intel 82801JI SMBus" rev 0x00: apic 6 int
> 18
> iic0 at ichiic0
> sdtemp0 at iic0 addr 0x18: mcp98243
> sdtemp1 at iic0 addr 0x19: mcp98243
> sdtemp2 at iic0 addr 0x1a: mcp98243
> sdtemp3 at iic0 addr 0x1b: mcp98243
> sdtemp4 at iic0 addr 0x1c: mcp98243
> sdtemp5 at iic0 addr 0x1d: stts2002
> iic0: addr 0x2e 00=40 words 00=4040 01=0000 02=0000 03=0000 04=0000 05=0000
> 06=0000 07=0000
> nvt0 at iic0 addr 0x2f: W83795ADG
> spdmem0 at iic0 addr 0x50: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> spdmem1 at iic0 addr 0x51: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> spdmem2 at iic0 addr 0x52: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> spdmem3 at iic0 addr 0x53: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> spdmem4 at iic0 addr 0x54: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> spdmem5 at iic0 addr 0x55: 8GB DDR3 SDRAM registered ECC PC3-12800 with
> thermal sensor
> usb2 at uhci0: USB revision 1.0
> uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> usb3 at uhci1: USB revision 1.0
> uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> usb4 at uhci2: USB revision 1.0
> uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> usb5 at uhci3: USB revision 1.0
> uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> usb6 at uhci4: USB revision 1.0
> uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> usb7 at uhci5: USB revision 1.0
> uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00
> addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
> lm1 at wbsio0 port 0xa10/8: W83627DHG
> vmm0 at mainbus0: VMX/EPT
> uhidev0 at uhub3 port 1 configuration 1 interface 0 "American Megatrends Inc.
> Virtual Keyboard and Mouse" rev 1.10/1.00 addr 2
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd1 at ukbd0 mux 1
> wskbd1: connecting to wsdisplay0
> uhidev1 at uhub3 port 1 configuration 1 interface 1 "American Megatrends Inc.
> Virtual Keyboard and Mouse" rev 1.10/1.00 addr 2
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons
> wsmouse0 at ums0 mux 0
> vscsi0 at root
> scsibus2 at vscsi0: 256 targets
> softraid0 at root
> scsibus3 at softraid0: 256 targets
> root on sd0a (d75aaa14b0711a78.a) swap on sd0b dump on sd0b
