Hi,
I'm looking for a bit of help to track down the reason behind this kernel panic, it seems like netmap works fine for the majority of the time, but occasionally it will cause the box to kernel panic. The machine is running FreeBSD Current from a few weeks ago (Rev 296937) And it has a Chelsio T520-SO network card in it. We've been developing with netmap for a while now, and while the kernel panic doesn't seem to be 100% reproducible, it's happening regularly enough to cause alarm! Thanks for any help! Steven
jj.gla.uk.iotx dumped core - see /var/crash/vmcore.0 Mon Jan 25 14:27:06 UTC 2016 FreeBSD jj.gla.uk.iotx 10.2-RELEASE-p10 FreeBSD 10.2-RELEASE-p10 #1 r294714M: Mon Jan 25 12:45:48 UTC 2016 j...@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC amd64 panic: page fault GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: Fatal trap 12: page fault while in kernel mode cpuid = 4; apic id = 08 fault virtual address = 0x6 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff804d2269 stack pointer = 0x28:0xfffffe0467ce0420 frame pointer = 0x28:0xfffffe0467ce04f0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 59932 (PingTest) trap number = 12 panic: page fault cpuid = 4 KDB: stack backtrace: #0 0xffffffff809c5590 at kdb_backtrace+0x60 #1 0xffffffff80989146 at vpanic+0x126 #2 0xffffffff80989013 at panic+0x43 #3 0xffffffff80d8b16b at trap_fatal+0x36b #4 0xffffffff80d8b46d at trap_pfault+0x2ed #5 0xffffffff80d8ab0a at trap+0x47a #6 0xffffffff80d70e82 at calltrap+0x8 #7 0xffffffff806a9ba9 at netmap_do_unregif+0x89 #8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1 #9 0xffffffff806abcb5 at netmap_ioctl+0x755 #10 0xffffffff808706b9 at devfs_ioctl_f+0x139 #11 0xffffffff809dd485 at kern_ioctl+0x255 #12 0xffffffff809dd180 at sys_ioctl+0x140 #13 0xffffffff80d8ba87 at amd64_syscall+0x357 #14 0xffffffff80d7116b at Xfast_syscall+0xfb Uptime: 39m8s Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols #0 doadump (textdump=<value optimized out>) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=<value optimized out>) at pcpu.h:219 #1 0xffffffff80988da2 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff80989185 in vpanic (fmt=<value optimized out>, ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff80989013 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:687 #4 0xffffffff80d8b16b in trap_fatal (frame=<value optimized out>, eva=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:851 #5 0xffffffff80d8b46d in trap_pfault (frame=0xfffffe0467ce0370, usermode=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:674 #6 0xffffffff80d8ab0a in trap (frame=0xfffffe0467ce0370) at /usr/src/sys/amd64/amd64/trap.c:440 #7 0xffffffff80d70e82 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff804d2269 in cxgbe_netmap_reg (na=<value optimized out>, on=<value optimized out>) at endian.h:95 #9 0xffffffff806a9ba9 in netmap_do_unregif (priv=<value optimized out>, nifp=0xfffffe0467dc2000) at /usr/src/sys/dev/netmap/netmap.c:1011 #10 0xffffffff806ab4e1 in netmap_do_regif (priv=0xfffff8034cd99600, na=<value optimized out>, ringid=<value optimized out>, flags=<value optimized out>, err=0xfffffe0467ce08e4) at /usr/src/sys/dev/netmap/netmap.c:1973 #11 0xffffffff806abcb5 in netmap_ioctl (dev=<value optimized out>, cmd=<value optimized out>, data=0xfffffe0467ce0a20 "ncxl0", fflag=<value optimized out>, td=0xfffff800181e1000) at /usr/src/sys/dev/netmap/netmap.c:2124 #12 0xffffffff808706b9 in devfs_ioctl_f (fp=0xfffff80018adc640, com=3225184658, data=0xfffffe0467ce0a20, cred=<value optimized out>, td=0xfffff800181e1000) at /usr/src/sys/fs/devfs/devfs_vnops.c:785 #13 0xffffffff809dd485 in kern_ioctl (td=0xfffff800181e1000, fd=<value optimized out>, com=18446735278021152768) at file.h:320 #14 0xffffffff809dd180 in sys_ioctl (td=0xfffff800181e1000, uap=0xfffffe0467ce0b80) at /usr/src/sys/kern/sys_generic.c:718 #15 0xffffffff80d8ba87 in amd64_syscall (td=0xfffff800181e1000, traced=0) at subr_syscall.c:134 #16 0xffffffff80d7116b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #17 0x0000000801d8efda in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) ------------------------------------------------------------------------ ps -axlww UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -8 0 0 18005602445714496 - DLs - 0:00.24 [kernel] 0 1 0 0 20 0 9476 17979215789071360 wait DLs - 0:00.09 [init] 0 2 0 0 -16 0 0 18005602445714496 - DL - 0:00.00 [cam] 0 3 0 0 -8 0 0 18005602445714496 tx->tx_s DL - 0:00.01 [zfskern] 0 4 0 0 -16 0 0 18005602445714496 waiting_ DL - 0:00.00 [sctp_iterator] 0 5 0 0 -16 0 0 18005602445714496 umarcl DL - 0:00.00 [pagedaemon] 0 6 0 0 -16 0 0 18005602445714496 psleep DL - 0:00.00 [vmdaemon] 0 7 0 0 155 0 0 18005602445714496 pgzero DL - 0:00.00 [pagezero] 0 8 0 0 -16 0 0 18005602445714496 psleep DL - 0:00.00 [bufdaemon] 0 9 0 0 16 0 0 18005602445714496 syncer DL - 0:00.00 [syncer] 0 10 0 0 -16 0 0 18005602445714496 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 18005602445714496 - RL - 1:53.38 [idle] 0 12 0 0 -84 0 0 18005602445714496 - WL - 0:00.12 [intr] 0 13 0 0 -8 0 0 18005602445714496 - DL - 0:00.01 [geom] 0 14 0 0 -16 0 0 18005602445714496 - DL - 0:00.01 [rand_harvestq] 0 15 0 0 -68 0 0 18005602445714496 - DL - 0:00.04 [usb] 0 16 0 0 -16 0 0 18005602445714496 - RL - 0:00.00 [vnlru] 0 1146 1 0 52 0 16728 17979215789043968 select Ds - 0:00.00 [moused] 0 1163 1 0 20 0 13624 17979215807998464 select Ds - 0:00.00 [devd] 0 1326 1 0 20 0 14512 17979215789053184 select Ds - 0:00.02 [syslogd] 0 1458 1 0 20 0 61224 17979215800481792 select Ds - 0:00.00 [sshd] 0 1462 1 0 20 0 16612 17979215791803904 nanslp Ds - 0:00.00 [cron] 0 1509 1 0 52 0 14508 17979215810882048 ttyin Ds+ - 0:00.00 [getty] 0 1510 1 0 52 0 14508 17979215789040384 ttyin Ds+ - 0:00.00 [getty] 0 1511 1 0 52 0 14508 17979215793232896 ttyin Ds+ - 0:00.00 [getty] 0 1512 1 0 52 0 14508 17979215809296384 ttyin Ds+ - 0:00.00 [getty] 0 1513 1 0 52 0 14508 17979215810767360 ttyin Ds+ - 0:00.00 [getty] 0 1514 1 0 52 0 14508 0 ttyin Ds+ - 0:00.00 [getty] 0 1515 1 0 52 0 14508 17979215799724544 ttyin Ds+ - 0:00.00 [getty] 0 1516 1 0 52 0 14508 17979215811466496 ttyin Ds+ - 0:00.00 [getty] 0 1534 1458 0 21 0 86492 17979214623182336 select Ds - 0:00.00 [sshd] 1002 1537 1534 0 20 0 86492 17979215803392768 select D - 0:00.00 [sshd] 1002 1538 1537 0 20 0 17088 17979214623193088 wait Ds - 0:00.00 [sh] 0 1540 1538 0 20 0 47728 17979215803385600 wait D - 0:00.00 [su] 0 1541 1540 0 20 0 23592 17979215793152768 pause D - 0:00.01 [csh] 0 59932 1541 0 33 0 135952 17979215810326784 nanslp D+ - 0:00.00 [PingTest] ------------------------------------------------------------------------ vmstat -s 2422120 cpu context switches 223681 device interrupts 71352 software interrupts 14341394 traps 21324016 system calls 16 kernel threads created 80415 fork() calls 79382 vfork() calls 0 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 4346 vnode pager pageins 26278 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 631 pages reactivated 4145359 copy-on-write faults 252 copy-on-write optimized faults 9320823 zero fill pages zeroed 0 zero fill pages prezeroed 17 intransit blocking page faults 13709213 total VM faults taken 4141 page faults requiring I/O 0 pages affected by kernel thread creation 2822123 pages affected by fork() 2789623 pages affected by vfork() 0 pages affected by rfork() 0 pages cached 17946274 pages freed 0 pages freed by daemon 0 pages freed by exiting processes 29267 pages active 21500 pages inactive 552 pages in VM cache 723821 pages wired down 3288262 pages free 4096 bytes per page 8376854 total name lookups cache hits (85% pos + 5% neg) system 0% per-directory deletions 3%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) isadev 7 1K - 7 128 entropy 1027 65K - 1041 32,64,4096 cdev 4 1K - 4 256 filedesc 36 72K - 159814 2048 sigio 1 1K - 1 64 filecaps 0 0K - 2 64 kdtrace 472 112K - 160423 64,256 kenv 86 12K - 97 16,32,64,128,8192 kqueue 0 0K - 119 256,2048 proc-args 20 1K - 132741 16,32,64,128,256 hhook 2 1K - 2 256 ithread 268 39K - 268 32,128,256 acpiintr 1 1K - 1 64 KTRACE 100 13K - 100 128 linker 183 35K - 225 16,32,64,128,256,512,1024,2048,4096,8192 lockf 14 2K - 172018 64,128 loginclass 3 1K - 25 64 devbuf 18517 41054K - 18859 16,32,64,128,256,512,1024,2048,4096,8192,32768,65536 temp 71 18K - 266848 16,32,64,128,256,512,1024,2048,16384 ip6ndp 10 1K - 10 64,128 module 496 62K - 497 128 mtx_pool 2 16K - 2 8192 osd 5 1K - 18 16,32,64 acpica 2216 225K - 57097 16,32,64,128,256,512,1024,2048,4096 pmchooks 1 1K - 1 128 CAM path 11 1K - 75 32 pgrp 19 3K - 73 128 session 16 2K - 30 128 proc 2 64K - 2 32768 subproc 163 208K - 159942 512,4096 cred 64 10K - 1170462 64,256 cxgbe 13 525K - 16 128,256,512,1024,2048,8192,16384 plimit 12 3K - 27 256 uidinfo 3 9K - 18 128,8192 feeder 7 1K - 7 32 sysctl 0 0K - 681 16,32,64 sysctloid 8014 403K - 8111 16,32,64,128 sysctltmp 0 0K - 393 16,32,64,128,256 tidhash 1 64K - 1 65536 callout 9 3208K - 9 umtx 936 117K - 936 128 p1003.1b 1 1K - 1 16 SWAP 4 553K - 4 64 bus 1365 117K - 6708 16,32,64,128,256,1024 bus-sc 86 254K - 4250 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 devstat 10 21K - 10 32,4096 eventhandler 100 8K - 100 64,128 kobj 334 1336K - 587 4096 Per-cpu 1 1K - 1 32 rman 342 41K - 777 16,32,128 sbuf 0 0K - 1051 16,32,64,128,256,512,1024,2048,4096,8192,16384 DEVFS3 139 35K - 155 256 DEVFS1 119 60K - 131 512 taskqueue 153 22K - 209 16,32,64,128,256 Unitno 22 2K - 104896 32,64 vmem 2 640K - 6 16384,65536 ioctlops 0 0K - 235 256,512,1024 select 20 3K - 20 128 iov 0 0K - 576 16,64,128,256,512 msg 4 30K - 4 2048,4096,8192,16384 sem 4 106K - 4 2048,4096 shm 1 32K - 1 32768 tty 20 20K - 20 1024 pts 1 1K - 1 256 mbuf_tag 0 0K - 9 32 shmfd 1 8K - 1 8192 soname 4 1K - 14831 16,32,128 pcb 16 2199K - 123 16,32,128,1024,2048,8192 DEVFS_RULE 55 26K - 55 64,512 acl 0 0K - 3014 4096 vfscache 1 4096K - 1 vfs_hash 1 2048K - 1 vnodes 1 1K - 1 256 DEVFS 25 1K - 26 16,128 DEVFSP 2 1K - 2 64 mount 116 4K - 311 16,32,64,128,256 vnodemarker 0 0K - 1619 512 BPF 9 2K - 9 128 ifnet 10 19K - 10 128,2048 ifaddr 101 23K - 101 32,64,128,256,512,2048,4096 ether_multi 17 1K - 18 16,32,64 clone 8 1K - 8 128 arpcom 8 1K - 8 16 lltable 23 11K - 23 256,512 NFSD V4client 1 1K - 1 256 NFSD lckfile 1 1K - 1 256 routetbl 32 6K - 300 32,64,128,256,512 igmp 9 3K - 9 256 in_multi 2 1K - 2 256 sctp_a_it 0 0K - 3 16 sctp_vrf 1 1K - 1 64 sctp_ifa 4 1K - 4 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 3 256 hostcache 1 32K - 1 32768 syncache 1 64K - 1 65536 in6_multi 15 2K - 15 32,256 mld 9 2K - 9 128 rpc 2 16K - 2 8192 audit_evclass 187 6K - 229 32 ufs_quota 1 2048K - 1 vm_pgdata 3 2049K - 3 128 UMAHash 40 956K - 164 512,1024,2048,4096,8192,16384,32768,65536 memdesc 1 4K - 1 4096 NFSD session 1 1K - 1 1024 atkbddev 2 1K - 2 64 acpitask 1 16K - 1 16384 pfs_nodes 21 6K - 21 256 GEOM 92 17K - 983 16,32,64,128,256,512,1024,2048,8192,16384 acpisem 41 6K - 41 128 CAM periph 6 2K - 22 16,32,64,128,256 acpidev 36 3K - 36 64 CAM queue 16 5K - 51 16,32,512 UART 6 5K - 6 16,1024 raid_data 0 0K - 132 32,128,256 netmap 82151 337579K - 82151 16,32,2048,4096,32768 CAM dev queue 7 1K - 7 64 CAM SIM 7 2K - 7 256 CAM XPT 32 3K - 131 16,32,64,128,256,512,1024,2048,65536 pci_link 16 2K - 16 32,128 acpi_perf 8 4K - 8 512 apmdev 1 1K - 1 128 madt_table 0 0K - 1 4096 CAM DEV 9 18K - 20 2048 USB 47 71K - 56 16,128,256,512,1024,2048,4096 io_apic 1 2K - 1 2048 USBdev 36 9K - 36 32,64,128,256,512,4096 MCA 8 1K - 8 128 kbdmux 7 22K - 7 16,512,1024,2048,16384 LED 8 1K - 8 16,128 msi 64 8K - 64 128 nexusdev 3 1K - 3 16 CAM CCB 0 0K - 28917 2048 solaris 664256 129403K - 16300367 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 kstat_data 6 1K - 6 64 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 384, 0, 226, 4, 226, 0, 0 UMA Zones: 1664, 0, 226, 0, 226, 0, 0 UMA Slabs: 80, 0, 104341, 9, 104742, 0, 0 UMA RCntSlabs: 88, 0, 5716, 44, 5716, 0, 0 UMA Hash: 256, 0, 64, 41, 104, 0, 0 4 Bucket: 32, 0, 726, 2899, 65040, 0, 0 6 Bucket: 48, 0, 533, 2289, 9187, 0, 0 8 Bucket: 64, 0, 76, 3272, 12234, 11, 0 12 Bucket: 96, 0, 101, 1293, 11338, 0, 0 16 Bucket: 128, 0, 154, 993, 24386, 0, 0 32 Bucket: 256, 0, 1438, 467, 36740, 52, 0 64 Bucket: 512, 0, 613, 1171, 26691, 626, 0 128 Bucket: 1024, 0, 634, 74, 17838, 0, 0 256 Bucket: 2048, 0, 379, 65, 9119, 13, 0 vmem btag: 56, 0, 137269, 968, 137391, 975, 0 VM OBJECT: 256, 0, 71126, 8359, 2406383, 0, 0 RADIX NODE: 144, 0, 35700, 561, 3225847, 0, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 128, 0, 6, 273, 6, 0, 0 MAP ENTRY: 128, 0, 688, 1575, 6098698, 0, 0 VMSPACE: 448, 0, 20, 394, 159796, 0, 0 fakepg: 104, 0, 0, 0, 0, 0, 0 mt_zone: 4112, 0, 366, 0, 366, 0, 0 16: 16, 0, 224543, 1357, 987328, 0, 0 32: 32, 0, 89913, 10587, 4623127, 0, 0 64: 64, 0, 239484, 11244, 3948497, 0, 0 128: 128, 0, 37079, 1423, 3303055, 0, 0 256: 256, 0, 89619, 44766, 3163869, 0, 0 512: 512, 0, 486, 242, 2227568, 0, 0 1024: 1024, 0, 2796, 584, 150015, 0, 0 2048: 2048, 0, 99, 131, 189207, 0, 0 4096: 4096, 0, 8157, 8, 179060, 0, 0 8192: 8192, 0, 26, 8, 634, 0, 0 16384: 16384, 0, 14, 5, 638, 0, 0 32768: 32768, 0, 82, 1, 384, 0, 0 65536: 65536, 0, 37, 5, 197, 0, 0 SLEEPQUEUE: 80, 0, 469, 802, 469, 0, 0 64 pcpu: 8, 0, 2092, 1236, 2092, 0, 0 Files: 80, 0, 50, 1350, 1087281, 0, 0 TURNSTILE: 136, 0, 469, 331, 469, 0, 0 rl_entry: 40, 0, 63, 2037, 63, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0 PROC: 1256, 0, 35, 91, 159813, 0, 0 THREAD: 1176, 0, 435, 33, 608, 0, 0 cpuset: 72, 0, 325, 555, 525, 0, 0 audit_record: 1248, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 6501450, 8184, 3202, 126976, 0, 0 mbuf: 256, 6501450, 1, 2024, 105697, 0, 0 mbuf_cluster: 2048, 1015850, 11385, 11, 11385, 0, 0 mbuf_jumbo_page: 4096, 507925, 0, 18, 97, 0, 0 mbuf_jumbo_9k: 9216, 451488, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 338616, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 ttyinq: 160, 0, 180, 320, 540, 0, 0 ttyoutq: 256, 0, 95, 400, 287, 0, 0 g_bio: 248, 0, 0, 1056, 92469, 0, 0 DMAR_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0 nvme_request: 128, 0, 0, 0, 0, 0, 0 ata_request: 336, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0 FPU_save_area: 512, 0, 0, 0, 0, 0, 0 taskq_zone: 48, 0, 0, 3071, 16157, 0, 0 VNODE: 472, 0, 92684, 4588, 256320, 0, 0 VNODEPOLL: 112, 0, 0, 0, 0, 0, 0 BUF TRIE: 144, 0, 0, 105273, 0, 0, 0 S VFS Cache: 108, 0, 28430, 5450, 342012, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 6901, 22391, 108820, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 144, 3399112, 0, 0 DIRHASH: 1024, 0, 0, 0, 0, 0, 0 NCLNODE: 528, 0, 0, 0, 0, 0, 0 Mountpoints: 816, 0, 12, 18, 12, 0, 0 pipe: 744, 0, 1, 144, 53151, 0, 0 procdesc: 128, 0, 0, 0, 0, 0, 0 range_seg_cache: 64, 0, 1347, 1691, 12798, 0, 0 zio_cache: 920, 0, 8, 16984, 2100989, 0, 0 zio_link_cache: 48, 0, 0, 18509, 1012129, 0, 0 zio_buf_512: 512, 0, 247408, 488, 660543, 0, 0 zio_data_buf_512: 512, 0, 67640, 336, 406851, 0, 0 zio_buf_1024: 1024, 0, 1198, 50, 44769, 0, 0 zio_data_buf_1024: 1024, 0, 41452, 32, 41842, 0, 0 zio_buf_1536: 1536, 0, 399, 43, 17558, 0, 0 zio_data_buf_1536: 1536, 0, 16426, 44, 16710, 0, 0 zio_buf_2048: 2048, 0, 140, 40, 8803, 0, 0 zio_data_buf_2048: 2048, 0, 7555, 21, 7807, 0, 0 zio_buf_2560: 2560, 0, 71, 19, 5336, 0, 0 zio_data_buf_2560: 2560, 0, 5025, 15, 5251, 0, 0 zio_buf_3072: 3072, 0, 63, 21, 3861, 0, 0 zio_data_buf_3072: 3072, 0, 3564, 12, 3768, 0, 0 zio_buf_3584: 3584, 0, 34, 11, 3558, 0, 0 zio_data_buf_3584: 3584, 0, 3356, 0, 3526, 0, 0 zio_buf_4096: 4096, 0, 45, 7272, 186898, 0, 0 zio_data_buf_4096: 4096, 0, 3274, 2, 3506, 0, 0 zio_buf_5120: 5120, 0, 41, 161, 5126, 0, 0 zio_data_buf_5120: 5120, 0, 4883, 0, 5162, 0, 0 zio_buf_6144: 6144, 0, 31, 118, 3462, 0, 0 zio_data_buf_6144: 6144, 0, 3247, 0, 3471, 0, 0 zio_buf_7168: 7168, 0, 15, 90, 2633, 0, 0 zio_data_buf_7168: 7168, 0, 2473, 1, 2638, 0, 0 zio_buf_8192: 8192, 0, 14, 453, 4939, 0, 0 zio_data_buf_8192: 8192, 0, 1660, 2, 1823, 0, 0 zio_buf_10240: 10240, 0, 19, 174, 2697, 0, 0 zio_data_buf_10240: 10240, 0, 2455, 2, 2734, 0, 0 zio_buf_12288: 12288, 0, 22, 102, 3321, 0, 0 zio_data_buf_12288: 12288, 0, 1746, 2, 1972, 0, 0 zio_buf_14336: 14336, 0, 8, 114, 1437, 0, 0 zio_data_buf_14336: 14336, 0, 1287, 2, 1435, 0, 0 zio_buf_16384: 16384, 0, 13288, 288, 29096, 0, 0 zio_data_buf_16384: 16384, 0, 890, 2, 1052, 0, 0 zio_buf_20480: 20480, 0, 15, 67, 1941, 0, 0 zio_data_buf_20480: 20480, 0, 1233, 1, 1518, 0, 0 zio_buf_24576: 24576, 0, 6, 49, 1394, 0, 0 zio_data_buf_24576: 24576, 0, 883, 1, 1100, 0, 0 zio_buf_28672: 28672, 0, 1, 50, 953, 0, 0 zio_data_buf_28672: 28672, 0, 557, 2, 732, 0, 0 zio_buf_32768: 32768, 0, 4, 33, 799, 0, 0 zio_data_buf_32768: 32768, 0, 436, 1, 606, 0, 0 zio_buf_40960: 40960, 0, 4, 49, 1233, 0, 0 zio_data_buf_40960: 40960, 0, 710, 2, 979, 0, 0 zio_buf_49152: 49152, 0, 7, 38, 931, 0, 0 zio_data_buf_49152: 49152, 0, 398, 2, 646, 0, 0 zio_buf_57344: 57344, 0, 2, 33, 673, 0, 0 zio_data_buf_57344: 57344, 0, 249, 2, 532, 0, 0 zio_buf_65536: 65536, 0, 1, 20, 538, 0, 0 zio_data_buf_65536: 65536, 0, 198, 2, 598, 0, 0 zio_buf_81920: 81920, 0, 4, 40, 1099, 0, 0 zio_data_buf_81920: 81920, 0, 284, 3, 481, 0, 0 zio_buf_98304: 98304, 0, 1, 15, 877, 0, 0 zio_data_buf_98304: 98304, 0, 178, 3, 341, 0, 0 zio_buf_114688: 114688, 0, 3, 15, 634, 0, 0 zio_data_buf_114688: 114688, 0, 128, 5, 291, 0, 0 zio_buf_131072: 131072, 0, 4, 129, 12606, 0, 0 zio_data_buf_131072: 131072, 0, 5172, 2, 9526, 0, 0 zio_buf_163840: 163840, 0, 0, 0, 0, 0, 0 zio_data_buf_163840: 163840, 0, 0, 0, 0, 0, 0 zio_buf_196608: 196608, 0, 0, 0, 0, 0, 0 zio_data_buf_196608: 196608, 0, 0, 0, 0, 0, 0 zio_buf_229376: 229376, 0, 0, 0, 0, 0, 0 zio_data_buf_229376: 229376, 0, 0, 0, 0, 0, 0 zio_buf_262144: 262144, 0, 0, 0, 0, 0, 0 zio_data_buf_262144: 262144, 0, 0, 0, 0, 0, 0 zio_buf_327680: 327680, 0, 0, 0, 0, 0, 0 zio_data_buf_327680: 327680, 0, 0, 0, 0, 0, 0 zio_buf_393216: 393216, 0, 0, 0, 0, 0, 0 zio_data_buf_393216: 393216, 0, 0, 0, 0, 0, 0 zio_buf_458752: 458752, 0, 0, 0, 0, 0, 0 zio_data_buf_458752: 458752, 0, 0, 0, 0, 0, 0 zio_buf_524288: 524288, 0, 0, 0, 0, 0, 0 zio_data_buf_524288: 524288, 0, 0, 0, 0, 0, 0 zio_buf_655360: 655360, 0, 0, 0, 0, 0, 0 zio_data_buf_655360: 655360, 0, 0, 0, 0, 0, 0 zio_buf_786432: 786432, 0, 0, 0, 0, 0, 0 zio_data_buf_786432: 786432, 0, 0, 0, 0, 0, 0 zio_buf_917504: 917504, 0, 0, 0, 0, 0, 0 zio_data_buf_917504: 917504, 0, 0, 0, 0, 0, 0 zio_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0 zio_data_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0 zio_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_data_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_data_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_data_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_data_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_data_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_data_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_data_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_data_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_data_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_data_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_data_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_data_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0 zio_data_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0 zio_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0 zio_data_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0 zio_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0 zio_data_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0 zio_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0 zio_data_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0 lz4_ctx: 16384, 0, 0, 16, 240204, 0, 0 sa_cache: 80, 0, 92636, 5264, 256181, 0, 0 dnode_t: 752, 0, 236272, 58, 237409, 0, 0 dmu_buf_impl_t: 224, 0, 436781, 595, 997313, 0, 0 arc_buf_hdr_t: 216, 0, 204419, 619, 596058, 0, 0 arc_buf_t: 72, 0, 204419, 1116, 596064, 0, 0 zil_lwb_cache: 192, 0, 5, 495, 391, 0, 0 zfs_znode_cache: 368, 0, 92636, 4514, 256181, 0, 0 ksiginfo: 112, 0, 117, 933, 202, 0, 0 itimer: 352, 0, 0, 33, 1, 0, 0 KNOTE: 128, 0, 0, 651, 118, 0, 0 socket: 696, 522950, 11, 94, 2956, 0, 0 ipq: 56, 31808, 0, 0, 0, 0, 0 udp_inpcb: 392, 522950, 2, 238, 395, 0, 0 udpcb: 24, 523044, 2, 2169, 395, 0, 0 tcp_inpcb: 392, 522950, 2, 208, 33, 0, 0 tcpcb: 1032, 522951, 2, 52, 33, 0, 0 tcptw: 88, 27810, 0, 270, 2, 0, 0 syncache: 160, 15375, 0, 75, 1, 0, 0 hostcache: 136, 15370, 3, 200, 3, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 tcpreass: 40, 63500, 0, 1600, 5246, 0, 0 sctp_ep: 1424, 522950, 0, 0, 0, 0, 0 sctp_asoc: 2416, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 830, 3, 0, 0 sctp_raddr: 728, 80000, 0, 0, 0, 0, 0 sctp_chunk: 136, 400026, 0, 0, 0, 0, 0 sctp_readq: 104, 400026, 0, 0, 0, 0, 0 sctp_stream_msg_out: 104, 400026, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 392, 522950, 0, 0, 0, 0, 0 ripcb: 392, 522950, 0, 0, 0, 0, 0 unpcb: 240, 522960, 7, 489, 2523, 0, 0 rtentry: 200, 0, 13, 367, 13, 0, 0 selfd: 56, 0, 34, 2025, 213191, 0, 0 SWAPMETA: 288, 2031705, 0, 0, 0, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq23: ehci0 8940 262 cpu0:timer 164378 4834 irq282: igb0:que 0 66374 1952 irq283: igb0:que 1 72735 2139 irq284: igb0:que 2 2556 75 irq285: igb0:que 3 5221 153 irq286: igb0:que 4 3334 98 irq287: igb0:que 5 4889 143 irq288: igb0:que 6 25523 750 irq289: igb0:que 7 2921 85 irq290: igb0:link 2 0 irq319: ahci1 31186 917 cpu1:timer 93730 2756 cpu5:timer 71948 2116 cpu2:timer 76360 2245 cpu6:timer 80255 2360 cpu4:timer 83108 2444 cpu7:timer 72318 2127 cpu3:timer 71680 2108 Total 937458 27572 ------------------------------------------------------------------------ pstat -T 50/522948 files 0M/4095M swap space ------------------------------------------------------------------------ pstat -s Device 512-blocks Used Avail Capacity /dev/ada0p2 4194048 0 4194048 0% /dev/ada1p2 4194048 0 4194048 0% Total 8388096 0 8388096 0% ------------------------------------------------------------------------ iostat iostat: kvm_read(_tk_nin): invalid address (0x0) iostat: disabling TTY statistics ada0 ada1 pass0 cpu KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 53.56 444 23.20 54.27 436 23.10 0.00 0 0.00 1 0 2 0 97 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 632 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits Misses 0 0 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Server Ret-Failed 0 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 0 0 0 ------------------------------------------------------------------------ netstat -s tcp: 76265 packets sent 28741 data packets (2150624 bytes) 0 data packets (0 bytes) retransmitted 0 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 47220 ack-only packets (15 delayed) 0 URG only packets 0 window probe packets 248 window update packets 56 control packets 106646 packets received 16487 acks (for 2150621 bytes) 14 duplicate acks 0 acks for unsent data 84963 packets (120930850 bytes) received in-sequence 0 completely duplicate packets (0 bytes) 0 old duplicate packets 0 packets with some dup. data (0 bytes duped) 5246 out-of-order packets (7563709 bytes) 0 packets (0 bytes) of data after window 0 window probes 14 window update packets 0 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 1 discarded due to memory problems 28 connection requests 1 connection accept 0 bad connection attempts 0 listen queue overflows 0 ignored RSTs in the windows 29 connections established (including accepts) 31 connections closed (including 0 drops) 5 connections updated cached RTT on close 5 connections updated cached RTT variance on close 0 connections updated cached ssthresh on close 0 embryonic connections dropped 16487 segments updated rtt (of 16062 attempts) 0 retransmit timeouts 0 connections dropped by rexmit timeout 0 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 0 keepalive timeouts 0 keepalive probes sent 0 connections dropped by keepalive 16274 correct ACK header predictions 84869 correct data packet header predictions 1 syncache entry added 0 retransmitted 0 dupsyn 0 dropped 1 completed 0 bucket overflow 0 cache overflow 0 reset 0 stale 0 aborted 0 badack 0 unreach 0 zone failures 1 cookie sent 0 cookies received 3 hostcache entries added 0 bucket overflow 0 SACK recovery episodes 0 segment rexmits in SACK recovery episodes 0 byte rexmits in SACK recovery episodes 0 SACK options (SACK blocks) received 5139 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window 0 packets with valid tcp-md5 signature received 0 packets with invalid tcp-md5 signature received 0 packets with tcp-md5 signature mismatch 0 packets with unexpected tcp-md5 signature received 0 packets without expected tcp-md5 signature received udp: 7804 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 0 with no checksum 0 dropped due to no socket 7744 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 60 delivered 60 datagrams output 0 times multicast source filter matched ip: 114450 total packets received 0 bad header checksums 0 with size smaller than minimum 0 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 114450 packets for this host 0 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 0 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 76325 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 0 calls to icmp_error 0 errors not generated in response to an icmp message 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored 0 message responses generated 0 invalid return addresses 0 no return routes igmp: 0 messages received 0 messages received with too few bytes 0 messages received with wrong TTL 0 messages received with bad checksum 0 V1/V2 membership queries received 0 V3 membership queries received 0 membership queries received with invalid field(s) 0 general queries received 0 group queries received 0 group-source queries received 0 group-source queries dropped 0 membership reports received 0 membership reports received with invalid field(s) 0 membership reports received for groups to which we belong 0 V3 reports received without Router Alert 0 membership reports sent arp: 5 ARP requests sent 9 ARP replies sent 3823 ARP requests received 176 ARP replies received 3999 ARP packets received 0 total packets dropped due to no ARP entry 0 ARP entrys timed out 0 Duplicate IPs seen ip6: 0 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 packets reassembled ok 0 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 0 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 14 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 0 multicast packets which we don't join Mbuf statistics: 0 one mbuf 2 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not contiguous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 0 failures of source address selection Source addresses selection rule applied: icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 0 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 path MTU changes rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output ------------------------------------------------------------------------ netstat -m netstat: invalid address (0x0) 8185/5226/13411 mbufs in use (current/cache/total) 8183/3213/11396/1015850 mbuf clusters in use (current/cache/total/max) 8184/3202 mbuf+clusters out of packet secondary zone in use (current/cache) 0/18/18/507925 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/451488 9k jumbo clusters in use (current/cache/total/max) 0/0/0/338616 16k jumbo clusters in use (current/cache/total/max) 18412K/7804K/26216K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) ------------------------------------------------------------------------ netstat -anr Routing tables Internet: Destination Gateway Flags Netif Expire default 192.168.6.254 UGS igb0 127.0.0.1 link#9 UH lo0 192.168.6.0/24 link#5 U igb0 192.168.6.248 link#5 UHS lo0 Internet6: Destination Gateway Flags Netif Expire ::/96 ::1 UGRS lo0 ::1 link#9 UH lo0 ::ffff:0.0.0.0/96 ::1 UGRS lo0 fe80::/10 ::1 UGRS lo0 fe80::%lo0/64 link#9 U lo0 fe80::1%lo0 link#9 UHS lo0 ff01::%lo0/32 ::1 U lo0 ff02::/16 ::1 UGRS lo0 ff02::%lo0/32 ::1 U lo0 ------------------------------------------------------------------------ netstat -anA Active Internet connections (including servers) Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state) fffff800365d8810 tcp4 0 0 192.168.6.248.22 192.168.6.21.50240 ESTABLISHED fffff8003665f810 tcp4 0 0 192.168.6.248.22 *.* LISTEN fffff8003620b310 udp4 0 0 *.514 *.* fffff8003620b498 udp6 0 0 *.514 *.* Active UNIX domain sockets Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr fffff80036231960 stream 0 0 0 fffff8003621ae10 0 0 fffff8003621ae10 stream 0 0 0 fffff80036231960 0 0 fffff80036236c30 stream 0 0 fffff8003625d1d8 0 0 0 /var/run/devd.pipe fffff800362fc960 dgram 0 0 0 fffff8003622d4b0 0 0 fffff8003622d4b0 dgram 0 0 fffff800365cab10 0 fffff800362fc960 0 /var/run/logpriv fffff8003622d5a0 dgram 0 0 fffff800365cace8 0 0 0 /var/run/log fffff80036236b40 seqpac 0 0 fffff8003625d000 0 0 0 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ netstat -aL Current listen queue sizes (qlen/incqlen/maxqlen) Proto Listen Local Address tcp4 0/0/128 192.168.6.248.ssh unix 0/0/4 /var/run/devd.pipe unix 0/0/4 /var/run/devd.seqpacket.pipe ------------------------------------------------------------------------ fstat fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 5 at 0x14000000000 fstat: can't read file 11 at 0x9800000000 fstat: can't read file 17 at 0x9600000000 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0xa00000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0xe00000000 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x400000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read file 8 at 0x4000000001fffff fstat: can't read file 10 at 0x780000ffff fstat: can't read file 11 at 0x400000000 fstat: can't read file 13 at 0x200007fffffffff fstat: can't read file 14 at 0x4000000001fffff fstat: can't read file 16 at 0x780000ffff fstat: can't read file 17 at 0x400000000 fstat: can't read file 19 at 0x200007fffffffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read file 7 at 0x200007fffffffff fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read file 1 at 0x200007fffffffff fstat: can't read file 2 at 0x4000000001fffff fstat: can't read file 4 at 0x780000ffff fstat: can't read file 5 at 0x800000000 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 fstat: can't read znode_phys at 0x1 USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root PingTest 59932 root - - error - root PingTest 59932 wd - - error - root PingTest 59932 text - - error - root PingTest 59932 ctty /dev 99 crw--w---- pts/0 rw root PingTest 59932 0 /dev 99 crw--w---- pts/0 rw root csh 1541 root - - error - root csh 1541 wd - - error - root csh 1541 text - - error - root csh 1541 ctty /dev 99 crw--w---- pts/0 rw root su 1540 root - - error - root su 1540 wd - - error - root su 1540 text - - error - root su 1540 ctty /dev 99 crw--w---- pts/0 rw root su 1540 0 /dev 99 crw--w---- pts/0 rw joe sh 1538 root - - error - joe sh 1538 wd - - error - joe sh 1538 text - - error - joe sh 1538 ctty /dev 99 crw--w---- pts/0 rw joe sh 1538 0 /dev 99 crw--w---- pts/0 rw joe sh 1538 6 /dev 99 crw--w---- pts/0 rw joe sshd 1537 root - - error - joe sshd 1537 wd - - error - joe sshd 1537 text - - error - joe sshd 1537 0 /dev 8 crw-rw-rw- null rw joe sshd 1537 6 /dev 8 crw-rw-rw- null rw root sshd 1534 root - - error - root sshd 1534 wd - - error - root sshd 1534 text - - error - root sshd 1534 0 /dev 8 crw-rw-rw- null r root getty 1516 root - - error - root getty 1516 wd - - error - root getty 1516 text - - error - root getty 1516 ctty /dev 61 crw------- ttyv7 rw root getty 1516 0 /dev 61 crw------- ttyv7 rw root getty 1515 root - - error - root getty 1515 wd - - error - root getty 1515 text - - error - root getty 1515 ctty /dev 60 crw------- ttyv6 rw root getty 1515 0 /dev 60 crw------- ttyv6 rw root getty 1514 root - - error - root getty 1514 wd - - error - root getty 1514 text - - error - root getty 1514 ctty /dev 59 crw------- ttyv5 rw root getty 1514 0 /dev 59 crw------- ttyv5 rw root getty 1513 root - - error - root getty 1513 wd - - error - root getty 1513 text - - error - root getty 1513 ctty /dev 58 crw------- ttyv4 rw root getty 1513 0 /dev 58 crw------- ttyv4 rw root getty 1512 root - - error - root getty 1512 wd - - error - root getty 1512 text - - error - root getty 1512 ctty /dev 57 crw------- ttyv3 rw root getty 1512 0 /dev 57 crw------- ttyv3 rw root getty 1511 root - - error - root getty 1511 wd - - error - root getty 1511 text - - error - root getty 1511 ctty /dev 56 crw------- ttyv2 rw root getty 1511 0 /dev 56 crw------- ttyv2 rw root getty 1510 root - - error - root getty 1510 wd - - error - root getty 1510 text - - error - root getty 1510 ctty /dev 55 crw------- ttyv1 rw root getty 1510 0 /dev 55 crw------- ttyv1 rw root getty 1509 root - - error - root getty 1509 wd - - error - root getty 1509 text - - error - root getty 1509 ctty /dev 54 crw------- ttyv0 rw root getty 1509 0 /dev 54 crw------- ttyv0 rw root cron 1462 root - - error - root cron 1462 wd - - error - root cron 1462 text - - error - root cron 1462 0 /dev 8 crw-rw-rw- null rw root sshd 1458 root - - error - root sshd 1458 wd - - error - root sshd 1458 text - - error - root sshd 1458 0 /dev 8 crw-rw-rw- null rw root syslogd 1326 root - - error - root syslogd 1326 wd - - error - root syslogd 1326 text - - error - root syslogd 1326 0 /dev 8 crw-rw-rw- null rw root syslogd 1326 6 /dev 8 crw-rw-rw- null rw root syslogd 1326 12 /dev 8 crw-rw-rw- null rw root syslogd 1326 18 - - error - root devd 1163 root - - error - root devd 1163 wd - - error - root devd 1163 text - - error - root devd 1163 0 /dev 8 crw-rw-rw- null rw root devd 1163 6 /dev 8 crw-rw-rw- null rw root moused 1146 root - - error - root moused 1146 wd - - error - root moused 1146 text - - error - root moused 1146 0 /dev 8 crw-rw-rw- null rw root zfskern 3 root - - error - root zfskern 3 wd - - error - root init 1 root - - error - root init 1 wd - - error - root init 1 text - - error - root kernel 0 root - - error - root kernel 0 wd - - error - ------------------------------------------------------------------------ dmesg Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.2-RELEASE-p10 #1 r294714M: Mon Jan 25 12:45:48 UTC 2016 j...@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Atom(TM) CPU C2750 @ 2.40GHz (2400.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x406d8 Family=0x6 Model=0x4d Stepping=8 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x43d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,AESNI,RDRAND> AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM> AMD Features2=0x101<LAHF,Prefetch> Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 17179869184 (16384 MB) avail memory = 16539582464 (15773 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <INTEL TIANO > FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 8 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 cpu4 (AP): APIC ID: 8 cpu5 (AP): APIC ID: 10 cpu6 (AP): APIC ID: 12 cpu7 (AP): APIC ID: 14 ioapic0 <Version 2.0> irqs 0-23 on motherboard netmap: loaded module random: <Software, Yarrow> initialized module_register_init: MOD_LOAD (vesa, 0xffffffff80df9540, 0) error 19 kbd1 at kbdmux0 acpi0: <ALASKA A M I > on motherboard acpi0: Power Button (fixed) cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 cpu4: <ACPI CPU> on acpi0 cpu5: <ACPI CPU> on acpi0 cpu6: <ACPI CPU> on acpi0 cpu7: <ACPI CPU> on acpi0 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. Event timer "RTC" frequency 32768 Hz quality 0 attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> mem 0xdd9c0000-0xdd9dffff irq 16 at device 1.0 on pci0 pci1: <ACPI PCI bus> on pcib1 pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1 pci2: <ACPI PCI bus> on pcib2 vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 0xde000000-0xdeffffff,0xdf000000-0xdf01ffff irq 16 at device 0.0 on pci2 vgapci0: Boot video device pcib3: <ACPI PCI-PCI bridge> mem 0xdd9a0000-0xdd9bffff irq 16 at device 2.0 on pci0 pci3: <ACPI PCI bus> on pcib3 pcib4: <ACPI PCI-PCI bridge> mem 0xdd980000-0xdd99ffff irq 20 at device 3.0 on pci0 pci4: <ACPI PCI bus> on pcib4 pci4: <network, ethernet> at device 0.0 (no driver attached) pci4: <network, ethernet> at device 0.1 (no driver attached) pci4: <network, ethernet> at device 0.2 (no driver attached) pci4: <network, ethernet> at device 0.3 (no driver attached) t5nex0: <Chelsio T520-SO> mem 0xdd300000-0xdd37ffff,0xdc000000-0xdcffffff,0xdd884000-0xdd885fff irq 22 at device 0.4 on pci4 cxl0: <port 0> on t5nex0 cxl0: Ethernet address: 00:07:43:33:89:f0 cxl0: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap) ncxl0: Ethernet address: 00:07:43:33:89:f1 ncxl0: netmap queues/slots: TX 2/1023, RX 2/1024 cxl1: <port 1> on t5nex0 cxl1: Ethernet address: 00:07:43:33:89:f8 cxl1: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap) ncxl1: Ethernet address: 00:07:43:33:89:f9 ncxl1: netmap queues/slots: TX 2/1023, RX 2/1024 t5nex0: PCIe gen2 x8, 2 ports, 26 MSI-X interrupts, 63 eq, 25 iq pci4: <mass storage, SCSI> at device 0.5 (no driver attached) pci4: <serial bus, Fibre Channel> at device 0.6 (no driver attached) pci0: <base peripheral, IOMMU> at device 15.0 (no driver attached) igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0c0-0xe0df mem 0xdd960000-0xdd97ffff,0xdd9ec000-0xdd9effff irq 20 at device 20.0 on pci0 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 0c:c4:7a:7c:58:30 igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0a0-0xe0bf mem 0xdd940000-0xdd95ffff,0xdd9e8000-0xdd9ebfff irq 21 at device 20.1 on pci0 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 0c:c4:7a:7c:58:31 igb1: Bound queue 0 to cpu 0 igb1: Bound queue 1 to cpu 1 igb1: Bound queue 2 to cpu 2 igb1: Bound queue 3 to cpu 3 igb1: Bound queue 4 to cpu 4 igb1: Bound queue 5 to cpu 5 igb1: Bound queue 6 to cpu 6 igb1: Bound queue 7 to cpu 7 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 igb2: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe080-0xe09f mem 0xdd920000-0xdd93ffff,0xdd9e4000-0xdd9e7fff irq 22 at device 20.2 on pci0 igb2: Using MSIX interrupts with 9 vectors igb2: Ethernet address: 0c:c4:7a:7c:58:32 igb2: Bound queue 0 to cpu 0 igb2: Bound queue 1 to cpu 1 igb2: Bound queue 2 to cpu 2 igb2: Bound queue 3 to cpu 3 igb2: Bound queue 4 to cpu 4 igb2: Bound queue 5 to cpu 5 igb2: Bound queue 6 to cpu 6 igb2: Bound queue 7 to cpu 7 igb2: netmap queues/slots: TX 8/1024, RX 8/1024 igb3: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe060-0xe07f mem 0xdd900000-0xdd91ffff,0xdd9e0000-0xdd9e3fff irq 23 at device 20.3 on pci0 igb3: Using MSIX interrupts with 9 vectors igb3: Ethernet address: 0c:c4:7a:7c:58:33 igb3: Bound queue 0 to cpu 0 igb3: Bound queue 1 to cpu 1 igb3: Bound queue 2 to cpu 2 igb3: Bound queue 3 to cpu 3 igb3: Bound queue 4 to cpu 4 igb3: Bound queue 5 to cpu 5 igb3: Bound queue 6 to cpu 6 igb3: Bound queue 7 to cpu 7 igb3: netmap queues/slots: TX 8/1024, RX 8/1024 ehci0: <Intel Avoton USB 2.0 controller> mem 0xdd9f3000-0xdd9f33ff irq 23 at device 22.0 on pci0 usbus0: EHCI version 1.0 usbus0 on ehci0 ahci0: <Intel Avoton AHCI SATA controller> port 0xe150-0xe157,0xe140-0xe143,0xe130-0xe137,0xe120-0xe123,0xe040-0xe05f mem 0xdd9f2000-0xdd9f27ff irq 19 at device 23.0 on pci0 ahci0: AHCI v1.30 with 4 3Gbps ports, Port Multiplier not supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich2: <AHCI channel> at channel 2 on ahci0 ahcich3: <AHCI channel> at channel 3 on ahci0 ahci1: <Intel Avoton AHCI SATA controller> port 0xe110-0xe117,0xe100-0xe103,0xe0f0-0xe0f7,0xe0e0-0xe0e3,0xe020-0xe03f mem 0xdd9f1000-0xdd9f17ff irq 19 at device 24.0 on pci0 ahci1: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported ahcich4: <AHCI channel> at channel 0 on ahci1 ahcich5: <AHCI channel> at channel 1 on ahci1 isab0: <PCI-ISA bridge> at device 31.0 on pci0 isa0: <ISA bus> on isab0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: CGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range est0: <Enhanced SpeedStep Frequency Control> on cpu0 est1: <Enhanced SpeedStep Frequency Control> on cpu1 est2: <Enhanced SpeedStep Frequency Control> on cpu2 est3: <Enhanced SpeedStep Frequency Control> on cpu3 est4: <Enhanced SpeedStep Frequency Control> on cpu4 est5: <Enhanced SpeedStep Frequency Control> on cpu5 est6: <Enhanced SpeedStep Frequency Control> on cpu6 est7: <Enhanced SpeedStep Frequency Control> on cpu7 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec random: unblocking device. usbus0: 480Mbps High Speed USB v2.0 ugen0.1: <Intel> at usbus0 uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0 ada0 at ahcich4 bus 0 scbus4 target 0 lun 0 ada0: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device ada0: Serial Number S2NHNXAG900346Y ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad12 ada1 at ahcich5 bus 0 scbus5 target 0 lun 0 ada1: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device ada1: Serial Number S2NHNXAG900330L ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad14 SMP: AP CPU #1 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC-low" frequency 1200028824 Hz quality 1000 Root mount waiting for: usbus0 Root mount waiting for: usbus0 Root mount waiting for: usbus0 Root mount waiting for: usbus0 uhub0: 8 ports with 8 removable, self powered Root mount waiting for: usbus0 ugen0.2: <vendor 0x8087> at usbus0 uhub1: <vendor 0x8087 product 0x07db, class 9/0, rev 2.00/0.02, addr 2> on usbus0 uhub1: 4 ports with 4 removable, self powered Root mount waiting for: usbus0 ugen0.3: <vendor 0x0409> at usbus0 uhub2: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 3> on usbus0 uhub2: 4 ports with 4 removable, self powered ugen0.4: <vendor 0x0409> at usbus0 uhub3: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 4> on usbus0 Root mount waiting for: usbus0 uhub3: 3 ports with 3 removable, self powered ugen0.5: <vendor 0x0557> at usbus0 uhub4: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 5> on usbus0 Root mount waiting for: usbus0 uhub4: 4 ports with 3 removable, self powered ugen0.6: <vendor 0x0557> at usbus0 ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on usbus0 kbd2 at ukbd0 Trying to mount root from zfs:zroot/ROOT/default []... Setting hostuuid: 00000000-0000-0000-0000-0cc47a7c5830. Setting hostid: 0x824b79f8. Entropy harvesting: interrupts ethernet point_to_point swi. Starting file system checks: Mounting local file systems:. Writing entropy file:. Setting hostname: jj.gla.uk.iotx. Starting Network: lo0 cxl0 ncxl0 cxl1 ncxl1 igb0 igb1 igb2 igb3. lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6> inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x9 inet 127.0.0.1 netmask 0xff000000 nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> ether 00:07:43:33:89:f0 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 ether 00:07:43:33:89:f1 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> ether 00:07:43:33:89:f8 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 ether 00:07:43:33:89:f9 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier igb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:30 inet 192.168.6.248 netmask 0xffffff00 broadcast 192.168.6.255 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:31 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:32 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:33 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier Starting devd. Starting Network: cxl0. cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> ether 00:07:43:33:89:f0 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier Starting Network: ncxl0. ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 ether 00:07:43:33:89:f1 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier Starting Network: cxl1. cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> ether 00:07:43:33:89:f8 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier Starting Network: ncxl1. ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500 ether 00:07:43:33:89:f9 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet 10Gbase-Twinax <full-duplex> status: no carrier Starting Network: igb1. igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:31 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier Starting Network: igb2. igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:32 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier Starting Network: igb3. igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO> ether 0c:c4:7a:7c:58:33 nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect status: no carrier Configuring syscons: keymap. ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. eval: ${route_route_mngmt,...}: Bad substitution /etc/rc: WARNING: route_route_mngmt, not found. /etc/rc: WARNING: route_route_old not found. add net default: gateway 192.168.6.254 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/llvm37/lib 32-bit compatibility ldconfig path: /usr/lib32 Clearing /tmp (X related). Updating motd:. Mounting late file systems:. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Raising kernel security level: kern.securelevel: -1 -> 1 Starting background file system checks in 60 seconds. Mon Jan 25 13:39:43 UTC 2016 Jan 25 13:55:37 jj su: joe to root on /dev/pts/0 516.216275 [1233] netmap_mem_global_config reconfiguring Fatal trap 12: page fault while in kernel mode cpuid = 4; apic id = 08 fault virtual address = 0x6 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff804d2269 stack pointer = 0x28:0xfffffe0467ce0420 frame pointer = 0x28:0xfffffe0467ce04f0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 59932 (PingTest) trap number = 12 panic: page fault cpuid = 4 KDB: stack backtrace: #0 0xffffffff809c5590 at kdb_backtrace+0x60 #1 0xffffffff80989146 at vpanic+0x126 #2 0xffffffff80989013 at panic+0x43 #3 0xffffffff80d8b16b at trap_fatal+0x36b #4 0xffffffff80d8b46d at trap_pfault+0x2ed #5 0xffffffff80d8ab0a at trap+0x47a #6 0xffffffff80d70e82 at calltrap+0x8 #7 0xffffffff806a9ba9 at netmap_do_unregif+0x89 #8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1 #9 0xffffffff806abcb5 at netmap_ioctl+0x755 #10 0xffffffff808706b9 at devfs_ioctl_f+0x139 #11 0xffffffff809dd485 at kern_ioctl+0x255 #12 0xffffffff809dd180 at sys_ioctl+0x140 #13 0xffffffff80d8ba87 at amd64_syscall+0x357 #14 0xffffffff80d7116b at Xfast_syscall+0xfb Uptime: 39m8s Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% ------------------------------------------------------------------------ kernel config options CONFIG_AUTOGENERATED ident GENERIC machine amd64 cpu HAMMER makeoptions WITH_CTF=1 makeoptions DEBUG=-g options XENHVM options HYPERV options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options ATA_STATIC_ID options ACPI_DMAR options SMP options KDB_TRACE options KDB options RCTL options RACCT_DEFAULT_TO_DISABLED options RACCT options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options PROCDESC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD device isa device mem device io device uart_ns8250 device cpufreq device acpi device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device trm device adv device adw device aic device bt device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device twe device nvme device nvd device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device vt_efifb device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ix device ixv device ixl device ixlv device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device wb device xl device cs device ed device ex device ep device fe device sn device xe device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx device netmap device cxgbe ------------------------------------------------------------------------ ddb capture buffer ddb: ddb_capture: kvm_nlist
_______________________________________________ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"