Hi,

I'm looking for a bit of help to track down the reason behind this kernel 
panic, it seems like netmap works fine for the majority of the time, but 
occasionally it will cause the box to kernel panic.


The machine is running FreeBSD Current from a few weeks ago (Rev 296937)


And it has a Chelsio T520-SO network card in it.


We've been developing with netmap for a while now, and while the kernel panic 
doesn't seem to be 100% reproducible, it's happening regularly enough to cause 
alarm!


Thanks for any help!


Steven


jj.gla.uk.iotx dumped core - see /var/crash/vmcore.0

Mon Jan 25 14:27:06 UTC 2016

FreeBSD jj.gla.uk.iotx 10.2-RELEASE-p10 FreeBSD 10.2-RELEASE-p10 #1 r294714M: 
Mon Jan 25 12:45:48 UTC 2016     
j...@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC  amd64

panic: page fault

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid = 4; apic id = 08
fault virtual address   = 0x6
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff804d2269
stack pointer           = 0x28:0xfffffe0467ce0420
frame pointer           = 0x28:0xfffffe0467ce04f0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 59932 (PingTest)
trap number             = 12
panic: page fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff809c5590 at kdb_backtrace+0x60
#1 0xffffffff80989146 at vpanic+0x126
#2 0xffffffff80989013 at panic+0x43
#3 0xffffffff80d8b16b at trap_fatal+0x36b
#4 0xffffffff80d8b46d at trap_pfault+0x2ed
#5 0xffffffff80d8ab0a at trap+0x47a
#6 0xffffffff80d70e82 at calltrap+0x8
#7 0xffffffff806a9ba9 at netmap_do_unregif+0x89
#8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1
#9 0xffffffff806abcb5 at netmap_ioctl+0x755
#10 0xffffffff808706b9 at devfs_ioctl_f+0x139
#11 0xffffffff809dd485 at kern_ioctl+0x255
#12 0xffffffff809dd180 at sys_ioctl+0x140
#13 0xffffffff80d8ba87 at amd64_syscall+0x357
#14 0xffffffff80d7116b at Xfast_syscall+0xfb
Uptime: 39m8s
Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

Reading symbols from /boot/kernel/zfs.ko.symbols...done.
Loaded symbols for /boot/kernel/zfs.ko.symbols
Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
Loaded symbols for /boot/kernel/opensolaris.ko.symbols
Reading symbols from /boot/kernel/ums.ko.symbols...done.
Loaded symbols for /boot/kernel/ums.ko.symbols
#0  doadump (textdump=<value optimized out>) at pcpu.h:219
219     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:219
#1  0xffffffff80988da2 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:451
#2  0xffffffff80989185 in vpanic (fmt=<value optimized out>, 
    ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:758
#3  0xffffffff80989013 in panic (fmt=0x0)
    at /usr/src/sys/kern/kern_shutdown.c:687
#4  0xffffffff80d8b16b in trap_fatal (frame=<value optimized out>, 
    eva=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:851
#5  0xffffffff80d8b46d in trap_pfault (frame=0xfffffe0467ce0370, 
    usermode=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:674
#6  0xffffffff80d8ab0a in trap (frame=0xfffffe0467ce0370)
    at /usr/src/sys/amd64/amd64/trap.c:440
#7  0xffffffff80d70e82 in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:236
#8  0xffffffff804d2269 in cxgbe_netmap_reg (na=<value optimized out>, 
    on=<value optimized out>) at endian.h:95
#9  0xffffffff806a9ba9 in netmap_do_unregif (priv=<value optimized out>, 
    nifp=0xfffffe0467dc2000) at /usr/src/sys/dev/netmap/netmap.c:1011
#10 0xffffffff806ab4e1 in netmap_do_regif (priv=0xfffff8034cd99600, 
    na=<value optimized out>, ringid=<value optimized out>, 
    flags=<value optimized out>, err=0xfffffe0467ce08e4)
    at /usr/src/sys/dev/netmap/netmap.c:1973
#11 0xffffffff806abcb5 in netmap_ioctl (dev=<value optimized out>, 
    cmd=<value optimized out>, data=0xfffffe0467ce0a20 "ncxl0", 
    fflag=<value optimized out>, td=0xfffff800181e1000)
    at /usr/src/sys/dev/netmap/netmap.c:2124
#12 0xffffffff808706b9 in devfs_ioctl_f (fp=0xfffff80018adc640, 
    com=3225184658, data=0xfffffe0467ce0a20, cred=<value optimized out>, 
    td=0xfffff800181e1000) at /usr/src/sys/fs/devfs/devfs_vnops.c:785
#13 0xffffffff809dd485 in kern_ioctl (td=0xfffff800181e1000, 
    fd=<value optimized out>, com=18446735278021152768) at file.h:320
#14 0xffffffff809dd180 in sys_ioctl (td=0xfffff800181e1000, 
    uap=0xfffffe0467ce0b80) at /usr/src/sys/kern/sys_generic.c:718
#15 0xffffffff80d8ba87 in amd64_syscall (td=0xfffff800181e1000, traced=0)
    at subr_syscall.c:134
#16 0xffffffff80d7116b in Xfast_syscall ()
    at /usr/src/sys/amd64/amd64/exception.S:396
#17 0x0000000801d8efda in ?? ()
Previous frame inner to this frame (corrupt stack?)
Current language:  auto; currently minimal
(kgdb) 

------------------------------------------------------------------------
ps -axlww

 UID   PID PPID CPU PRI NI    VSZ               RSS MWCHAN   STAT TT     TIME 
COMMAND
   0     0    0   0  -8  0      0 18005602445714496 -        DLs   -  0:00.24 
[kernel]
   0     1    0   0  20  0   9476 17979215789071360 wait     DLs   -  0:00.09 
[init]
   0     2    0   0 -16  0      0 18005602445714496 -        DL    -  0:00.00 
[cam]
   0     3    0   0  -8  0      0 18005602445714496 tx->tx_s DL    -  0:00.01 
[zfskern]
   0     4    0   0 -16  0      0 18005602445714496 waiting_ DL    -  0:00.00 
[sctp_iterator]
   0     5    0   0 -16  0      0 18005602445714496 umarcl   DL    -  0:00.00 
[pagedaemon]
   0     6    0   0 -16  0      0 18005602445714496 psleep   DL    -  0:00.00 
[vmdaemon]
   0     7    0   0 155  0      0 18005602445714496 pgzero   DL    -  0:00.00 
[pagezero]
   0     8    0   0 -16  0      0 18005602445714496 psleep   DL    -  0:00.00 
[bufdaemon]
   0     9    0   0  16  0      0 18005602445714496 syncer   DL    -  0:00.00 
[syncer]
   0    10    0   0 -16  0      0 18005602445714496 audit_wo DL    -  0:00.00 
[audit]
   0    11    0   0 155  0      0 18005602445714496 -        RL    -  1:53.38 
[idle]
   0    12    0   0 -84  0      0 18005602445714496 -        WL    -  0:00.12 
[intr]
   0    13    0   0  -8  0      0 18005602445714496 -        DL    -  0:00.01 
[geom]
   0    14    0   0 -16  0      0 18005602445714496 -        DL    -  0:00.01 
[rand_harvestq]
   0    15    0   0 -68  0      0 18005602445714496 -        DL    -  0:00.04 
[usb]
   0    16    0   0 -16  0      0 18005602445714496 -        RL    -  0:00.00 
[vnlru]
   0  1146    1   0  52  0  16728 17979215789043968 select   Ds    -  0:00.00 
[moused]
   0  1163    1   0  20  0  13624 17979215807998464 select   Ds    -  0:00.00 
[devd]
   0  1326    1   0  20  0  14512 17979215789053184 select   Ds    -  0:00.02 
[syslogd]
   0  1458    1   0  20  0  61224 17979215800481792 select   Ds    -  0:00.00 
[sshd]
   0  1462    1   0  20  0  16612 17979215791803904 nanslp   Ds    -  0:00.00 
[cron]
   0  1509    1   0  52  0  14508 17979215810882048 ttyin    Ds+   -  0:00.00 
[getty]
   0  1510    1   0  52  0  14508 17979215789040384 ttyin    Ds+   -  0:00.00 
[getty]
   0  1511    1   0  52  0  14508 17979215793232896 ttyin    Ds+   -  0:00.00 
[getty]
   0  1512    1   0  52  0  14508 17979215809296384 ttyin    Ds+   -  0:00.00 
[getty]
   0  1513    1   0  52  0  14508 17979215810767360 ttyin    Ds+   -  0:00.00 
[getty]
   0  1514    1   0  52  0  14508                 0 ttyin    Ds+   -  0:00.00 
[getty]
   0  1515    1   0  52  0  14508 17979215799724544 ttyin    Ds+   -  0:00.00 
[getty]
   0  1516    1   0  52  0  14508 17979215811466496 ttyin    Ds+   -  0:00.00 
[getty]
   0  1534 1458   0  21  0  86492 17979214623182336 select   Ds    -  0:00.00 
[sshd]
1002  1537 1534   0  20  0  86492 17979215803392768 select   D     -  0:00.00 
[sshd]
1002  1538 1537   0  20  0  17088 17979214623193088 wait     Ds    -  0:00.00 
[sh]
   0  1540 1538   0  20  0  47728 17979215803385600 wait     D     -  0:00.00 
[su]
   0  1541 1540   0  20  0  23592 17979215793152768 pause    D     -  0:00.01 
[csh]
   0 59932 1541   0  33  0 135952 17979215810326784 nanslp   D+    -  0:00.00 
[PingTest]

------------------------------------------------------------------------
vmstat -s

  2422120 cpu context switches
   223681 device interrupts
    71352 software interrupts
 14341394 traps
 21324016 system calls
       16 kernel threads created
    80415  fork() calls
    79382 vfork() calls
        0 rfork() calls
        0 swap pager pageins
        0 swap pager pages paged in
        0 swap pager pageouts
        0 swap pager pages paged out
     4346 vnode pager pageins
    26278 vnode pager pages paged in
        0 vnode pager pageouts
        0 vnode pager pages paged out
        0 page daemon wakeups
        0 pages examined by the page daemon
      631 pages reactivated
  4145359 copy-on-write faults
      252 copy-on-write optimized faults
  9320823 zero fill pages zeroed
        0 zero fill pages prezeroed
       17 intransit blocking page faults
 13709213 total VM faults taken
     4141 page faults requiring I/O
        0 pages affected by kernel thread creation
  2822123 pages affected by  fork()
  2789623 pages affected by vfork()
        0 pages affected by rfork()
        0 pages cached
 17946274 pages freed
        0 pages freed by daemon
        0 pages freed by exiting processes
    29267 pages active
    21500 pages inactive
      552 pages in VM cache
   723821 pages wired down
  3288262 pages free
     4096 bytes per page
  8376854 total name lookups
          cache hits (85% pos + 5% neg) system 0% per-directory
          deletions 3%, falsehits 0%, toolong 0%

------------------------------------------------------------------------
vmstat -m

         Type InUse MemUse HighUse Requests  Size(s)
       isadev     7     1K       -        7  128
      entropy  1027    65K       -     1041  32,64,4096
         cdev     4     1K       -        4  256
     filedesc    36    72K       -   159814  2048
        sigio     1     1K       -        1  64
     filecaps     0     0K       -        2  64
      kdtrace   472   112K       -   160423  64,256
         kenv    86    12K       -       97  16,32,64,128,8192
       kqueue     0     0K       -      119  256,2048
    proc-args    20     1K       -   132741  16,32,64,128,256
        hhook     2     1K       -        2  256
      ithread   268    39K       -      268  32,128,256
     acpiintr     1     1K       -        1  64
       KTRACE   100    13K       -      100  128
       linker   183    35K       -      225  
16,32,64,128,256,512,1024,2048,4096,8192
        lockf    14     2K       -   172018  64,128
   loginclass     3     1K       -       25  64
       devbuf 18517 41054K       -    18859  
16,32,64,128,256,512,1024,2048,4096,8192,32768,65536
         temp    71    18K       -   266848  
16,32,64,128,256,512,1024,2048,16384
       ip6ndp    10     1K       -       10  64,128
       module   496    62K       -      497  128
     mtx_pool     2    16K       -        2  8192
          osd     5     1K       -       18  16,32,64
       acpica  2216   225K       -    57097  16,32,64,128,256,512,1024,2048,4096
     pmchooks     1     1K       -        1  128
     CAM path    11     1K       -       75  32
         pgrp    19     3K       -       73  128
      session    16     2K       -       30  128
         proc     2    64K       -        2  32768
      subproc   163   208K       -   159942  512,4096
         cred    64    10K       -  1170462  64,256
        cxgbe    13   525K       -       16  128,256,512,1024,2048,8192,16384
       plimit    12     3K       -       27  256
      uidinfo     3     9K       -       18  128,8192
       feeder     7     1K       -        7  32
       sysctl     0     0K       -      681  16,32,64
    sysctloid  8014   403K       -     8111  16,32,64,128
    sysctltmp     0     0K       -      393  16,32,64,128,256
      tidhash     1    64K       -        1  65536
      callout     9  3208K       -        9  
         umtx   936   117K       -      936  128
     p1003.1b     1     1K       -        1  16
         SWAP     4   553K       -        4  64
          bus  1365   117K       -     6708  16,32,64,128,256,1024
       bus-sc    86   254K       -     4250  
16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
      devstat    10    21K       -       10  32,4096
 eventhandler   100     8K       -      100  64,128
         kobj   334  1336K       -      587  4096
      Per-cpu     1     1K       -        1  32
         rman   342    41K       -      777  16,32,128
         sbuf     0     0K       -     1051  
16,32,64,128,256,512,1024,2048,4096,8192,16384
       DEVFS3   139    35K       -      155  256
       DEVFS1   119    60K       -      131  512
    taskqueue   153    22K       -      209  16,32,64,128,256
       Unitno    22     2K       -   104896  32,64
         vmem     2   640K       -        6  16384,65536
     ioctlops     0     0K       -      235  256,512,1024
       select    20     3K       -       20  128
          iov     0     0K       -      576  16,64,128,256,512
          msg     4    30K       -        4  2048,4096,8192,16384
          sem     4   106K       -        4  2048,4096
          shm     1    32K       -        1  32768
          tty    20    20K       -       20  1024
          pts     1     1K       -        1  256
     mbuf_tag     0     0K       -        9  32
        shmfd     1     8K       -        1  8192
       soname     4     1K       -    14831  16,32,128
          pcb    16  2199K       -      123  16,32,128,1024,2048,8192
   DEVFS_RULE    55    26K       -       55  64,512
          acl     0     0K       -     3014  4096
     vfscache     1  4096K       -        1  
     vfs_hash     1  2048K       -        1  
       vnodes     1     1K       -        1  256
        DEVFS    25     1K       -       26  16,128
       DEVFSP     2     1K       -        2  64
        mount   116     4K       -      311  16,32,64,128,256
  vnodemarker     0     0K       -     1619  512
          BPF     9     2K       -        9  128
        ifnet    10    19K       -       10  128,2048
       ifaddr   101    23K       -      101  32,64,128,256,512,2048,4096
  ether_multi    17     1K       -       18  16,32,64
        clone     8     1K       -        8  128
       arpcom     8     1K       -        8  16
      lltable    23    11K       -       23  256,512
NFSD V4client     1     1K       -        1  256
 NFSD lckfile     1     1K       -        1  256
     routetbl    32     6K       -      300  32,64,128,256,512
         igmp     9     3K       -        9  256
     in_multi     2     1K       -        2  256
    sctp_a_it     0     0K       -        3  16
     sctp_vrf     1     1K       -        1  64
     sctp_ifa     4     1K       -        4  128
     sctp_ifn     2     1K       -        2  128
    sctp_iter     0     0K       -        3  256
    hostcache     1    32K       -        1  32768
     syncache     1    64K       -        1  65536
    in6_multi    15     2K       -       15  32,256
          mld     9     2K       -        9  128
          rpc     2    16K       -        2  8192
audit_evclass   187     6K       -      229  32
    ufs_quota     1  2048K       -        1  
    vm_pgdata     3  2049K       -        3  128
      UMAHash    40   956K       -      164  
512,1024,2048,4096,8192,16384,32768,65536
      memdesc     1     4K       -        1  4096
 NFSD session     1     1K       -        1  1024
     atkbddev     2     1K       -        2  64
     acpitask     1    16K       -        1  16384
    pfs_nodes    21     6K       -       21  256
         GEOM    92    17K       -      983  
16,32,64,128,256,512,1024,2048,8192,16384
      acpisem    41     6K       -       41  128
   CAM periph     6     2K       -       22  16,32,64,128,256
      acpidev    36     3K       -       36  64
    CAM queue    16     5K       -       51  16,32,512
         UART     6     5K       -        6  16,1024
    raid_data     0     0K       -      132  32,128,256
       netmap 82151 337579K       -    82151  16,32,2048,4096,32768
CAM dev queue     7     1K       -        7  64
      CAM SIM     7     2K       -        7  256
      CAM XPT    32     3K       -      131  
16,32,64,128,256,512,1024,2048,65536
     pci_link    16     2K       -       16  32,128
    acpi_perf     8     4K       -        8  512
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
      CAM DEV     9    18K       -       20  2048
          USB    47    71K       -       56  16,128,256,512,1024,2048,4096
      io_apic     1     2K       -        1  2048
       USBdev    36     9K       -       36  32,64,128,256,512,4096
          MCA     8     1K       -        8  128
       kbdmux     7    22K       -        7  16,512,1024,2048,16384
          LED     8     1K       -        8  16,128
          msi    64     8K       -       64  128
     nexusdev     3     1K       -        3  16
      CAM CCB     0     0K       -    28917  2048
      solaris 664256 129403K       - 16300367  
16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
   kstat_data     6     1K       -        6  64

------------------------------------------------------------------------
vmstat -z

ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               384,      0,     226,       4,     226,   0,   0
UMA Zones:             1664,      0,     226,       0,     226,   0,   0
UMA Slabs:               80,      0,  104341,       9,  104742,   0,   0
UMA RCntSlabs:           88,      0,    5716,      44,    5716,   0,   0
UMA Hash:               256,      0,      64,      41,     104,   0,   0
4 Bucket:                32,      0,     726,    2899,   65040,   0,   0
6 Bucket:                48,      0,     533,    2289,    9187,   0,   0
8 Bucket:                64,      0,      76,    3272,   12234,  11,   0
12 Bucket:               96,      0,     101,    1293,   11338,   0,   0
16 Bucket:              128,      0,     154,     993,   24386,   0,   0
32 Bucket:              256,      0,    1438,     467,   36740,  52,   0
64 Bucket:              512,      0,     613,    1171,   26691, 626,   0
128 Bucket:            1024,      0,     634,      74,   17838,   0,   0
256 Bucket:            2048,      0,     379,      65,    9119,  13,   0
vmem btag:               56,      0,  137269,     968,  137391, 975,   0
VM OBJECT:              256,      0,   71126,    8359, 2406383,   0,   0
RADIX NODE:             144,      0,   35700,     561, 3225847,   0,   0
MAP:                    240,      0,       3,      61,       3,   0,   0
KMAP ENTRY:             128,      0,       6,     273,       6,   0,   0
MAP ENTRY:              128,      0,     688,    1575, 6098698,   0,   0
VMSPACE:                448,      0,      20,     394,  159796,   0,   0
fakepg:                 104,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     366,       0,     366,   0,   0
16:                      16,      0,  224543,    1357,  987328,   0,   0
32:                      32,      0,   89913,   10587, 4623127,   0,   0
64:                      64,      0,  239484,   11244, 3948497,   0,   0
128:                    128,      0,   37079,    1423, 3303055,   0,   0
256:                    256,      0,   89619,   44766, 3163869,   0,   0
512:                    512,      0,     486,     242, 2227568,   0,   0
1024:                  1024,      0,    2796,     584,  150015,   0,   0
2048:                  2048,      0,      99,     131,  189207,   0,   0
4096:                  4096,      0,    8157,       8,  179060,   0,   0
8192:                  8192,      0,      26,       8,     634,   0,   0
16384:                16384,      0,      14,       5,     638,   0,   0
32768:                32768,      0,      82,       1,     384,   0,   0
65536:                65536,      0,      37,       5,     197,   0,   0
SLEEPQUEUE:              80,      0,     469,     802,     469,   0,   0
64 pcpu:                  8,      0,    2092,    1236,    2092,   0,   0
Files:                   80,      0,      50,    1350, 1087281,   0,   0
TURNSTILE:              136,      0,     469,     331,     469,   0,   0
rl_entry:                40,      0,      63,    2037,      63,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1256,      0,      35,      91,  159813,   0,   0
THREAD:                1176,      0,     435,      33,     608,   0,   0
cpuset:                  72,      0,     325,     555,     525,   0,   0
audit_record:          1248,      0,       0,       0,       0,   0,   0
mbuf_packet:            256, 6501450,    8184,    3202,  126976,   0,   0
mbuf:                   256, 6501450,       1,    2024,  105697,   0,   0
mbuf_cluster:          2048, 1015850,   11385,      11,   11385,   0,   0
mbuf_jumbo_page:       4096, 507925,       0,      18,      97,   0,   0
mbuf_jumbo_9k:         9216, 451488,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384, 338616,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
ttyinq:                 160,      0,     180,     320,     540,   0,   0
ttyoutq:                256,      0,      95,     400,     287,   0,   0
g_bio:                  248,      0,       0,    1056,   92469,   0,   0
DMAR_MAP_ENTRY:         120,      0,       0,       0,       0,   0,   0
nvme_request:           128,      0,       0,       0,       0,   0,   0
ata_request:            336,      0,       0,       0,       0,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0
FPU_save_area:          512,      0,       0,       0,       0,   0,   0
taskq_zone:              48,      0,       0,    3071,   16157,   0,   0
VNODE:                  472,      0,   92684,    4588,  256320,   0,   0
VNODEPOLL:              112,      0,       0,       0,       0,   0,   0
BUF TRIE:               144,      0,       0,  105273,       0,   0,   0
S VFS Cache:            108,      0,   28430,    5450,  342012,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,    6901,   22391,  108820,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NAMEI:                 1024,      0,       0,     144, 3399112,   0,   0
DIRHASH:               1024,      0,       0,       0,       0,   0,   0
NCLNODE:                528,      0,       0,       0,       0,   0,   0
Mountpoints:            816,      0,      12,      18,      12,   0,   0
pipe:                   744,      0,       1,     144,   53151,   0,   0
procdesc:               128,      0,       0,       0,       0,   0,   0
range_seg_cache:         64,      0,    1347,    1691,   12798,   0,   0
zio_cache:              920,      0,       8,   16984, 2100989,   0,   0
zio_link_cache:          48,      0,       0,   18509, 1012129,   0,   0
zio_buf_512:            512,      0,  247408,     488,  660543,   0,   0
zio_data_buf_512:       512,      0,   67640,     336,  406851,   0,   0
zio_buf_1024:          1024,      0,    1198,      50,   44769,   0,   0
zio_data_buf_1024:     1024,      0,   41452,      32,   41842,   0,   0
zio_buf_1536:          1536,      0,     399,      43,   17558,   0,   0
zio_data_buf_1536:     1536,      0,   16426,      44,   16710,   0,   0
zio_buf_2048:          2048,      0,     140,      40,    8803,   0,   0
zio_data_buf_2048:     2048,      0,    7555,      21,    7807,   0,   0
zio_buf_2560:          2560,      0,      71,      19,    5336,   0,   0
zio_data_buf_2560:     2560,      0,    5025,      15,    5251,   0,   0
zio_buf_3072:          3072,      0,      63,      21,    3861,   0,   0
zio_data_buf_3072:     3072,      0,    3564,      12,    3768,   0,   0
zio_buf_3584:          3584,      0,      34,      11,    3558,   0,   0
zio_data_buf_3584:     3584,      0,    3356,       0,    3526,   0,   0
zio_buf_4096:          4096,      0,      45,    7272,  186898,   0,   0
zio_data_buf_4096:     4096,      0,    3274,       2,    3506,   0,   0
zio_buf_5120:          5120,      0,      41,     161,    5126,   0,   0
zio_data_buf_5120:     5120,      0,    4883,       0,    5162,   0,   0
zio_buf_6144:          6144,      0,      31,     118,    3462,   0,   0
zio_data_buf_6144:     6144,      0,    3247,       0,    3471,   0,   0
zio_buf_7168:          7168,      0,      15,      90,    2633,   0,   0
zio_data_buf_7168:     7168,      0,    2473,       1,    2638,   0,   0
zio_buf_8192:          8192,      0,      14,     453,    4939,   0,   0
zio_data_buf_8192:     8192,      0,    1660,       2,    1823,   0,   0
zio_buf_10240:        10240,      0,      19,     174,    2697,   0,   0
zio_data_buf_10240:   10240,      0,    2455,       2,    2734,   0,   0
zio_buf_12288:        12288,      0,      22,     102,    3321,   0,   0
zio_data_buf_12288:   12288,      0,    1746,       2,    1972,   0,   0
zio_buf_14336:        14336,      0,       8,     114,    1437,   0,   0
zio_data_buf_14336:   14336,      0,    1287,       2,    1435,   0,   0
zio_buf_16384:        16384,      0,   13288,     288,   29096,   0,   0
zio_data_buf_16384:   16384,      0,     890,       2,    1052,   0,   0
zio_buf_20480:        20480,      0,      15,      67,    1941,   0,   0
zio_data_buf_20480:   20480,      0,    1233,       1,    1518,   0,   0
zio_buf_24576:        24576,      0,       6,      49,    1394,   0,   0
zio_data_buf_24576:   24576,      0,     883,       1,    1100,   0,   0
zio_buf_28672:        28672,      0,       1,      50,     953,   0,   0
zio_data_buf_28672:   28672,      0,     557,       2,     732,   0,   0
zio_buf_32768:        32768,      0,       4,      33,     799,   0,   0
zio_data_buf_32768:   32768,      0,     436,       1,     606,   0,   0
zio_buf_40960:        40960,      0,       4,      49,    1233,   0,   0
zio_data_buf_40960:   40960,      0,     710,       2,     979,   0,   0
zio_buf_49152:        49152,      0,       7,      38,     931,   0,   0
zio_data_buf_49152:   49152,      0,     398,       2,     646,   0,   0
zio_buf_57344:        57344,      0,       2,      33,     673,   0,   0
zio_data_buf_57344:   57344,      0,     249,       2,     532,   0,   0
zio_buf_65536:        65536,      0,       1,      20,     538,   0,   0
zio_data_buf_65536:   65536,      0,     198,       2,     598,   0,   0
zio_buf_81920:        81920,      0,       4,      40,    1099,   0,   0
zio_data_buf_81920:   81920,      0,     284,       3,     481,   0,   0
zio_buf_98304:        98304,      0,       1,      15,     877,   0,   0
zio_data_buf_98304:   98304,      0,     178,       3,     341,   0,   0
zio_buf_114688:      114688,      0,       3,      15,     634,   0,   0
zio_data_buf_114688: 114688,      0,     128,       5,     291,   0,   0
zio_buf_131072:      131072,      0,       4,     129,   12606,   0,   0
zio_data_buf_131072: 131072,      0,    5172,       2,    9526,   0,   0
zio_buf_163840:      163840,      0,       0,       0,       0,   0,   0
zio_data_buf_163840: 163840,      0,       0,       0,       0,   0,   0
zio_buf_196608:      196608,      0,       0,       0,       0,   0,   0
zio_data_buf_196608: 196608,      0,       0,       0,       0,   0,   0
zio_buf_229376:      229376,      0,       0,       0,       0,   0,   0
zio_data_buf_229376: 229376,      0,       0,       0,       0,   0,   0
zio_buf_262144:      262144,      0,       0,       0,       0,   0,   0
zio_data_buf_262144: 262144,      0,       0,       0,       0,   0,   0
zio_buf_327680:      327680,      0,       0,       0,       0,   0,   0
zio_data_buf_327680: 327680,      0,       0,       0,       0,   0,   0
zio_buf_393216:      393216,      0,       0,       0,       0,   0,   0
zio_data_buf_393216: 393216,      0,       0,       0,       0,   0,   0
zio_buf_458752:      458752,      0,       0,       0,       0,   0,   0
zio_data_buf_458752: 458752,      0,       0,       0,       0,   0,   0
zio_buf_524288:      524288,      0,       0,       0,       0,   0,   0
zio_data_buf_524288: 524288,      0,       0,       0,       0,   0,   0
zio_buf_655360:      655360,      0,       0,       0,       0,   0,   0
zio_data_buf_655360: 655360,      0,       0,       0,       0,   0,   0
zio_buf_786432:      786432,      0,       0,       0,       0,   0,   0
zio_data_buf_786432: 786432,      0,       0,       0,       0,   0,   0
zio_buf_917504:      917504,      0,       0,       0,       0,   0,   0
zio_data_buf_917504: 917504,      0,       0,       0,       0,   0,   0
zio_buf_1048576:     1048576,      0,       0,       0,       0,   0,   0
zio_data_buf_1048576: 1048576,      0,       0,       0,       0,   0,   0
zio_buf_1310720:     1310720,      0,       0,       0,       0,   0,   0
zio_data_buf_1310720: 1310720,      0,       0,       0,       0,   0,   0
zio_buf_1572864:     1572864,      0,       0,       0,       0,   0,   0
zio_data_buf_1572864: 1572864,      0,       0,       0,       0,   0,   0
zio_buf_1835008:     1835008,      0,       0,       0,       0,   0,   0
zio_data_buf_1835008: 1835008,      0,       0,       0,       0,   0,   0
zio_buf_2097152:     2097152,      0,       0,       0,       0,   0,   0
zio_data_buf_2097152: 2097152,      0,       0,       0,       0,   0,   0
zio_buf_2621440:     2621440,      0,       0,       0,       0,   0,   0
zio_data_buf_2621440: 2621440,      0,       0,       0,       0,   0,   0
zio_buf_3145728:     3145728,      0,       0,       0,       0,   0,   0
zio_data_buf_3145728: 3145728,      0,       0,       0,       0,   0,   0
zio_buf_3670016:     3670016,      0,       0,       0,       0,   0,   0
zio_data_buf_3670016: 3670016,      0,       0,       0,       0,   0,   0
zio_buf_4194304:     4194304,      0,       0,       0,       0,   0,   0
zio_data_buf_4194304: 4194304,      0,       0,       0,       0,   0,   0
zio_buf_5242880:     5242880,      0,       0,       0,       0,   0,   0
zio_data_buf_5242880: 5242880,      0,       0,       0,       0,   0,   0
zio_buf_6291456:     6291456,      0,       0,       0,       0,   0,   0
zio_data_buf_6291456: 6291456,      0,       0,       0,       0,   0,   0
zio_buf_7340032:     7340032,      0,       0,       0,       0,   0,   0
zio_data_buf_7340032: 7340032,      0,       0,       0,       0,   0,   0
zio_buf_8388608:     8388608,      0,       0,       0,       0,   0,   0
zio_data_buf_8388608: 8388608,      0,       0,       0,       0,   0,   0
zio_buf_10485760:    10485760,      0,       0,       0,       0,   0,   0
zio_data_buf_10485760: 10485760,      0,       0,       0,       0,   0,   0
zio_buf_12582912:    12582912,      0,       0,       0,       0,   0,   0
zio_data_buf_12582912: 12582912,      0,       0,       0,       0,   0,   0
zio_buf_14680064:    14680064,      0,       0,       0,       0,   0,   0
zio_data_buf_14680064: 14680064,      0,       0,       0,       0,   0,   0
zio_buf_16777216:    16777216,      0,       0,       0,       0,   0,   0
zio_data_buf_16777216: 16777216,      0,       0,       0,       0,   0,   0
lz4_ctx:              16384,      0,       0,      16,  240204,   0,   0
sa_cache:                80,      0,   92636,    5264,  256181,   0,   0
dnode_t:                752,      0,  236272,      58,  237409,   0,   0
dmu_buf_impl_t:         224,      0,  436781,     595,  997313,   0,   0
arc_buf_hdr_t:          216,      0,  204419,     619,  596058,   0,   0
arc_buf_t:               72,      0,  204419,    1116,  596064,   0,   0
zil_lwb_cache:          192,      0,       5,     495,     391,   0,   0
zfs_znode_cache:        368,      0,   92636,    4514,  256181,   0,   0
ksiginfo:               112,      0,     117,     933,     202,   0,   0
itimer:                 352,      0,       0,      33,       1,   0,   0
KNOTE:                  128,      0,       0,     651,     118,   0,   0
socket:                 696, 522950,      11,      94,    2956,   0,   0
ipq:                     56,  31808,       0,       0,       0,   0,   0
udp_inpcb:              392, 522950,       2,     238,     395,   0,   0
udpcb:                   24, 523044,       2,    2169,     395,   0,   0
tcp_inpcb:              392, 522950,       2,     208,      33,   0,   0
tcpcb:                 1032, 522951,       2,      52,      33,   0,   0
tcptw:                   88,  27810,       0,     270,       2,   0,   0
syncache:               160,  15375,       0,      75,       1,   0,   0
hostcache:              136,  15370,       3,     200,       3,   0,   0
sackhole:                32,      0,       0,       0,       0,   0,   0
tcpreass:                40,  63500,       0,    1600,    5246,   0,   0
sctp_ep:               1424, 522950,       0,       0,       0,   0,   0
sctp_asoc:             2416,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80012,       0,     830,       3,   0,   0
sctp_raddr:             728,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400026,       0,       0,       0,   0,   0
sctp_readq:             104, 400026,       0,       0,       0,   0,   0
sctp_stream_msg_out:    104, 400026,       0,       0,       0,   0,   0
sctp_asconf:             40, 400000,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400060,       0,       0,       0,   0,   0
udplite_inpcb:          392, 522950,       0,       0,       0,   0,   0
ripcb:                  392, 522950,       0,       0,       0,   0,   0
unpcb:                  240, 522960,       7,     489,    2523,   0,   0
rtentry:                200,      0,      13,     367,      13,   0,   0
selfd:                   56,      0,      34,    2025,  213191,   0,   0
SWAPMETA:               288, 2031705,       0,       0,       0,   0,   0


------------------------------------------------------------------------
vmstat -i

interrupt                          total       rate
irq23: ehci0                        8940        262
cpu0:timer                        164378       4834
irq282: igb0:que 0                 66374       1952
irq283: igb0:que 1                 72735       2139
irq284: igb0:que 2                  2556         75
irq285: igb0:que 3                  5221        153
irq286: igb0:que 4                  3334         98
irq287: igb0:que 5                  4889        143
irq288: igb0:que 6                 25523        750
irq289: igb0:que 7                  2921         85
irq290: igb0:link                      2          0
irq319: ahci1                      31186        917
cpu1:timer                         93730       2756
cpu5:timer                         71948       2116
cpu2:timer                         76360       2245
cpu6:timer                         80255       2360
cpu4:timer                         83108       2444
cpu7:timer                         72318       2127
cpu3:timer                         71680       2108
Total                             937458      27572

------------------------------------------------------------------------
pstat -T

 50/522948 files
0M/4095M swap space

------------------------------------------------------------------------
pstat -s

Device          512-blocks     Used    Avail Capacity
/dev/ada0p2        4194048        0  4194048     0%
/dev/ada1p2        4194048        0  4194048     0%
Total              8388096        0  8388096     0%

------------------------------------------------------------------------
iostat

iostat: kvm_read(_tk_nin): invalid address (0x0)
iostat: disabling TTY statistics
            ada0             ada1            pass0             cpu
  KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
 53.56 444 23.20  54.27 436 23.10   0.00   0  0.00   1  0  2  0 97

------------------------------------------------------------------------
ipcs -a

Message Queues:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP       
          CBYTES                 QNUM               QBYTES        LSPID        
LRPID STIME    RTIME    CTIME   

Shared Memory:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP       
  NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   

Semaphores:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP       
   NSEMS OTIME    CTIME   


------------------------------------------------------------------------
ipcs -T

msginfo:
        msgmax:        16384    (max characters in a message)
        msgmni:           40    (# of message queues)
        msgmnb:         2048    (max characters in a message queue)
        msgtql:           40    (max # of messages in system)
        msgssz:            8    (size of a message segment)
        msgseg:         2048    (# of message segments in system)

shminfo:
        shmmax:    536870912    (max shared memory segment size)
        shmmin:            1    (min shared memory segment size)
        shmmni:          192    (max number of shared memory identifiers)
        shmseg:          128    (max shared memory segments per process)
        shmall:       131072    (max amount of shared memory in pages)

seminfo:
        semmni:           50    (# of semaphore identifiers)
        semmns:          340    (# of semaphores in system)
        semmnu:          150    (# of undo structures in system)
        semmsl:          340    (max # of semaphores per id)
        semopm:          100    (max # of operations per semop call)
        semume:           50    (max # of undo entries per process)
        semusz:          632    (size in bytes of undo structure)
        semvmx:        32767    (semaphore maximum value)
        semaem:        16384    (adjust on exit max value)


------------------------------------------------------------------------
nfsstat

Client Info:
Rpc Counts:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit
        0         0         0         0         0
Rpc Info:
 TimedOut   Invalid X Replies   Retries  Requests
        0         0         0         0         0
Cache Info:
Attr Hits    Misses Lkup Hits    Misses BioR Hits    Misses BioW Hits    Misses
        0         0         0         0         0         0         0         0
BioRLHits    Misses BioD Hits    Misses DirE Hits    Misses Accs Hits    Misses
        0         0         0         0         0         0         0         0

Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit
        0         0         0         0         0
Server Ret-Failed
                0
Server Faults
            0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses
        0         0         0         0
Server Write Gathering:
 WriteOps  WriteRPC   Opsaved
        0         0         0

------------------------------------------------------------------------
netstat -s

tcp:
        76265 packets sent
                28741 data packets (2150624 bytes)
                0 data packets (0 bytes) retransmitted
                0 data packets unnecessarily retransmitted
                0 resends initiated by MTU discovery
                47220 ack-only packets (15 delayed)
                0 URG only packets
                0 window probe packets
                248 window update packets
                56 control packets
        106646 packets received
                16487 acks (for 2150621 bytes)
                14 duplicate acks
                0 acks for unsent data
                84963 packets (120930850 bytes) received in-sequence
                0 completely duplicate packets (0 bytes)
                0 old duplicate packets
                0 packets with some dup. data (0 bytes duped)
                5246 out-of-order packets (7563709 bytes)
                0 packets (0 bytes) of data after window
                0 window probes
                14 window update packets
                0 packets received after close
                0 discarded for bad checksums
                0 discarded for bad header offset fields
                0 discarded because packet too short
                1 discarded due to memory problems
        28 connection requests
        1 connection accept
        0 bad connection attempts
        0 listen queue overflows
        0 ignored RSTs in the windows
        29 connections established (including accepts)
        31 connections closed (including 0 drops)
                5 connections updated cached RTT on close
                5 connections updated cached RTT variance on close
                0 connections updated cached ssthresh on close
        0 embryonic connections dropped
        16487 segments updated rtt (of 16062 attempts)
        0 retransmit timeouts
                0 connections dropped by rexmit timeout
        0 persist timeouts
                0 connections dropped by persist timeout
        0 Connections (fin_wait_2) dropped because of timeout
        0 keepalive timeouts
                0 keepalive probes sent
                0 connections dropped by keepalive
        16274 correct ACK header predictions
        84869 correct data packet header predictions
        1 syncache entry added
                0 retransmitted
                0 dupsyn
                0 dropped
                1 completed
                0 bucket overflow
                0 cache overflow
                0 reset
                0 stale
                0 aborted
                0 badack
                0 unreach
                0 zone failures
        1 cookie sent
        0 cookies received
        3 hostcache entries added
                0 bucket overflow
        0 SACK recovery episodes
        0 segment rexmits in SACK recovery episodes
        0 byte rexmits in SACK recovery episodes
        0 SACK options (SACK blocks) received
        5139 SACK options (SACK blocks) sent
        0 SACK scoreboard overflow
        0 packets with ECN CE bit set
        0 packets with ECN ECT(0) bit set
        0 packets with ECN ECT(1) bit set
        0 successful ECN handshakes
        0 times ECN reduced the congestion window
        0 packets with valid tcp-md5 signature received
        0 packets with invalid tcp-md5 signature received
        0 packets with tcp-md5 signature mismatch
        0 packets with unexpected tcp-md5 signature received
        0 packets without expected tcp-md5 signature received
udp:
        7804 datagrams received
        0 with incomplete header
        0 with bad data length field
        0 with bad checksum
        0 with no checksum
        0 dropped due to no socket
        7744 broadcast/multicast datagrams undelivered
        0 dropped due to full socket buffers
        0 not for hashed pcb
        60 delivered
        60 datagrams output
        0 times multicast source filter matched
ip:
        114450 total packets received
        0 bad header checksums
        0 with size smaller than minimum
        0 with data size < data length
        0 with ip length > max ip packet size
        0 with header length < data size
        0 with data length < header length
        0 with bad options
        0 with incorrect version number
        0 fragments received
        0 fragments dropped (dup or out of space)
        0 fragments dropped after timeout
        0 packets reassembled ok
        114450 packets for this host
        0 packets for unknown/unsupported protocol
        0 packets forwarded (0 packets fast forwarded)
        0 packets not forwardable
        0 packets received for unknown multicast group
        0 redirects sent
        76325 packets sent from this host
        0 packets sent with fabricated ip header
        0 output packets dropped due to no bufs, etc.
        0 output packets discarded due to no route
        0 output datagrams fragmented
        0 fragments created
        0 datagrams that can't be fragmented
        0 tunneling packets that can't find gif
        0 datagrams with bad address in header
icmp:
        0 calls to icmp_error
        0 errors not generated in response to an icmp message
        0 messages with bad code fields
        0 messages less than the minimum length
        0 messages with bad checksum
        0 messages with bad length
        0 multicast echo requests ignored
        0 multicast timestamp requests ignored
        0 message responses generated
        0 invalid return addresses
        0 no return routes
igmp:
        0 messages received
        0 messages received with too few bytes
        0 messages received with wrong TTL
        0 messages received with bad checksum
        0 V1/V2 membership queries received
        0 V3 membership queries received
        0 membership queries received with invalid field(s)
        0 general queries received
        0 group queries received
        0 group-source queries received
        0 group-source queries dropped
        0 membership reports received
        0 membership reports received with invalid field(s)
        0 membership reports received for groups to which we belong
        0 V3 reports received without Router Alert
        0 membership reports sent
arp:
        5 ARP requests sent
        9 ARP replies sent
        3823 ARP requests received
        176 ARP replies received
        3999 ARP packets received
        0 total packets dropped due to no ARP entry
        0 ARP entrys timed out
        0 Duplicate IPs seen
ip6:
        0 total packets received
        0 with size smaller than minimum
        0 with data size < data length
        0 with bad options
        0 with incorrect version number
        0 fragments received
        0 fragments dropped (dup or out of space)
        0 fragments dropped after timeout
        0 fragments that exceeded limit
        0 packets reassembled ok
        0 packets for this host
        0 packets forwarded
        0 packets not forwardable
        0 redirects sent
        0 packets sent from this host
        0 packets sent with fabricated ip header
        0 output packets dropped due to no bufs, etc.
        14 output packets discarded due to no route
        0 output datagrams fragmented
        0 fragments created
        0 datagrams that can't be fragmented
        0 packets that violated scope rules
        0 multicast packets which we don't join
        Mbuf statistics:
                0 one mbuf
                2 one ext mbuf
                0 two or more ext mbuf
        0 packets whose headers are not contiguous
        0 tunneling packets that can't find gif
        0 packets discarded because of too many headers
        0 failures of source address selection
        Source addresses selection rule applied:
icmp6:
        0 calls to icmp6_error
        0 errors not generated in response to an icmp6 message
        0 errors not generated because of rate limitation
        0 messages with bad code fields
        0 messages < minimum length
        0 bad checksums
        0 messages with bad length
        Histogram of error messages to be generated:
                0 no route
                0 administratively prohibited
                0 beyond scope
                0 address unreachable
                0 port unreachable
                0 packet too big
                0 time exceed transit
                0 time exceed reassembly
                0 erroneous header field
                0 unrecognized next header
                0 unrecognized option
                0 redirect
                0 unknown
        0 message responses generated
        0 messages with too many ND options
        0 messages with bad ND options
        0 bad neighbor solicitation messages
        0 bad neighbor advertisement messages
        0 bad router solicitation messages
        0 bad router advertisement messages
        0 bad redirect messages
        0 path MTU changes
rip6:
        0 messages received
        0 checksum calculations on inbound
        0 messages with bad checksum
        0 messages dropped due to no socket
        0 multicast messages dropped due to no socket
        0 messages dropped due to full socket buffers
        0 delivered
        0 datagrams output

------------------------------------------------------------------------
netstat -m

netstat: invalid address (0x0)
8185/5226/13411 mbufs in use (current/cache/total)
8183/3213/11396/1015850 mbuf clusters in use (current/cache/total/max)
8184/3202 mbuf+clusters out of packet secondary zone in use (current/cache)
0/18/18/507925 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/451488 9k jumbo clusters in use (current/cache/total/max)
0/0/0/338616 16k jumbo clusters in use (current/cache/total/max)
18412K/7804K/26216K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)

------------------------------------------------------------------------
netstat -anr

Routing tables

Internet:
Destination        Gateway            Flags      Netif Expire
default            192.168.6.254      UGS        igb0
127.0.0.1          link#9             UH          lo0
192.168.6.0/24     link#5             U          igb0
192.168.6.248      link#5             UHS         lo0

Internet6:
Destination                       Gateway                       Flags      
Netif Expire
::/96                             ::1                           UGRS        lo0
::1                               link#9                        UH          lo0
::ffff:0.0.0.0/96                 ::1                           UGRS        lo0
fe80::/10                         ::1                           UGRS        lo0
fe80::%lo0/64                     link#9                        U           lo0
fe80::1%lo0                       link#9                        UHS         lo0
ff01::%lo0/32                     ::1                           U           lo0
ff02::/16                         ::1                           UGRS        lo0
ff02::%lo0/32                     ::1                           U           lo0

------------------------------------------------------------------------
netstat -anA

Active Internet connections (including servers)
Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign Address    
(state)
fffff800365d8810 tcp4       0      0 192.168.6.248.22   192.168.6.21.50240 
ESTABLISHED
fffff8003665f810 tcp4       0      0 192.168.6.248.22   *.*                
LISTEN
fffff8003620b310 udp4       0      0 *.514              *.*                
fffff8003620b498 udp6       0      0 *.514              *.*                
Active UNIX domain sockets
Address  Type   Recv-Q Send-Q    Inode     Conn     Refs  Nextref Addr
fffff80036231960 stream      0      0        0 fffff8003621ae10        0        0
fffff8003621ae10 stream      0      0        0 fffff80036231960        0        0
fffff80036236c30 stream      0      0 fffff8003625d1d8        0        0        
0 /var/run/devd.pipe
fffff800362fc960 dgram       0      0        0 fffff8003622d4b0        0        0
fffff8003622d4b0 dgram       0      0 fffff800365cab10        0 
fffff800362fc960        0 /var/run/logpriv
fffff8003622d5a0 dgram       0      0 fffff800365cace8        0        0        
0 /var/run/log
fffff80036236b40 seqpac      0      0 fffff8003625d000        0        0        
0 /var/run/devd.seqpacket.pipe

------------------------------------------------------------------------
netstat -aL

Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen         Local Address         
tcp4  0/0/128        192.168.6.248.ssh      
unix  0/0/4          /var/run/devd.pipe
unix  0/0/4          /var/run/devd.seqpacket.pipe

------------------------------------------------------------------------
fstat

fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 5 at 0x14000000000
fstat: can't read file 11 at 0x9800000000
fstat: can't read file 17 at 0x9600000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0xa00000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0xe00000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x400000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read file 11 at 0x400000000
fstat: can't read file 13 at 0x200007fffffffff
fstat: can't read file 14 at 0x4000000001fffff
fstat: can't read file 16 at 0x780000ffff
fstat: can't read file 17 at 0x400000000
fstat: can't read file 19 at 0x200007fffffffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
root     PingTest   59932 root -         -       error    -
root     PingTest   59932   wd -         -       error    -
root     PingTest   59932 text -         -       error    -
root     PingTest   59932 ctty /dev         99 crw--w----   pts/0 rw
root     PingTest   59932    0 /dev         99 crw--w----   pts/0 rw
root     csh         1541 root -         -       error    -
root     csh         1541   wd -         -       error    -
root     csh         1541 text -         -       error    -
root     csh         1541 ctty /dev         99 crw--w----   pts/0 rw
root     su          1540 root -         -       error    -
root     su          1540   wd -         -       error    -
root     su          1540 text -         -       error    -
root     su          1540 ctty /dev         99 crw--w----   pts/0 rw
root     su          1540    0 /dev         99 crw--w----   pts/0 rw
joe      sh          1538 root -         -       error    -
joe      sh          1538   wd -         -       error    -
joe      sh          1538 text -         -       error    -
joe      sh          1538 ctty /dev         99 crw--w----   pts/0 rw
joe      sh          1538    0 /dev         99 crw--w----   pts/0 rw
joe      sh          1538    6 /dev         99 crw--w----   pts/0 rw
joe      sshd        1537 root -         -       error    -
joe      sshd        1537   wd -         -       error    -
joe      sshd        1537 text -         -       error    -
joe      sshd        1537    0 /dev          8 crw-rw-rw-    null rw
joe      sshd        1537    6 /dev          8 crw-rw-rw-    null rw
root     sshd        1534 root -         -       error    -
root     sshd        1534   wd -         -       error    -
root     sshd        1534 text -         -       error    -
root     sshd        1534    0 /dev          8 crw-rw-rw-    null  r
root     getty       1516 root -         -       error    -
root     getty       1516   wd -         -       error    -
root     getty       1516 text -         -       error    -
root     getty       1516 ctty /dev         61 crw-------   ttyv7 rw
root     getty       1516    0 /dev         61 crw-------   ttyv7 rw
root     getty       1515 root -         -       error    -
root     getty       1515   wd -         -       error    -
root     getty       1515 text -         -       error    -
root     getty       1515 ctty /dev         60 crw-------   ttyv6 rw
root     getty       1515    0 /dev         60 crw-------   ttyv6 rw
root     getty       1514 root -         -       error    -
root     getty       1514   wd -         -       error    -
root     getty       1514 text -         -       error    -
root     getty       1514 ctty /dev         59 crw-------   ttyv5 rw
root     getty       1514    0 /dev         59 crw-------   ttyv5 rw
root     getty       1513 root -         -       error    -
root     getty       1513   wd -         -       error    -
root     getty       1513 text -         -       error    -
root     getty       1513 ctty /dev         58 crw-------   ttyv4 rw
root     getty       1513    0 /dev         58 crw-------   ttyv4 rw
root     getty       1512 root -         -       error    -
root     getty       1512   wd -         -       error    -
root     getty       1512 text -         -       error    -
root     getty       1512 ctty /dev         57 crw-------   ttyv3 rw
root     getty       1512    0 /dev         57 crw-------   ttyv3 rw
root     getty       1511 root -         -       error    -
root     getty       1511   wd -         -       error    -
root     getty       1511 text -         -       error    -
root     getty       1511 ctty /dev         56 crw-------   ttyv2 rw
root     getty       1511    0 /dev         56 crw-------   ttyv2 rw
root     getty       1510 root -         -       error    -
root     getty       1510   wd -         -       error    -
root     getty       1510 text -         -       error    -
root     getty       1510 ctty /dev         55 crw-------   ttyv1 rw
root     getty       1510    0 /dev         55 crw-------   ttyv1 rw
root     getty       1509 root -         -       error    -
root     getty       1509   wd -         -       error    -
root     getty       1509 text -         -       error    -
root     getty       1509 ctty /dev         54 crw-------   ttyv0 rw
root     getty       1509    0 /dev         54 crw-------   ttyv0 rw
root     cron        1462 root -         -       error    -
root     cron        1462   wd -         -       error    -
root     cron        1462 text -         -       error    -
root     cron        1462    0 /dev          8 crw-rw-rw-    null rw
root     sshd        1458 root -         -       error    -
root     sshd        1458   wd -         -       error    -
root     sshd        1458 text -         -       error    -
root     sshd        1458    0 /dev          8 crw-rw-rw-    null rw
root     syslogd     1326 root -         -       error    -
root     syslogd     1326   wd -         -       error    -
root     syslogd     1326 text -         -       error    -
root     syslogd     1326    0 /dev          8 crw-rw-rw-    null rw
root     syslogd     1326    6 /dev          8 crw-rw-rw-    null rw
root     syslogd     1326   12 /dev          8 crw-rw-rw-    null rw
root     syslogd     1326   18 -         -       error    -
root     devd        1163 root -         -       error    -
root     devd        1163   wd -         -       error    -
root     devd        1163 text -         -       error    -
root     devd        1163    0 /dev          8 crw-rw-rw-    null rw
root     devd        1163    6 /dev          8 crw-rw-rw-    null rw
root     moused      1146 root -         -       error    -
root     moused      1146   wd -         -       error    -
root     moused      1146 text -         -       error    -
root     moused      1146    0 /dev          8 crw-rw-rw-    null rw
root     zfskern        3 root -         -       error    -
root     zfskern        3   wd -         -       error    -
root     init           1 root -         -       error    -
root     init           1   wd -         -       error    -
root     init           1 text -         -       error    -
root     kernel         0 root -         -       error    -
root     kernel         0   wd -         -       error    -

------------------------------------------------------------------------
dmesg

Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.2-RELEASE-p10 #1 r294714M: Mon Jan 25 12:45:48 UTC 2016
    j...@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Atom(TM) CPU  C2750  @ 2.40GHz (2400.06-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x406d8  Family=0x6  Model=0x4d  Stepping=8
  
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  
Features2=0x43d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,AESNI,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16539582464 (15773 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INTEL  TIANO   >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  6
 cpu4 (AP): APIC ID:  8
 cpu5 (AP): APIC ID: 10
 cpu6 (AP): APIC ID: 12
 cpu7 (AP): APIC ID: 14
ioapic0 <Version 2.0> irqs 0-23 on motherboard
netmap: loaded module
random: <Software, Yarrow> initialized
module_register_init: MOD_LOAD (vesa, 0xffffffff80df9540, 0) error 19
kbd1 at kbdmux0
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> mem 0xdd9c0000-0xdd9dffff irq 16 at device 1.0 on 
pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 
0xde000000-0xdeffffff,0xdf000000-0xdf01ffff irq 16 at device 0.0 on pci2
vgapci0: Boot video device
pcib3: <ACPI PCI-PCI bridge> mem 0xdd9a0000-0xdd9bffff irq 16 at device 2.0 on 
pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> mem 0xdd980000-0xdd99ffff irq 20 at device 3.0 on 
pci0
pci4: <ACPI PCI bus> on pcib4
pci4: <network, ethernet> at device 0.0 (no driver attached)
pci4: <network, ethernet> at device 0.1 (no driver attached)
pci4: <network, ethernet> at device 0.2 (no driver attached)
pci4: <network, ethernet> at device 0.3 (no driver attached)
t5nex0: <Chelsio T520-SO> mem 
0xdd300000-0xdd37ffff,0xdc000000-0xdcffffff,0xdd884000-0xdd885fff irq 22 at 
device 0.4 on pci4
cxl0: <port 0> on t5nex0
cxl0: Ethernet address: 00:07:43:33:89:f0
cxl0: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap)
ncxl0: Ethernet address: 00:07:43:33:89:f1
ncxl0: netmap queues/slots: TX 2/1023, RX 2/1024
cxl1: <port 1> on t5nex0
cxl1: Ethernet address: 00:07:43:33:89:f8
cxl1: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap)
ncxl1: Ethernet address: 00:07:43:33:89:f9
ncxl1: netmap queues/slots: TX 2/1023, RX 2/1024
t5nex0: PCIe gen2 x8, 2 ports, 26 MSI-X interrupts, 63 eq, 25 iq
pci4: <mass storage, SCSI> at device 0.5 (no driver attached)
pci4: <serial bus, Fibre Channel> at device 0.6 (no driver attached)
pci0: <base peripheral, IOMMU> at device 15.0 (no driver attached)
igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0c0-0xe0df 
mem 0xdd960000-0xdd97ffff,0xdd9ec000-0xdd9effff irq 20 at device 20.0 on pci0
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 0c:c4:7a:7c:58:30
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb0: netmap queues/slots: TX 8/1024, RX 8/1024
igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0a0-0xe0bf 
mem 0xdd940000-0xdd95ffff,0xdd9e8000-0xdd9ebfff irq 21 at device 20.1 on pci0
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 0c:c4:7a:7c:58:31
igb1: Bound queue 0 to cpu 0
igb1: Bound queue 1 to cpu 1
igb1: Bound queue 2 to cpu 2
igb1: Bound queue 3 to cpu 3
igb1: Bound queue 4 to cpu 4
igb1: Bound queue 5 to cpu 5
igb1: Bound queue 6 to cpu 6
igb1: Bound queue 7 to cpu 7
igb1: netmap queues/slots: TX 8/1024, RX 8/1024
igb2: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe080-0xe09f 
mem 0xdd920000-0xdd93ffff,0xdd9e4000-0xdd9e7fff irq 22 at device 20.2 on pci0
igb2: Using MSIX interrupts with 9 vectors
igb2: Ethernet address: 0c:c4:7a:7c:58:32
igb2: Bound queue 0 to cpu 0
igb2: Bound queue 1 to cpu 1
igb2: Bound queue 2 to cpu 2
igb2: Bound queue 3 to cpu 3
igb2: Bound queue 4 to cpu 4
igb2: Bound queue 5 to cpu 5
igb2: Bound queue 6 to cpu 6
igb2: Bound queue 7 to cpu 7
igb2: netmap queues/slots: TX 8/1024, RX 8/1024
igb3: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe060-0xe07f 
mem 0xdd900000-0xdd91ffff,0xdd9e0000-0xdd9e3fff irq 23 at device 20.3 on pci0
igb3: Using MSIX interrupts with 9 vectors
igb3: Ethernet address: 0c:c4:7a:7c:58:33
igb3: Bound queue 0 to cpu 0
igb3: Bound queue 1 to cpu 1
igb3: Bound queue 2 to cpu 2
igb3: Bound queue 3 to cpu 3
igb3: Bound queue 4 to cpu 4
igb3: Bound queue 5 to cpu 5
igb3: Bound queue 6 to cpu 6
igb3: Bound queue 7 to cpu 7
igb3: netmap queues/slots: TX 8/1024, RX 8/1024
ehci0: <Intel Avoton USB 2.0 controller> mem 0xdd9f3000-0xdd9f33ff irq 23 at 
device 22.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
ahci0: <Intel Avoton AHCI SATA controller> port 
0xe150-0xe157,0xe140-0xe143,0xe130-0xe137,0xe120-0xe123,0xe040-0xe05f mem 
0xdd9f2000-0xdd9f27ff irq 19 at device 23.0 on pci0
ahci0: AHCI v1.30 with 4 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahci1: <Intel Avoton AHCI SATA controller> port 
0xe110-0xe117,0xe100-0xe103,0xe0f0-0xe0f7,0xe0e0-0xe0e3,0xe020-0xe03f mem 
0xdd9f1000-0xdd9f17ff irq 19 at device 24.0 on pci0
ahci1: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 
0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
random: unblocking device.
usbus0: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ada0 at ahcich4 bus 0 scbus4 target 0 lun 0
ada0: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device
ada0: Serial Number S2NHNXAG900346Y
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad12
ada1 at ahcich5 bus 0 scbus5 target 0 lun 0
ada1: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device
ada1: Serial Number S2NHNXAG900330L
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad14
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #3 Launched!
Timecounter "TSC-low" frequency 1200028824 Hz quality 1000
Root mount waiting for: usbus0
Root mount waiting for: usbus0
Root mount waiting for: usbus0
Root mount waiting for: usbus0
uhub0: 8 ports with 8 removable, self powered
Root mount waiting for: usbus0
ugen0.2: <vendor 0x8087> at usbus0
uhub1: <vendor 0x8087 product 0x07db, class 9/0, rev 2.00/0.02, addr 2> on 
usbus0
uhub1: 4 ports with 4 removable, self powered
Root mount waiting for: usbus0
ugen0.3: <vendor 0x0409> at usbus0
uhub2: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 3> on 
usbus0
uhub2: 4 ports with 4 removable, self powered
ugen0.4: <vendor 0x0409> at usbus0
uhub3: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 4> on 
usbus0
Root mount waiting for: usbus0
uhub3: 3 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557> at usbus0
uhub4: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 5> on 
usbus0
Root mount waiting for: usbus0
uhub4: 4 ports with 3 removable, self powered
ugen0.6: <vendor 0x0557> at usbus0
ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on 
usbus0
kbd2 at ukbd0
Trying to mount root from zfs:zroot/ROOT/default []...
Setting hostuuid: 00000000-0000-0000-0000-0cc47a7c5830.
Setting hostid: 0x824b79f8.
Entropy harvesting: interrupts ethernet point_to_point swi.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: jj.gla.uk.iotx.
Starting Network: lo0 cxl0 ncxl0 cxl1 ncxl1 igb0 igb1 igb2 igb3.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128 
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x9 
        inet 127.0.0.1 netmask 0xff000000 
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:33:89:f0
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 00:07:43:33:89:f1
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:33:89:f8
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 00:07:43:33:89:f9
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
igb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:30
        inet 192.168.6.248 netmask 0xffffff00 broadcast 192.168.6.255 
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:31
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:32
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:33
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
Starting devd.
Starting Network: cxl0.
cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:33:89:f0
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
Starting Network: ncxl0.
ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 00:07:43:33:89:f1
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
Starting Network: cxl1.
cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:33:89:f8
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
Starting Network: ncxl1.
ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 00:07:43:33:89:f9
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-Twinax <full-duplex>
        status: no carrier
Starting Network: igb1.
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:31
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
Starting Network: igb2.
igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:32
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
Starting Network: igb3.
igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
        
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
        ether 0c:c4:7a:7c:58:33
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect
        status: no carrier
Configuring syscons: keymap.
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
Starting ums0 moused.
eval: ${route_route_mngmt,...}: Bad substitution
/etc/rc: WARNING: route_route_mngmt, not found.
/etc/rc: WARNING: route_route_old not found.
add net default: gateway 192.168.6.254
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 
/usr/local/llvm37/lib
32-bit compatibility ldconfig path: /usr/lib32
Clearing /tmp (X related).
Updating motd:.
Mounting late file systems:.
Configuring syscons: keymap blanktime.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Raising kernel security level: 
kern.securelevel: -1 -> 1
Starting background file system checks in 60 seconds.

Mon Jan 25 13:39:43 UTC 2016
Jan 25 13:55:37 jj su: joe to root on /dev/pts/0
516.216275 [1233] netmap_mem_global_config  reconfiguring


Fatal trap 12: page fault while in kernel mode
cpuid = 4; apic id = 08
fault virtual address   = 0x6
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff804d2269
stack pointer           = 0x28:0xfffffe0467ce0420
frame pointer           = 0x28:0xfffffe0467ce04f0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 59932 (PingTest)
trap number             = 12
panic: page fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff809c5590 at kdb_backtrace+0x60
#1 0xffffffff80989146 at vpanic+0x126
#2 0xffffffff80989013 at panic+0x43
#3 0xffffffff80d8b16b at trap_fatal+0x36b
#4 0xffffffff80d8b46d at trap_pfault+0x2ed
#5 0xffffffff80d8ab0a at trap+0x47a
#6 0xffffffff80d70e82 at calltrap+0x8
#7 0xffffffff806a9ba9 at netmap_do_unregif+0x89
#8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1
#9 0xffffffff806abcb5 at netmap_ioctl+0x755
#10 0xffffffff808706b9 at devfs_ioctl_f+0x139
#11 0xffffffff809dd485 at kern_ioctl+0x255
#12 0xffffffff809dd180 at sys_ioctl+0x140
#13 0xffffffff80d8ba87 at amd64_syscall+0x357
#14 0xffffffff80d7116b at Xfast_syscall+0xfb
Uptime: 39m8s
Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

------------------------------------------------------------------------
kernel config

options CONFIG_AUTOGENERATED
ident   GENERIC
machine amd64
cpu     HAMMER
makeoptions     WITH_CTF=1
makeoptions     DEBUG=-g
options XENHVM
options HYPERV
options USB_DEBUG
options ATH_ENABLE_11N
options AH_AR5416_INTERRUPT_MITIGATION
options AH_SUPPORT_AR5416
options IEEE80211_SUPPORT_MESH
options IEEE80211_AMPDU_AGE
options IEEE80211_DEBUG
options SC_PIXEL_MODE
options VESA
options AHD_REG_PRETTY_PRINT
options AHC_REG_PRETTY_PRINT
options ATA_STATIC_ID
options ACPI_DMAR
options SMP
options KDB_TRACE
options KDB
options RCTL
options RACCT_DEFAULT_TO_DISABLED
options RACCT
options INCLUDE_CONFIG_FILE
options DDB_CTF
options KDTRACE_HOOKS
options KDTRACE_FRAME
options MAC
options PROCDESC
options CAPABILITIES
options CAPABILITY_MODE
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD7
options COMPAT_FREEBSD6
options COMPAT_FREEBSD5
options COMPAT_FREEBSD4
options COMPAT_FREEBSD32
options GEOM_LABEL
options GEOM_RAID
options GEOM_PART_GPT
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options QUOTA
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options SCTP
options TCP_OFFLOAD
options INET6
options INET
options PREEMPTION
options SCHED_ULE
options NEW_PCIB
options GEOM_PART_MBR
options GEOM_PART_EBR_COMPAT
options GEOM_PART_EBR
options GEOM_PART_BSD
device  isa
device  mem
device  io
device  uart_ns8250
device  cpufreq
device  acpi
device  pci
device  fdc
device  ahci
device  ata
device  mvs
device  siis
device  ahc
device  ahd
device  esp
device  hptiop
device  isp
device  mpt
device  mps
device  mpr
device  sym
device  trm
device  adv
device  adw
device  aic
device  bt
device  isci
device  scbus
device  ch
device  da
device  sa
device  cd
device  pass
device  ses
device  amr
device  arcmsr
device  ciss
device  dpt
device  hptmv
device  hptnr
device  hptrr
device  hpt27xx
device  iir
device  ips
device  mly
device  twa
device  tws
device  aac
device  aacp
device  aacraid
device  ida
device  mfi
device  mlx
device  mrsas
device  twe
device  nvme
device  nvd
device  atkbdc
device  atkbd
device  psm
device  kbdmux
device  vga
device  splash
device  sc
device  vt
device  vt_vga
device  vt_efifb
device  agp
device  cbb
device  pccard
device  cardbus
device  uart
device  ppc
device  ppbus
device  lpt
device  ppi
device  puc
device  bxe
device  de
device  em
device  igb
device  ix
device  ixv
device  ixl
device  ixlv
device  le
device  ti
device  txp
device  vx
device  miibus
device  ae
device  age
device  alc
device  ale
device  bce
device  bfe
device  bge
device  cas
device  dc
device  et
device  fxp
device  gem
device  hme
device  jme
device  lge
device  msk
device  nfe
device  nge
device  pcn
device  re
device  rl
device  sf
device  sge
device  sis
device  sk
device  ste
device  stge
device  tl
device  tx
device  vge
device  vr
device  wb
device  xl
device  cs
device  ed
device  ex
device  ep
device  fe
device  sn
device  xe
device  wlan
device  wlan_wep
device  wlan_ccmp
device  wlan_tkip
device  wlan_amrr
device  an
device  ath
device  ath_pci
device  ath_hal
device  ath_rate_sample
device  ipw
device  iwi
device  iwn
device  malo
device  mwl
device  ral
device  wi
device  wpi
device  loop
device  random
device  padlock_rng
device  rdrand_rng
device  ether
device  vlan
device  tun
device  md
device  gif
device  faith
device  firmware
device  bpf
device  uhci
device  ohci
device  ehci
device  xhci
device  usb
device  ukbd
device  umass
device  sound
device  snd_cmi
device  snd_csa
device  snd_emu10kx
device  snd_es137x
device  snd_hda
device  snd_ich
device  snd_via8233
device  mmc
device  mmcsd
device  sdhci
device  virtio
device  virtio_pci
device  vtnet
device  virtio_blk
device  virtio_scsi
device  virtio_balloon
device  hyperv
device  xenpci
device  vmx
device  netmap
device  cxgbe

------------------------------------------------------------------------
ddb capture buffer

ddb: ddb_capture: kvm_nlist
_______________________________________________
freebsd-net@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Reply via email to