Hi John Please find below with KALLSYMS enabled. To be honest it doesn't appear to add anything extra? To enable it, I set CONFIG_KERNEL_KALLSYMS=y and performed a make target/linux/clean - then re-compiled and used sysupgrade to flash. Did I miss something, and how can I check whether KALLSYMS was compiled in?
Wed Nov 9 14:13:23 2016 local6.info coova-chilli[1585]: CoovaChilli(ChilliSpot) 1.3.0. Copyright 2002-2005 Mondru AB. Licensed under GPL. Copyright 2006-2012 David Bird (Coova Technologies) <support at coova.com>. Licensed under GPL. See http://www.coova.org/ for details. Wed Nov 9 14:13:23 2016 local6.notice coova-chilli[1585]: tun.c: 605: TX queue length set to 100 Wed Nov 9 14:13:24 2016 kern.warn kernel: hostapd invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0 Wed Nov 9 14:13:24 2016 kern.warn kernel: CPU: 0 PID: 1548 Comm: hostapd Not tainted 4.4.30 #0 Wed Nov 9 14:13:24 2016 kern.warn kernel: Stack : 803898c4 00000000 00000001 803e0000 83961b80 803ce083 8036b284 0000060c Wed Nov 9 14:13:24 2016 kern.warn kernel: 8043379c 82081d1c 00000000 00000003 00003b43 800a60c4 00000006 80373ab0 Wed Nov 9 14:13:24 2016 kern.warn kernel: 00000000 00000000 8036ec10 82081bbc 80436542 800a4044 803cd710 00000000 Wed Nov 9 14:13:24 2016 kern.warn kernel: 00000001 801ee500 00000000 00000000 00000000 00000000 00000000 00000000 Wed Nov 9 14:13:24 2016 kern.warn kernel: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 Wed Nov 9 14:13:24 2016 kern.warn kernel: ... Wed Nov 9 14:13:24 2016 kern.warn kernel: Call Trace: Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800715a8>] show_stack+0x50/0x84 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800d2400>] dump_header.isra.4+0x48/0x130 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800d27e4>] oom_kill_process+0x98/0x43c Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800d2eec>] out_of_memory+0x2e0/0x324 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800d67e0>] __alloc_pages_nodemask+0x684/0x6f0 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800d17e4>] filemap_fault+0x258/0x458 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800ec3cc>] __do_fault+0x3c/0xa8 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800ef66c>] handle_mm_fault+0x4e4/0xb84 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<800761d4>] __do_page_fault+0x134/0x470 Wed Nov 9 14:13:24 2016 kern.warn kernel: [<80060820>] ret_from_exception+0x0/0x10 Wed Nov 9 14:13:24 2016 kern.warn kernel: Wed Nov 9 14:13:24 2016 kern.warn kernel: Mem-Info: Wed Nov 9 14:13:24 2016 kern.warn kernel: active_anon:381 inactive_anon:7 isolated_anon:0 Wed Nov 9 14:13:24 2016 kern.warn kernel: active_file:25 inactive_file:30 isolated_file:0 Wed Nov 9 14:13:24 2016 kern.warn kernel: unevictable:0 dirty:0 writeback:0 unstable:0 Wed Nov 9 14:13:24 2016 kern.warn kernel: slab_reclaimable:140 slab_unreclaimable:1354 Wed Nov 9 14:13:24 2016 kern.warn kernel: mapped:2 shmem:31 pagetables:64 bounce:0 Wed Nov 9 14:13:24 2016 kern.warn kernel: free:2048 free_pcp:0 free_cma:0 Wed Nov 9 14:13:24 2016 kern.warn kernel: Normal free:8192kB min:8192kB low:10240kB high:12288kB active_anon:1524kB inactive_anon:28kB active_file:100kB inactive_file:120kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:65536kB managed:60684kB mlocked:0kB dirty:0kB writeback:0kB mapped:8kB shmem:124kB slab_reclaimable:560kB slab_unreclaimable:5416kB kernel_stack:384kB pagetables:256kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unrecWed Nov 9 14:13:24 2016 kern.warn kernel: lowmem_reserve[]: 0 0 Wed Nov 9 14:13:24 2016 kern.warn kernel: Normal: 258*4kB (UM) 205*8kB (UM) 117*16kB (UM) 52*32kB (UM) 13*64kB (UM) 5*128kB (U) 2*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 8192kB Wed Nov 9 14:13:24 2016 kern.warn kernel: 86 total pagecache pages Wed Nov 9 14:13:24 2016 kern.warn kernel: 0 pages in swap cache Wed Nov 9 14:13:24 2016 kern.warn kernel: Swap cache stats: add 0, delete 0, find 0/0 Wed Nov 9 14:13:24 2016 kern.warn kernel: Free swap = 0kB Wed Nov 9 14:13:24 2016 kern.warn kernel: Total swap = 0kB Wed Nov 9 14:13:24 2016 kern.warn kernel: 16384 pages RAM Wed Nov 9 14:13:24 2016 kern.warn kernel: 0 pages HighMem/MovableOnly Wed Nov 9 14:13:24 2016 kern.warn kernel: 1213 pages reserved Wed Nov 9 14:13:24 2016 kern.info kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Wed Nov 9 14:13:24 2016 kern.info kernel: [ 420] 0 420 295 15 4 0 0 0 ubusd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 421] 0 421 224 10 3 0 0 0 askfirst Wed Nov 9 14:13:24 2016 kern.info kernel: [ 707] 0 707 307 34 4 0 0 0 logd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 716] 0 716 361 23 4 0 0 0 rpcd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 762] 0 762 414 40 5 0 0 0 netifd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 801] 0 801 297 10 3 0 0 0 crond Wed Nov 9 14:13:24 2016 kern.info kernel: [ 827] 0 827 265 11 3 0 0 0 dropbear Wed Nov 9 14:13:24 2016 kern.info kernel: [ 849] 0 849 322 19 3 0 0 0 uhttpd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 991] 0 991 296 10 3 0 0 0 ntpd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1109] 0 1109 296 9 3 0 0 0 udhcpc Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1341] 0 1341 486 34 3 0 0 0 hostapd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1376] 453 1376 261 17 4 0 0 0 dnsmasq Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1548] 0 1548 485 30 4 0 0 0 hostapd Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1571] 0 1571 282 25 3 0 0 0 dropbear Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1573] 0 1573 297 10 4 0 0 0 ash Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1585] 0 1585 776 43 4 0 0 0 chilli Wed Nov 9 14:13:24 2016 kern.info kernel: [ 1586] 0 1586 260 3 3 0 0 0 hotplug-call Wed Nov 9 14:13:24 2016 kern.err kernel: Out of memory: Kill process 1585 (chilli) score 3 or sacrifice child Wed Nov 9 14:13:24 2016 kern.err kernel: Killed process 1585 (chilli) total-vm:3104kB, anon-rss:168kB, file-rss:4kB Wed Nov 9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA overrun on vdev 0, skipped old beacon Wed Nov 9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA overrun on vdev 1, skipped old beacon Wed Nov 9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA overrun on vdev 0, skipped old beacon Wed Nov 9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA overrun on vdev 1, skipped old beacon Wed Nov 9 14:13:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA overrun on vdev 0, skipped old beacon This is a 64MB RAM unit though and has over half of its memory free before starting Coova-Chilli. We have the same software running on 32MB units for many years with 20MB free still. Why does it only get OOM and crash when attaching it to the 5GHz WiFi and not 2.4GHz or the LAN bridge etc. Seems something between ath10k and Coova-Chilli on this particular board/revision? Anything else I can try to find out why it goes OOM or crashes? Thanks James -----Original Message----- From: Lede-dev [mailto:lede-dev-boun...@lists.infradead.org] On Behalf Of John Crispin Sent: 8 November 2016 02:16:43 PST To: James W <james.w...@purplewifi.com>; lede-dev@lists.infradead.org; Subject: Re: [LEDE-DEV] Crash on D-Link DIR-869-A1 (ar71xx) with ath10k / Coova-Chilli can you retry with KALLSYMS enabled such that the stack trace is a little more descriptive please John On 08/11/2016 10:33, James Wood wrote: > Hi, > > I'm trying to use Coova-Chilli on this ar71xx based device which supports > both 2.5 and 5GHz respectively. I'm facing a problem in that when I start > Coova-Chilli, it crashes out and either locks up the device or kills some > processes due to being out of memory. > > This only happens when I set Coova-Chilli to use the ath10k 5GHz wifi > network, not 2.4GHz or LAN port (it works fine on those). Haven't seen this > before on other devices that use the same ath10k driver / ar71xx chip. > > Below is what is printed in the log when Coova-Chilli starts up. You can see > it goes a bit crazy and ends up killing other processes. > > Tue Nov 8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:21 2016 local6.info coova-chilli[6371]: > CoovaChilli(ChilliSpot) 1.3.0. Copyright 2002-2005 Mondru AB. Licensed under > GPL. Copyright 2006-2012 David Bird (Coova Technologies) > <support at coova.com>. Licensed under GPL. See http://www.coova.org/ for > details. > Tue Nov 8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: chilli invoked oom-killer: > gfp_mask=0x2420848, order=0, oom_score_adj=0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: CPU: 0 PID: 6371 Comm: chilli Not > tainted 4.4.27 #0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: Stack : 80334d74 00000000 > 00000001 80380000 00000000 00000000 00000000 00000000 > Tue Nov 8 09:20:25 2016 kern.warn kernel: 00000000 00000000 00000000 > 00000000 00000000 00000000 00000000 00000000 > Tue Nov 8 09:20:25 2016 kern.warn kernel: 00000000 00000000 00000000 > 00000000 00000000 00000000 00000000 00000000 > Tue Nov 8 09:20:25 2016 kern.warn kernel: 00000000 00000000 00000000 > 00000000 00000000 00000000 00000000 00000000 > Tue Nov 8 09:20:25 2016 kern.warn kernel: 00000000 00000000 00000000 > 00000000 00000000 00000000 00000000 00000000 > Tue Nov 8 09:20:25 2016 kern.warn kernel: ... > Tue Nov 8 09:20:25 2016 kern.warn kernel: Call Trace:[<80071180>] > 0x80071180 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80071180>] 0x80071180 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800d04b8>] 0x800d04b8 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800db8c4>] 0x800db8c4 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800d089c>] 0x800d089c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800d0fa4>] 0x800d0fa4 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800d4898>] 0x800d4898 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800cda48>] 0x800cda48 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8012e88c>] 0x8012e88c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8012eb0c>] 0x8012eb0c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8012ed5c>] 0x8012ed5c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8015397c>] 0x8015397c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80157b8c>] 0x80157b8c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80154680>] 0x80154680 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80155808>] 0x80155808 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800d8034>] 0x800d8034 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800ccb78>] 0x800ccb78 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800cf7f0>] 0x800cf7f0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80097bdc>] 0x80097bdc > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800ea484>] 0x800ea484 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800ed1ec>] 0x800ed1ec > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800ed724>] 0x800ed724 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80075da8>] 0x80075da8 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80253e5c>] 0x80253e5c > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8009db20>] 0x8009db20 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80113130>] 0x80113130 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8009e468>] 0x8009e468 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<8009a260>] 0x8009a260 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<800662a0>] 0x800662a0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: [<80060820>] 0x80060820 > Tue Nov 8 09:20:25 2016 kern.warn kernel: > Tue Nov 8 09:20:25 2016 kern.warn kernel: Mem-Info: > Tue Nov 8 09:20:25 2016 kern.warn kernel: active_anon:416 inactive_anon:7 > isolated_anon:0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: active_file:99 inactive_file:174 > isolated_file:0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: unevictable:0 dirty:0 > writeback:0 unstable:0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: slab_reclaimable:141 > slab_unreclaimable:1417 > Tue Nov 8 09:20:25 2016 kern.warn kernel: mapped:2 shmem:71 pagetables:62 > bounce:0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: free:2027 free_pcp:2 free_cma:0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: Normal free:8108kB min:8192kB > low:10240kB high:12288kB active_anon:1664kB inactive_anon:28kB > active_file:396kB inactive_file:696kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:65536kB managed:61020kB mlocked:0kB dirty:0kB > writeback:0kB mapped:8kB shmem:284kB slab_reclaimable:564kB > slab_unreclaimable:5668kB kernel_stack:384kB pagetables:248kB unstable:0kB > bounce:0kB free_pcp:8kB local_pcp:8kB free_cma:0kB writeback_tmp:0kB > pages_scanned:0 all_unrecTue Nov 8 09:20:25 2016 kern.warn kernel: > lowmem_reserve[]: 0 0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: Normal: 255*4kB (UME) 318*8kB > (UE) 228*16kB (UE) 28*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB > 0*2048kB 0*4096kB = 8108kB > Tue Nov 8 09:20:25 2016 kern.warn kernel: 344 total pagecache pages > Tue Nov 8 09:20:25 2016 kern.warn kernel: 0 pages in swap cache > Tue Nov 8 09:20:25 2016 kern.warn kernel: Swap cache stats: add 0, delete > 0, find 0/0 > Tue Nov 8 09:20:25 2016 kern.warn kernel: Free swap = 0kB > Tue Nov 8 09:20:25 2016 kern.warn kernel: Total swap = 0kB > Tue Nov 8 09:20:25 2016 kern.warn kernel: 16384 pages RAM > Tue Nov 8 09:20:25 2016 kern.warn kernel: 0 pages HighMem/MovableOnly > Tue Nov 8 09:20:25 2016 kern.warn kernel: 1129 pages reserved > Tue Nov 8 09:20:25 2016 kern.info kernel: [ pid ] uid tgid total_vm > rss nr_ptes nr_pmds swapents oom_score_adj name > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 417] 0 417 295 > 15 3 0 0 0 ubusd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 418] 0 418 224 > 9 3 0 0 0 askfirst > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 908] 0 908 361 > 23 4 0 0 0 rpcd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 994] 0 994 297 > 10 4 0 0 0 crond > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 1020] 0 1020 322 > 20 3 0 0 0 uhttpd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 2239] 0 2239 265 > 11 3 0 0 0 dropbear > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 3861] 0 3861 426 > 38 4 0 0 0 netifd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 4095] 0 4095 296 > 9 3 0 0 0 udhcpc > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 4207] 453 4207 266 > 21 4 0 0 0 dnsmasq > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 4228] 0 4228 296 > 9 3 0 0 0 ntpd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 5024] 0 5024 282 > 25 4 0 0 0 dropbear > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 5025] 0 5025 297 > 10 5 0 0 0 ash > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 5929] 0 5929 307 > 35 4 0 0 0 logd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 6348] 0 6348 485 > 36 4 0 0 0 hostapd > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 6371] 0 6371 776 > 43 4 0 0 0 chilli > Tue Nov 8 09:20:25 2016 kern.info kernel: [ 6373] 0 6373 400 > 36 3 0 0 0 procd > Tue Nov 8 09:20:25 2016 kern.err kernel: Out of memory: Kill process 6371 > (chilli) score 3 or sacrifice child > Tue Nov 8 09:20:25 2016 kern.err kernel: Killed process 6371 (chilli) > total-vm:3104kB, anon-rss:168kB, file-rss:4kB > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_warn: 22 callbacks > suppressed > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 1, skipped old beacon > Tue Nov 8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA > overrun on vdev 0, skipped old beacon > > Any help/advice would be much appreciated. I have also tried using the > latest code from github as of this morning (I was a few weeks behind). > > Thanks, > > James W > > > _______________________________________________ Lede-dev mailing list Lede-dev@lists.infradead.org http://lists.infradead.org/mailman/listinfo/lede-dev
