It's starting to happen again. "top" shows that systemd-timesync is using 100% of CPU, and many errors are turning up in the kern.log and syslog:
Jun 1 20:46:57 ot08 kernel: [27109.247795] NMI watchdog: Watchdog detected hard LOCKUP on cpu 3 Jun 1 20:46:57 ot08 kernel: [27109.247797] Modules linked in: nls_iso8859_1 btrfs xor raid6_pq ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs libcrc32c pci_stub vboxpci(OE) vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic i915_bpo intel_ips snd_hda_intel snd_hda_codec snd_hda_core joydev input_leds intel_rapl snd_hwdep x86_pkg_temp_thermal intel_powerclamp coretemp snd_pcm snd_seq_midi snd_seq_midi_event kvm_intel snd_rawmidi snd_seq kvm snd_seq_device snd_timer irqbypass crct10dif_pclmul crc32_pclmul snd shpchp mei_me mei aesni_intel soundcore serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd hci_uart btbcm btqca btintel bluetooth 8250_fintek intel_lpss_acpi acpi_als intel_lpss kfifo_buf industrialio tpm_infineon acpi_pad mac_hid binfmt_misc parport_pc ppdev lp parport autofs4 uas usb_storage hid_generic hid_microsoft usbhid nouveau mxm_wmi i2c_algo_bit ttm drm_kms_helper syscopyarea e1000e sysfillrect psmouse sysimgblt fb_sys_fops ptp pps_core ahci drm libahci wmi i2c_hid video pinctrl_sunrisepoint hid pinctrl_intel fjes Jun 1 20:46:57 ot08 kernel: [27109.247833] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G OE 4.4.0-22-generic #40-Ubuntu Jun 1 20:46:57 ot08 kernel: [27109.247834] Hardware name: Gigabyte Technology Co., Ltd. Z170-D3H/Z170-D3H-CF, BIOS F2 07/24/2015 Jun 1 20:46:57 ot08 kernel: [27109.247834] task: ffff880fba4cbb00 ti: ffff880fba4dc000 task.ti: ffff880fba4dc000 Jun 1 20:46:57 ot08 kernel: [27109.247835] RIP: 0010:[<ffffffff816bc421>] [<ffffffff816bc421>] cpuidle_enter_state+0x111/0x2b0 Jun 1 20:46:57 ot08 kernel: [27109.247839] RSP: 0018:ffff880fba4dfe70 EFLAGS: 00000246 Jun 1 20:46:57 ot08 kernel: [27109.247840] RAX: 0000000000000000 RBX: 0000000000000006 RCX: 0000000000000018 Jun 1 20:46:57 ot08 kernel: [27109.247840] RDX: 0036858fe1872cf3 RSI: 00000000004b1e6b RDI: 0000000000000000 Jun 1 20:46:57 ot08 kernel: [27109.247841] RBP: ffff880fba4dfea8 R08: 00000000000af8b3 R09: 0000000000000014 Jun 1 20:46:57 ot08 kernel: [27109.247841] R10: 0000000100663ed0 R11: 000000000000be5b R12: 0000000000000006 Jun 1 20:46:57 ot08 kernel: [27109.247842] R13: ffff880fffcdec00 R14: 000018a66d13ebb4 R15: ffffffff81eb1eb8 Jun 1 20:46:57 ot08 kernel: [27109.247843] FS: 0000000000000000(0000) GS:ffff880fffcc0000(0000) knlGS:0000000000000000 Jun 1 20:46:57 ot08 kernel: [27109.247844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 1 20:46:57 ot08 kernel: [27109.247844] CR2: 00007fad3ee0a000 CR3: 0000000001e0a000 CR4: 00000000003406e0 . . . . and so on . . . Jun 1 22:10:13 ot08 kernel: [32156.713009] Code: d2 e8 7d aa 2f 00 3b 05 3b 25 e3 00 89 c1 0f 8d 99 fe ff ff 48 98 49 8b 55 00 48 03 14 c5 80 42 f3 81 8b 42 18 a8 01 74 ca f3 90 <8b> 42 18 a8 01 75 f7 eb bf 0f b6 4d d0 4c 89 fa 4c 89 f6 44 89 Jun 1 22:10:41 ot08 kernel: [32184.709855] NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [systemd-timesyn:18992] Jun 1 22:10:41 ot08 kernel: [32184.709857] Modules linked in: nls_iso8859_1 btrfs xor raid6_pq ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs libcrc32c pci_stub vboxpci(OE) vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) bnep snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic i915_bpo intel_ips snd_hda_intel snd_hda_codec snd_hda_core joydev input_leds intel_rapl snd_hwdep x86_pkg_temp_thermal intel_powerclamp coretemp snd_pcm snd_seq_midi snd_seq_midi_event kvm_intel snd_rawmidi snd_seq kvm snd_seq_device snd_timer irqbypass crct10dif_pclmul crc32_pclmul snd shpchp mei_me mei aesni_intel soundcore serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd hci_uart btbcm btqca btintel bluetooth 8250_fintek intel_lpss_acpi acpi_als intel_lpss kfifo_buf industrialio tpm_infineon acpi_pad mac_hid binfmt_misc parport_pc ppdev lp parport autofs4 uas usb_storage hid_generic hid_microsoft usbhid nouveau mxm_wmi i2c_algo_bit ttm drm_kms_helper syscopyarea e1000e sysfillrect psmouse sysimgblt fb_sys_fops ptp pps_core ahci drm libahci wmi i2c_hid video pinctrl_sunrisepoint hid pinctrl_intel fjes Jun 1 22:10:41 ot08 kernel: [32184.709921] CPU: 4 PID: 18992 Comm: systemd-timesyn Tainted: G OEL 4.4.0-22-generic #40-Ubuntu Jun 1 22:10:41 ot08 kernel: [32184.709922] Hardware name: Gigabyte Technology Co., Ltd. Z170-D3H/Z170-D3H-CF, BIOS F2 07/24/2015 Jun 1 22:10:41 ot08 kernel: [32184.709923] task: ffff880fb4ee2c40 ti: ffff880f1d684000 task.ti: ffff880f1d684000 Jun 1 22:10:41 ot08 kernel: [32184.709924] RIP: 0010:[<ffffffff81103e08>] [<ffffffff81103e08>] smp_call_function_many+0x1f8/0x260 Jun 1 22:10:41 ot08 kernel: [32184.709928] RSP: 0018:ffff880f1d687d20 EFLAGS: 00000202 Jun 1 22:10:41 ot08 kernel: [32184.709928] RAX: 0000000000000003 RBX: 0000000000000100 RCX: 0000000000000003 Jun 1 22:10:41 ot08 kernel: [32184.709929] RDX: ffff880fffcdb200 RSI: 0000000000000100 RDI: ffff880fffd17c88 Jun 1 22:10:41 ot08 kernel: [32184.709929] RBP: ffff880f1d687d58 R08: 0000000000000000 R09: 00000000000000ef Jun 1 22:10:41 ot08 kernel: [32184.709930] R10: 0000000000000004 R11: ffff880fffd17c88 R12: ffff880fffd17c88 Jun 1 22:10:41 ot08 kernel: [32184.709931] R13: ffff880fffd17c80 R14: ffffffff81035d10 R15: 0000000000000000 Jun 1 22:10:41 ot08 kernel: [32184.709931] FS: 00007f6cbc418780(0000) GS:ffff880fffd00000(0000) knlGS:0000000000000000 Jun 1 22:10:41 ot08 kernel: [32184.709932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 1 22:10:41 ot08 kernel: [32184.709933] CR2: 000000000133e028 CR3: 0000000092547000 CR4: 00000000003406e0 Jun 1 22:10:41 ot08 kernel: [32184.709933] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jun 1 22:10:41 ot08 kernel: [32184.709934] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Jun 1 22:10:41 ot08 kernel: [32184.709935] Stack: Jun 1 22:10:41 ot08 kernel: [32184.709935] 0000000000017c40 01ff880f00000001 ffffffff8171d4d7 ffffffff81035d10 Jun 1 22:10:41 ot08 kernel: [32184.709936] 0000000000000000 ffffffff8171d4d8 0000000000000001 ffff880f1d687d80 Jun 1 22:10:41 ot08 kernel: [32184.709937] ffffffff81103f4d ffffffff8171d4d7 0000000000000005 ffff880f1d687dd3 Jun 1 22:10:41 ot08 kernel: [32184.709939] Call Trace: Jun 1 22:10:41 ot08 kernel: [32184.709941] [<ffffffff8171d4d7>] ? dev_hard_start_xmit+0x137/0x3d0 Jun 1 22:10:41 ot08 kernel: [32184.709943] [<ffffffff81035d10>] ? arch_unregister_cpu+0x30/0x30 Jun 1 22:10:41 ot08 kernel: [32184.709944] [<ffffffff8171d4d8>] ? dev_hard_start_xmit+0x138/0x3d0 Jun 1 22:10:41 ot08 kernel: [32184.709946] [<ffffffff81103f4d>] on_each_cpu+0x2d/0x60 Jun 1 22:10:41 ot08 kernel: [32184.709947] [<ffffffff8171d4d7>] ? dev_hard_start_xmit+0x137/0x3d0 Jun 1 22:10:41 ot08 kernel: [32184.709948] [<ffffffff81036d0a>] text_poke_bp+0x6a/0xf0 Jun 1 22:10:41 ot08 kernel: [32184.709949] [<ffffffff8171d4d7>] ? dev_hard_start_xmit+0x137/0x3d0 Jun 1 22:10:41 ot08 kernel: [32184.709951] [<ffffffff810339fb>] arch_jump_label_transform+0x9b/0x120 Jun 1 22:10:41 ot08 kernel: [32184.709952] [<ffffffff8118ad6c>] __jump_label_update+0x6c/0x80 Jun 1 22:10:41 ot08 kernel: [32184.709954] [<ffffffff8118ae08>] jump_label_update+0x88/0x90 Jun 1 22:10:41 ot08 kernel: [32184.709955] [<ffffffff8118b014>] static_key_slow_inc+0x94/0xa0 Jun 1 22:10:41 ot08 kernel: [32184.709957] [<ffffffff81715c0b>] net_enable_timestamp+0x3b/0x40 Jun 1 22:10:41 ot08 kernel: [32184.709959] [<ffffffff81704d86>] sock_enable_timestamp+0x36/0x40 Jun 1 22:10:41 ot08 kernel: [32184.709960] [<ffffffff817050f6>] sock_setsockopt+0x366/0x810 Jun 1 22:10:41 ot08 kernel: [32184.709962] [<ffffffff813838b2>] ? apparmor_socket_setsockopt+0x22/0x30 Jun 1 22:10:41 ot08 kernel: [32184.709964] [<ffffffff816ffe2d>] SyS_setsockopt+0xcd/0xe0 Jun 1 22:10:41 ot08 kernel: [32184.709966] [<ffffffff818252f2>] entry_SYSCALL_64_fastpath+0x16/0x71 Jun 1 22:10:41 ot08 kernel: [32184.709966] Code: d2 e8 7d aa 2f 00 3b 05 3b 25 e3 00 89 c1 0f 8d 99 fe ff ff 48 98 49 8b 55 00 48 03 14 c5 80 42 f3 81 8b 42 18 a8 01 74 ca f3 90 <8b> 42 18 a8 01 75 f7 eb bf 0f b6 4d d0 4c 89 fa 4c 89 f6 44 89 Jun 1 22:10:57 ot08 kernel: [32200.320164] INFO: rcu_sched detected stalls on CPUs/tasks: Jun 1 22:10:57 ot08 kernel: [32200.320167] 3-...: (1 GPs behind) idle=5a3/1/0 softirq=695357/695357 fqs=1274786 Jun 1 22:10:57 ot08 kernel: [32200.320185] (detected by 0, t=1275142 jiffies, g=527400, c=527399, q=17000) Jun 1 22:10:57 ot08 kernel: [32200.320186] Task dump for CPU 3: Jun 1 22:10:57 ot08 kernel: [32200.320187] swapper/3 R running task 0 0 1 0x00000008 Jun 1 22:10:57 ot08 kernel: [32200.320189] ffff880fba4dfe70 0000000000000018 00000000ffcd3b00 000018a66d41fc67 Jun 1 22:10:57 ot08 kernel: [32200.320191] ffffffff81f35140 ffff880fba4e0000 ffff880fffcdec00 ffffffff81eb1c60 Jun 1 22:10:57 ot08 kernel: [32200.320192] ffff880fba4dc000 ffff880fba4dfeb8 ffffffff816bc5f7 ffff880fba4dfed0 Jun 1 22:10:57 ot08 kernel: [32200.320193] Call Trace: Jun 1 22:10:57 ot08 kernel: [32200.320197] [<ffffffff816bc5f7>] ? cpuidle_enter+0x17/0x20 Jun 1 22:10:57 ot08 kernel: [32200.320200] [<ffffffff810c3db2>] ? call_cpuidle+0x32/0x60 Jun 1 22:10:57 ot08 kernel: [32200.320201] [<ffffffff816bc5d3>] ? cpuidle_select+0x13/0x20 Jun 1 22:10:57 ot08 kernel: [32200.320203] [<ffffffff810c4070>] ? cpu_startup_entry+0x290/0x350 Jun 1 22:10:57 ot08 kernel: [32200.320205] [<ffffffff81051714>] ? start_secondary+0x154/0x190 -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to xorg in Ubuntu. https://bugs.launchpad.net/bugs/1587730 Title: graphic system freezes after a while, can still ssh into machine Status in xorg package in Ubuntu: New Bug description: Ubuntu 16.04 desktop with all updates up to date Gigagyte GA-Z170 motherboard, Intel i7-6700 3.4gHz, 64GB RAM, Samsung 840 SSD, Gigabyte GEForce GT710 graphics (nvidia chipset) Very light load. A few terminal windows, a few Firefox pages, Thunderbird, and VirtualBox (with the extension pack loaded) running one small Linux VM with 512Mb memory (very lightly loaded as it's only running bind9). I think (but don't have perfect certainty on this) that some of the crashes have happened without VirtualBox running. Also running rsync so that backuppc on a separate machine can back it up over the network (backuppc has been a real lifesaver with all the reinstallations!) After booting the system runs happily for a while then the GUI freezes. This can take a few hours or up to a day or two. You can still ssh into the system, and if you do "top" it typically shows 100% CPU load on systemd-timesync. The same happens whether I use nouveau or the proprietary nvidia driver (361) I have tried a complete reinstallation (4 times already, starting to get quite frustrating) using the proprietary drivers and NOT using the proprietary drivers and the same still happens. The most recent time was with nouveau, and Xorg.log has a number of entries like this: (EE) [mi] EQ overflowing. Additional events will be discarded until existing events are processed. (EE) (EE) Backtrace: (EE) 0: /usr/lib/xorg/Xorg (xorg_backtrace+0x4e) [0x5652cde325ce] (EE) 1: /usr/lib/xorg/Xorg (mieqEnqueue+0x253) [0x5652cde14083] (EE) 2: /usr/lib/xorg/Xorg (QueuePointerEvents+0x52) [0x5652cdcec662] (EE) 3: /usr/lib/xorg/modules/input/evdev_drv.so (0x7f31f985c000+0x61f3) [0x7f31f98621f3] (EE) 4: /usr/lib/xorg/modules/input/evdev_drv.so (0x7f31f985c000+0x6a5d) [0x7f31f9862a5d] (EE) 5: /usr/lib/xorg/Xorg (0x5652cdc80000+0x94228) [0x5652cdd14228] (EE) 6: /usr/lib/xorg/Xorg (0x5652cdc80000+0xb96f2) [0x5652cdd396f2] (EE) 7: /lib/x86_64-linux-gnu/libc.so.6 (0x7f3202cef000+0x354a0) [0x7f3202d244a0] (EE) 8: /usr/lib/xorg/Xorg (GiveUp+0x0) [0x5652cde37330] (EE) 9: /lib/x86_64-linux-gnu/libc.so.6 (0x7f3202cef000+0x354a0) [0x7f3202d244a0] (EE) 10: /lib/x86_64-linux-gnu/libc.so.6 (__select+0x13) [0x7f3202debcf3] (EE) 11: /usr/lib/xorg/Xorg (WaitForSomething+0x1d7) [0x5652cde2f307] (EE) 12: /usr/lib/xorg/Xorg (0x5652cdc80000+0x539ee) [0x5652cdcd39ee] (EE) 13: /usr/lib/xorg/Xorg (0x5652cdc80000+0x57c33) [0x5652cdcd7c33] (EE) 14: /lib/x86_64-linux-gnu/libc.so.6 (__libc_start_main+0xf0) [0x7f3202d0f830] (EE) 15: /usr/lib/xorg/Xorg (_start+0x29) [0x5652cdcc1f59] (EE) (EE) [mi] These backtraces from mieqEnqueue may point to a culprit higher up the stack. (EE) [mi] mieq is *NOT* the cause. It is a victim. (EE) [mi] EQ overflow continuing. 100 events have been dropped. Then at the end the last few are: [ 6265.543] [mi] Increasing EQ size to 1024 to prevent dropped events. [ 6265.543] [mi] EQ processing has resumed after 1070 dropped events. [ 6265.543] [mi] This may be caused by a misbehaving driver monopolizing the server's resources. What cna the problem possibly be, especially as 16.04 is meant to be a stable release and an Nvidia GT710 card is hardly bleeding-edge? Help greatly appreciated! ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: xorg 1:7.7+13ubuntu3 ProcVersionSignature: Ubuntu 4.4.0-22.40-generic 4.4.8 Uname: Linux 4.4.0-22-generic x86_64 .tmp.unity_support_test.0: ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 CompizPlugins: No value set for `/apps/compiz-1/general/screen0/options/active_plugins' CompositorRunning: compiz CompositorUnredirectDriverBlacklist: '(nouveau|Intel).*Mesa 8.0' CompositorUnredirectFSW: true Date: Wed Jun 1 13:22:13 2016 DistUpgraded: Fresh install DistroCodename: xenial DistroVariant: ubuntu DkmsStatus: virtualbox, 5.0.18, 4.4.0-22-generic, x86_64: installed ExtraDebuggingInterest: Yes, if not too technical GraphicsCard: NVIDIA Corporation Device [10de:128b] (rev a1) (prog-if 00 [VGA controller]) Subsystem: Gigabyte Technology Co., Ltd Device [1458:36ec] InstallationDate: Installed on 2016-06-01 (0 days ago) InstallationMedia: Ubuntu 16.04 LTS "Xenial Xerus" - Release amd64 (20160420.1) MachineType: Gigabyte Technology Co., Ltd. Z170-D3H ProcEnviron: LANGUAGE=en_HK:en PATH=(custom, no user) LANG=en_HK.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-22-generic root=UUID=79d1ab40-4431-445f-87bb-6a8d44370cee ro quiet splash vt.handoff=7 SourcePackage: xorg UpgradeStatus: No upgrade log present (probably fresh install) dmi.bios.date: 07/24/2015 dmi.bios.vendor: American Megatrends Inc. dmi.bios.version: F2 dmi.board.asset.tag: To be filled by O.E.M. dmi.board.name: Z170-D3H-CF dmi.board.vendor: Gigabyte Technology Co., Ltd. dmi.board.version: x.x dmi.chassis.asset.tag: To Be Filled By O.E.M. dmi.chassis.type: 3 dmi.chassis.vendor: To Be Filled By O.E.M. dmi.chassis.version: To Be Filled By O.E.M. dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvrF2:bd07/24/2015:svnGigabyteTechnologyCo.,Ltd.:pnZ170-D3H:pvrTobefilledbyO.E.M.:rvnGigabyteTechnologyCo.,Ltd.:rnZ170-D3H-CF:rvrx.x:cvnToBeFilledByO.E.M.:ct3:cvrToBeFilledByO.E.M.: dmi.product.name: Z170-D3H dmi.product.version: To be filled by O.E.M. dmi.sys.vendor: Gigabyte Technology Co., Ltd. version.compiz: compiz 1:0.9.12.2+16.04.20160415-0ubuntu1 version.ia32-libs: ia32-libs N/A version.libdrm2: libdrm2 2.4.67-1 version.libgl1-mesa-dri: libgl1-mesa-dri 11.2.0-1ubuntu2 version.libgl1-mesa-dri-experimental: libgl1-mesa-dri-experimental N/A version.libgl1-mesa-glx: libgl1-mesa-glx 11.2.0-1ubuntu2 version.xserver-xorg-core: xserver-xorg-core 2:1.18.3-1ubuntu2.2 version.xserver-xorg-input-evdev: xserver-xorg-input-evdev 1:2.10.1-1ubuntu2 version.xserver-xorg-video-ati: xserver-xorg-video-ati 1:7.7.0-1 version.xserver-xorg-video-intel: xserver-xorg-video-intel 2:2.99.917+git20160325-1ubuntu1 version.xserver-xorg-video-nouveau: xserver-xorg-video-nouveau 1:1.0.12-1build2 xserver.bootTime: Wed Jun 1 13:14:17 2016 xserver.configfile: default xserver.devices: input Power Button KEYBOARD, id 6 input Power Button KEYBOARD, id 7 input Sleep Button KEYBOARD, id 8 input Microsoft Microsoft Wireless Optical Desktop® 2.10 KEYBOARD, id 9 input Microsoft Microsoft Wireless Optical Desktop® 2.10 KEYBOARD, id 10 xserver.errors: Failed to load module "nvidia" (module does not exist, 0) Failed to load module "nvidia" (module does not exist, 0) xserver.logfile: /var/log/Xorg.0.log xserver.version: 2:1.18.3-1ubuntu2.2 xserver.video_driver: nouveau To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg/+bug/1587730/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
