[Intel-wired-lan] [PATCH v4] igc: add support to interrupt, eeprom, registers and link self-tests

Brown, Aaron F aaron.f.brown at intel.com
Fri May 1 19:18:30 UTC 2020


> From: Intel-wired-lan <intel-wired-lan-bounces at osuosl.org> On Behalf Of Vitaly
> Lifshits
> Sent: Sunday, April 5, 2020 5:16 AM
> To: intel-wired-lan at osuosl.org
> Subject: [Intel-wired-lan] [PATCH v4] igc: add support to interrupt, eeprom,
> registers and link self-tests
> 
> Introduced igc_diag.c and igc_diag.h, these files have the
> diagnostics functionality of igc driver. For the time being
> these files are being used by ethtool self-test callbacks.
> Which mean that interrupt, eeprom, registers and link self-tests for
> ethtool were implemented.
> 
> Signed-off-by: Vitaly Lifshits <vitaly.lifshits at intel.com>
> Reported-by: kbuild test robot <lkp at intel.com>
> Reported-by: Dan Carpenter <dan.carpenter at oracle.com>
> ---
> v2: Fix return 0/1 to boolean value in igc_reg_test function
> v3: Address community comments
> v4: Fix interrupt test and address community comments
> ---
>  drivers/net/ethernet/intel/igc/Makefile      |   2 +-
>  drivers/net/ethernet/intel/igc/igc.h         |   4 +
>  drivers/net/ethernet/intel/igc/igc_diag.c    | 336
> +++++++++++++++++++++++++++
>  drivers/net/ethernet/intel/igc/igc_diag.h    |  37 +++
>  drivers/net/ethernet/intel/igc/igc_ethtool.c |  63 +++++
>  drivers/net/ethernet/intel/igc/igc_main.c    |   4 +-
>  drivers/net/ethernet/intel/igc/igc_regs.h    |   2 +
>  7 files changed, 445 insertions(+), 3 deletions(-)
>  create mode 100644 drivers/net/ethernet/intel/igc/igc_diag.c
>  create mode 100644 drivers/net/ethernet/intel/igc/igc_diag.h
> 

This does enable ethtool diags tests to run and at first it looks fine and I was about to give my Tested-by: to when a "watchdog: BUG: soft lockup  - CPU#7 stuck" leading to a call trace popped up on one of my systems that had been running other tests for several days before running a last round of diags...  And then on it showed up on the other system I had been doing most the diags on...  

When it appears the system is still up and the trace gets dumped to /var/log/messages but the system is not responsive to the console or network connections.  The trace repeats every 30 seconds or so.

It's repeatable but generally takes hundreds of iterations to show up.  The soonest I've seen it appear (after creating an ethtool diag / print iteration / repeat script) was around 50 iterations.  The second soonest I counted was 730 iterations and an my last try int took 1713.  It can take hours to appear with nothing more than an endless `ethtool -t $iface` loop, but not days. 

Here's a trace capture (this shows igb and e1000e drivers loaded, but the issue triggers with just igc loaded as well.)
-----------------------------------------------------------------------
May  1 06:36:27 u1322 kernel: igc 0000:01:00.0 eth1: Offline testing starting
May  1 06:36:32 u1322 kernel: igc 0000:01:00.0 eth1: Register testing starting
May  1 06:36:32 u1322 kernel: igc 0000:01:00.0 eth1: EEPROM testing starting
May  1 06:36:32 u1322 kernel: igc 0000:01:00.0 eth1: interrupt testing starting
May  1 06:36:32 u1322 kernel: igc 0000:01:00.0 eth1: testing shared interrupt
May  1 06:37:00 u1322 kernel: watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [ethtool:9111]
May  1 06:37:00 u1322 kernel: Modules linked in: igb igc e1000e rfcomm xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defra
g_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter nft_compat nf_tables nfnetlink tun stp llc cmac bnep iTCO_wdt iTCO_vendor_s
upport wmi_bmof intel_wmi_thunderbolt mxm_wmi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm snd_hda_codec
_hdmi snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio btusb irqbypass btrtl snd_hda_intel btbcm snd_intel_dspc
fg btintel snd_hda_codec bluetooth snd_hwdep snd_hda_core snd_seq crct10dif_pclmul snd_seq_device crc32_pclmul snd_pcm g
hash_clmulni_intel joydev pl2303 intel_cstate snd_timer intel_uncore snd ecdh_generic mei_me ecc soundcore pcspkr mei i2
c_i801 intel_rapl_perf rfkill sg wmi intel_pmc_core acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs l
ibcrc32c sr_mod sd_mod cdrom t10_pi i915 intel_gtt drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops cec drm
ahci libahci libata crc32c_intel dca i2c_algo_bit video
May  1 06:37:00 u1322 kernel: [last unloaded: bridge]
May  1 06:37:00 u1322 kernel: CPU: 7 PID: 9111 Comm: ethtool Not tainted 5.7.0-rc2_next-queue_dev-queue_c097661-00758-gc
097661edb2b #31
May  1 06:37:00 u1322 kernel: Hardware name: Gigabyte Technology Co., Ltd. Z370 AORUS Gaming 5/Z370 AORUS Gaming 5-CF, B
IOS F6 04/03/2018
May  1 06:37:00 u1322 kernel: RIP: 0010:__do_softirq+0x76/0x2ec
May  1 06:37:00 u1322 kernel: Code: 81 05 b2 7e e1 5d 00 01 00 00 c7 44 24 20 0a 00 00 00 44 89 74 24 04 48 c7 c0 40 b5
02 00 65 66 c7 00 00 00 fb b8 ff ff ff ff <48> c7 c6 00 51 a0 a2 0f bc 44 24 04 83 c0 01 49 89 f7 89 44 24 08
May  1 06:37:00 u1322 kernel: RSP: 0018:ffffaed900254f70 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
May  1 06:37:00 u1322 kernel: RAX: 00000000ffffffff RBX: ffff96bb7e3d8640 RCX: 000000000000001f
May  1 06:37:00 u1322 kernel: RDX: 0000000000000043 RSI: 000000002819aad9 RDI: fffffffa31c219af
May  1 06:37:00 u1322 kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: 000000000002b5c0
May  1 06:37:00 u1322 kernel: R10: 000167b91c1d8b72 R11: 000070ac2bd6bc76 R12: 0000000000000000
May  1 06:37:00 u1322 kernel: R13: 0000000000000000 R14: 0000000000000282 R15: 0000000000000000
May  1 06:37:00 u1322 kernel: FS:  00007ff4033ab740(0000) GS:ffff96bb7e3c0000(0000) knlGS:0000000000000000
May  1 06:37:00 u1322 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May  1 06:37:00 u1322 kernel: CR2: 00007fde63363000 CR3: 0000000fe1f1c004 CR4: 00000000003606e0
May  1 06:37:00 u1322 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
May  1 06:37:00 u1322 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
May  1 06:37:00 u1322 kernel: Call Trace:
May  1 06:37:00 u1322 kernel: <IRQ>
May  1 06:37:00 u1322 kernel: ? hrtimer_interrupt+0x12e/0x220
May  1 06:37:00 u1322 kernel: ? hrtimer_interrupt+0x12e/0x220
May  1 06:37:00 u1322 kernel: irq_exit+0xe3/0xf0
May  1 06:37:00 u1322 kernel: smp_apic_timer_interrupt+0x74/0x130
May  1 06:37:00 u1322 kernel: apic_timer_interrupt+0xf/0x20
May  1 06:37:00 u1322 kernel: </IRQ>
May  1 06:37:00 u1322 kernel: RIP: 0010:igc_rd32+0x16/0x80 [igc]
May  1 06:37:00 u1322 kernel: Code: e1 31 c0 c3 b8 fd ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 55 89
f0 41 54 55 53 48 8b 57 08 48 01 d0 8b 18 <83> fb ff 74 09 89 d8 5b 5d 41 5c 41 5d c3 85 f6 74 07 8b 02 83 f8
May  1 06:37:00 u1322 kernel: RSP: 0018:ffffaed906a57c48 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
May  1 06:37:00 u1322 kernel: RAX: ffffaed901d00008 RBX: 0000000040380681 RCX: 0000000000000000
May  1 06:37:00 u1322 kernel: RDX: ffffaed901d00000 RSI: 0000000000000008 RDI: ffff96ac87278ae0
May  1 06:37:00 u1322 kernel: RBP: 0000000000000001 R08: 0000000000000010 R09: 000000000000fe6d
May  1 06:37:00 u1322 kernel: R10: 000000000000fe6d R11: 000070ac2bc77a36 R12: ffff96ac87278ae0
May  1 06:37:00 u1322 kernel: R13: ffff96bb71f30410 R14: 0000000000000001 R15: ffff96ac87278880
May  1 06:37:00 u1322 kernel: ? usleep_range+0x5c/0x80
May  1 06:37:00 u1322 kernel: igc_intr_test.cold.2+0x11d/0x279 [igc]
May  1 06:37:00 u1322 kernel: igc_ethtool_diag_test+0xe4/0x166 [igc]
May  1 06:37:00 u1322 kernel: dev_ethtool+0x1049/0x2a30
May  1 06:37:00 u1322 kernel: ? inet_ioctl+0x187/0x1d0
May  1 06:37:00 u1322 kernel: ? netdev_run_todo+0x5e/0x290
May  1 06:37:00 u1322 kernel: dev_ioctl+0xb5/0x550
May  1 06:37:00 u1322 kernel: sock_do_ioctl+0xa0/0x140
May  1 06:37:00 u1322 kernel: sock_ioctl+0x22a/0x380
May  1 06:37:00 u1322 kernel: ksys_ioctl+0x86/0xc0
May  1 06:37:00 u1322 kernel: __x64_sys_ioctl+0x16/0x20
May  1 06:37:00 u1322 kernel: do_syscall_64+0x55/0x1d0
May  1 06:37:00 u1322 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
May  1 06:37:00 u1322 kernel: RIP: 0033:0x7ff402b4bb2b
May  1 06:37:00 u1322 kernel: Code: 0f 1e fa 48 8b 05 5d a3 2c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f
44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 2d a3 2c 00 f7 d8 64 89 01 48
May  1 06:37:00 u1322 kernel: RSP: 002b:00007ffd006b7ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010May  1 06:37:00 u1322 kernel: ? hrtimer_interrupt+0x12e/0x220
May  1 06:37:00 u1322 kernel: irq_exit+0xe3/0xf0
May  1 06:37:00 u1322 kernel: smp_apic_timer_interrupt+0x74/0x130
May  1 06:37:00 u1322 kernel: apic_timer_interrupt+0xf/0x20
May  1 06:37:00 u1322 kernel: </IRQ>
May  1 06:37:00 u1322 kernel: RIP: 0010:igc_rd32+0x16/0x80 [igc]
May  1 06:37:00 u1322 kernel: Code: e1 31 c0 c3 b8 fd ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 55 89
f0 41 54 55 53 48 8b 57 08 48 01 d0 8b 18 <83> fb ff 74 09 89 d8 5b 5d 41 5c 41 5d c3 85 f6 74 07 8b 02 83 f8
May  1 06:37:00 u1322 kernel: RSP: 0018:ffffaed906a57c48 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
May  1 06:37:00 u1322 kernel: RAX: ffffaed901d00008 RBX: 0000000040380681 RCX: 0000000000000000
May  1 06:37:00 u1322 kernel: RDX: ffffaed901d00000 RSI: 0000000000000008 RDI: ffff96ac87278ae0
May  1 06:37:00 u1322 kernel: RBP: 0000000000000001 R08: 0000000000000010 R09: 000000000000fe6d
May  1 06:37:00 u1322 kernel: R10: 000000000000fe6d R11: 000070ac2bc77a36 R12: ffff96ac87278ae0
May  1 06:37:00 u1322 kernel: R13: ffff96bb71f30410 R14: 0000000000000001 R15: ffff96ac87278880
May  1 06:37:00 u1322 kernel: ? usleep_range+0x5c/0x80
May  1 06:37:00 u1322 kernel: igc_intr_test.cold.2+0x11d/0x279 [igc]
May  1 06:37:00 u1322 kernel: igc_ethtool_diag_test+0xe4/0x166 [igc]
May  1 06:37:00 u1322 kernel: dev_ethtool+0x1049/0x2a30
May  1 06:37:00 u1322 kernel: ? inet_ioctl+0x187/0x1d0
May  1 06:37:00 u1322 kernel: ? netdev_run_todo+0x5e/0x290
May  1 06:37:00 u1322 kernel: dev_ioctl+0xb5/0x550
May  1 06:37:00 u1322 kernel: sock_do_ioctl+0xa0/0x140
May  1 06:37:00 u1322 kernel: sock_ioctl+0x22a/0x380
May  1 06:37:00 u1322 kernel: ksys_ioctl+0x86/0xc0
May  1 06:37:00 u1322 kernel: __x64_sys_ioctl+0x16/0x20
May  1 06:37:00 u1322 kernel: do_syscall_64+0x55/0x1d0
May  1 06:37:00 u1322 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
May  1 06:37:00 u1322 kernel: RIP: 0033:0x7ff402b4bb2b
May  1 06:37:00 u1322 kernel: Code: 0f 1e fa 48 8b 05 5d a3 2c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f
44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 2d a3 2c 00 f7 d8 64 89 01 48
May  1 06:37:00 u1322 kernel: RSP: 002b:00007ffd006b7ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
May  1 06:37:00 u1322 kernel: RAX: ffffffffffffffda RBX: 0000000000a92320 RCX: 00007ff402b4bb2b
May  1 06:37:00 u1322 kernel: RDX: 00007ffd006b7f40 RSI: 0000000000008946 RDI: 0000000000000003
May  1 06:37:00 u1322 kernel: RBP: 0000000000a92260 R08: 0000000000a92320 R09: 0000000000000003
May  1 06:37:00 u1322 kernel: R10: fffffffffffff6e6 R11: 0000000000000246 R12: 00007ffd006b7f30
May  1 06:37:00 u1322 kernel: R13: 0000000000000038 R14: 0000000000000001 R15: 0000000000000000
May  1 06:37:28 u1322 kernel: watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [ethtool:9111]
May  1 06:37:28 u1322 kernel: Modules linked in: igb igc e1000e rfcomm xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter nft_compat nf_tables nfnetlink tun stp llc cmac bnep iTCO_wdt iTCO_vendor_support wmi_bmof intel_wmi_thunderbolt mxm_wmi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio btusb irqbypass btrtl snd_hda_intel btbcm snd_intel_dspcfg btintel snd_hda_codec bluetooth snd_hwdep snd_hda_core snd_seq crct10dif_pclmul snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel joydev pl2303 intel_cstate snd_timer intel_uncore snd ecdh_generic mei_me ecc soundcore pcspkr mei i2c_i801 intel_rapl_perf rfkill sg wmi intel_pmc_core acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom t10_pi i915 intel_gtt drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops cec drm ahci libahci libata crc32c_intel dca i2c_algo_bit video
May  1 06:37:28 u1322 kernel: [last unloaded: bridge]
May  1 06:37:28 u1322 kernel: CPU: 7 PID: 9111 Comm: ethtool Tainted: G             L    5.7.0-rc2_next-queue_dev-queue_c097661-00758-gc097661edb2b #31
May  1 06:37:28 u1322 kernel: Hardware name: Gigabyte Technology Co., Ltd. Z370 AORUS Gaming 5/Z370 AORUS Gaming 5-CF, BIOS F6 04/03/2018
May  1 06:37:28 u1322 kernel: RIP: 0010:__do_softirq+0x76/0x2ec
May  1 06:37:28 u1322 kernel: Code: 81 05 b2 7e e1 5d 00 01 00 00 c7 44 24 20 0a 00 00 00 44 89 74 24 04 48 c7 c0 40 b5 02 00 65 66 c7 00 00 00 fb b8 ff ff ff ff <48> c7 c6 00 51 a0 a2 0f bc 44 24 04 83 c0 01 49 89 f7 89 44 24 08
May  1 06:37:28 u1322 kernel: RSP: 0018:ffffaed900254f70 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
May  1 06:37:28 u1322 kernel: RAX: 00000000ffffffff RBX: ffff96bb7e3d8640 RCX: 000000000000001f
May  1 06:37:28 u1322 kernel: RDX: 0000000000000043 RSI: 000000002819aad9 RDI: fffffffa31c219af
May  1 06:37:28 u1322 kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: 000000000002b5c0
May  1 06:37:28 u1322 kernel: R10: 000167b91c1d8b72 R11: 000070ac2bd6bc76 R12: 0000000000000000
May  1 06:37:28 u1322 kernel: R13: 0000000000000000 R14: 0000000000000282 R15: 0000000000000000
May  1 06:37:28 u1322 kernel: FS:  00007ff4033ab740(0000) GS:ffff96bb7e3c0000(0000) knlGS:0000000000000000
May  1 06:37:28 u1322 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May  1 06:37:28 u1322 kernel: CR2: 00007fde63363000 CR3: 0000000fe1f1c004 CR4: 00000000003606e0
May  1 06:37:28 u1322 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
May  1 06:37:28 u1322 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
May  1 06:37:28 u1322 kernel: Call Trace:
May  1 06:37:28 u1322 kernel: <IRQ>
May  1 06:37:28 u1322 kernel: ? hrtimer_interrupt+0x12e/0x220
May  1 06:37:28 u1322 kernel: irq_exit+0xe3/0xf0
May  1 06:37:28 u1322 kernel: smp_apic_timer_interrupt+0x74/0x130
May  1 06:37:28 u1322 kernel: apic_timer_interrupt+0xf/0x20
May  1 06:37:28 u1322 kernel: </IRQ>
May  1 06:37:28 u1322 kernel: RIP: 0010:igc_rd32+0x16/0x80 [igc]
May  1 06:37:28 u1322 kernel: Code: e1 31 c0 c3 b8 fd ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 55 89 f0 41 54 55 53 48 8b 57 08 48 01 d0 8b 18 <83> fb ff 74 09 89 d8 5b 5d 41 5c 41 5d c3 85 f6 74 07 8b 02 83 f8
May  1 06:37:28 u1322 kernel: RSP: 0018:ffffaed906a57c48 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
May  1 06:37:28 u1322 kernel: RAX: ffffaed901d00008 RBX: 0000000040380681 RCX: 0000000000000000
May  1 06:37:28 u1322 kernel: RDX: ffffaed901d00000 RSI: 0000000000000008 RDI: ffff96ac87278ae0
May  1 06:37:28 u1322 kernel: RBP: 0000000000000001 R08: 0000000000000010 R09: 000000000000fe6d
May  1 06:37:28 u1322 kernel: R10: 000000000000fe6d R11: 000070ac2bc77a36 R12: ffff96ac87278ae0
May  1 06:37:28 u1322 kernel: R13: ffff96bb71f30410 R14: 0000000000000001 R15: ffff96ac87278880
May  1 06:37:28 u1322 kernel: ? usleep_range+0x5c/0x80
May  1 06:37:28 u1322 kernel: igc_intr_test.cold.2+0x11d/0x279 [igc]
May  1 06:37:28 u1322 kernel: igc_ethtool_diag_test+0xe4/0x166 [igc]
May  1 06:37:28 u1322 kernel: dev_ethtool+0x1049/0x2a30
May  1 06:37:28 u1322 kernel: ? inet_ioctl+0x187/0x1d0
May  1 06:37:28 u1322 kernel: ? netdev_run_todo+0x5e/0x290
May  1 06:37:28 u1322 kernel: dev_ioctl+0xb5/0x550
May  1 06:37:28 u1322 kernel: sock_do_ioctl+0xa0/0x140
May  1 06:37:28 u1322 kernel: sock_ioctl+0x22a/0x380
May  1 06:37:28 u1322 kernel: ksys_ioctl+0x86/0xc0
May  1 06:37:28 u1322 kernel: __x64_sys_ioctl+0x16/0x20
May  1 06:37:28 u1322 kernel: do_syscall_64+0x55/0x1d0
May  1 06:37:28 u1322 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
May  1 06:37:28 u1322 kernel: RIP: 0033:0x7ff402b4bb2b
May  1 06:37:28 u1322 kernel: Code: 0f 1e fa 48 8b 05 5d a3 2c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 2d a3 2c 00 f7 d8 64 89 01 48
May  1 06:37:28 u1322 kernel: RSP: 002b:00007ffd006b7ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
May  1 06:37:28 u1322 kernel: RAX: ffffffffffffffda RBX: 0000000000a92320 RCX: 00007ff402b4bb2b
May  1 06:37:28 u1322 kernel: RDX: 00007ffd006b7f40 RSI: 0000000000008946 RDI: 0000000000000003
May  1 06:37:28 u1322 kernel: RBP: 0000000000a92260 R08: 0000000000a92320 R09: 0000000000000003
May  1 06:37:28 u1322 kernel: R10: fffffffffffff6e6 R11: 0000000000000246 R12: 00007ffd006b7f30
May  1 06:37:28 u1322 kernel: R13: 0000000000000038 R14: 0000000000000001 R15: 0000000000000000
May  1 06:37:33 u1322 kernel: rcu: INFO: rcu_sched self-detected stall on CPU
May  1 06:37:33 u1322 kernel: rcu: #0117-....: (2 GPs behind) idle=4be/1/0x4000000000000004 softirq=180999/181000 fqs=14982
May  1 06:37:33 u1322 kernel: #011(t=60000 jiffies g=2095585 q=2857)
May  1 06:37:33 u1322 kernel: NMI backtrace for cpu 7
May  1 06:37:33 u1322 kernel: CPU: 7 PID: 9111 Comm: ethtool Tainted: G             L    5.7.0-rc2_next-queue_dev-queue_c097661-00758-gc097661edb2b #31
May  1 06:37:33 u1322 kernel: Hardware name: Gigabyte Technology Co., Ltd. Z370 AORUS Gaming 5/Z370 AORUS Gaming 5-CF, BIOS F6 04/03/2018
May  1 06:37:33 u1322 kernel: Call Trace:
May  1 06:37:33 u1322 kernel: <IRQ>
May  1 06:37:33 u1322 kernel: dump_stack+0x50/0x70
May  1 06:37:33 u1322 kernel: nmi_cpu_backtrace.cold.8+0x13/0x4f
May  1 06:37:33 u1322 kernel: ? lapic_can_unplug_cpu.cold.30+0x37/0x37
May  1 06:37:33 u1322 kernel: nmi_trigger_cpumask_backtrace+0xde/0xe0
May  1 06:37:33 u1322 kernel: rcu_dump_cpu_stacks+0xae/0xdc
May  1 06:37:33 u1322 kernel: rcu_sched_clock_irq.cold.87+0x10a/0x380
May  1 06:37:33 u1322 kernel: ? timekeeping_advance+0x371/0x5a0
May  1 06:37:33 u1322 kernel: ? tick_sched_do_timer+0x70/0x70
May  1 06:37:33 u1322 kernel: ? tick_sched_do_timer+0x70/0x70
May  1 06:37:33 u1322 kernel: update_process_times+0x24/0x50
May  1 06:37:33 u1322 kernel: tick_sched_handle+0x22/0x60
May  1 06:37:33 u1322 kernel: tick_sched_timer+0x37/0x70
May  1 06:37:33 u1322 kernel: __hrtimer_run_queues+0x100/0x280
May  1 06:37:33 u1322 kernel: hrtimer_interrupt+0x100/0x220
May  1 06:37:33 u1322 kernel: smp_apic_timer_interrupt+0x6a/0x130
May  1 06:37:33 u1322 kernel: apic_timer_interrupt+0xf/0x20
May  1 06:37:33 u1322 kernel: RIP: 0010:__do_softirq+0x76/0x2ec
May  1 06:37:33 u1322 kernel: Code: 81 05 b2 7e e1 5d 00 01 00 00 c7 44 24 20 0a 00 00 00 44 89 74 24 04 48 c7 c0 40 b5 02 00 65 66 c7 00 00 00 fb b8 ff ff ff ff <48> c7 c6 00 51 a0 a2 0f bc 44 24 04 83 c0 01 49 89 f7 89 44 24 08
May  1 06:37:33 u1322 kernel: RSP: 0018:ffffaed900254f70 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
May  1 06:37:33 u1322 kernel: RAX: 00000000ffffffff RBX: ffff96bb7e3d8640 RCX: 000000000000001f
May  1 06:37:33 u1322 kernel: RDX: 0000000000000043 RSI: 000000002819aad9 RDI: fffffffa31c219af
May  1 06:37:33 u1322 kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: 000000000002b5c0
May  1 06:37:33 u1322 kernel: R10: 000167b91c1d8b72 R11: 000070ac2bd6bc76 R12: 0000000000000000
May  1 06:37:33 u1322 kernel: R13: 0000000000000000 R14: 0000000000000282 R15: 0000000000000000
May  1 06:37:33 u1322 kernel: ? apic_timer_interrupt+0xa/0x20
May  1 06:37:33 u1322 kernel: ? hrtimer_interrupt+0x12e/0x220
May  1 06:37:33 u1322 kernel: irq_exit+0xe3/0xf0
May  1 06:37:33 u1322 kernel: smp_apic_timer_interrupt+0x74/0x130
May  1 06:37:33 u1322 kernel: apic_timer_interrupt+0xf/0x20
May  1 06:37:33 u1322 kernel: </IRQ>
May  1 06:37:33 u1322 kernel: RIP: 0010:igc_rd32+0x16/0x80 [igc]
May  1 06:37:33 u1322 kernel: Code: e1 31 c0 c3 b8 fd ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 55 89 f0 41 54 55 53 48 8b 57 08 48 01 d0 8b 18 <83> fb ff 74 09 89 d8 5b 5d 41 5c 41 5d c3 85 f6 74 07 8b 02 83 f8
May  1 06:37:33 u1322 kernel: RSP: 0018:ffffaed906a57c48 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
May  1 06:37:33 u1322 kernel: RAX: ffffaed901d00008 RBX: 0000000040380681 RCX: 0000000000000000
May  1 06:37:33 u1322 kernel: RDX: ffffaed901d00000 RSI: 0000000000000008 RDI: ffff96ac87278ae0
May  1 06:37:33 u1322 kernel: RBP: 0000000000000001 R08: 0000000000000010 R09: 000000000000fe6d
May  1 06:37:33 u1322 kernel: R10: 000000000000fe6d R11: 000070ac2bc77a36 R12: ffff96ac87278ae0
May  1 06:37:33 u1322 kernel: R13: ffff96bb71f30410 R14: 0000000000000001 R15: ffff96ac87278880
May  1 06:37:33 u1322 kernel: ? usleep_range+0x5c/0x80
May  1 06:37:33 u1322 kernel: igc_intr_test.cold.2+0x11d/0x279 [igc]
May  1 06:37:33 u1322 kernel: igc_ethtool_diag_test+0xe4/0x166 [igc]
May  1 06:37:33 u1322 kernel: dev_ethtool+0x1049/0x2a30
May  1 06:37:33 u1322 kernel: ? inet_ioctl+0x187/0x1d0
May  1 06:37:33 u1322 kernel: ? netdev_run_todo+0x5e/0x290
May  1 06:37:33 u1322 kernel: dev_ioctl+0xb5/0x550
May  1 06:37:33 u1322 kernel: sock_do_ioctl+0xa0/0x140
May  1 06:37:33 u1322 kernel: sock_ioctl+0x22a/0x380
May  1 06:37:33 u1322 kernel: ksys_ioctl+0x86/0xc0
May  1 06:37:33 u1322 kernel: __x64_sys_ioctl+0x16/0x20
May  1 06:37:33 u1322 kernel: do_syscall_64+0x55/0x1d0
May  1 06:37:33 u1322 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
May  1 06:37:33 u1322 kernel: RIP: 0033:0x7ff402b4bb2b
May  1 06:37:33 u1322 kernel: Code: 0f 1e fa 48 8b 05 5d a3 2c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 2d a3 2c 00 f7 d8 64 89 01 48
May  1 06:37:33 u1322 kernel: RSP: 002b:00007ffd006b7ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
May  1 06:37:33 u1322 kernel: RAX: ffffffffffffffda RBX: 0000000000a92320 RCX: 00007ff402b4bb2b
May  1 06:37:33 u1322 kernel: RDX: 00007ffd006b7f40 RSI: 0000000000008946 RDI: 0000000000000003
May  1 06:37:33 u1322 kernel: RBP: 0000000000a92260 R08: 0000000000a92320 R09: 0000000000000003
May  1 06:37:33 u1322 kernel: R10: fffffffffffff6e6 R11: 0000000000000246 R12: 00007ffd006b7f30
May  1 06:37:33 u1322 kernel: R13: 0000000000000038 R14: 0000000000000001 R15: 0000000000000000
----
And it continues to occurs at roughly 30 second intervals until the system is rebooted.



More information about the Intel-wired-lan mailing list