[ 758.699029] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 758.702124] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 758.829872] kselftest: Running tests in drivers/net
[ 911.884400] kworker/u129:14 (307) used greatest stack depth: 21456 bytes left
[ 989.709296] INFO: task python3:5361 blocked for more than 122 seconds.
[ 989.717542] Not tainted 7.1.0-rc6-xptt-gbb2f4d839a3a #1
[ 989.725439] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.735028] task:python3 state:D stack:25672 pid:5361 tgid:5361 ppid:5360 task_flags:0x400100 flags:0x00080000
[ 989.748231] Call Trace:
[ 989.751771]
[ 989.754919] __schedule+0xcc3/0x19c0
[ 989.759737] ? io_schedule_timeout+0x140/0x140
[ 989.765521] ? find_held_lock+0x2b/0x80
[ 989.770628] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.776511] schedule+0xd8/0x260
[ 989.780919] schedule_preempt_disabled+0x18/0x30
[ 989.786900] __mutex_lock+0x6af/0x2010
[ 989.791903] ? threaded_store+0x132/0x220
[ 989.797202] ? ww_mutex_lock+0x160/0x160
[ 989.802389] ? selinux_inode_free_security+0x330/0x330
[ 989.808958] ? cap_capable+0x1d6/0x3e0
[ 989.813966] ? threaded_store+0x132/0x220
[ 989.819266] threaded_store+0x132/0x220
[ 989.824367] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.829661] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.834958] ? sysfs_kf_write+0x65/0x160
[ 989.840158] ? sysfs_file_ops+0x140/0x140
[ 989.845442] kernfs_fop_write_iter+0x335/0x510
[ 989.851225] ? kernfs_ops+0xf0/0xf0
[ 989.855934] new_sync_write+0x333/0x750
[ 989.861037] ? __lock_acquire+0x508/0xc10
[ 989.866333] ? new_sync_read+0x740/0x740
[ 989.871532] ? lock_acquire.part.0+0xbc/0x260
[ 989.877218] ? ksys_write+0x116/0x250
[ 989.882123] vfs_write+0x657/0x9b0
[ 989.886736] ksys_write+0x116/0x250
[ 989.891448] ? __ia32_sys_read+0xc0/0xc0
[ 989.896646] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.902235] ? rcu_is_watching+0x15/0xd0
[ 989.907435] do_syscall_64+0xf3/0x650
[ 989.912341] ? trace_hardirqs_off+0xd/0x30
[ 989.917735] ? exc_page_fault+0xda/0xf0
[ 989.922836] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.929302] RIP: 0033:0x7fecb6d2664e
[ 989.934108] RSP: 002b:00007ffc5d586a70 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.943405] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fecb6d2664e
[ 989.952211] RDX: 0000000000000001 RSI: 000055ae9b0d8420 RDI: 0000000000000007
[ 989.961018] RBP: 00007ffc5d586a80 R08: 0000000000000000 R09: 0000000000000000
[ 989.969843] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fecb6b9f390
[ 989.978643] R13: 000055ae9b0d8420 R14: 0000000000000007 R15: 00007fecb6b35120
[ 989.987462]
[ 989.990768] INFO: task python3:5361 is blocked on a mutex likely owned by task python3:3384.
[ 990.001038] task:python3 state:D stack:25584 pid:3384 tgid:3384 ppid:3383 task_flags:0x400100 flags:0x00080802
[ 990.014242] Call Trace:
[ 990.017781]
[ 990.020929] __schedule+0xcc3/0x19c0
[ 990.025740] ? io_schedule_timeout+0x140/0x140
[ 990.031524] ? find_held_lock+0x2b/0x80
[ 990.036629] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.042807] schedule+0xd8/0x260
[ 990.047225] schedule_timeout+0x13f/0x290
[ 990.052523] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.058892] ? trace_contention_end+0xb3/0x1a0
[ 990.064674] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.070363] ? ww_mutex_lock+0x160/0x160
[ 990.075561] msleep+0x1b/0x30
[ 990.079687] napi_set_threaded+0x3a5/0x440
[ 990.085081] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.090574] netif_set_threaded+0x257/0x400
[ 990.096064] threaded_store+0x1b8/0x220
[ 990.101166] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.106463] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.111759] ? sysfs_kf_write+0x65/0x160
[ 990.116958] ? sysfs_file_ops+0x140/0x140
[ 990.122250] kernfs_fop_write_iter+0x335/0x510
[ 990.128034] ? kernfs_ops+0xf0/0xf0
[ 990.132743] new_sync_write+0x333/0x750
[ 990.137842] ? __lock_acquire+0x508/0xc10
[ 990.143137] ? new_sync_read+0x740/0x740
[ 990.148335] ? lock_acquire.part.0+0xbc/0x260
[ 990.154021] ? ksys_write+0x116/0x250
[ 990.158929] vfs_write+0x657/0x9b0
[ 990.163536] ksys_write+0x116/0x250
[ 990.168248] ? __ia32_sys_read+0xc0/0xc0
[ 990.173446] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.179033] ? rcu_is_watching+0x15/0xd0
[ 990.184231] do_syscall_64+0xf3/0x650
[ 990.189136] ? trace_hardirqs_off+0xd/0x30
[ 990.194528] ? exc_page_fault+0xda/0xf0
[ 990.199627] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.206095] RIP: 0033:0x7f1e46d7764e
[ 990.210903] RSP: 002b:00007ffdd5de5370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.220208] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1e46d7764e
[ 990.229015] RDX: 0000000000000001 RSI: 00005653c721b420 RDI: 0000000000000007
[ 990.237822] RBP: 00007ffdd5de5380 R08: 0000000000000000 R09: 0000000000000000
[ 990.246627] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1e46bf0390
[ 990.255433] R13: 00005653c721b420 R14: 0000000000000007 R15: 00007f1e46b85120
[ 990.264245]
[ 990.267502] \x0aShowing all locks held in the system:
[ 990.276032] 1 lock held by khungtaskd/184:
[ 990.281423] #0: ffffffff9cefdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.292897] 1 lock held by systemd-journal/805:
[ 990.298784] 4 locks held by python3/3384:
[ 990.304077] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.313965] #1: ff11000140597480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.324925] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.336081] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.346185] 4 locks held by python3/5361:
[ 990.351480] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.361367] #1: ff110001a21b2080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.372328] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.383475] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.393563]
[ 990.396029] =============================================\x0a
[ 1112.590593] INFO: task python3:5361 blocked for more than 245 seconds.
[ 1112.598739] Not tainted 7.1.0-rc6-xptt-gbb2f4d839a3a #1
[ 1112.605991] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.615581] task:python3 state:D stack:25672 pid:5361 tgid:5361 ppid:5360 task_flags:0x400100 flags:0x00080000
[ 1112.628787] Call Trace:
[ 1112.632329]
[ 1112.635480] __schedule+0xcc3/0x19c0
[ 1112.640296] ? io_schedule_timeout+0x140/0x140
[ 1112.646084] ? find_held_lock+0x2b/0x80
[ 1112.651191] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.657076] schedule+0xd8/0x260
[ 1112.661494] schedule_preempt_disabled+0x18/0x30
[ 1112.667472] __mutex_lock+0x6af/0x2010
[ 1112.672476] ? threaded_store+0x132/0x220
[ 1112.677779] ? ww_mutex_lock+0x160/0x160
[ 1112.682979] ? selinux_inode_free_security+0x330/0x330
[ 1112.689549] ? cap_capable+0x1d6/0x3e0
[ 1112.694558] ? threaded_store+0x132/0x220
[ 1112.699856] threaded_store+0x132/0x220
[ 1112.704960] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.710258] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.715557] ? sysfs_kf_write+0x65/0x160
[ 1112.720752] ? sysfs_file_ops+0x140/0x140
[ 1112.726049] kernfs_fop_write_iter+0x335/0x510
[ 1112.731835] ? kernfs_ops+0xf0/0xf0
[ 1112.736546] new_sync_write+0x333/0x750
[ 1112.741650] ? __lock_acquire+0x508/0xc10
[ 1112.746950] ? new_sync_read+0x740/0x740
[ 1112.752153] ? lock_acquire.part.0+0xbc/0x260
[ 1112.757840] ? ksys_write+0x116/0x250
[ 1112.762743] vfs_write+0x657/0x9b0
[ 1112.767357] ksys_write+0x116/0x250
[ 1112.772069] ? __ia32_sys_read+0xc0/0xc0
[ 1112.777267] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.782856] ? rcu_is_watching+0x15/0xd0
[ 1112.788052] do_syscall_64+0xf3/0x650
[ 1112.792958] ? trace_hardirqs_off+0xd/0x30
[ 1112.798354] ? exc_page_fault+0xda/0xf0
[ 1112.803456] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.809927] RIP: 0033:0x7fecb6d2664e
[ 1112.814738] RSP: 002b:00007ffc5d586a70 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.824035] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fecb6d2664e
[ 1112.832836] RDX: 0000000000000001 RSI: 000055ae9b0d8420 RDI: 0000000000000007
[ 1112.841646] RBP: 00007ffc5d586a80 R08: 0000000000000000 R09: 0000000000000000
[ 1112.850453] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fecb6b9f390
[ 1112.859265] R13: 000055ae9b0d8420 R14: 0000000000000007 R15: 00007fecb6b35120
[ 1112.868079]
[ 1112.871360] INFO: task python3:5361 is blocked on a mutex likely owned by task python3:3384.
[ 1112.881631] task:python3 state:D stack:25584 pid:3384 tgid:3384 ppid:3383 task_flags:0x400100 flags:0x00080802
[ 1112.894834] Call Trace:
[ 1112.898374]
[ 1112.901527] __schedule+0xcc3/0x19c0
[ 1112.906338] ? io_schedule_timeout+0x140/0x140
[ 1112.912122] ? find_held_lock+0x2b/0x80
[ 1112.917226] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.923406] schedule+0xd8/0x260
[ 1112.927824] schedule_timeout+0x13f/0x290
[ 1112.933122] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.939483] ? trace_contention_end+0xb3/0x1a0
[ 1112.945270] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.950961] ? ww_mutex_lock+0x160/0x160
[ 1112.956163] msleep+0x1b/0x30
[ 1112.960288] napi_set_threaded+0x3a5/0x440
[ 1112.965686] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.971181] netif_set_threaded+0x257/0x400
[ 1112.976676] threaded_store+0x1b8/0x220
[ 1112.981781] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.987080] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.992378] ? sysfs_kf_write+0x65/0x160
[ 1112.997569] ? sysfs_file_ops+0x140/0x140
[ 1113.002866] kernfs_fop_write_iter+0x335/0x510
[ 1113.008653] ? kernfs_ops+0xf0/0xf0
[ 1113.013362] new_sync_write+0x333/0x750
[ 1113.018467] ? __lock_acquire+0x508/0xc10
[ 1113.023763] ? new_sync_read+0x740/0x740
[ 1113.028964] ? lock_acquire.part.0+0xbc/0x260
[ 1113.034652] ? ksys_write+0x116/0x250
[ 1113.039553] vfs_write+0x657/0x9b0
[ 1113.044169] ksys_write+0x116/0x250
[ 1113.048883] ? __ia32_sys_read+0xc0/0xc0
[ 1113.054080] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.059672] ? rcu_is_watching+0x15/0xd0
[ 1113.064875] do_syscall_64+0xf3/0x650
[ 1113.069783] ? trace_hardirqs_off+0xd/0x30
[ 1113.075179] ? exc_page_fault+0xda/0xf0
[ 1113.080271] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.086739] RIP: 0033:0x7f1e46d7764e
[ 1113.091547] RSP: 002b:00007ffdd5de5370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.100845] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1e46d7764e
[ 1113.109651] RDX: 0000000000000001 RSI: 00005653c721b420 RDI: 0000000000000007
[ 1113.118457] RBP: 00007ffdd5de5380 R08: 0000000000000000 R09: 0000000000000000
[ 1113.127265] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1e46bf0390
[ 1113.136073] R13: 00005653c721b420 R14: 0000000000000007 R15: 00007f1e46b85120
[ 1113.144880]
[ 1113.148143] \x0aShowing all locks held in the system:
[ 1113.156682] 1 lock held by khungtaskd/184:
[ 1113.162079] #0: ffffffff9cefdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.173551] 4 locks held by python3/3384:
[ 1113.178848] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.188741] #1: ff11000140597480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.199703] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.210862] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.220958] 4 locks held by python3/5361:
[ 1113.226255] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.236144] #1: ff110001a21b2080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.247095] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.258252] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.268336]
[ 1113.270803] =============================================\x0a
[ 1235.471913] INFO: task python3:5361 blocked for more than 368 seconds.
[ 1235.480064] Not tainted 7.1.0-rc6-xptt-gbb2f4d839a3a #1
[ 1235.487317] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.496905] task:python3 state:D stack:25672 pid:5361 tgid:5361 ppid:5360 task_flags:0x400100 flags:0x00080002
[ 1235.510103] Call Trace:
[ 1235.513642]
[ 1235.516792] __schedule+0xcc3/0x19c0
[ 1235.521612] ? io_schedule_timeout+0x140/0x140
[ 1235.527398] ? find_held_lock+0x2b/0x80
[ 1235.532503] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.538387] schedule+0xd8/0x260
[ 1235.542807] schedule_preempt_disabled+0x18/0x30
[ 1235.548785] __mutex_lock+0x6af/0x2010
[ 1235.553789] ? threaded_store+0x132/0x220
[ 1235.559091] ? ww_mutex_lock+0x160/0x160
[ 1235.564290] ? selinux_inode_free_security+0x330/0x330
[ 1235.570860] ? cap_capable+0x1d6/0x3e0
[ 1235.575871] ? threaded_store+0x132/0x220
[ 1235.581171] threaded_store+0x132/0x220
[ 1235.586275] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.591573] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.596875] ? sysfs_kf_write+0x65/0x160
[ 1235.602075] ? sysfs_file_ops+0x140/0x140
[ 1235.607371] kernfs_fop_write_iter+0x335/0x510
[ 1235.613158] ? kernfs_ops+0xf0/0xf0
[ 1235.617868] new_sync_write+0x333/0x750
[ 1235.622964] ? __lock_acquire+0x508/0xc10
[ 1235.628254] ? new_sync_read+0x740/0x740
[ 1235.633458] ? lock_acquire.part.0+0xbc/0x260
[ 1235.639143] ? ksys_write+0x116/0x250
[ 1235.644056] vfs_write+0x657/0x9b0
[ 1235.648674] ksys_write+0x116/0x250
[ 1235.653384] ? __ia32_sys_read+0xc0/0xc0
[ 1235.658585] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.664175] ? rcu_is_watching+0x15/0xd0
[ 1235.669376] do_syscall_64+0xf3/0x650
[ 1235.674285] ? trace_hardirqs_off+0xd/0x30
[ 1235.679681] ? exc_page_fault+0xda/0xf0
[ 1235.684782] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.691244] RIP: 0033:0x7fecb6d2664e
[ 1235.696053] RSP: 002b:00007ffc5d586a70 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.705353] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fecb6d2664e
[ 1235.714160] RDX: 0000000000000001 RSI: 000055ae9b0d8420 RDI: 0000000000000007
[ 1235.722969] RBP: 00007ffc5d586a80 R08: 0000000000000000 R09: 0000000000000000
[ 1235.731780] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fecb6b9f390
[ 1235.740588] R13: 000055ae9b0d8420 R14: 0000000000000007 R15: 00007fecb6b35120
[ 1235.749393]
[ 1235.752677] INFO: task python3:5361 is blocked on a mutex likely owned by task python3:3384.
[ 1235.762949] task:python3 state:D stack:25584 pid:3384 tgid:3384 ppid:3383 task_flags:0x400100 flags:0x00080802
[ 1235.776153] Call Trace:
[ 1235.779691]
[ 1235.782844] __schedule+0xcc3/0x19c0
[ 1235.787654] ? io_schedule_timeout+0x140/0x140
[ 1235.793440] ? find_held_lock+0x2b/0x80
[ 1235.798544] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.804725] schedule+0xd8/0x260
[ 1235.809142] schedule_timeout+0x13f/0x290
[ 1235.814439] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.820807] ? trace_contention_end+0xb3/0x1a0
[ 1235.826591] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.832273] ? ww_mutex_lock+0x160/0x160
[ 1235.837472] msleep+0x1b/0x30
[ 1235.841599] napi_set_threaded+0x3a5/0x440
[ 1235.846996] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.852489] netif_set_threaded+0x257/0x400
[ 1235.857983] threaded_store+0x1b8/0x220
[ 1235.863085] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.868383] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.873681] ? sysfs_kf_write+0x65/0x160
[ 1235.878871] ? sysfs_file_ops+0x140/0x140
[ 1235.884167] kernfs_fop_write_iter+0x335/0x510
[ 1235.889951] ? kernfs_ops+0xf0/0xf0
[ 1235.894664] new_sync_write+0x333/0x750
[ 1235.899766] ? __lock_acquire+0x508/0xc10
[ 1235.905062] ? new_sync_read+0x740/0x740
[ 1235.910263] ? lock_acquire.part.0+0xbc/0x260
[ 1235.915949] ? ksys_write+0x116/0x250
[ 1235.920862] vfs_write+0x657/0x9b0
[ 1235.925479] ksys_write+0x116/0x250
[ 1235.930192] ? __ia32_sys_read+0xc0/0xc0
[ 1235.935392] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.940974] ? rcu_is_watching+0x15/0xd0
[ 1235.946166] do_syscall_64+0xf3/0x650
[ 1235.951076] ? trace_hardirqs_off+0xd/0x30
[ 1235.956471] ? exc_page_fault+0xda/0xf0
[ 1235.961567] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.968036] RIP: 0033:0x7f1e46d7764e
[ 1235.972845] RSP: 002b:00007ffdd5de5370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.982144] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1e46d7764e
[ 1235.990955] RDX: 0000000000000001 RSI: 00005653c721b420 RDI: 0000000000000007
[ 1235.999763] RBP: 00007ffdd5de5380 R08: 0000000000000000 R09: 0000000000000000
[ 1236.008570] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1e46bf0390
[ 1236.017370] R13: 00005653c721b420 R14: 0000000000000007 R15: 00007f1e46b85120
[ 1236.026186]
[ 1236.029453] \x0aShowing all locks held in the system:
[ 1236.037993] 1 lock held by khungtaskd/184:
[ 1236.043385] #0: ffffffff9cefdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.054870] 4 locks held by python3/3384:
[ 1236.060167] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.070057] #1: ff11000140597480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.081019] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.092176] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.102263] 4 locks held by python3/5361:
[ 1236.107560] #0: ff11000132d843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.117451] #1: ff110001a21b2080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.128412] #2: ff11000125c3eb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.139560] #3: ff11000125bf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.149648]
[ 1236.152113] =============================================\x0a
[ 1358.353192] INFO: task python3:5361 blocked for more than 491 seconds.
[ 1358.361342] Not tainted 7.1.0-rc6-xptt-gbb2f4d839a3a #1
[ 1358.368592] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.378183] task:python3 state:D stack:25672 pid:5361 tgid:5361 ppid:5360 task_flags:0x400100 flags:0x00080002
[ 1358.391389] Call Trace:
[ 1358.394927]
[ 1358.398077] __schedule+0xcc3/0x19c0
[ 1358.402894] ? io_schedule_timeout+0x140/0x140
[ 1358.408678] ? find_held_lock+0x2b/0x80
[ 1358.413782] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.419680] schedule+0xd8/0x260
[ 1358.424098] schedule_preempt_disabled+0x18/0x30
[ 1358.430078] __mutex_lock+0x6af/0x2010
[ 1358.435075] ? threaded_store+0x132/0x220
[ 1358.440374] ? ww_mutex_lock+0x160/0x160
[ 1358.445570] ? selinux_inode_free_security+0x330/0x330
[ 1358.452140] ? cap_capable+0x1d6/0x3e0
[ 1358.457147] ? threaded_store+0x132/0x220
[ 1358.462443] threaded_store+0x132/0x220
[ 1358.467543] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.472838] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.478134] ? sysfs_kf_write+0x65/0x160
[ 1358.483338] ? sysfs_file_ops+0x140/0x140
[ 1358.488634] kernfs_fop_write_iter+0x335/0x510
[ 1358.494416] ? kernfs_ops+0xf0/0xf0
[ 1358.499124] new_sync_write+0x333/0x750
[ 1358.504226] ? __lock_acquire+0x508/0xc10
[ 1358.509520] ? new_sync_read+0x740/0x740
[ 1358.514721] ? lock_acquire.part.0+0xbc/0x260
[ 1358.520405] ? ksys_write+0x116/0x250
[ 1358.525313] vfs_write+0x657/0x9b0
[ 1358.529928] ksys_write+0x116/0x250
[ 1358.534630] ? __ia32_sys_read+0xc0/0xc0
[ 1358.539827] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.545416] ? rcu_is_watching+0x15/0xd0
[ 1358.550610] do_syscall_64+0xf3/0x650
[ 1358.555514] ? trace_hardirqs_off+0xd/0x30
[ 1358.560909] ? exc_page_fault+0xda/0xf0
[ 1358.566012] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.572476] RIP: 0033:0x7fecb6d2664e
[ 1358.577287] RSP: 002b:00007ffc5d586a70 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.586586] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fecb6d2664e
[ 1358.595393] RDX: 0000000000000001 RSI: 000055ae9b0d8420 RDI: 0000000000000007
[ 1358.604197] RBP: 00007ffc5d586a80 R08: 0000000000000000 R09: 0000000000000000
[ 1358.613003] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fecb6b9f390
[ 1358.621810] R13: 000055ae9b0d8420 R14: 0000000000000007 R15: 00007fecb6b35120
[ 1358.630615]
[ 1358.633920] INFO: task python3:5361 is blocked on a mutex likely owned by task python3:3384.
[ 1358.644192] task:python3 state:D stack:25584 pid:3384 tgid:3384 ppid:3383 task_flags:0x400100 flags:0x00080802
[ 1358.657391] Call Trace:
[ 1358.660927]
[ 1358.664075] __schedule+0xcc3/0x19c0
[ 1358.668886] ? io_schedule_timeout+0x140/0x140
[ 1358.674668] ? find_held_lock+0x2b/0x80
[ 1358.679768] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.685946] schedule+0xd8/0x260
[ 1358.690363] schedule_timeout+0x13f/0x290
[ 1358.695660] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.702034] ? trace_contention_end+0xb3/0x1a0
[ 1358.707817] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.713508] ? ww_mutex_lock+0x160/0x160
[ 1358.718705] msleep+0x1b/0x30
[ 1358.722830] napi_set_threaded+0x3a5/0x440
[ 1358.728223] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.733717] netif_set_threaded+0x257/0x400
[ 1358.739211] threaded_store+0x1b8/0x220
[ 1358.744312] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.749612] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.754906] ? sysfs_kf_write+0x65/0x160
[ 1358.760106] ? sysfs_file_ops+0x140/0x140
[ 1358.765402] kernfs_fop_write_iter+0x335/0x510
[ 1358.771184] ? kernfs_ops+0xf0/0xf0
[ 1358.775895] new_sync_write+0x333/0x750
[ 1358.780997] ? __lock_acquire+0x508/0xc10
[ 1358.786291] ? new_sync_read+0x740/0x740
[ 1358.791491] ? lock_acquire.part.0+0xbc/0x260
[ 1358.797173] ? ksys_write+0x116/0x250
[ 1358.802082] vfs_write+0x657/0x9b0
[ 1358.806698] ksys_write+0x116/0x250
[ 1358.811409] ? __ia32_sys_read+0xc0/0xc0
[ 1358.816609] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.822195] ? rcu_is_watching+0x15/0xd0
[ 1358.823322] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 1358.827391] do_syscall_64+0xf3/0x650