[ 761.773507] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 761.776050] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py
[ 761.939778] kselftest: Running tests in drivers/net
[ 989.736414] INFO: task python3:5063 blocked for more than 122 seconds.
[ 989.744645] Not tainted 7.0.0-rc4-ingc-g465c390dc465 #1
[ 989.751894] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.761474] task:python3 state:D stack:25312 pid:5063 tgid:5063 ppid:5062 task_flags:0x400100 flags:0x00080000
[ 989.774670] Call Trace:
[ 989.778207]
[ 989.781359] __schedule+0xad9/0x1490
[ 989.786174] ? io_schedule_timeout+0x130/0x130
[ 989.791957] ? find_held_lock+0x2b/0x80
[ 989.797064] ? __lock_release.isra.0+0x59/0x170
[ 989.802949] schedule+0xd4/0x260
[ 989.807367] schedule_preempt_disabled+0x18/0x30
[ 989.813346] __mutex_lock+0xd76/0x1f20
[ 989.818351] ? threaded_store+0x132/0x220
[ 989.823651] ? ww_mutex_lock+0x160/0x160
[ 989.828847] ? selinux_inode_free_security+0x310/0x310
[ 989.835415] ? cap_capable+0x1ed/0x3f0
[ 989.840423] ? sysfs_file_ops+0x140/0x140
[ 989.845723] ? threaded_store+0x132/0x220
[ 989.851010] threaded_store+0x132/0x220
[ 989.856109] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.861603] ? sysfs_file_ops+0x140/0x140
[ 989.866897] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.872191] ? sysfs_kf_write+0x65/0x160
[ 989.877390] kernfs_fop_write_iter+0x335/0x510
[ 989.883174] ? kernfs_ops+0xf0/0xf0
[ 989.887884] new_sync_write+0x308/0x6f0
[ 989.892988] ? new_sync_read+0x6f0/0x6f0
[ 989.898187] ? lock_acquire.part.0+0xbc/0x260
[ 989.903872] ? ksys_write+0xff/0x200
[ 989.908685] vfs_write+0x62a/0x980
[ 989.913298] ksys_write+0xff/0x200
[ 989.917908] ? __ia32_sys_read+0xc0/0xc0
[ 989.923106] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.928696] ? rcu_is_watching+0x15/0xd0
[ 989.933894] do_syscall_64+0xf3/0x5e0
[ 989.938800] ? irq_exit_rcu+0x39/0xf0
[ 989.943706] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.950173] RIP: 0033:0x7ff84c0cac5e
[ 989.954971] RSP: 002b:00007ffdb89e2750 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.964267] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff84c0cac5e
[ 989.973075] RDX: 0000000000000001 RSI: 0000557885059110 RDI: 0000000000000007
[ 989.981882] RBP: 00007ffdb89e2760 R08: 0000000000000000 R09: 0000000000000000
[ 989.990689] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff84bf65e80
[ 989.999497] R13: 0000557885059110 R14: 0000000000000007 R15: 00007ff84c7cbb98
[ 990.008311]
[ 990.011580] INFO: task python3:5063 is blocked on a mutex likely owned by task python3:3109.
[ 990.021858] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 990.035061] Call Trace:
[ 990.038597]
[ 990.041747] __schedule+0xad9/0x1490
[ 990.046558] ? io_schedule_timeout+0x130/0x130
[ 990.052340] ? find_held_lock+0x2b/0x80
[ 990.057444] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.063621] schedule+0xd4/0x260
[ 990.068038] schedule_timeout+0x103/0x260
[ 990.073333] ? rcu_is_watching+0x15/0xd0
[ 990.078533] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.084893] ? hrtimers_cpu_dying+0x250/0x250
[ 990.090581] ? ww_mutex_lock+0x160/0x160
[ 990.095771] msleep+0x1b/0x30
[ 990.099895] napi_set_threaded+0x376/0x410
[ 990.105291] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.110783] netif_set_threaded+0x254/0x400
[ 990.116269] ? sysfs_file_ops+0x140/0x140
[ 990.121564] threaded_store+0x1bb/0x220
[ 990.126667] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.132156] ? sysfs_file_ops+0x140/0x140
[ 990.137453] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.142747] ? sysfs_kf_write+0x65/0x160
[ 990.147947] kernfs_fop_write_iter+0x335/0x510
[ 990.153731] ? kernfs_ops+0xf0/0xf0
[ 990.158444] new_sync_write+0x308/0x6f0
[ 990.163545] ? new_sync_read+0x6f0/0x6f0
[ 990.168745] ? lock_acquire.part.0+0xbc/0x260
[ 990.174430] ? ksys_write+0xff/0x200
[ 990.179241] vfs_write+0x62a/0x980
[ 990.183855] ksys_write+0xff/0x200
[ 990.188467] ? __ia32_sys_read+0xc0/0xc0
[ 990.193664] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.199255] ? rcu_is_watching+0x15/0xd0
[ 990.204454] do_syscall_64+0xf3/0x5e0
[ 990.209357] ? irq_exit_rcu+0x39/0xf0
[ 990.214264] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.220727] RIP: 0033:0x7efdfa26ec5e
[ 990.225535] RSP: 002b:00007ffe47b83330 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.234831] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efdfa26ec5e
[ 990.243638] RDX: 0000000000000001 RSI: 0000561e4ec78110 RDI: 0000000000000007
[ 990.252447] RBP: 00007ffe47b83340 R08: 0000000000000000 R09: 0000000000000000
[ 990.261260] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efdfa109e80
[ 990.270065] R13: 0000561e4ec78110 R14: 0000000000000007 R15: 00007efdfa09a480
[ 990.278877]
[ 990.282135] \x0aShowing all locks held in the system:
[ 990.290672] 1 lock held by khungtaskd/184:
[ 990.296064] #0: ffffffffb0ece020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.307546] 4 locks held by python3/3109:
[ 990.312841] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.322632] #1: ff1100013b482c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.333588] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.344745] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.354841] 4 locks held by python3/5063:
[ 990.360133] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.369924] #1: ff11000184b1e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.380885] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.392041] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.402133]
[ 990.404599] =============================================\x0a
[ 1112.616723] INFO: task python3:5063 blocked for more than 245 seconds.
[ 1112.624873] Not tainted 7.0.0-rc4-ingc-g465c390dc465 #1
[ 1112.632124] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.641710] task:python3 state:D stack:25312 pid:5063 tgid:5063 ppid:5062 task_flags:0x400100 flags:0x00080000
[ 1112.654913] Call Trace:
[ 1112.658453]
[ 1112.661601] __schedule+0xad9/0x1490
[ 1112.666415] ? io_schedule_timeout+0x130/0x130
[ 1112.672201] ? find_held_lock+0x2b/0x80
[ 1112.677303] ? __lock_release.isra.0+0x59/0x170
[ 1112.683189] schedule+0xd4/0x260
[ 1112.687606] schedule_preempt_disabled+0x18/0x30
[ 1112.693582] __mutex_lock+0xd76/0x1f20
[ 1112.698586] ? threaded_store+0x132/0x220
[ 1112.703883] ? ww_mutex_lock+0x160/0x160
[ 1112.709083] ? selinux_inode_free_security+0x310/0x310
[ 1112.715652] ? cap_capable+0x1ed/0x3f0
[ 1112.720660] ? sysfs_file_ops+0x140/0x140
[ 1112.725962] ? threaded_store+0x132/0x220
[ 1112.731258] threaded_store+0x132/0x220
[ 1112.736360] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.741841] ? sysfs_file_ops+0x140/0x140
[ 1112.747139] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.752433] ? sysfs_kf_write+0x65/0x160
[ 1112.757631] kernfs_fop_write_iter+0x335/0x510
[ 1112.763417] ? kernfs_ops+0xf0/0xf0
[ 1112.768129] new_sync_write+0x308/0x6f0
[ 1112.773232] ? new_sync_read+0x6f0/0x6f0
[ 1112.778433] ? lock_acquire.part.0+0xbc/0x260
[ 1112.784119] ? ksys_write+0xff/0x200
[ 1112.788930] vfs_write+0x62a/0x980
[ 1112.793544] ksys_write+0xff/0x200
[ 1112.798158] ? __ia32_sys_read+0xc0/0xc0
[ 1112.803355] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.808943] ? rcu_is_watching+0x15/0xd0
[ 1112.814148] do_syscall_64+0xf3/0x5e0
[ 1112.819053] ? irq_exit_rcu+0x39/0xf0
[ 1112.823961] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.830419] RIP: 0033:0x7ff84c0cac5e
[ 1112.835227] RSP: 002b:00007ffdb89e2750 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.844525] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff84c0cac5e
[ 1112.853333] RDX: 0000000000000001 RSI: 0000557885059110 RDI: 0000000000000007
[ 1112.862139] RBP: 00007ffdb89e2760 R08: 0000000000000000 R09: 0000000000000000
[ 1112.870945] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff84bf65e80
[ 1112.879752] R13: 0000557885059110 R14: 0000000000000007 R15: 00007ff84c7cbb98
[ 1112.888571]
[ 1112.891852] INFO: task python3:5063 is blocked on a mutex likely owned by task python3:3109.
[ 1112.902125] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1112.915329] Call Trace:
[ 1112.918868]
[ 1112.922018] __schedule+0xad9/0x1490
[ 1112.926830] ? io_schedule_timeout+0x130/0x130
[ 1112.932612] ? find_held_lock+0x2b/0x80
[ 1112.937714] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.943893] schedule+0xd4/0x260
[ 1112.948313] schedule_timeout+0x103/0x260
[ 1112.953612] ? rcu_is_watching+0x15/0xd0
[ 1112.958803] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.965166] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.970855] ? ww_mutex_lock+0x160/0x160
[ 1112.976058] msleep+0x1b/0x30
[ 1112.980186] napi_set_threaded+0x376/0x410
[ 1112.985581] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.991077] netif_set_threaded+0x254/0x400
[ 1112.996573] ? sysfs_file_ops+0x140/0x140
[ 1113.001870] threaded_store+0x1bb/0x220
[ 1113.006975] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.012466] ? sysfs_file_ops+0x140/0x140
[ 1113.017765] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.023065] ? sysfs_kf_write+0x65/0x160
[ 1113.028266] kernfs_fop_write_iter+0x335/0x510
[ 1113.034052] ? kernfs_ops+0xf0/0xf0
[ 1113.038763] new_sync_write+0x308/0x6f0
[ 1113.043866] ? new_sync_read+0x6f0/0x6f0
[ 1113.049060] ? lock_acquire.part.0+0xbc/0x260
[ 1113.054747] ? ksys_write+0xff/0x200
[ 1113.059563] vfs_write+0x62a/0x980
[ 1113.064177] ksys_write+0xff/0x200
[ 1113.068791] ? __ia32_sys_read+0xc0/0xc0
[ 1113.073991] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.079575] ? rcu_is_watching+0x15/0xd0
[ 1113.084776] do_syscall_64+0xf3/0x5e0
[ 1113.089687] ? irq_exit_rcu+0x39/0xf0
[ 1113.089692] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.089695] RIP: 0033:0x7efdfa26ec5e
[ 1113.089697] RSP: 002b:00007ffe47b83330 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.089700] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efdfa26ec5e
[ 1113.089701] RDX: 0000000000000001 RSI: 0000561e4ec78110 RDI: 0000000000000007
[ 1113.089703] RBP: 00007ffe47b83340 R08: 0000000000000000 R09: 0000000000000000
[ 1113.089704] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efdfa109e80
[ 1113.089705] R13: 0000561e4ec78110 R14: 0000000000000007 R15: 00007efdfa09a480
[ 1113.089712]
[ 1113.162538] \x0aShowing all locks held in the system:
[ 1113.171076] 1 lock held by khungtaskd/184:
[ 1113.176471] #0: ffffffffb0ece020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.187948] 3 locks held by systemd-journal/802:
[ 1113.193928] #0: ff1100180e4b7220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1113.203814] #1: ffffffffb10c8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.216631] #2: ff11000199b322e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1113.228090] 4 locks held by python3/3109:
[ 1113.233386] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.243178] #1: ff1100013b482c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.254141] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.265301] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.275398] 4 locks held by python3/5063:
[ 1113.280693] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.290483] #1: ff11000184b1e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.301442] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.312599] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.322684] 5 locks held by (time-dir)/6135:
[ 1113.328273] #0: ff1100012e8613f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.338066] #1: ff1100012c3bd688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.349026] #2: ffffffffb0f36e48 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1113.359696] #3: ffffffffb0d68e90 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1113.371329] #4: ffffffffb0f36b50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1113.383755]
[ 1113.386222] =============================================\x0a
[ 1161.118734] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 1235.499012] INFO: task python3:5063 blocked for more than 368 seconds.
[ 1235.507158] Not tainted 7.0.0-rc4-ingc-g465c390dc465 #1
[ 1235.514408] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.524000] task:python3 state:D stack:25312 pid:5063 tgid:5063 ppid:5062 task_flags:0x400100 flags:0x00080002
[ 1235.537207] Call Trace:
[ 1235.540747]
[ 1235.543901] __schedule+0xad9/0x1490
[ 1235.548718] ? io_schedule_timeout+0x130/0x130
[ 1235.554504] ? find_held_lock+0x2b/0x80
[ 1235.559612] ? __lock_release.isra.0+0x59/0x170
[ 1235.565497] schedule+0xd4/0x260
[ 1235.569914] schedule_preempt_disabled+0x18/0x30
[ 1235.575896] __mutex_lock+0xd76/0x1f20
[ 1235.580905] ? threaded_store+0x132/0x220
[ 1235.586208] ? ww_mutex_lock+0x160/0x160
[ 1235.591408] ? selinux_inode_free_security+0x310/0x310
[ 1235.597978] ? cap_capable+0x1ed/0x3f0
[ 1235.602986] ? sysfs_file_ops+0x140/0x140
[ 1235.608285] ? threaded_store+0x132/0x220
[ 1235.613580] threaded_store+0x132/0x220
[ 1235.618685] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.624181] ? sysfs_file_ops+0x140/0x140
[ 1235.629479] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.634775] ? sysfs_kf_write+0x65/0x160
[ 1235.639975] kernfs_fop_write_iter+0x335/0x510
[ 1235.645751] ? kernfs_ops+0xf0/0xf0
[ 1235.650455] new_sync_write+0x308/0x6f0
[ 1235.655562] ? new_sync_read+0x6f0/0x6f0
[ 1235.660763] ? lock_acquire.part.0+0xbc/0x260
[ 1235.666448] ? ksys_write+0xff/0x200
[ 1235.671263] vfs_write+0x62a/0x980
[ 1235.675878] ksys_write+0xff/0x200
[ 1235.680492] ? __ia32_sys_read+0xc0/0xc0
[ 1235.685689] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.691281] ? rcu_is_watching+0x15/0xd0
[ 1235.696483] do_syscall_64+0xf3/0x5e0
[ 1235.701391] ? irq_exit_rcu+0x39/0xf0
[ 1235.706299] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.712759] RIP: 0033:0x7ff84c0cac5e
[ 1235.717569] RSP: 002b:00007ffdb89e2750 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.726858] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff84c0cac5e
[ 1235.735668] RDX: 0000000000000001 RSI: 0000557885059110 RDI: 0000000000000007
[ 1235.744476] RBP: 00007ffdb89e2760 R08: 0000000000000000 R09: 0000000000000000
[ 1235.753284] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff84bf65e80
[ 1235.762094] R13: 0000557885059110 R14: 0000000000000007 R15: 00007ff84c7cbb98
[ 1235.770910]
[ 1235.774177] INFO: task python3:5063 is blocked on a mutex likely owned by task python3:3109.
[ 1235.784451] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1235.797652] Call Trace:
[ 1235.801191]
[ 1235.804342] __schedule+0xad9/0x1490
[ 1235.809155] ? io_schedule_timeout+0x130/0x130
[ 1235.814940] ? find_held_lock+0x2b/0x80
[ 1235.820036] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.826215] schedule+0xd4/0x260
[ 1235.830635] schedule_timeout+0x103/0x260
[ 1235.835933] ? rcu_is_watching+0x15/0xd0
[ 1235.841134] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.847504] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.853196] ? ww_mutex_lock+0x160/0x160
[ 1235.858396] msleep+0x1b/0x30
[ 1235.862524] napi_set_threaded+0x376/0x410
[ 1235.867922] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.873415] netif_set_threaded+0x254/0x400
[ 1235.878909] ? sysfs_file_ops+0x140/0x140
[ 1235.884208] threaded_store+0x1bb/0x220
[ 1235.889311] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.894805] ? sysfs_file_ops+0x140/0x140
[ 1235.900101] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.905400] ? sysfs_kf_write+0x65/0x160
[ 1235.910601] kernfs_fop_write_iter+0x335/0x510
[ 1235.916386] ? kernfs_ops+0xf0/0xf0
[ 1235.921090] new_sync_write+0x308/0x6f0
[ 1235.926191] ? new_sync_read+0x6f0/0x6f0
[ 1235.931393] ? lock_acquire.part.0+0xbc/0x260
[ 1235.937078] ? ksys_write+0xff/0x200
[ 1235.941889] vfs_write+0x62a/0x980
[ 1235.946503] ksys_write+0xff/0x200
[ 1235.951120] ? __ia32_sys_read+0xc0/0xc0
[ 1235.956322] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.961912] ? rcu_is_watching+0x15/0xd0
[ 1235.967111] do_syscall_64+0xf3/0x5e0
[ 1235.972019] ? irq_exit_rcu+0x39/0xf0
[ 1235.976916] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.983385] RIP: 0033:0x7efdfa26ec5e
[ 1235.988194] RSP: 002b:00007ffe47b83330 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.997489] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efdfa26ec5e
[ 1236.006298] RDX: 0000000000000001 RSI: 0000561e4ec78110 RDI: 0000000000000007
[ 1236.015106] RBP: 00007ffe47b83340 R08: 0000000000000000 R09: 0000000000000000
[ 1236.023916] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efdfa109e80
[ 1236.032723] R13: 0000561e4ec78110 R14: 0000000000000007 R15: 00007efdfa09a480
[ 1236.041527]
[ 1236.044797] \x0aShowing all locks held in the system:
[ 1236.053336] 1 lock held by khungtaskd/184:
[ 1236.058731] #0: ffffffffb0ece020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.070214] 4 locks held by python3/3109:
[ 1236.075508] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.085300] #1: ff1100013b482c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.096265] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.107422] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.117517] 4 locks held by python3/5063:
[ 1236.122814] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.132603] #1: ff11000184b1e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.143566] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.154727] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.164821]
[ 1236.167288] =============================================\x0a
[ 1358.380277] INFO: task python3:5063 blocked for more than 491 seconds.
[ 1358.388424] Not tainted 7.0.0-rc4-ingc-g465c390dc465 #1
[ 1358.395674] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.405264] task:python3 state:D stack:25312 pid:5063 tgid:5063 ppid:5062 task_flags:0x400100 flags:0x00080002
[ 1358.418467] Call Trace:
[ 1358.422009]
[ 1358.425158] __schedule+0xad9/0x1490
[ 1358.429972] ? io_schedule_timeout+0x130/0x130
[ 1358.435750] ? find_held_lock+0x2b/0x80
[ 1358.440857] ? __lock_release.isra.0+0x59/0x170
[ 1358.446761] schedule+0xd4/0x260
[ 1358.451183] schedule_preempt_disabled+0x18/0x30
[ 1358.457161] __mutex_lock+0xd76/0x1f20
[ 1358.462166] ? threaded_store+0x132/0x220
[ 1358.467465] ? ww_mutex_lock+0x160/0x160
[ 1358.472665] ? selinux_inode_free_security+0x310/0x310
[ 1358.479235] ? cap_capable+0x1ed/0x3f0
[ 1358.484244] ? sysfs_file_ops+0x140/0x140
[ 1358.489543] ? threaded_store+0x132/0x220
[ 1358.494830] threaded_store+0x132/0x220
[ 1358.499934] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.505424] ? sysfs_file_ops+0x140/0x140
[ 1358.510720] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.516016] ? sysfs_kf_write+0x65/0x160
[ 1358.521218] kernfs_fop_write_iter+0x335/0x510
[ 1358.527006] ? kernfs_ops+0xf0/0xf0
[ 1358.531720] new_sync_write+0x308/0x6f0
[ 1358.536823] ? new_sync_read+0x6f0/0x6f0
[ 1358.542024] ? lock_acquire.part.0+0xbc/0x260
[ 1358.547711] ? ksys_write+0xff/0x200
[ 1358.552514] vfs_write+0x62a/0x980
[ 1358.557130] ksys_write+0xff/0x200
[ 1358.561744] ? __ia32_sys_read+0xc0/0xc0
[ 1358.566941] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.572533] ? rcu_is_watching+0x15/0xd0
[ 1358.577735] do_syscall_64+0xf3/0x5e0
[ 1358.582644] ? irq_exit_rcu+0x39/0xf0
[ 1358.587554] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.594024] RIP: 0033:0x7ff84c0cac5e
[ 1358.598834] RSP: 002b:00007ffdb89e2750 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.608126] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff84c0cac5e
[ 1358.616933] RDX: 0000000000000001 RSI: 0000557885059110 RDI: 0000000000000007
[ 1358.625739] RBP: 00007ffdb89e2760 R08: 0000000000000000 R09: 0000000000000000
[ 1358.634548] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff84bf65e80
[ 1358.643358] R13: 0000557885059110 R14: 0000000000000007 R15: 00007ff84c7cbb98
[ 1358.652174]
[ 1358.655442] INFO: task python3:5063 is blocked on a mutex likely owned by task python3:3109.
[ 1358.665714] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1358.678917] Call Trace:
[ 1358.682455]
[ 1358.685608] __schedule+0xad9/0x1490
[ 1358.690420] ? io_schedule_timeout+0x130/0x130
[ 1358.696206] ? find_held_lock+0x2b/0x80
[ 1358.701307] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.707478] schedule+0xd4/0x260
[ 1358.711896] schedule_timeout+0x103/0x260
[ 1358.717193] ? rcu_is_watching+0x15/0xd0
[ 1358.722391] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.728763] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.734456] ? ww_mutex_lock+0x160/0x160
[ 1358.739656] msleep+0x1b/0x30
[ 1358.743783] napi_set_threaded+0x376/0x410
[ 1358.749176] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.754669] netif_set_threaded+0x254/0x400
[ 1358.760164] ? sysfs_file_ops+0x140/0x140
[ 1358.765459] threaded_store+0x1bb/0x220
[ 1358.770563] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.776054] ? sysfs_file_ops+0x140/0x140
[ 1358.781352] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.786638] ? sysfs_kf_write+0x65/0x160
[ 1358.791840] kernfs_fop_write_iter+0x335/0x510
[ 1358.797625] ? kernfs_ops+0xf0/0xf0
[ 1358.802338] new_sync_write+0x308/0x6f0
[ 1358.807440] ? new_sync_read+0x6f0/0x6f0
[ 1358.812642] ? lock_acquire.part.0+0xbc/0x260
[ 1358.818328] ? ksys_write+0xff/0x200
[ 1358.823140] vfs_write+0x62a/0x980
[ 1358.827755] ksys_write+0xff/0x200
[ 1358.832369] ? __ia32_sys_read+0xc0/0xc0
[ 1358.837566] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.843159] ? rcu_is_watching+0x15/0xd0
[ 1358.848358] do_syscall_64+0xf3/0x5e0
[ 1358.853262] ? irq_exit_rcu+0x39/0xf0
[ 1358.858169] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.864635] RIP: 0033:0x7efdfa26ec5e
[ 1358.869444] RSP: 002b:00007ffe47b83330 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.878741] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efdfa26ec5e
[ 1358.887549] RDX: 0000000000000001 RSI: 0000561e4ec78110 RDI: 0000000000000007
[ 1358.896358] RBP: 00007ffe47b83340 R08: 0000000000000000 R09: 0000000000000000
[ 1358.905168] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efdfa109e80
[ 1358.913977] R13: 0000561e4ec78110 R14: 0000000000000007 R15: 00007efdfa09a480
[ 1358.922792]
[ 1358.926065] \x0aShowing all locks held in the system:
[ 1358.934602] 1 lock held by khungtaskd/184:
[ 1358.939993] #0: ffffffffb0ece020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.951475] 4 locks held by python3/3109:
[ 1358.956772] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.966564] #1: ff1100013b482c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.977530] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.988689] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.998783] 4 locks held by python3/5063:
[ 1359.004076] #0: ff1100012e6f93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.013865] #1: ff11000184b1e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.024825] #2: ff1100012141b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.035982] #3: ff110001214a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.046077]
[ 1359.048543] =============================================\x0a