[ 781.844938] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 781.848465] nipa-hw-worker: [4/40] Retrying drivers/net:napi_threaded.py
[ 782.019783] kselftest: Running tests in drivers/net
[ 989.738973] INFO: task python3:5435 blocked for more than 122 seconds.
[ 989.747171] Not tainted 7.0.0-rc6-tlcq-gca745fc70c59 #1
[ 989.754422] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.764009] task:python3 state:D stack:24848 pid:5435 tgid:5435 ppid:5434 task_flags:0x400100 flags:0x00080000
[ 989.777212] Call Trace:
[ 989.780740]
[ 989.783890] __schedule+0xad9/0x1490
[ 989.788706] ? io_schedule_timeout+0x130/0x130
[ 989.794490] ? find_held_lock+0x2b/0x80
[ 989.799594] ? __lock_release.isra.0+0x59/0x170
[ 989.805481] schedule+0xd4/0x260
[ 989.809899] schedule_preempt_disabled+0x18/0x30
[ 989.815878] __mutex_lock+0xd76/0x1f20
[ 989.820883] ? threaded_store+0x132/0x220
[ 989.826183] ? ww_mutex_lock+0x160/0x160
[ 989.831371] ? selinux_inode_free_security+0x310/0x310
[ 989.837942] ? cap_capable+0x1ed/0x3f0
[ 989.842947] ? sysfs_file_ops+0x140/0x140
[ 989.848244] ? threaded_store+0x132/0x220
[ 989.853541] threaded_store+0x132/0x220
[ 989.858641] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.864131] ? sysfs_file_ops+0x140/0x140
[ 989.869428] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.874722] ? sysfs_kf_write+0x65/0x160
[ 989.879920] kernfs_fop_write_iter+0x335/0x510
[ 989.885703] ? kernfs_ops+0xf0/0xf0
[ 989.890414] new_sync_write+0x308/0x6f0
[ 989.895518] ? new_sync_read+0x6f0/0x6f0
[ 989.900717] ? lock_acquire.part.0+0xbc/0x260
[ 989.906401] ? ksys_write+0xff/0x200
[ 989.911214] vfs_write+0x62a/0x980
[ 989.915826] ksys_write+0xff/0x200
[ 989.920441] ? __ia32_sys_read+0xc0/0xc0
[ 989.925631] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.931220] ? rcu_is_watching+0x15/0xd0
[ 989.936423] do_syscall_64+0xf3/0x5e0
[ 989.941330] ? exc_page_fault+0x9e/0xb0
[ 989.946430] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.952897] RIP: 0033:0x7fde0ab42c5e
[ 989.957704] RSP: 002b:00007fff921e8310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.967007] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fde0ab42c5e
[ 989.975814] RDX: 0000000000000001 RSI: 00005567f1f9d760 RDI: 0000000000000007
[ 989.984612] RBP: 00007fff921e8320 R08: 0000000000000000 R09: 0000000000000000
[ 989.993417] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fde0a9dde80
[ 990.002224] R13: 00005567f1f9d760 R14: 0000000000000007 R15: 00007fde0b243b98
[ 990.011038]
[ 990.014308] INFO: task python3:5435 is blocked on a mutex likely owned by task python3:3468.
[ 990.024582] task:python3 state:D stack:25312 pid:3468 tgid:3468 ppid:3467 task_flags:0x400100 flags:0x00080802
[ 990.037781] Call Trace:
[ 990.041319]
[ 990.044469] __schedule+0xad9/0x1490
[ 990.049279] ? io_schedule_timeout+0x130/0x130
[ 990.055053] ? find_held_lock+0x2b/0x80
[ 990.060156] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.066333] schedule+0xd4/0x260
[ 990.070751] schedule_timeout+0x103/0x260
[ 990.076046] ? rcu_is_watching+0x15/0xd0
[ 990.081246] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.087616] ? hrtimers_cpu_dying+0x250/0x250
[ 990.093306] ? ww_mutex_lock+0x160/0x160
[ 990.098506] msleep+0x1b/0x30
[ 990.102630] napi_set_threaded+0x376/0x410
[ 990.108026] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.113508] netif_set_threaded+0x254/0x400
[ 990.119002] ? sysfs_file_ops+0x140/0x140
[ 990.124294] threaded_store+0x1bb/0x220
[ 990.129396] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.134886] ? sysfs_file_ops+0x140/0x140
[ 990.140179] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.145474] ? sysfs_kf_write+0x65/0x160
[ 990.150673] kernfs_fop_write_iter+0x335/0x510
[ 990.156457] ? kernfs_ops+0xf0/0xf0
[ 990.161168] new_sync_write+0x308/0x6f0
[ 990.166268] ? new_sync_read+0x6f0/0x6f0
[ 990.171468] ? lock_acquire.part.0+0xbc/0x260
[ 990.177154] ? ksys_write+0xff/0x200
[ 990.181966] vfs_write+0x62a/0x980
[ 990.186583] ksys_write+0xff/0x200
[ 990.191199] ? __ia32_sys_read+0xc0/0xc0
[ 990.196397] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.201990] ? rcu_is_watching+0x15/0xd0
[ 990.207189] do_syscall_64+0xf3/0x5e0
[ 990.212089] ? irq_exit_rcu+0x39/0xf0
[ 990.216998] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.223458] RIP: 0033:0x7ff861436c5e
[ 990.228267] RSP: 002b:00007ffeb55a1b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.237555] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff861436c5e
[ 990.246357] RDX: 0000000000000001 RSI: 0000555a0bcf3760 RDI: 0000000000000007
[ 990.255167] RBP: 00007ffeb55a1b90 R08: 0000000000000000 R09: 0000000000000000
[ 990.263976] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff8612d1e80
[ 990.272783] R13: 0000555a0bcf3760 R14: 0000000000000007 R15: 00007ff861262480
[ 990.281599]
[ 990.284847] \x0aShowing all locks held in the system:
[ 990.293366] 3 locks held by systemd/1:
[ 990.298368] #0: ff110001be59cc78 (&f->f_pos_lock){+.+.}-{4:4}, at: fdget_pos+0x230/0x310
[ 990.308356] #1: ff1100012ed513f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.318138] #2: ff11000183718288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.329116] 1 lock held by khungtaskd/185:
[ 990.334510] #0: ffffffffb1ace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.345993] 4 locks held by python3/3468:
[ 990.351286] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.361076] #1: ff110001665d0288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.372036] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.383191] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.393299] 4 locks held by python3/5435:
[ 990.398597] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.408387] #1: ff110001e4ac4488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.419349] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.430505] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.440595]
[ 990.443059] =============================================\x0a
[ 1112.621346] INFO: task python3:5435 blocked for more than 245 seconds.
[ 1112.629492] Not tainted 7.0.0-rc6-tlcq-gca745fc70c59 #1
[ 1112.636742] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.646333] task:python3 state:D stack:24848 pid:5435 tgid:5435 ppid:5434 task_flags:0x400100 flags:0x00080000
[ 1112.659538] Call Trace:
[ 1112.663079]
[ 1112.666229] __schedule+0xad9/0x1490
[ 1112.671046] ? io_schedule_timeout+0x130/0x130
[ 1112.676834] ? find_held_lock+0x2b/0x80
[ 1112.681941] ? __lock_release.isra.0+0x59/0x170
[ 1112.687827] schedule+0xd4/0x260
[ 1112.692248] schedule_preempt_disabled+0x18/0x30
[ 1112.698230] __mutex_lock+0xd76/0x1f20
[ 1112.703234] ? threaded_store+0x132/0x220
[ 1112.708536] ? ww_mutex_lock+0x160/0x160
[ 1112.713735] ? selinux_inode_free_security+0x310/0x310
[ 1112.720305] ? cap_capable+0x1ed/0x3f0
[ 1112.725312] ? sysfs_file_ops+0x140/0x140
[ 1112.731204] ? threaded_store+0x132/0x220
[ 1112.736529] threaded_store+0x132/0x220
[ 1112.741632] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.747123] ? sysfs_file_ops+0x140/0x140
[ 1112.752424] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.757722] ? sysfs_kf_write+0x65/0x160
[ 1112.762923] kernfs_fop_write_iter+0x335/0x510
[ 1112.768708] ? kernfs_ops+0xf0/0xf0
[ 1112.773418] new_sync_write+0x308/0x6f0
[ 1112.778520] ? new_sync_read+0x6f0/0x6f0
[ 1112.783722] ? lock_acquire.part.0+0xbc/0x260
[ 1112.789408] ? ksys_write+0xff/0x200
[ 1112.794223] vfs_write+0x62a/0x980
[ 1112.798838] ksys_write+0xff/0x200
[ 1112.803521] ? __ia32_sys_read+0xc0/0xc0
[ 1112.808721] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.814312] ? rcu_is_watching+0x15/0xd0
[ 1112.819511] do_syscall_64+0xf3/0x5e0
[ 1112.824410] ? exc_page_fault+0x9e/0xb0
[ 1112.829513] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.835984] RIP: 0033:0x7fde0ab42c5e
[ 1112.840795] RSP: 002b:00007fff921e8310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.850097] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fde0ab42c5e
[ 1112.858905] RDX: 0000000000000001 RSI: 00005567f1f9d760 RDI: 0000000000000007
[ 1112.867709] RBP: 00007fff921e8320 R08: 0000000000000000 R09: 0000000000000000
[ 1112.876517] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fde0a9dde80
[ 1112.885327] R13: 00005567f1f9d760 R14: 0000000000000007 R15: 00007fde0b243b98
[ 1112.894141]
[ 1112.897566] INFO: task python3:5435 is blocked on a mutex likely owned by task python3:3468.
[ 1112.907840] task:python3 state:D stack:25312 pid:3468 tgid:3468 ppid:3467 task_flags:0x400100 flags:0x00080802
[ 1112.921046] Call Trace:
[ 1112.924586]
[ 1112.927738] __schedule+0xad9/0x1490
[ 1112.932613] ? io_schedule_timeout+0x130/0x130
[ 1112.938396] ? find_held_lock+0x2b/0x80
[ 1112.943500] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.949701] schedule+0xd4/0x260
[ 1112.954129] schedule_timeout+0x103/0x260
[ 1112.959427] ? rcu_is_watching+0x15/0xd0
[ 1112.964628] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.970999] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.976691] ? ww_mutex_lock+0x160/0x160
[ 1112.981892] msleep+0x1b/0x30
[ 1112.986019] napi_set_threaded+0x376/0x410
[ 1112.991406] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.996899] netif_set_threaded+0x254/0x400
[ 1113.002395] ? sysfs_file_ops+0x140/0x140
[ 1113.007691] threaded_store+0x1bb/0x220
[ 1113.012797] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.018290] ? sysfs_file_ops+0x140/0x140
[ 1113.023588] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.028953] ? sysfs_kf_write+0x65/0x160
[ 1113.034153] kernfs_fop_write_iter+0x335/0x510
[ 1113.039931] ? kernfs_ops+0xf0/0xf0
[ 1113.044643] new_sync_write+0x308/0x6f0
[ 1113.049749] ? new_sync_read+0x6f0/0x6f0
[ 1113.054953] ? lock_acquire.part.0+0xbc/0x260
[ 1113.060639] ? ksys_write+0xff/0x200
[ 1113.065453] vfs_write+0x62a/0x980
[ 1113.070072] ksys_write+0xff/0x200
[ 1113.074689] ? __ia32_sys_read+0xc0/0xc0
[ 1113.079890] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.085482] ? rcu_is_watching+0x15/0xd0
[ 1113.090684] do_syscall_64+0xf3/0x5e0
[ 1113.095592] ? irq_exit_rcu+0x39/0xf0
[ 1113.100499] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.106968] RIP: 0033:0x7ff861436c5e
[ 1113.111777] RSP: 002b:00007ffeb55a1b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.121080] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff861436c5e
[ 1113.129887] RDX: 0000000000000001 RSI: 0000555a0bcf3760 RDI: 0000000000000007
[ 1113.138700] RBP: 00007ffeb55a1b90 R08: 0000000000000000 R09: 0000000000000000
[ 1113.147517] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff8612d1e80
[ 1113.156329] R13: 0000555a0bcf3760 R14: 0000000000000007 R15: 00007ff861262480
[ 1113.165147]
[ 1113.168413] \x0aShowing all locks held in the system:
[ 1113.176961] 1 lock held by khungtaskd/185:
[ 1113.182354] #0: ffffffffb1ace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.193842] 5 locks held by systemd-journal/806:
[ 1113.199837] #0: ff1100180eab72e0 (&rq->__lock){-.-.}-{2:2}, at: raw_spin_rq_lock_nested+0x2c/0x40
[ 1113.210719] #1: ffffffffb1cc9340 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.223539] #2: ff110001a21bb830 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1113.234992] #3: ff1100019bb051e8 (&xa->xa_lock#5){-.-.}-{3:3}, at: __folio_mark_dirty+0x91/0x270
[ 1113.245763] #4: ffffffffb1ace120 (rcu_read_lock){....}-{1:3}, at: lruvec_stat_mod_folio+0x7c/0x430
[ 1113.256744] 4 locks held by python3/3468:
[ 1113.262040] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.271831] #1: ff110001665d0288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.282798] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.293958] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.304071] 4 locks held by python3/5435:
[ 1113.309369] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.319162] #1: ff110001e4ac4488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.330128] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.341287] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.351376] 5 locks held by systemd/6449:
[ 1113.356675] #0: ff1100012ed513f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.366466] #1: ff1100012aa21a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.377418] #2: ffffffffb1b372c8 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x560
[ 1113.389054] #3: ffffffffb1968f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a6/0x5c0
[ 1113.400603] #4: ffffffffb1b36fd0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2b2/0x5c0
[ 1113.412936]
[ 1113.415396] =============================================\x0a
[ 1235.501778] INFO: task python3:5435 blocked for more than 368 seconds.
[ 1235.509928] Not tainted 7.0.0-rc6-tlcq-gca745fc70c59 #1
[ 1235.517180] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.526772] task:python3 state:D stack:24848 pid:5435 tgid:5435 ppid:5434 task_flags:0x400100 flags:0x00080002
[ 1235.539981] Call Trace:
[ 1235.543521]
[ 1235.546675] __schedule+0xad9/0x1490
[ 1235.551493] ? io_schedule_timeout+0x130/0x130
[ 1235.557277] ? find_held_lock+0x2b/0x80
[ 1235.562384] ? __lock_release.isra.0+0x59/0x170
[ 1235.568273] schedule+0xd4/0x260
[ 1235.572695] schedule_preempt_disabled+0x18/0x30
[ 1235.578676] __mutex_lock+0xd76/0x1f20
[ 1235.583683] ? threaded_store+0x132/0x220
[ 1235.588986] ? ww_mutex_lock+0x160/0x160
[ 1235.594184] ? selinux_inode_free_security+0x310/0x310
[ 1235.600758] ? cap_capable+0x1ed/0x3f0
[ 1235.605766] ? sysfs_file_ops+0x140/0x140
[ 1235.611066] ? threaded_store+0x132/0x220
[ 1235.616358] threaded_store+0x132/0x220
[ 1235.621461] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.626948] ? sysfs_file_ops+0x140/0x140
[ 1235.632247] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.637546] ? sysfs_kf_write+0x65/0x160
[ 1235.642748] kernfs_fop_write_iter+0x335/0x510
[ 1235.648536] ? kernfs_ops+0xf0/0xf0
[ 1235.653249] new_sync_write+0x308/0x6f0
[ 1235.658356] ? new_sync_read+0x6f0/0x6f0
[ 1235.663556] ? lock_acquire.part.0+0xbc/0x260
[ 1235.669232] ? ksys_write+0xff/0x200
[ 1235.674046] vfs_write+0x62a/0x980
[ 1235.678665] ksys_write+0xff/0x200
[ 1235.683282] ? __ia32_sys_read+0xc0/0xc0
[ 1235.688483] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.694074] ? rcu_is_watching+0x15/0xd0
[ 1235.699279] do_syscall_64+0xf3/0x5e0
[ 1235.704187] ? exc_page_fault+0x9e/0xb0
[ 1235.709288] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.715748] RIP: 0033:0x7fde0ab42c5e
[ 1235.720560] RSP: 002b:00007fff921e8310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.729858] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fde0ab42c5e
[ 1235.738666] RDX: 0000000000000001 RSI: 00005567f1f9d760 RDI: 0000000000000007
[ 1235.747474] RBP: 00007fff921e8320 R08: 0000000000000000 R09: 0000000000000000
[ 1235.756274] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fde0a9dde80
[ 1235.765087] R13: 00005567f1f9d760 R14: 0000000000000007 R15: 00007fde0b243b98
[ 1235.773904]
[ 1235.777182] INFO: task python3:5435 is blocked on a mutex likely owned by task python3:3468.
[ 1235.787456] task:python3 state:D stack:25312 pid:3468 tgid:3468 ppid:3467 task_flags:0x400100 flags:0x00080802
[ 1235.800660] Call Trace:
[ 1235.804202]
[ 1235.807354] __schedule+0xad9/0x1490
[ 1235.812165] ? io_schedule_timeout+0x130/0x130
[ 1235.817952] ? find_held_lock+0x2b/0x80
[ 1235.823056] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.829235] schedule+0xd4/0x260
[ 1235.833653] schedule_timeout+0x103/0x260
[ 1235.838954] ? rcu_is_watching+0x15/0xd0
[ 1235.844155] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.850524] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.856215] ? ww_mutex_lock+0x160/0x160
[ 1235.861415] msleep+0x1b/0x30
[ 1235.865535] napi_set_threaded+0x376/0x410
[ 1235.870931] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.876417] netif_set_threaded+0x254/0x400
[ 1235.881911] ? sysfs_file_ops+0x140/0x140
[ 1235.887210] threaded_store+0x1bb/0x220
[ 1235.892316] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.897809] ? sysfs_file_ops+0x140/0x140
[ 1235.903104] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.908402] ? sysfs_kf_write+0x65/0x160
[ 1235.913608] kernfs_fop_write_iter+0x335/0x510
[ 1235.919397] ? kernfs_ops+0xf0/0xf0
[ 1235.924108] new_sync_write+0x308/0x6f0
[ 1235.929214] ? new_sync_read+0x6f0/0x6f0
[ 1235.934417] ? lock_acquire.part.0+0xbc/0x260
[ 1235.940106] ? ksys_write+0xff/0x200
[ 1235.944919] vfs_write+0x62a/0x980
[ 1235.949536] ksys_write+0xff/0x200
[ 1235.954151] ? __ia32_sys_read+0xc0/0xc0
[ 1235.959352] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.964941] ? rcu_is_watching+0x15/0xd0
[ 1235.970141] do_syscall_64+0xf3/0x5e0
[ 1235.975047] ? irq_exit_rcu+0x39/0xf0
[ 1235.979957] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.986425] RIP: 0033:0x7ff861436c5e
[ 1235.991235] RSP: 002b:00007ffeb55a1b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.000534] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff861436c5e
[ 1236.009346] RDX: 0000000000000001 RSI: 0000555a0bcf3760 RDI: 0000000000000007
[ 1236.018162] RBP: 00007ffeb55a1b90 R08: 0000000000000000 R09: 0000000000000000
[ 1236.026972] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff8612d1e80
[ 1236.035784] R13: 0000555a0bcf3760 R14: 0000000000000007 R15: 00007ff861262480
[ 1236.044605]
[ 1236.047870] \x0aShowing all locks held in the system:
[ 1236.056410] 1 lock held by khungtaskd/185:
[ 1236.061801] #0: ffffffffb1ace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.073288] 4 locks held by python3/3468:
[ 1236.078585] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.088386] #1: ff110001665d0288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.099350] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.110508] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.120611] 4 locks held by python3/5435:
[ 1236.125906] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.135699] #1: ff110001e4ac4488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.146663] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.157819] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.167913]
[ 1236.170382] =============================================\x0a
[ 1358.383148] INFO: task python3:5435 blocked for more than 491 seconds.
[ 1358.391299] Not tainted 7.0.0-rc6-tlcq-gca745fc70c59 #1
[ 1358.398549] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.408140] task:python3 state:D stack:24848 pid:5435 tgid:5435 ppid:5434 task_flags:0x400100 flags:0x00080002
[ 1358.421347] Call Trace:
[ 1358.424886]
[ 1358.428038] __schedule+0xad9/0x1490
[ 1358.432858] ? io_schedule_timeout+0x130/0x130
[ 1358.438644] ? find_held_lock+0x2b/0x80
[ 1358.443749] ? __lock_release.isra.0+0x59/0x170
[ 1358.449655] schedule+0xd4/0x260
[ 1358.454316] schedule_preempt_disabled+0x18/0x30
[ 1358.460298] __mutex_lock+0xd76/0x1f20
[ 1358.465303] ? threaded_store+0x132/0x220
[ 1358.470604] ? ww_mutex_lock+0x160/0x160
[ 1358.475803] ? selinux_inode_free_security+0x310/0x310
[ 1358.482376] ? cap_capable+0x1ed/0x3f0
[ 1358.487381] ? sysfs_file_ops+0x140/0x140
[ 1358.492679] ? threaded_store+0x132/0x220
[ 1358.497975] threaded_store+0x132/0x220
[ 1358.503075] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.508566] ? sysfs_file_ops+0x140/0x140
[ 1358.513881] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.519169] ? sysfs_kf_write+0x65/0x160
[ 1358.524369] kernfs_fop_write_iter+0x335/0x510
[ 1358.530151] ? kernfs_ops+0xf0/0xf0
[ 1358.534863] new_sync_write+0x308/0x6f0
[ 1358.539961] ? new_sync_read+0x6f0/0x6f0
[ 1358.545162] ? lock_acquire.part.0+0xbc/0x260
[ 1358.550849] ? ksys_write+0xff/0x200
[ 1358.555659] vfs_write+0x62a/0x980
[ 1358.560275] ksys_write+0xff/0x200
[ 1358.564891] ? __ia32_sys_read+0xc0/0xc0
[ 1358.570090] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.575671] ? rcu_is_watching+0x15/0xd0
[ 1358.580863] do_syscall_64+0xf3/0x5e0
[ 1358.585770] ? exc_page_fault+0x9e/0xb0
[ 1358.590868] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.597426] RIP: 0033:0x7fde0ab42c5e
[ 1358.602236] RSP: 002b:00007fff921e8310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.611536] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fde0ab42c5e
[ 1358.620346] RDX: 0000000000000001 RSI: 00005567f1f9d760 RDI: 0000000000000007
[ 1358.629153] RBP: 00007fff921e8320 R08: 0000000000000000 R09: 0000000000000000
[ 1358.637956] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fde0a9dde80
[ 1358.646771] R13: 00005567f1f9d760 R14: 0000000000000007 R15: 00007fde0b243b98
[ 1358.655587]
[ 1358.658907] INFO: task python3:5435 is blocked on a mutex likely owned by task python3:3468.
[ 1358.669179] task:python3 state:D stack:25312 pid:3468 tgid:3468 ppid:3467 task_flags:0x400100 flags:0x00080802
[ 1358.682386] Call Trace:
[ 1358.682389]
[ 1358.682392] __schedule+0xad9/0x1490
[ 1358.682397] ? io_schedule_timeout+0x130/0x130
[ 1358.682400] ? find_held_lock+0x2b/0x80
[ 1358.682405] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.710998] schedule+0xd4/0x260
[ 1358.715417] schedule_timeout+0x103/0x260
[ 1358.720714] ? rcu_is_watching+0x15/0xd0
[ 1358.725914] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.732289] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.737981] ? ww_mutex_lock+0x160/0x160
[ 1358.743184] msleep+0x1b/0x30
[ 1358.747310] napi_set_threaded+0x376/0x410
[ 1358.752708] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.758202] netif_set_threaded+0x254/0x400
[ 1358.763696] ? sysfs_file_ops+0x140/0x140
[ 1358.768996] threaded_store+0x1bb/0x220
[ 1358.774100] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.779595] ? sysfs_file_ops+0x140/0x140
[ 1358.784893] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.790180] ? sysfs_kf_write+0x65/0x160
[ 1358.795379] kernfs_fop_write_iter+0x335/0x510
[ 1358.801164] ? kernfs_ops+0xf0/0xf0
[ 1358.805868] new_sync_write+0x308/0x6f0
[ 1358.810964] ? new_sync_read+0x6f0/0x6f0
[ 1358.816165] ? lock_acquire.part.0+0xbc/0x260
[ 1358.821850] ? ksys_write+0xff/0x200
[ 1358.826664] vfs_write+0x62a/0x980
[ 1358.831280] ksys_write+0xff/0x200
[ 1358.835897] ? __ia32_sys_read+0xc0/0xc0
[ 1358.841097] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.846687] ? rcu_is_watching+0x15/0xd0
[ 1358.851888] do_syscall_64+0xf3/0x5e0
[ 1358.856795] ? irq_exit_rcu+0x39/0xf0
[ 1358.861701] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.868169] RIP: 0033:0x7ff861436c5e
[ 1358.872979] RSP: 002b:00007ffeb55a1b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.882271] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff861436c5e
[ 1358.891080] RDX: 0000000000000001 RSI: 0000555a0bcf3760 RDI: 0000000000000007
[ 1358.899905] RBP: 00007ffeb55a1b90 R08: 0000000000000000 R09: 0000000000000000
[ 1358.908709] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff8612d1e80
[ 1358.917519] R13: 0000555a0bcf3760 R14: 0000000000000007 R15: 00007ff861262480
[ 1358.926332]
[ 1358.929603] \x0aShowing all locks held in the system:
[ 1358.938146] 1 lock held by khungtaskd/185:
[ 1358.943541] #0: ffffffffb1ace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.955012] 2 locks held by systemd-journal/806:
[ 1358.960992] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1358.970882] #1: ffffffffb1cc9340 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.983711] 4 locks held by python3/3468:
[ 1358.989007] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.998800] #1: ff110001665d0288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.009764] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.020922] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.031026] 4 locks held by python3/5435:
[ 1359.036322] #0: ff1100012ec693f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.046117] #1: ff110001e4ac4488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.057083] #2: ff110017db2750f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.068241] #3: ff110017db2d9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.078332] 5 locks held by (time-dir)/7218:
[ 1359.083910] #0: ff1100012ed513f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.093704] #1: ff11000137496888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.104669] #2: ffffffffb1b372c8 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1359.115339] #3: ffffffffb1968f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1359.126987] #4: ffffffffb1b36fd0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1359.139421]
[ 1359.141899] =============================================\x0a