[ 740.451440] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 740.454083] nipa-hw-worker: [4/36] Retrying drivers/net:napi_threaded.py
[ 740.592778] kselftest: Running tests in drivers/net
[ 866.864409] INFO: task python3:4670 blocked for more than 122 seconds.
[ 866.872641] Not tainted 7.0.0-rc3-yxic-g32dca9ae1adf #1
[ 866.879893] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 866.889484] task:python3 state:D stack:25312 pid:4670 tgid:4670 ppid:4668 task_flags:0x400100 flags:0x00080000
[ 866.902689] Call Trace:
[ 866.906229]
[ 866.909382] __schedule+0xad9/0x1490
[ 866.914199] ? io_schedule_timeout+0x130/0x130
[ 866.919982] ? find_held_lock+0x2b/0x80
[ 866.925089] ? __lock_release.isra.0+0x59/0x170
[ 866.930974] schedule+0xd4/0x260
[ 866.935384] schedule_preempt_disabled+0x18/0x30
[ 866.941364] __mutex_lock+0xd76/0x1f20
[ 866.946361] ? threaded_store+0x132/0x220
[ 866.951661] ? ww_mutex_lock+0x160/0x160
[ 866.956861] ? selinux_inode_free_security+0x310/0x310
[ 866.963434] ? cap_capable+0x1ed/0x3f0
[ 866.968441] ? sysfs_file_ops+0x140/0x140
[ 866.973738] ? threaded_store+0x132/0x220
[ 866.979037] threaded_store+0x132/0x220
[ 866.984137] ? tx_maxrate_store+0x4e0/0x4e0
[ 866.989634] ? sysfs_file_ops+0x140/0x140
[ 866.994930] ? sysfs_file_kobj+0xbd/0x1e0
[ 867.000229] ? sysfs_kf_write+0x65/0x160
[ 867.005430] kernfs_fop_write_iter+0x335/0x510
[ 867.011215] ? kernfs_ops+0xf0/0xf0
[ 867.015920] new_sync_write+0x308/0x6f0
[ 867.021026] ? new_sync_read+0x6f0/0x6f0
[ 867.026225] ? lock_acquire.part.0+0xbc/0x260
[ 867.031911] ? ksys_write+0xff/0x200
[ 867.036726] vfs_write+0x62a/0x980
[ 867.041340] ksys_write+0xff/0x200
[ 867.045952] ? __ia32_sys_read+0xc0/0xc0
[ 867.051152] ? kernfs_fop_llseek+0x160/0x1f0
[ 867.056743] ? rcu_is_watching+0x15/0xd0
[ 867.061946] do_syscall_64+0xf3/0x5e0
[ 867.066854] ? irq_exit_rcu+0x39/0xf0
[ 867.071760] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 867.078229] RIP: 0033:0x7f308419bc5e
[ 867.083039] RSP: 002b:00007ffd303a8ec0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 867.092339] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f308419bc5e
[ 867.101148] RDX: 0000000000000001 RSI: 0000555701e96cd0 RDI: 0000000000000007
[ 867.109955] RBP: 00007ffd303a8ed0 R08: 0000000000000000 R09: 0000000000000000
[ 867.118762] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3084036e80
[ 867.127569] R13: 0000555701e96cd0 R14: 0000000000000007 R15: 00007f308489cb98
[ 867.136374]
[ 867.139640] INFO: task python3:4670 is blocked on a mutex likely owned by task python3:2696.
[ 867.149911] task:python3 state:D stack:25312 pid:2696 tgid:2696 ppid:2695 task_flags:0x400100 flags:0x00080802
[ 867.163113] Call Trace:
[ 867.166654]
[ 867.169805] __schedule+0xad9/0x1490
[ 867.174615] ? io_schedule_timeout+0x130/0x130
[ 867.180398] ? find_held_lock+0x2b/0x80
[ 867.185502] ? __try_to_del_timer_sync+0x154/0x1f0
[ 867.191680] schedule+0xd4/0x260
[ 867.196097] schedule_timeout+0x103/0x260
[ 867.201396] ? rcu_is_watching+0x15/0xd0
[ 867.206596] ? hrtimer_nanosleep_restart+0x180/0x180
[ 867.212960] ? hrtimers_cpu_dying+0x250/0x250
[ 867.218650] ? ww_mutex_lock+0x160/0x160
[ 867.223849] msleep+0x1b/0x30
[ 867.227973] napi_set_threaded+0x376/0x410
[ 867.233369] ? napi_resume_irqs+0x1a0/0x1a0
[ 867.238866] netif_set_threaded+0x254/0x400
[ 867.244359] ? sysfs_file_ops+0x140/0x140
[ 867.249648] threaded_store+0x1bb/0x220
[ 867.254750] ? tx_maxrate_store+0x4e0/0x4e0
[ 867.260250] ? sysfs_file_ops+0x140/0x140
[ 867.265544] ? sysfs_file_kobj+0xbd/0x1e0
[ 867.270842] ? sysfs_kf_write+0x65/0x160
[ 867.276042] kernfs_fop_write_iter+0x335/0x510
[ 867.281818] ? kernfs_ops+0xf0/0xf0
[ 867.286530] new_sync_write+0x308/0x6f0
[ 867.291634] ? new_sync_read+0x6f0/0x6f0
[ 867.296833] ? lock_acquire.part.0+0xbc/0x260
[ 867.302519] ? ksys_write+0xff/0x200
[ 867.307333] vfs_write+0x62a/0x980
[ 867.311946] ksys_write+0xff/0x200
[ 867.316562] ? __ia32_sys_read+0xc0/0xc0
[ 867.321763] ? kernfs_fop_llseek+0x160/0x1f0
[ 867.327355] ? rcu_is_watching+0x15/0xd0
[ 867.332552] do_syscall_64+0xf3/0x5e0
[ 867.337459] ? irq_exit_rcu+0x39/0xf0
[ 867.342364] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 867.348832] RIP: 0033:0x7f4ddaab0c5e
[ 867.353629] RSP: 002b:00007ffdd1bc2a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 867.362925] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ddaab0c5e
[ 867.371724] RDX: 0000000000000001 RSI: 0000562b0f20ecd0 RDI: 0000000000000007
[ 867.380535] RBP: 00007ffdd1bc2a20 R08: 0000000000000000 R09: 0000000000000000
[ 867.389343] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4dda94be80
[ 867.398143] R13: 0000562b0f20ecd0 R14: 0000000000000007 R15: 00007f4dda8da480
[ 867.406958]
[ 867.410215] \x0aShowing all locks held in the system:
[ 867.418751] 1 lock held by khungtaskd/185:
[ 867.424147] #0: ffffffffb56cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 867.435619] 3 locks held by systemd-journal/798:
[ 867.441597] #0: ff1100180dd371e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 867.451484] #1: ffffffffb58c8960 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 867.464292] #2: ff11000198b6fa40 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 867.475753] 4 locks held by python3/2696:
[ 867.481049] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 867.490841] #1: ff110001eb366888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 867.501805] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 867.512974] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 867.523069] 4 locks held by python3/4670:
[ 867.528363] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 867.538152] #1: ff1100015dbd1a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 867.549114] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 867.560269] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 867.570354]
[ 867.572822] =============================================\x0a
[ 989.744642] INFO: task python3:4670 blocked for more than 245 seconds.
[ 989.752788] Not tainted 7.0.0-rc3-yxic-g32dca9ae1adf #1
[ 989.760038] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.769627] task:python3 state:D stack:25312 pid:4670 tgid:4670 ppid:4668 task_flags:0x400100 flags:0x00080002
[ 989.782824] Call Trace:
[ 989.786364]
[ 989.789513] __schedule+0xad9/0x1490
[ 989.794328] ? io_schedule_timeout+0x130/0x130
[ 989.800115] ? find_held_lock+0x2b/0x80
[ 989.805221] ? __lock_release.isra.0+0x59/0x170
[ 989.811106] schedule+0xd4/0x260
[ 989.815524] schedule_preempt_disabled+0x18/0x30
[ 989.821501] __mutex_lock+0xd76/0x1f20
[ 989.826506] ? threaded_store+0x132/0x220
[ 989.831806] ? ww_mutex_lock+0x160/0x160
[ 989.837007] ? selinux_inode_free_security+0x310/0x310
[ 989.843576] ? cap_capable+0x1ed/0x3f0
[ 989.848582] ? sysfs_file_ops+0x140/0x140
[ 989.853883] ? threaded_store+0x132/0x220
[ 989.859179] threaded_store+0x132/0x220
[ 989.864282] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.869776] ? sysfs_file_ops+0x140/0x140
[ 989.875077] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.880375] ? sysfs_kf_write+0x65/0x160
[ 989.885577] kernfs_fop_write_iter+0x335/0x510
[ 989.891364] ? kernfs_ops+0xf0/0xf0
[ 989.896077] new_sync_write+0x308/0x6f0
[ 989.901181] ? new_sync_read+0x6f0/0x6f0
[ 989.906382] ? lock_acquire.part.0+0xbc/0x260
[ 989.912070] ? ksys_write+0xff/0x200
[ 989.916873] vfs_write+0x62a/0x980
[ 989.921488] ksys_write+0xff/0x200
[ 989.926094] ? __ia32_sys_read+0xc0/0xc0
[ 989.931292] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.936883] ? rcu_is_watching+0x15/0xd0
[ 989.942085] do_syscall_64+0xf3/0x5e0
[ 989.946990] ? irq_exit_rcu+0x39/0xf0
[ 989.951899] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.958366] RIP: 0033:0x7f308419bc5e
[ 989.963168] RSP: 002b:00007ffd303a8ec0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.972470] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f308419bc5e
[ 989.981278] RDX: 0000000000000001 RSI: 0000555701e96cd0 RDI: 0000000000000007
[ 989.990087] RBP: 00007ffd303a8ed0 R08: 0000000000000000 R09: 0000000000000000
[ 989.998896] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3084036e80
[ 990.007703] R13: 0000555701e96cd0 R14: 0000000000000007 R15: 00007f308489cb98
[ 990.016516]
[ 990.019800] INFO: task python3:4670 is blocked on a mutex likely owned by task python3:2696.
[ 990.030072] task:python3 state:D stack:25312 pid:2696 tgid:2696 ppid:2695 task_flags:0x400100 flags:0x00080802
[ 990.043274] Call Trace:
[ 990.046813]
[ 990.049961] __schedule+0xad9/0x1490
[ 990.054773] ? io_schedule_timeout+0x130/0x130
[ 990.060558] ? find_held_lock+0x2b/0x80
[ 990.065659] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.071838] schedule+0xd4/0x260
[ 990.076257] schedule_timeout+0x103/0x260
[ 990.081556] ? rcu_is_watching+0x15/0xd0
[ 990.086757] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.093129] ? hrtimers_cpu_dying+0x250/0x250
[ 990.098822] ? ww_mutex_lock+0x160/0x160
[ 990.104022] msleep+0x1b/0x30
[ 990.108149] napi_set_threaded+0x376/0x410
[ 990.113535] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.119029] netif_set_threaded+0x254/0x400
[ 990.124523] ? sysfs_file_ops+0x140/0x140
[ 990.129819] threaded_store+0x1bb/0x220
[ 990.134923] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.140415] ? sysfs_file_ops+0x140/0x140
[ 990.145712] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.151008] ? sysfs_kf_write+0x65/0x160
[ 990.156210] kernfs_fop_write_iter+0x335/0x510
[ 990.161997] ? kernfs_ops+0xf0/0xf0
[ 990.166698] new_sync_write+0x308/0x6f0
[ 990.171799] ? new_sync_read+0x6f0/0x6f0
[ 990.177002] ? lock_acquire.part.0+0xbc/0x260
[ 990.182689] ? ksys_write+0xff/0x200
[ 990.187502] vfs_write+0x62a/0x980
[ 990.192117] ksys_write+0xff/0x200
[ 990.196730] ? __ia32_sys_read+0xc0/0xc0
[ 990.201928] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.207515] ? rcu_is_watching+0x15/0xd0
[ 990.212714] do_syscall_64+0xf3/0x5e0
[ 990.217620] ? irq_exit_rcu+0x39/0xf0
[ 990.222528] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.228993] RIP: 0033:0x7f4ddaab0c5e
[ 990.233804] RSP: 002b:00007ffdd1bc2a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.243101] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ddaab0c5e
[ 990.251911] RDX: 0000000000000001 RSI: 0000562b0f20ecd0 RDI: 0000000000000007
[ 990.260719] RBP: 00007ffdd1bc2a20 R08: 0000000000000000 R09: 0000000000000000
[ 990.269530] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4dda94be80
[ 990.278338] R13: 0000562b0f20ecd0 R14: 0000000000000007 R15: 00007f4dda8da480
[ 990.287153]
[ 990.290413] \x0aShowing all locks held in the system:
[ 990.298952] 1 lock held by khungtaskd/185:
[ 990.304348] #0: ffffffffb56cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.315829] 4 locks held by python3/2696:
[ 990.321122] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.330914] #1: ff110001eb366888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.341878] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.353035] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.363128] 4 locks held by python3/4670:
[ 990.368421] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.378214] #1: ff1100015dbd1a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.389186] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.400342] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.410434]
[ 990.412900] =============================================\x0a
[ 1112.625811] INFO: task python3:4670 blocked for more than 368 seconds.
[ 1112.633959] Not tainted 7.0.0-rc3-yxic-g32dca9ae1adf #1
[ 1112.641209] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.650800] task:python3 state:D stack:25312 pid:4670 tgid:4670 ppid:4668 task_flags:0x400100 flags:0x00080002
[ 1112.664003] Call Trace:
[ 1112.667541]
[ 1112.670690] __schedule+0xad9/0x1490
[ 1112.675502] ? io_schedule_timeout+0x130/0x130
[ 1112.681288] ? find_held_lock+0x2b/0x80
[ 1112.686392] ? __lock_release.isra.0+0x59/0x170
[ 1112.692276] schedule+0xd4/0x260
[ 1112.696692] schedule_preempt_disabled+0x18/0x30
[ 1112.702669] __mutex_lock+0xd76/0x1f20
[ 1112.707672] ? threaded_store+0x132/0x220
[ 1112.712962] ? ww_mutex_lock+0x160/0x160
[ 1112.718160] ? selinux_inode_free_security+0x310/0x310
[ 1112.724730] ? cap_capable+0x1ed/0x3f0
[ 1112.729737] ? sysfs_file_ops+0x140/0x140
[ 1112.735037] ? threaded_store+0x132/0x220
[ 1112.740323] threaded_store+0x132/0x220
[ 1112.745427] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.750920] ? sysfs_file_ops+0x140/0x140
[ 1112.756214] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.761509] ? sysfs_kf_write+0x65/0x160
[ 1112.766710] kernfs_fop_write_iter+0x335/0x510
[ 1112.772496] ? kernfs_ops+0xf0/0xf0
[ 1112.777204] new_sync_write+0x308/0x6f0
[ 1112.782307] ? new_sync_read+0x6f0/0x6f0
[ 1112.787509] ? lock_acquire.part.0+0xbc/0x260
[ 1112.793196] ? ksys_write+0xff/0x200
[ 1112.798007] vfs_write+0x62a/0x980
[ 1112.802622] ksys_write+0xff/0x200
[ 1112.807235] ? __ia32_sys_read+0xc0/0xc0
[ 1112.812432] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.818021] ? rcu_is_watching+0x15/0xd0
[ 1112.823221] do_syscall_64+0xf3/0x5e0
[ 1112.828126] ? irq_exit_rcu+0x39/0xf0
[ 1112.833034] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.839500] RIP: 0033:0x7f308419bc5e
[ 1112.844310] RSP: 002b:00007ffd303a8ec0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.853608] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f308419bc5e
[ 1112.862417] RDX: 0000000000000001 RSI: 0000555701e96cd0 RDI: 0000000000000007
[ 1112.871225] RBP: 00007ffd303a8ed0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.880030] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3084036e80
[ 1112.888836] R13: 0000555701e96cd0 R14: 0000000000000007 R15: 00007f308489cb98
[ 1112.897648]
[ 1112.900924] INFO: task python3:4670 is blocked on a mutex likely owned by task python3:2696.
[ 1112.911196] task:python3 state:D stack:25312 pid:2696 tgid:2696 ppid:2695 task_flags:0x400100 flags:0x00080802
[ 1112.924395] Call Trace:
[ 1112.927933]
[ 1112.931082] __schedule+0xad9/0x1490
[ 1112.935890] ? io_schedule_timeout+0x130/0x130
[ 1112.941671] ? find_held_lock+0x2b/0x80
[ 1112.946773] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.952953] schedule+0xd4/0x260
[ 1112.957372] schedule_timeout+0x103/0x260
[ 1112.962669] ? rcu_is_watching+0x15/0xd0
[ 1112.967865] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.974236] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.979924] ? ww_mutex_lock+0x160/0x160
[ 1112.985111] msleep+0x1b/0x30
[ 1112.989238] napi_set_threaded+0x376/0x410
[ 1112.994632] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.000127] netif_set_threaded+0x254/0x400
[ 1113.005622] ? sysfs_file_ops+0x140/0x140
[ 1113.010921] threaded_store+0x1bb/0x220
[ 1113.016024] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.021506] ? sysfs_file_ops+0x140/0x140
[ 1113.026798] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.032095] ? sysfs_kf_write+0x65/0x160
[ 1113.037293] kernfs_fop_write_iter+0x335/0x510
[ 1113.043075] ? kernfs_ops+0xf0/0xf0
[ 1113.047784] new_sync_write+0x308/0x6f0
[ 1113.052887] ? new_sync_read+0x6f0/0x6f0
[ 1113.058085] ? lock_acquire.part.0+0xbc/0x260
[ 1113.063769] ? ksys_write+0xff/0x200
[ 1113.068580] vfs_write+0x62a/0x980
[ 1113.073194] ksys_write+0xff/0x200
[ 1113.077809] ? __ia32_sys_read+0xc0/0xc0
[ 1113.083007] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.088595] ? rcu_is_watching+0x15/0xd0
[ 1113.093793] do_syscall_64+0xf3/0x5e0
[ 1113.098698] ? irq_exit_rcu+0x39/0xf0
[ 1113.103606] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.110073] RIP: 0033:0x7f4ddaab0c5e
[ 1113.114878] RSP: 002b:00007ffdd1bc2a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.124172] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ddaab0c5e
[ 1113.132978] RDX: 0000000000000001 RSI: 0000562b0f20ecd0 RDI: 0000000000000007
[ 1113.141791] RBP: 00007ffdd1bc2a20 R08: 0000000000000000 R09: 0000000000000000
[ 1113.150599] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4dda94be80
[ 1113.159396] R13: 0000562b0f20ecd0 R14: 0000000000000007 R15: 00007f4dda8da480
[ 1113.168209]
[ 1113.171472] \x0aShowing all locks held in the system:
[ 1113.180008] 1 lock held by khungtaskd/185:
[ 1113.185402] #0: ffffffffb56cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.196885] 4 locks held by python3/2696:
[ 1113.202178] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.211968] #1: ff110001eb366888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.222931] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.234087] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.244178] 4 locks held by python3/4670:
[ 1113.249464] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.259255] #1: ff1100015dbd1a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.270218] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.281375] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.291454]
[ 1113.293924] =============================================\x0a
[ 1235.508008] INFO: task python3:4670 blocked for more than 491 seconds.
[ 1235.516154] Not tainted 7.0.0-rc3-yxic-g32dca9ae1adf #1
[ 1235.523404] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.532994] task:python3 state:D stack:25312 pid:4670 tgid:4670 ppid:4668 task_flags:0x400100 flags:0x00080002
[ 1235.546201] Call Trace:
[ 1235.549740]
[ 1235.552892] __schedule+0xad9/0x1490
[ 1235.557707] ? io_schedule_timeout+0x130/0x130
[ 1235.563490] ? find_held_lock+0x2b/0x80
[ 1235.568587] ? __lock_release.isra.0+0x59/0x170
[ 1235.574472] schedule+0xd4/0x260
[ 1235.578888] schedule_preempt_disabled+0x18/0x30
[ 1235.584868] __mutex_lock+0xd76/0x1f20
[ 1235.589871] ? threaded_store+0x132/0x220
[ 1235.595168] ? ww_mutex_lock+0x160/0x160
[ 1235.600367] ? selinux_inode_free_security+0x310/0x310
[ 1235.606936] ? cap_capable+0x1ed/0x3f0
[ 1235.611944] ? sysfs_file_ops+0x140/0x140
[ 1235.617238] ? threaded_store+0x132/0x220
[ 1235.622533] threaded_store+0x132/0x220
[ 1235.627634] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.633126] ? sysfs_file_ops+0x140/0x140
[ 1235.638420] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.643715] ? sysfs_kf_write+0x65/0x160
[ 1235.648916] kernfs_fop_write_iter+0x335/0x510
[ 1235.654702] ? kernfs_ops+0xf0/0xf0
[ 1235.659411] new_sync_write+0x308/0x6f0
[ 1235.664512] ? new_sync_read+0x6f0/0x6f0
[ 1235.669713] ? lock_acquire.part.0+0xbc/0x260
[ 1235.675396] ? ksys_write+0xff/0x200
[ 1235.680206] vfs_write+0x62a/0x980
[ 1235.684820] ksys_write+0xff/0x200
[ 1235.689434] ? __ia32_sys_read+0xc0/0xc0
[ 1235.694629] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.700216] ? rcu_is_watching+0x15/0xd0
[ 1235.705418] do_syscall_64+0xf3/0x5e0
[ 1235.710322] ? irq_exit_rcu+0x39/0xf0
[ 1235.715230] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.721695] RIP: 0033:0x7f308419bc5e
[ 1235.726505] RSP: 002b:00007ffd303a8ec0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.735802] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f308419bc5e
[ 1235.744608] RDX: 0000000000000001 RSI: 0000555701e96cd0 RDI: 0000000000000007
[ 1235.753413] RBP: 00007ffd303a8ed0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.762222] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3084036e80
[ 1235.771028] R13: 0000555701e96cd0 R14: 0000000000000007 R15: 00007f308489cb98
[ 1235.779839]
[ 1235.783102] INFO: task python3:4670 is blocked on a mutex likely owned by task python3:2696.
[ 1235.793372] task:python3 state:D stack:25312 pid:2696 tgid:2696 ppid:2695 task_flags:0x400100 flags:0x00080802
[ 1235.806571] Call Trace:
[ 1235.810107]
[ 1235.813255] __schedule+0xad9/0x1490
[ 1235.818064] ? io_schedule_timeout+0x130/0x130
[ 1235.823848] ? find_held_lock+0x2b/0x80
[ 1235.828950] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.835120] schedule+0xd4/0x260
[ 1235.839539] schedule_timeout+0x103/0x260
[ 1235.844836] ? rcu_is_watching+0x15/0xd0
[ 1235.850034] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.856401] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.862090] ? ww_mutex_lock+0x160/0x160
[ 1235.867287] msleep+0x1b/0x30
[ 1235.871410] napi_set_threaded+0x376/0x410
[ 1235.876804] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.882299] netif_set_threaded+0x254/0x400
[ 1235.887790] ? sysfs_file_ops+0x140/0x140
[ 1235.893085] threaded_store+0x1bb/0x220
[ 1235.898185] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.903676] ? sysfs_file_ops+0x140/0x140
[ 1235.908969] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.914265] ? sysfs_kf_write+0x65/0x160
[ 1235.919464] kernfs_fop_write_iter+0x335/0x510
[ 1235.925246] ? kernfs_ops+0xf0/0xf0
[ 1235.929957] new_sync_write+0x308/0x6f0
[ 1235.935060] ? new_sync_read+0x6f0/0x6f0
[ 1235.940259] ? lock_acquire.part.0+0xbc/0x260
[ 1235.945942] ? ksys_write+0xff/0x200
[ 1235.950754] vfs_write+0x62a/0x980
[ 1235.955369] ksys_write+0xff/0x200
[ 1235.959983] ? __ia32_sys_read+0xc0/0xc0
[ 1235.965183] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.970763] ? rcu_is_watching+0x15/0xd0
[ 1235.975963] do_syscall_64+0xf3/0x5e0
[ 1235.980869] ? irq_exit_rcu+0x39/0xf0
[ 1235.985773] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.992241] RIP: 0033:0x7f4ddaab0c5e
[ 1235.997047] RSP: 002b:00007ffdd1bc2a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.006346] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ddaab0c5e
[ 1236.015152] RDX: 0000000000000001 RSI: 0000562b0f20ecd0 RDI: 0000000000000007
[ 1236.023959] RBP: 00007ffdd1bc2a20 R08: 0000000000000000 R09: 0000000000000000
[ 1236.032766] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4dda94be80
[ 1236.041572] R13: 0000562b0f20ecd0 R14: 0000000000000007 R15: 00007f4dda8da480
[ 1236.050384]
[ 1236.053651] \x0aShowing all locks held in the system:
[ 1236.062189] 1 lock held by khungtaskd/185:
[ 1236.067582] #0: ffffffffb56cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.079064] 4 locks held by python3/2696:
[ 1236.084358] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.094147] #1: ff110001eb366888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.105108] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.116262] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.126354] 4 locks held by python3/4670:
[ 1236.131649] #0: ff1100012e2993f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.141439] #1: ff1100015dbd1a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.152400] #2: ff110001116530f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.163549] #3: ff110001116b9cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.173640]
[ 1236.176096] =============================================\x0a