[ 761.904004] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 761.906438] nipa-hw-worker: [5/40] Retrying drivers/net:napi_threaded.py
[ 762.040427] kselftest: Running tests in drivers/net
[ 768.523349] kworker/u130:3 (533) used greatest stack depth: 21688 bytes left
[ 989.706892] INFO: task python3:5265 blocked for more than 122 seconds.
[ 989.715114] Not tainted 7.0.0-rc5-broq-g1c6f2b3c518a #1
[ 989.722362] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.731951] task:python3 state:D stack:25312 pid:5265 tgid:5265 ppid:5264 task_flags:0x400100 flags:0x00080000
[ 989.745149] Call Trace:
[ 989.748687]
[ 989.751835] __schedule+0xad9/0x1490
[ 989.756651] ? io_schedule_timeout+0x130/0x130
[ 989.762435] ? find_held_lock+0x2b/0x80
[ 989.767540] ? __lock_release.isra.0+0x59/0x170
[ 989.773415] schedule+0xd4/0x260
[ 989.777834] schedule_preempt_disabled+0x18/0x30
[ 989.783814] __mutex_lock+0xd76/0x1f20
[ 989.788812] ? threaded_store+0x132/0x220
[ 989.794109] ? ww_mutex_lock+0x160/0x160
[ 989.799306] ? selinux_inode_free_security+0x310/0x310
[ 989.805875] ? cap_capable+0x1ed/0x3f0
[ 989.810881] ? sysfs_file_ops+0x140/0x140
[ 989.816179] ? threaded_store+0x132/0x220
[ 989.821472] threaded_store+0x132/0x220
[ 989.826576] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.832067] ? sysfs_file_ops+0x140/0x140
[ 989.837364] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.842657] ? sysfs_kf_write+0x65/0x160
[ 989.847857] kernfs_fop_write_iter+0x335/0x510
[ 989.853633] ? kernfs_ops+0xf0/0xf0
[ 989.858345] new_sync_write+0x308/0x6f0
[ 989.863438] ? new_sync_read+0x6f0/0x6f0
[ 989.868639] ? lock_acquire.part.0+0xbc/0x260
[ 989.874324] ? ksys_write+0xff/0x200
[ 989.879134] vfs_write+0x62a/0x980
[ 989.883739] ksys_write+0xff/0x200
[ 989.888351] ? __ia32_sys_read+0xc0/0xc0
[ 989.893546] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.899133] ? rcu_is_watching+0x15/0xd0
[ 989.904334] do_syscall_64+0xf3/0x5e0
[ 989.909239] ? irq_exit_rcu+0x39/0xf0
[ 989.914147] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.920616] RIP: 0033:0x7fe6024ddc5e
[ 989.925425] RSP: 002b:00007ffcae88efb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.934728] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe6024ddc5e
[ 989.943533] RDX: 0000000000000001 RSI: 000056325d0ce760 RDI: 0000000000000007
[ 989.952342] RBP: 00007ffcae88efc0 R08: 0000000000000000 R09: 0000000000000000
[ 989.961150] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe602378e80
[ 989.969956] R13: 000056325d0ce760 R14: 0000000000000007 R15: 00007fe602bdeb98
[ 989.978769]
[ 989.982071] INFO: task python3:5265 is blocked on a mutex likely owned by task python3:3275.
[ 989.992342] task:python3 state:D stack:25312 pid:3275 tgid:3275 ppid:3274 task_flags:0x400100 flags:0x00080802
[ 990.005544] Call Trace:
[ 990.009081]
[ 990.012232] __schedule+0xad9/0x1490
[ 990.017034] ? io_schedule_timeout+0x130/0x130
[ 990.022817] ? find_held_lock+0x2b/0x80
[ 990.027920] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.034098] schedule+0xd4/0x260
[ 990.038516] schedule_timeout+0x103/0x260
[ 990.043812] ? rcu_is_watching+0x15/0xd0
[ 990.049008] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.055379] ? hrtimers_cpu_dying+0x250/0x250
[ 990.061067] ? ww_mutex_lock+0x160/0x160
[ 990.066258] msleep+0x1b/0x30
[ 990.070382] napi_set_threaded+0x376/0x410
[ 990.075775] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.081268] netif_set_threaded+0x254/0x400
[ 990.086752] ? sysfs_file_ops+0x140/0x140
[ 990.092047] threaded_store+0x1bb/0x220
[ 990.097151] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.102642] ? sysfs_file_ops+0x140/0x140
[ 990.107938] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.113233] ? sysfs_kf_write+0x65/0x160
[ 990.118434] kernfs_fop_write_iter+0x335/0x510
[ 990.124219] ? kernfs_ops+0xf0/0xf0
[ 990.128922] new_sync_write+0x308/0x6f0
[ 990.134024] ? new_sync_read+0x6f0/0x6f0
[ 990.139221] ? lock_acquire.part.0+0xbc/0x260
[ 990.144907] ? ksys_write+0xff/0x200
[ 990.149719] vfs_write+0x62a/0x980
[ 990.154338] ksys_write+0xff/0x200
[ 990.158951] ? __ia32_sys_read+0xc0/0xc0
[ 990.164149] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.169737] ? rcu_is_watching+0x15/0xd0
[ 990.174936] do_syscall_64+0xf3/0x5e0
[ 990.179831] ? exc_page_fault+0x9e/0xb0
[ 990.184931] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.191395] RIP: 0033:0x7f599ca10c5e
[ 990.196199] RSP: 002b:00007ffd339c70f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.205497] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f599ca10c5e
[ 990.214303] RDX: 0000000000000001 RSI: 00005558422cb760 RDI: 0000000000000007
[ 990.223107] RBP: 00007ffd339c7100 R08: 0000000000000000 R09: 0000000000000000
[ 990.231914] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f599c8abe80
[ 990.240719] R13: 00005558422cb760 R14: 0000000000000007 R15: 00007f599c83a480
[ 990.249534]
[ 990.252790] \x0aShowing all locks held in the system:
[ 990.261327] 1 lock held by khungtaskd/185:
[ 990.266719] #0: ffffffff9f4ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.278203] 4 locks held by python3/3275:
[ 990.283495] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.293284] #1: ff1100013dfb7a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.304245] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.315395] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.325492] 4 locks held by python3/5265:
[ 990.330787] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.340577] #1: ff11000187d4e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.351538] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.362686] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.372777]
[ 990.375240] =============================================\x0a
[ 1112.589146] INFO: task python3:5265 blocked for more than 245 seconds.
[ 1112.597294] Not tainted 7.0.0-rc5-broq-g1c6f2b3c518a #1
[ 1112.604544] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.614137] task:python3 state:D stack:25312 pid:5265 tgid:5265 ppid:5264 task_flags:0x400100 flags:0x00080000
[ 1112.627346] Call Trace:
[ 1112.630887]
[ 1112.634035] __schedule+0xad9/0x1490
[ 1112.638855] ? io_schedule_timeout+0x130/0x130
[ 1112.644642] ? find_held_lock+0x2b/0x80
[ 1112.649749] ? __lock_release.isra.0+0x59/0x170
[ 1112.655635] schedule+0xd4/0x260
[ 1112.660053] schedule_preempt_disabled+0x18/0x30
[ 1112.666031] __mutex_lock+0xd76/0x1f20
[ 1112.671037] ? threaded_store+0x132/0x220
[ 1112.676336] ? ww_mutex_lock+0x160/0x160
[ 1112.681536] ? selinux_inode_free_security+0x310/0x310
[ 1112.688106] ? cap_capable+0x1ed/0x3f0
[ 1112.693115] ? sysfs_file_ops+0x140/0x140
[ 1112.698418] ? threaded_store+0x132/0x220
[ 1112.703713] threaded_store+0x132/0x220
[ 1112.708814] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.714306] ? sysfs_file_ops+0x140/0x140
[ 1112.719602] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.724898] ? sysfs_kf_write+0x65/0x160
[ 1112.730101] kernfs_fop_write_iter+0x335/0x510
[ 1112.735888] ? kernfs_ops+0xf0/0xf0
[ 1112.740600] new_sync_write+0x308/0x6f0
[ 1112.745704] ? new_sync_read+0x6f0/0x6f0
[ 1112.750905] ? lock_acquire.part.0+0xbc/0x260
[ 1112.756591] ? ksys_write+0xff/0x200
[ 1112.761402] vfs_write+0x62a/0x980
[ 1112.766018] ksys_write+0xff/0x200
[ 1112.770632] ? __ia32_sys_read+0xc0/0xc0
[ 1112.775829] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.781420] ? rcu_is_watching+0x15/0xd0
[ 1112.786622] do_syscall_64+0xf3/0x5e0
[ 1112.791527] ? irq_exit_rcu+0x39/0xf0
[ 1112.796437] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.802906] RIP: 0033:0x7fe6024ddc5e
[ 1112.807716] RSP: 002b:00007ffcae88efb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.817012] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe6024ddc5e
[ 1112.825824] RDX: 0000000000000001 RSI: 000056325d0ce760 RDI: 0000000000000007
[ 1112.834632] RBP: 00007ffcae88efc0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.843432] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe602378e80
[ 1112.852243] R13: 000056325d0ce760 R14: 0000000000000007 R15: 00007fe602bdeb98
[ 1112.861058]
[ 1112.864353] INFO: task python3:5265 is blocked on a mutex likely owned by task python3:3275.
[ 1112.874628] task:python3 state:D stack:25312 pid:3275 tgid:3275 ppid:3274 task_flags:0x400100 flags:0x00080802
[ 1112.887831] Call Trace:
[ 1112.891368]
[ 1112.894520] __schedule+0xad9/0x1490
[ 1112.899332] ? io_schedule_timeout+0x130/0x130
[ 1112.905117] ? find_held_lock+0x2b/0x80
[ 1112.910213] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.916393] schedule+0xd4/0x260
[ 1112.920812] schedule_timeout+0x103/0x260
[ 1112.926109] ? rcu_is_watching+0x15/0xd0
[ 1112.931310] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.937680] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.943373] ? ww_mutex_lock+0x160/0x160
[ 1112.948572] msleep+0x1b/0x30
[ 1112.952698] napi_set_threaded+0x376/0x410
[ 1112.958095] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.963592] netif_set_threaded+0x254/0x400
[ 1112.969085] ? sysfs_file_ops+0x140/0x140
[ 1112.974381] threaded_store+0x1bb/0x220
[ 1112.979485] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.984980] ? sysfs_file_ops+0x140/0x140
[ 1112.990276] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.995572] ? sysfs_kf_write+0x65/0x160
[ 1113.000772] kernfs_fop_write_iter+0x335/0x510
[ 1113.006557] ? kernfs_ops+0xf0/0xf0
[ 1113.011270] new_sync_write+0x308/0x6f0
[ 1113.016366] ? new_sync_read+0x6f0/0x6f0
[ 1113.021566] ? lock_acquire.part.0+0xbc/0x260
[ 1113.027244] ? ksys_write+0xff/0x200
[ 1113.032058] vfs_write+0x62a/0x980
[ 1113.036672] ksys_write+0xff/0x200
[ 1113.041289] ? __ia32_sys_read+0xc0/0xc0
[ 1113.046492] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.052083] ? rcu_is_watching+0x15/0xd0
[ 1113.057282] do_syscall_64+0xf3/0x5e0
[ 1113.062189] ? exc_page_fault+0x9e/0xb0
[ 1113.067291] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.073759] RIP: 0033:0x7f599ca10c5e
[ 1113.078567] RSP: 002b:00007ffd339c70f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.087863] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f599ca10c5e
[ 1113.096663] RDX: 0000000000000001 RSI: 00005558422cb760 RDI: 0000000000000007
[ 1113.105471] RBP: 00007ffd339c7100 R08: 0000000000000000 R09: 0000000000000000
[ 1113.114281] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f599c8abe80
[ 1113.123090] R13: 00005558422cb760 R14: 0000000000000007 R15: 00007f599c83a480
[ 1113.131905]
[ 1113.135170] \x0aShowing all locks held in the system:
[ 1113.143708] 1 lock held by khungtaskd/185:
[ 1113.149099] #0: ffffffff9f4ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.160571] 2 locks held by systemd-journal/801:
[ 1113.166557] 4 locks held by python3/3275:
[ 1113.171851] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.181645] #1: ff1100013dfb7a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.192608] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.203767] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.213865] 4 locks held by python3/5265:
[ 1113.219162] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.228951] #1: ff11000187d4e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.239915] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.251073] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.261166]
[ 1113.263634] =============================================\x0a
[ 1235.470437] INFO: task python3:5265 blocked for more than 368 seconds.
[ 1235.478587] Not tainted 7.0.0-rc5-broq-g1c6f2b3c518a #1
[ 1235.485837] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.495425] task:python3 state:D stack:25312 pid:5265 tgid:5265 ppid:5264 task_flags:0x400100 flags:0x00080002
[ 1235.508632] Call Trace:
[ 1235.512172]
[ 1235.515324] __schedule+0xad9/0x1490
[ 1235.520137] ? io_schedule_timeout+0x130/0x130
[ 1235.525921] ? find_held_lock+0x2b/0x80
[ 1235.531028] ? __lock_release.isra.0+0x59/0x170
[ 1235.536912] schedule+0xd4/0x260
[ 1235.541328] schedule_preempt_disabled+0x18/0x30
[ 1235.547305] __mutex_lock+0xd76/0x1f20
[ 1235.552308] ? threaded_store+0x132/0x220
[ 1235.557607] ? ww_mutex_lock+0x160/0x160
[ 1235.562805] ? selinux_inode_free_security+0x310/0x310
[ 1235.569364] ? cap_capable+0x1ed/0x3f0
[ 1235.574371] ? sysfs_file_ops+0x140/0x140
[ 1235.579667] ? threaded_store+0x132/0x220
[ 1235.584962] threaded_store+0x132/0x220
[ 1235.590067] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.595558] ? sysfs_file_ops+0x140/0x140
[ 1235.600856] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.606151] ? sysfs_kf_write+0x65/0x160
[ 1235.611350] kernfs_fop_write_iter+0x335/0x510
[ 1235.617133] ? kernfs_ops+0xf0/0xf0
[ 1235.621845] new_sync_write+0x308/0x6f0
[ 1235.626938] ? new_sync_read+0x6f0/0x6f0
[ 1235.632138] ? lock_acquire.part.0+0xbc/0x260
[ 1235.637825] ? ksys_write+0xff/0x200
[ 1235.642636] vfs_write+0x62a/0x980
[ 1235.647251] ksys_write+0xff/0x200
[ 1235.651864] ? __ia32_sys_read+0xc0/0xc0
[ 1235.657061] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.662648] ? rcu_is_watching+0x15/0xd0
[ 1235.667849] do_syscall_64+0xf3/0x5e0
[ 1235.672754] ? irq_exit_rcu+0x39/0xf0
[ 1235.677663] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.684123] RIP: 0033:0x7fe6024ddc5e
[ 1235.688933] RSP: 002b:00007ffcae88efb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.698232] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe6024ddc5e
[ 1235.707037] RDX: 0000000000000001 RSI: 000056325d0ce760 RDI: 0000000000000007
[ 1235.715845] RBP: 00007ffcae88efc0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.724642] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe602378e80
[ 1235.733450] R13: 000056325d0ce760 R14: 0000000000000007 R15: 00007fe602bdeb98
[ 1235.742257]
[ 1235.745531] INFO: task python3:5265 is blocked on a mutex likely owned by task python3:3275.
[ 1235.755802] task:python3 state:D stack:25312 pid:3275 tgid:3275 ppid:3274 task_flags:0x400100 flags:0x00080802
[ 1235.769004] Call Trace:
[ 1235.772542]
[ 1235.775690] __schedule+0xad9/0x1490
[ 1235.780498] ? io_schedule_timeout+0x130/0x130
[ 1235.786280] ? find_held_lock+0x2b/0x80
[ 1235.791381] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.797553] schedule+0xd4/0x260
[ 1235.801972] schedule_timeout+0x103/0x260
[ 1235.807260] ? rcu_is_watching+0x15/0xd0
[ 1235.812459] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.818826] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.824516] ? ww_mutex_lock+0x160/0x160
[ 1235.829712] msleep+0x1b/0x30
[ 1235.833835] napi_set_threaded+0x376/0x410
[ 1235.839229] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.844723] netif_set_threaded+0x254/0x400
[ 1235.850214] ? sysfs_file_ops+0x140/0x140
[ 1235.855510] threaded_store+0x1bb/0x220
[ 1235.860610] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.866102] ? sysfs_file_ops+0x140/0x140
[ 1235.871395] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.876693] ? sysfs_kf_write+0x65/0x160
[ 1235.881890] kernfs_fop_write_iter+0x335/0x510
[ 1235.887672] ? kernfs_ops+0xf0/0xf0
[ 1235.892382] new_sync_write+0x308/0x6f0
[ 1235.897485] ? new_sync_read+0x6f0/0x6f0
[ 1235.902683] ? lock_acquire.part.0+0xbc/0x260
[ 1235.908366] ? ksys_write+0xff/0x200
[ 1235.913179] vfs_write+0x62a/0x980
[ 1235.917794] ksys_write+0xff/0x200
[ 1235.922408] ? __ia32_sys_read+0xc0/0xc0
[ 1235.927611] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.933199] ? rcu_is_watching+0x15/0xd0
[ 1235.938399] do_syscall_64+0xf3/0x5e0
[ 1235.943295] ? exc_page_fault+0x9e/0xb0
[ 1235.948395] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.954861] RIP: 0033:0x7f599ca10c5e
[ 1235.959666] RSP: 002b:00007ffd339c70f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.968961] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f599ca10c5e
[ 1235.977768] RDX: 0000000000000001 RSI: 00005558422cb760 RDI: 0000000000000007
[ 1235.986575] RBP: 00007ffd339c7100 R08: 0000000000000000 R09: 0000000000000000
[ 1235.995373] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f599c8abe80
[ 1236.004178] R13: 00005558422cb760 R14: 0000000000000007 R15: 00007f599c83a480
[ 1236.012990]
[ 1236.016259] \x0aShowing all locks held in the system:
[ 1236.024798] 1 lock held by khungtaskd/185:
[ 1236.030192] #0: ffffffff9f4ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.041671] 4 locks held by python3/3275:
[ 1236.046964] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.056754] #1: ff1100013dfb7a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.067717] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.078873] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.088969] 4 locks held by python3/5265:
[ 1236.094265] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.104062] #1: ff11000187d4e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.115020] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.126178] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.136277]
[ 1236.138741] =============================================\x0a
[ 1358.351723] INFO: task python3:5265 blocked for more than 491 seconds.
[ 1358.360481] Not tainted 7.0.0-rc5-broq-g1c6f2b3c518a #1
[ 1358.367742] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.377333] task:python3 state:D stack:25312 pid:5265 tgid:5265 ppid:5264 task_flags:0x400100 flags:0x00080002
[ 1358.390537] Call Trace:
[ 1358.394077]
[ 1358.397230] __schedule+0xad9/0x1490
[ 1358.402045] ? io_schedule_timeout+0x130/0x130
[ 1358.407828] ? find_held_lock+0x2b/0x80
[ 1358.412927] ? __lock_release.isra.0+0x59/0x170
[ 1358.418809] schedule+0xd4/0x260
[ 1358.423225] schedule_preempt_disabled+0x18/0x30
[ 1358.429204] __mutex_lock+0xd76/0x1f20
[ 1358.434210] ? threaded_store+0x132/0x220
[ 1358.439511] ? ww_mutex_lock+0x160/0x160
[ 1358.444708] ? selinux_inode_free_security+0x310/0x310
[ 1358.451279] ? cap_capable+0x1ed/0x3f0
[ 1358.456287] ? sysfs_file_ops+0x140/0x140
[ 1358.461585] ? threaded_store+0x132/0x220
[ 1358.466882] threaded_store+0x132/0x220
[ 1358.471987] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.477478] ? sysfs_file_ops+0x140/0x140
[ 1358.482773] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.488070] ? sysfs_kf_write+0x65/0x160
[ 1358.493268] kernfs_fop_write_iter+0x335/0x510
[ 1358.499052] ? kernfs_ops+0xf0/0xf0
[ 1358.503762] new_sync_write+0x308/0x6f0
[ 1358.508865] ? new_sync_read+0x6f0/0x6f0
[ 1358.514056] ? lock_acquire.part.0+0xbc/0x260
[ 1358.519743] ? ksys_write+0xff/0x200
[ 1358.524557] vfs_write+0x62a/0x980
[ 1358.529170] ksys_write+0xff/0x200
[ 1358.533782] ? __ia32_sys_read+0xc0/0xc0
[ 1358.538980] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.544570] ? rcu_is_watching+0x15/0xd0
[ 1358.549768] do_syscall_64+0xf3/0x5e0
[ 1358.554675] ? irq_exit_rcu+0x39/0xf0
[ 1358.559582] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.566049] RIP: 0033:0x7fe6024ddc5e
[ 1358.570850] RSP: 002b:00007ffcae88efb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.580138] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe6024ddc5e
[ 1358.588940] RDX: 0000000000000001 RSI: 000056325d0ce760 RDI: 0000000000000007
[ 1358.597747] RBP: 00007ffcae88efc0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.606558] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe602378e80
[ 1358.615367] R13: 000056325d0ce760 R14: 0000000000000007 R15: 00007fe602bdeb98
[ 1358.624177]
[ 1358.627524] INFO: task python3:5265 is blocked on a mutex likely owned by task python3:3275.
[ 1358.637795] task:python3 state:D stack:25312 pid:3275 tgid:3275 ppid:3274 task_flags:0x400100 flags:0x00080802
[ 1358.651012] Call Trace:
[ 1358.654575]
[ 1358.657729] __schedule+0xad9/0x1490
[ 1358.662625] ? io_schedule_timeout+0x130/0x130
[ 1358.668409] ? find_held_lock+0x2b/0x80
[ 1358.673518] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.679696] schedule+0xd4/0x260
[ 1358.684183] schedule_timeout+0x103/0x260
[ 1358.689480] ? rcu_is_watching+0x15/0xd0
[ 1358.694681] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.701055] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.706747] ? ww_mutex_lock+0x160/0x160
[ 1358.711948] msleep+0x1b/0x30
[ 1358.716077] napi_set_threaded+0x376/0x410
[ 1358.721478] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.726975] netif_set_threaded+0x254/0x400
[ 1358.732468] ? sysfs_file_ops+0x140/0x140
[ 1358.737767] threaded_store+0x1bb/0x220
[ 1358.742871] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.748364] ? sysfs_file_ops+0x140/0x140
[ 1358.753651] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.758951] ? sysfs_kf_write+0x65/0x160
[ 1358.764152] kernfs_fop_write_iter+0x335/0x510
[ 1358.769942] ? kernfs_ops+0xf0/0xf0
[ 1358.774654] new_sync_write+0x308/0x6f0
[ 1358.779760] ? new_sync_read+0x6f0/0x6f0
[ 1358.784963] ? lock_acquire.part.0+0xbc/0x260
[ 1358.790649] ? ksys_write+0xff/0x200
[ 1358.795461] vfs_write+0x62a/0x980
[ 1358.800077] ksys_write+0xff/0x200
[ 1358.804693] ? __ia32_sys_read+0xc0/0xc0
[ 1358.809893] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.815483] ? rcu_is_watching+0x15/0xd0
[ 1358.820684] do_syscall_64+0xf3/0x5e0
[ 1358.825593] ? exc_page_fault+0x9e/0xb0
[ 1358.830697] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.837167] RIP: 0033:0x7f599ca10c5e
[ 1358.841978] RSP: 002b:00007ffd339c70f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.851350] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f599ca10c5e
[ 1358.860161] RDX: 0000000000000001 RSI: 00005558422cb760 RDI: 0000000000000007
[ 1358.868973] RBP: 00007ffd339c7100 R08: 0000000000000000 R09: 0000000000000000
[ 1358.877781] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f599c8abe80
[ 1358.886592] R13: 00005558422cb760 R14: 0000000000000007 R15: 00007f599c83a480
[ 1358.895410]
[ 1358.898683] \x0aShowing all locks held in the system:
[ 1358.907245] 1 lock held by khungtaskd/185:
[ 1358.912642] #0: ffffffff9f4ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.924143] 5 locks held by systemd-journal/801:
[ 1358.930122] #0: ff1100180e1b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1358.940013] #1: ff1100019f1d0fc0 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.950783] #2: ff110001a2b942e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1358.962234] #3: ff1100017dc551e8 (&xa->xa_lock#5){-.-.}-{3:3}, at: __folio_mark_dirty+0x91/0x270
[ 1358.973007] #4: ffffffff9f4ce120 (rcu_read_lock){....}-{1:3}, at: lruvec_stat_mod_folio+0x7c/0x430
[ 1358.983994] 4 locks held by python3/3275:
[ 1358.989290] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.999081] #1: ff1100013dfb7a88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.010051] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.021210] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.031399] 4 locks held by python3/5265:
[ 1359.036696] #0: ff1100012e3013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.046488] #1: ff11000187d4e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.057450] #2: ff110001210bf0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.068601] #3: ff11000121129d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.078694]
[ 1359.081163] =============================================\x0a