[ 786.550927] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 786.553535] nipa-hw-worker: [4/40] Retrying drivers/net:napi_threaded.py
[ 786.696829] kselftest: Running tests in drivers/net
[ 989.730680] INFO: task python3:5475 blocked for more than 122 seconds.
[ 989.738890] Not tainted 7.0.0-rc6-manf-ga8be5b003ef1 #1
[ 989.746138] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.755728] task:python3 state:D stack:25312 pid:5475 tgid:5475 ppid:5474 task_flags:0x400100 flags:0x00080000
[ 989.768932] Call Trace:
[ 989.772471]
[ 989.775618] __schedule+0xad9/0x1490
[ 989.780435] ? io_schedule_timeout+0x130/0x130
[ 989.786220] ? find_held_lock+0x2b/0x80
[ 989.791326] ? __lock_release.isra.0+0x59/0x170
[ 989.797207] schedule+0xd4/0x260
[ 989.801623] schedule_preempt_disabled+0x18/0x30
[ 989.807600] __mutex_lock+0xd76/0x1f20
[ 989.812603] ? threaded_store+0x132/0x220
[ 989.817901] ? ww_mutex_lock+0x160/0x160
[ 989.823099] ? selinux_inode_free_security+0x310/0x310
[ 989.829667] ? cap_capable+0x1ed/0x3f0
[ 989.834675] ? sysfs_file_ops+0x140/0x140
[ 989.839974] ? threaded_store+0x132/0x220
[ 989.845258] threaded_store+0x132/0x220
[ 989.850361] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.855853] ? sysfs_file_ops+0x140/0x140
[ 989.861150] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.866444] ? sysfs_kf_write+0x65/0x160
[ 989.871644] kernfs_fop_write_iter+0x335/0x510
[ 989.877430] ? kernfs_ops+0xf0/0xf0
[ 989.882143] new_sync_write+0x308/0x6f0
[ 989.887248] ? new_sync_read+0x6f0/0x6f0
[ 989.892449] ? lock_acquire.part.0+0xbc/0x260
[ 989.898134] ? ksys_write+0xff/0x200
[ 989.902944] vfs_write+0x62a/0x980
[ 989.907557] ksys_write+0xff/0x200
[ 989.912169] ? __ia32_sys_read+0xc0/0xc0
[ 989.917365] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.922956] ? rcu_is_watching+0x15/0xd0
[ 989.928154] do_syscall_64+0xf3/0x5e0
[ 989.933058] ? exc_page_fault+0x9e/0xb0
[ 989.938159] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.944629] RIP: 0033:0x7ffa0e9c0c5e
[ 989.949438] RSP: 002b:00007ffe2dc78f40 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.958727] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ffa0e9c0c5e
[ 989.967533] RDX: 0000000000000001 RSI: 000055a9a9cbc760 RDI: 0000000000000007
[ 989.976339] RBP: 00007ffe2dc78f50 R08: 0000000000000000 R09: 0000000000000000
[ 989.985146] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffa0e85be80
[ 989.993947] R13: 000055a9a9cbc760 R14: 0000000000000007 R15: 00007ffa0f0c1b98
[ 990.002758]
[ 990.006022] INFO: task python3:5475 is blocked on a mutex likely owned by task python3:3514.
[ 990.016303] task:python3 state:D stack:25312 pid:3514 tgid:3514 ppid:3513 task_flags:0x400100 flags:0x00080802
[ 990.029503] Call Trace:
[ 990.033033]
[ 990.036180] __schedule+0xad9/0x1490
[ 990.040992] ? io_schedule_timeout+0x130/0x130
[ 990.046777] ? find_held_lock+0x2b/0x80
[ 990.051876] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.058055] schedule+0xd4/0x260
[ 990.062473] schedule_timeout+0x103/0x260
[ 990.067770] ? rcu_is_watching+0x15/0xd0
[ 990.072967] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.079339] ? hrtimers_cpu_dying+0x250/0x250
[ 990.085027] ? ww_mutex_lock+0x160/0x160
[ 990.090219] msleep+0x1b/0x30
[ 990.094345] napi_set_threaded+0x376/0x410
[ 990.099738] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.105231] netif_set_threaded+0x254/0x400
[ 990.110721] ? sysfs_file_ops+0x140/0x140
[ 990.116016] threaded_store+0x1bb/0x220
[ 990.121120] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.126611] ? sysfs_file_ops+0x140/0x140
[ 990.131904] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.137199] ? sysfs_kf_write+0x65/0x160
[ 990.142399] kernfs_fop_write_iter+0x335/0x510
[ 990.148184] ? kernfs_ops+0xf0/0xf0
[ 990.152893] new_sync_write+0x308/0x6f0
[ 990.157994] ? new_sync_read+0x6f0/0x6f0
[ 990.163192] ? lock_acquire.part.0+0xbc/0x260
[ 990.168878] ? ksys_write+0xff/0x200
[ 990.173690] vfs_write+0x62a/0x980
[ 990.178305] ksys_write+0xff/0x200
[ 990.182908] ? __ia32_sys_read+0xc0/0xc0
[ 990.188105] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.193693] ? rcu_is_watching+0x15/0xd0
[ 990.198892] do_syscall_64+0xf3/0x5e0
[ 990.203787] ? irq_exit_rcu+0x39/0xf0
[ 990.208693] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.215158] RIP: 0033:0x7f70a2b6cc5e
[ 990.219963] RSP: 002b:00007fff5b9e4250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.229256] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70a2b6cc5e
[ 990.238062] RDX: 0000000000000001 RSI: 000055685e602760 RDI: 0000000000000007
[ 990.246867] RBP: 00007fff5b9e4260 R08: 0000000000000000 R09: 0000000000000000
[ 990.255675] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70a2a07e80
[ 990.264471] R13: 000055685e602760 R14: 0000000000000007 R15: 00007f70a2996480
[ 990.273283]
[ 990.276540] \x0aShowing all locks held in the system:
[ 990.285067] 1 lock held by khungtaskd/185:
[ 990.290460] #0: ffffffffae6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.301940] 4 locks held by python3/3514:
[ 990.307233] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.317021] #1: ff1100016145a688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.327984] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.339140] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.349235] 4 locks held by python3/5475:
[ 990.354531] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.364319] #1: ff110001ad190888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.375278] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.386434] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.396528]
[ 990.398993] =============================================\x0a
[ 1112.611931] INFO: task python3:5475 blocked for more than 245 seconds.
[ 1112.620082] Not tainted 7.0.0-rc6-manf-ga8be5b003ef1 #1
[ 1112.627350] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.636945] task:python3 state:D stack:25312 pid:5475 tgid:5475 ppid:5474 task_flags:0x400100 flags:0x00080000
[ 1112.650153] Call Trace:
[ 1112.653694]
[ 1112.656842] __schedule+0xad9/0x1490
[ 1112.661659] ? io_schedule_timeout+0x130/0x130
[ 1112.667442] ? find_held_lock+0x2b/0x80
[ 1112.672549] ? __lock_release.isra.0+0x59/0x170
[ 1112.678505] schedule+0xd4/0x260
[ 1112.682926] schedule_preempt_disabled+0x18/0x30
[ 1112.688907] __mutex_lock+0xd76/0x1f20
[ 1112.693915] ? threaded_store+0x132/0x220
[ 1112.699217] ? ww_mutex_lock+0x160/0x160
[ 1112.704416] ? selinux_inode_free_security+0x310/0x310
[ 1112.710987] ? cap_capable+0x1ed/0x3f0
[ 1112.715992] ? sysfs_file_ops+0x140/0x140
[ 1112.721288] ? threaded_store+0x132/0x220
[ 1112.726588] threaded_store+0x132/0x220
[ 1112.731693] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.737185] ? sysfs_file_ops+0x140/0x140
[ 1112.742480] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.747777] ? sysfs_kf_write+0x65/0x160
[ 1112.752975] kernfs_fop_write_iter+0x335/0x510
[ 1112.758763] ? kernfs_ops+0xf0/0xf0
[ 1112.763473] new_sync_write+0x308/0x6f0
[ 1112.768577] ? new_sync_read+0x6f0/0x6f0
[ 1112.773768] ? lock_acquire.part.0+0xbc/0x260
[ 1112.779452] ? ksys_write+0xff/0x200
[ 1112.784266] vfs_write+0x62a/0x980
[ 1112.788879] ksys_write+0xff/0x200
[ 1112.793489] ? __ia32_sys_read+0xc0/0xc0
[ 1112.798688] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.804277] ? rcu_is_watching+0x15/0xd0
[ 1112.809479] do_syscall_64+0xf3/0x5e0
[ 1112.814386] ? exc_page_fault+0x9e/0xb0
[ 1112.819485] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.825952] RIP: 0033:0x7ffa0e9c0c5e
[ 1112.830751] RSP: 002b:00007ffe2dc78f40 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.840054] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ffa0e9c0c5e
[ 1112.848861] RDX: 0000000000000001 RSI: 000055a9a9cbc760 RDI: 0000000000000007
[ 1112.857668] RBP: 00007ffe2dc78f50 R08: 0000000000000000 R09: 0000000000000000
[ 1112.866473] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffa0e85be80
[ 1112.875282] R13: 000055a9a9cbc760 R14: 0000000000000007 R15: 00007ffa0f0c1b98
[ 1112.884096]
[ 1112.887423] INFO: task python3:5475 is blocked on a mutex likely owned by task python3:3514.
[ 1112.897686] task:python3 state:D stack:25312 pid:3514 tgid:3514 ppid:3513 task_flags:0x400100 flags:0x00080802
[ 1112.910887] Call Trace:
[ 1112.914427]
[ 1112.917575] __schedule+0xad9/0x1490
[ 1112.922383] ? io_schedule_timeout+0x130/0x130
[ 1112.928164] ? find_held_lock+0x2b/0x80
[ 1112.933264] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.939445] schedule+0xd4/0x260
[ 1112.943861] schedule_timeout+0x103/0x260
[ 1112.949154] ? rcu_is_watching+0x15/0xd0
[ 1112.954352] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.960720] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.966410] ? ww_mutex_lock+0x160/0x160
[ 1112.971607] msleep+0x1b/0x30
[ 1112.975733] napi_set_threaded+0x376/0x410
[ 1112.981132] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.986627] netif_set_threaded+0x254/0x400
[ 1112.992117] ? sysfs_file_ops+0x140/0x140
[ 1112.997413] threaded_store+0x1bb/0x220
[ 1113.002517] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.008009] ? sysfs_file_ops+0x140/0x140
[ 1113.013294] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.018590] ? sysfs_kf_write+0x65/0x160
[ 1113.023787] kernfs_fop_write_iter+0x335/0x510
[ 1113.029570] ? kernfs_ops+0xf0/0xf0
[ 1113.034280] new_sync_write+0x308/0x6f0
[ 1113.039383] ? new_sync_read+0x6f0/0x6f0
[ 1113.044581] ? lock_acquire.part.0+0xbc/0x260
[ 1113.050268] ? ksys_write+0xff/0x200
[ 1113.055080] vfs_write+0x62a/0x980
[ 1113.059695] ksys_write+0xff/0x200
[ 1113.064300] ? __ia32_sys_read+0xc0/0xc0
[ 1113.069498] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.075087] ? rcu_is_watching+0x15/0xd0
[ 1113.080287] do_syscall_64+0xf3/0x5e0
[ 1113.085193] ? irq_exit_rcu+0x39/0xf0
[ 1113.090098] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.096563] RIP: 0033:0x7f70a2b6cc5e
[ 1113.101369] RSP: 002b:00007fff5b9e4250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.110663] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70a2b6cc5e
[ 1113.119472] RDX: 0000000000000001 RSI: 000055685e602760 RDI: 0000000000000007
[ 1113.128278] RBP: 00007fff5b9e4260 R08: 0000000000000000 R09: 0000000000000000
[ 1113.137085] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70a2a07e80
[ 1113.145891] R13: 000055685e602760 R14: 0000000000000007 R15: 00007f70a2996480
[ 1113.154704]
[ 1113.157967] \x0aShowing all locks held in the system:
[ 1113.166504] 1 lock held by khungtaskd/185:
[ 1113.171897] #0: ffffffffae6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.183378] 4 locks held by python3/3514:
[ 1113.188671] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.198461] #1: ff1100016145a688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.209424] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.220580] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.230673] 4 locks held by python3/5475:
[ 1113.235968] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.245763] #1: ff110001ad190888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.256723] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.267882] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.277974]
[ 1113.280445] =============================================\x0a
[ 1235.493172] INFO: task python3:5475 blocked for more than 368 seconds.
[ 1235.501320] Not tainted 7.0.0-rc6-manf-ga8be5b003ef1 #1
[ 1235.508561] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.518139] task:python3 state:D stack:25312 pid:5475 tgid:5475 ppid:5474 task_flags:0x400100 flags:0x00080002
[ 1235.531342] Call Trace:
[ 1235.534882]
[ 1235.538030] __schedule+0xad9/0x1490
[ 1235.542844] ? io_schedule_timeout+0x130/0x130
[ 1235.548629] ? find_held_lock+0x2b/0x80
[ 1235.553731] ? __lock_release.isra.0+0x59/0x170
[ 1235.559617] schedule+0xd4/0x260
[ 1235.564035] schedule_preempt_disabled+0x18/0x30
[ 1235.570014] __mutex_lock+0xd76/0x1f20
[ 1235.575018] ? threaded_store+0x132/0x220
[ 1235.580316] ? ww_mutex_lock+0x160/0x160
[ 1235.585516] ? selinux_inode_free_security+0x310/0x310
[ 1235.592086] ? cap_capable+0x1ed/0x3f0
[ 1235.597090] ? sysfs_file_ops+0x140/0x140
[ 1235.602388] ? threaded_store+0x132/0x220
[ 1235.607683] threaded_store+0x132/0x220
[ 1235.612786] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.618281] ? sysfs_file_ops+0x140/0x140
[ 1235.623577] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.628872] ? sysfs_kf_write+0x65/0x160
[ 1235.634068] kernfs_fop_write_iter+0x335/0x510
[ 1235.639851] ? kernfs_ops+0xf0/0xf0
[ 1235.644559] new_sync_write+0x308/0x6f0
[ 1235.649664] ? new_sync_read+0x6f0/0x6f0
[ 1235.654865] ? lock_acquire.part.0+0xbc/0x260
[ 1235.660542] ? ksys_write+0xff/0x200
[ 1235.665354] vfs_write+0x62a/0x980
[ 1235.669969] ksys_write+0xff/0x200
[ 1235.674574] ? __ia32_sys_read+0xc0/0xc0
[ 1235.679770] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.685358] ? rcu_is_watching+0x15/0xd0
[ 1235.690560] do_syscall_64+0xf3/0x5e0
[ 1235.695466] ? exc_page_fault+0x9e/0xb0
[ 1235.700565] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.707031] RIP: 0033:0x7ffa0e9c0c5e
[ 1235.711838] RSP: 002b:00007ffe2dc78f40 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.721137] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ffa0e9c0c5e
[ 1235.729944] RDX: 0000000000000001 RSI: 000055a9a9cbc760 RDI: 0000000000000007
[ 1235.738753] RBP: 00007ffe2dc78f50 R08: 0000000000000000 R09: 0000000000000000
[ 1235.747558] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffa0e85be80
[ 1235.756363] R13: 000055a9a9cbc760 R14: 0000000000000007 R15: 00007ffa0f0c1b98
[ 1235.765173]
[ 1235.768441] INFO: task python3:5475 is blocked on a mutex likely owned by task python3:3514.
[ 1235.778713] task:python3 state:D stack:25312 pid:3514 tgid:3514 ppid:3513 task_flags:0x400100 flags:0x00080802
[ 1235.791914] Call Trace:
[ 1235.795453]
[ 1235.798602] __schedule+0xad9/0x1490
[ 1235.803411] ? io_schedule_timeout+0x130/0x130
[ 1235.809192] ? find_held_lock+0x2b/0x80
[ 1235.814293] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.820469] schedule+0xd4/0x260
[ 1235.824884] schedule_timeout+0x103/0x260
[ 1235.830182] ? rcu_is_watching+0x15/0xd0
[ 1235.835381] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.841749] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.847438] ? ww_mutex_lock+0x160/0x160
[ 1235.852635] msleep+0x1b/0x30
[ 1235.856757] napi_set_threaded+0x376/0x410
[ 1235.862152] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.867648] netif_set_threaded+0x254/0x400
[ 1235.873138] ? sysfs_file_ops+0x140/0x140
[ 1235.878435] threaded_store+0x1bb/0x220
[ 1235.883538] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.889030] ? sysfs_file_ops+0x140/0x140
[ 1235.894317] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.899610] ? sysfs_kf_write+0x65/0x160
[ 1235.904808] kernfs_fop_write_iter+0x335/0x510
[ 1235.910590] ? kernfs_ops+0xf0/0xf0
[ 1235.915302] new_sync_write+0x308/0x6f0
[ 1235.920404] ? new_sync_read+0x6f0/0x6f0
[ 1235.925602] ? lock_acquire.part.0+0xbc/0x260
[ 1235.931285] ? ksys_write+0xff/0x200
[ 1235.936099] vfs_write+0x62a/0x980
[ 1235.940711] ksys_write+0xff/0x200
[ 1235.945325] ? __ia32_sys_read+0xc0/0xc0
[ 1235.950525] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.956118] ? rcu_is_watching+0x15/0xd0
[ 1235.961320] do_syscall_64+0xf3/0x5e0
[ 1235.966226] ? irq_exit_rcu+0x39/0xf0
[ 1235.971132] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.977599] RIP: 0033:0x7f70a2b6cc5e
[ 1235.982403] RSP: 002b:00007fff5b9e4250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.991697] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70a2b6cc5e
[ 1236.000503] RDX: 0000000000000001 RSI: 000055685e602760 RDI: 0000000000000007
[ 1236.009315] RBP: 00007fff5b9e4260 R08: 0000000000000000 R09: 0000000000000000
[ 1236.018122] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70a2a07e80
[ 1236.026928] R13: 000055685e602760 R14: 0000000000000007 R15: 00007f70a2996480
[ 1236.035738]
[ 1236.039004] \x0aShowing all locks held in the system:
[ 1236.047544] 1 lock held by khungtaskd/185:
[ 1236.052937] #0: ffffffffae6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.064416] 4 locks held by python3/3514:
[ 1236.069711] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.079500] #1: ff1100016145a688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.090463] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.101619] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.111710] 4 locks held by python3/5475:
[ 1236.116995] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.126783] #1: ff110001ad190888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.137742] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.148898] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.158989]
[ 1236.161455] =============================================\x0a
[ 1243.685196] kworker/u130:8 (850) used greatest stack depth: 21688 bytes left
[ 1358.374438] INFO: task python3:5475 blocked for more than 491 seconds.
[ 1358.382603] Not tainted 7.0.0-rc6-manf-ga8be5b003ef1 #1
[ 1358.389849] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.399437] task:python3 state:D stack:25312 pid:5475 tgid:5475 ppid:5474 task_flags:0x400100 flags:0x00080002
[ 1358.412641] Call Trace:
[ 1358.416183]
[ 1358.419336] __schedule+0xad9/0x1490
[ 1358.424156] ? io_schedule_timeout+0x130/0x130
[ 1358.429940] ? find_held_lock+0x2b/0x80
[ 1358.435049] ? __lock_release.isra.0+0x59/0x170
[ 1358.440945] schedule+0xd4/0x260
[ 1358.445369] schedule_preempt_disabled+0x18/0x30
[ 1358.451351] __mutex_lock+0xd76/0x1f20
[ 1358.456360] ? threaded_store+0x132/0x220
[ 1358.461661] ? ww_mutex_lock+0x160/0x160
[ 1358.466928] ? selinux_inode_free_security+0x310/0x310
[ 1358.473492] ? cap_capable+0x1ed/0x3f0
[ 1358.478499] ? sysfs_file_ops+0x140/0x140
[ 1358.483796] ? threaded_store+0x132/0x220
[ 1358.489093] threaded_store+0x132/0x220
[ 1358.494194] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.499687] ? sysfs_file_ops+0x140/0x140
[ 1358.504983] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.510280] ? sysfs_kf_write+0x65/0x160
[ 1358.515471] kernfs_fop_write_iter+0x335/0x510
[ 1358.521259] ? kernfs_ops+0xf0/0xf0
[ 1358.525970] new_sync_write+0x308/0x6f0
[ 1358.531077] ? new_sync_read+0x6f0/0x6f0
[ 1358.536275] ? lock_acquire.part.0+0xbc/0x260
[ 1358.541963] ? ksys_write+0xff/0x200
[ 1358.546766] vfs_write+0x62a/0x980
[ 1358.551383] ksys_write+0xff/0x200
[ 1358.555999] ? __ia32_sys_read+0xc0/0xc0
[ 1358.561198] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.566853] ? rcu_is_watching+0x15/0xd0
[ 1358.572054] do_syscall_64+0xf3/0x5e0
[ 1358.576963] ? exc_page_fault+0x9e/0xb0
[ 1358.582067] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.588604] RIP: 0033:0x7ffa0e9c0c5e
[ 1358.593415] RSP: 002b:00007ffe2dc78f40 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.602713] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ffa0e9c0c5e
[ 1358.611523] RDX: 0000000000000001 RSI: 000055a9a9cbc760 RDI: 0000000000000007
[ 1358.620333] RBP: 00007ffe2dc78f50 R08: 0000000000000000 R09: 0000000000000000
[ 1358.629142] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffa0e85be80
[ 1358.637949] R13: 000055a9a9cbc760 R14: 0000000000000007 R15: 00007ffa0f0c1b98
[ 1358.646763]
[ 1358.650051] INFO: task python3:5475 is blocked on a mutex likely owned by task python3:3514.
[ 1358.660325] task:python3 state:D stack:25312 pid:3514 tgid:3514 ppid:3513 task_flags:0x400100 flags:0x00080802
[ 1358.673529] Call Trace:
[ 1358.677067]
[ 1358.680218] __schedule+0xad9/0x1490
[ 1358.685029] ? io_schedule_timeout+0x130/0x130
[ 1358.690813] ? find_held_lock+0x2b/0x80
[ 1358.695907] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.702080] schedule+0xd4/0x260
[ 1358.706498] schedule_timeout+0x103/0x260
[ 1358.711794] ? rcu_is_watching+0x15/0xd0
[ 1358.716993] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.723355] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.729037] ? ww_mutex_lock+0x160/0x160
[ 1358.734237] msleep+0x1b/0x30
[ 1358.738363] napi_set_threaded+0x376/0x410
[ 1358.743762] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.749262] netif_set_threaded+0x254/0x400
[ 1358.754757] ? sysfs_file_ops+0x140/0x140
[ 1358.760055] threaded_store+0x1bb/0x220
[ 1358.765147] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.770638] ? sysfs_file_ops+0x140/0x140
[ 1358.775935] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.781230] ? sysfs_kf_write+0x65/0x160
[ 1358.786499] kernfs_fop_write_iter+0x335/0x510
[ 1358.792348] ? kernfs_ops+0xf0/0xf0
[ 1358.797058] new_sync_write+0x308/0x6f0
[ 1358.802161] ? new_sync_read+0x6f0/0x6f0
[ 1358.807356] ? lock_acquire.part.0+0xbc/0x260
[ 1358.813046] ? ksys_write+0xff/0x200
[ 1358.817856] vfs_write+0x62a/0x980
[ 1358.822471] ksys_write+0xff/0x200
[ 1358.827086] ? __ia32_sys_read+0xc0/0xc0
[ 1358.832282] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.837871] ? rcu_is_watching+0x15/0xd0
[ 1358.843072] do_syscall_64+0xf3/0x5e0
[ 1358.847977] ? irq_exit_rcu+0x39/0xf0
[ 1358.852887] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.859356] RIP: 0033:0x7f70a2b6cc5e
[ 1358.864238] RSP: 002b:00007fff5b9e4250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.873538] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70a2b6cc5e
[ 1358.882347] RDX: 0000000000000001 RSI: 000055685e602760 RDI: 0000000000000007
[ 1358.891157] RBP: 00007fff5b9e4260 R08: 0000000000000000 R09: 0000000000000000
[ 1358.899963] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70a2a07e80
[ 1358.908771] R13: 000055685e602760 R14: 0000000000000007 R15: 00007f70a2996480
[ 1358.917583]
[ 1358.920853] \x0aShowing all locks held in the system:
[ 1358.929394] 1 lock held by khungtaskd/185:
[ 1358.934785] #0: ffffffffae6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.946263] 1 lock held by systemd-journal/803:
[ 1358.952143] #0: ff1100180e6b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1358.962041] 4 locks held by python3/3514:
[ 1358.967338] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.977131] #1: ff1100016145a688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.988092] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.999250] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.009350] 4 locks held by python3/5475:
[ 1359.014647] #0: ff1100012e1a43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.024440] #1: ff110001ad190888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.035404] #2: ff11000120ca10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.046563] #3: ff11000120c59d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.056656]
[ 1359.059190] =============================================\x0a