[ 762.182097] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 762.186181] nipa-hw-worker: [4/39] Retrying drivers/net:napi_threaded.py
[ 762.350530] kselftest: Running tests in drivers/net
[ 989.743931] INFO: task python3:5051 blocked for more than 122 seconds.
[ 989.752155] Not tainted 7.0.0-rc4-bnjr-g5d9b6383bcf3 #1
[ 989.759403] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.768991] task:python3 state:D stack:25312 pid:5051 tgid:5051 ppid:5050 task_flags:0x400100 flags:0x00080000
[ 989.782196] Call Trace:
[ 989.785734]
[ 989.788885] __schedule+0xad9/0x1490
[ 989.793699] ? io_schedule_timeout+0x130/0x130
[ 989.799473] ? find_held_lock+0x2b/0x80
[ 989.804567] ? __lock_release.isra.0+0x59/0x170
[ 989.810454] schedule+0xd4/0x260
[ 989.814871] schedule_preempt_disabled+0x18/0x30
[ 989.820850] __mutex_lock+0xd76/0x1f20
[ 989.825855] ? threaded_store+0x132/0x220
[ 989.831154] ? ww_mutex_lock+0x160/0x160
[ 989.836351] ? selinux_inode_free_security+0x310/0x310
[ 989.842914] ? cap_capable+0x1ed/0x3f0
[ 989.847921] ? sysfs_file_ops+0x140/0x140
[ 989.853221] ? threaded_store+0x132/0x220
[ 989.858505] threaded_store+0x132/0x220
[ 989.863605] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.869096] ? sysfs_file_ops+0x140/0x140
[ 989.874392] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.879689] ? sysfs_kf_write+0x65/0x160
[ 989.884889] kernfs_fop_write_iter+0x335/0x510
[ 989.890673] ? kernfs_ops+0xf0/0xf0
[ 989.895383] new_sync_write+0x308/0x6f0
[ 989.900484] ? new_sync_read+0x6f0/0x6f0
[ 989.905682] ? lock_acquire.part.0+0xbc/0x260
[ 989.911365] ? ksys_write+0xff/0x200
[ 989.916178] vfs_write+0x62a/0x980
[ 989.920791] ksys_write+0xff/0x200
[ 989.925404] ? __ia32_sys_read+0xc0/0xc0
[ 989.930598] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.936188] ? rcu_is_watching+0x15/0xd0
[ 989.941388] do_syscall_64+0xf3/0x5e0
[ 989.946291] ? exc_page_fault+0x9e/0xb0
[ 989.951392] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.957861] RIP: 0033:0x7fce6b948c5e
[ 989.962670] RSP: 002b:00007ffeff462170 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.971966] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce6b948c5e
[ 989.980773] RDX: 0000000000000001 RSI: 000055ee29a7a110 RDI: 0000000000000007
[ 989.989573] RBP: 00007ffeff462180 R08: 0000000000000000 R09: 0000000000000000
[ 989.998382] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce6b7e3e80
[ 990.007190] R13: 000055ee29a7a110 R14: 0000000000000007 R15: 00007fce6c049b98
[ 990.016006]
[ 990.019284] INFO: task python3:5051 is blocked on a mutex likely owned by task python3:3118.
[ 990.029563] task:python3 state:D stack:24512 pid:3118 tgid:3118 ppid:3117 task_flags:0x400100 flags:0x00080802
[ 990.042767] Call Trace:
[ 990.046303]
[ 990.049451] __schedule+0xad9/0x1490
[ 990.054262] ? io_schedule_timeout+0x130/0x130
[ 990.060044] ? find_held_lock+0x2b/0x80
[ 990.065146] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.071324] schedule+0xd4/0x260
[ 990.075740] schedule_timeout+0x103/0x260
[ 990.081036] ? rcu_is_watching+0x15/0xd0
[ 990.086234] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.092605] ? hrtimers_cpu_dying+0x250/0x250
[ 990.098295] ? ww_mutex_lock+0x160/0x160
[ 990.103494] msleep+0x1b/0x30
[ 990.107619] napi_set_threaded+0x376/0x410
[ 990.113014] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.118507] netif_set_threaded+0x254/0x400
[ 990.123990] ? sysfs_file_ops+0x140/0x140
[ 990.129287] threaded_store+0x1bb/0x220
[ 990.134388] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.139881] ? sysfs_file_ops+0x140/0x140
[ 990.145177] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.150470] ? sysfs_kf_write+0x65/0x160
[ 990.155670] kernfs_fop_write_iter+0x335/0x510
[ 990.161453] ? kernfs_ops+0xf0/0xf0
[ 990.166165] new_sync_write+0x308/0x6f0
[ 990.171265] ? new_sync_read+0x6f0/0x6f0
[ 990.176465] ? lock_acquire.part.0+0xbc/0x260
[ 990.182149] ? ksys_write+0xff/0x200
[ 990.186959] vfs_write+0x62a/0x980
[ 990.191564] ksys_write+0xff/0x200
[ 990.196174] ? __ia32_sys_read+0xc0/0xc0
[ 990.201371] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.206962] ? rcu_is_watching+0x15/0xd0
[ 990.212155] do_syscall_64+0xf3/0x5e0
[ 990.217059] ? irq_exit_rcu+0x39/0xf0
[ 990.221965] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.228430] RIP: 0033:0x7fc91937fc5e
[ 990.233236] RSP: 002b:00007ffc2aad16c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.242531] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc91937fc5e
[ 990.251339] RDX: 0000000000000001 RSI: 0000560e21701110 RDI: 0000000000000007
[ 990.260143] RBP: 00007ffc2aad16d0 R08: 0000000000000000 R09: 0000000000000000
[ 990.268950] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc91921ae80
[ 990.277755] R13: 0000560e21701110 R14: 0000000000000007 R15: 00007fc9191aa480
[ 990.286567]
[ 990.289824] \x0aShowing all locks held in the system:
[ 990.298350] 1 lock held by khungtaskd/185:
[ 990.303742] #0: ffffffffab8ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.315227] 4 locks held by python3/3118:
[ 990.320522] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.330314] #1: ff11000140a6b888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.341274] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.352430] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.362526] 4 locks held by python3/5051:
[ 990.367819] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.377609] #1: ff1100019f3a2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.388569] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.399716] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.409805]
[ 990.412272] =============================================\x0a
[ 1112.625141] INFO: task python3:5051 blocked for more than 245 seconds.
[ 1112.633287] Not tainted 7.0.0-rc4-bnjr-g5d9b6383bcf3 #1
[ 1112.640537] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.650128] task:python3 state:D stack:25312 pid:5051 tgid:5051 ppid:5050 task_flags:0x400100 flags:0x00080000
[ 1112.663333] Call Trace:
[ 1112.666872]
[ 1112.670019] __schedule+0xad9/0x1490
[ 1112.674825] ? io_schedule_timeout+0x130/0x130
[ 1112.680610] ? find_held_lock+0x2b/0x80
[ 1112.685716] ? __lock_release.isra.0+0x59/0x170
[ 1112.691598] schedule+0xd4/0x260
[ 1112.696017] schedule_preempt_disabled+0x18/0x30
[ 1112.701993] __mutex_lock+0xd76/0x1f20
[ 1112.706997] ? threaded_store+0x132/0x220
[ 1112.712294] ? ww_mutex_lock+0x160/0x160
[ 1112.717493] ? selinux_inode_free_security+0x310/0x310
[ 1112.724062] ? cap_capable+0x1ed/0x3f0
[ 1112.729068] ? sysfs_file_ops+0x140/0x140
[ 1112.734363] ? threaded_store+0x132/0x220
[ 1112.739657] threaded_store+0x132/0x220
[ 1112.744761] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.750253] ? sysfs_file_ops+0x140/0x140
[ 1112.755550] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.760843] ? sysfs_kf_write+0x65/0x160
[ 1112.766044] kernfs_fop_write_iter+0x335/0x510
[ 1112.771820] ? kernfs_ops+0xf0/0xf0
[ 1112.776531] new_sync_write+0x308/0x6f0
[ 1112.781633] ? new_sync_read+0x6f0/0x6f0
[ 1112.786835] ? lock_acquire.part.0+0xbc/0x260
[ 1112.792519] ? ksys_write+0xff/0x200
[ 1112.797333] vfs_write+0x62a/0x980
[ 1112.801948] ksys_write+0xff/0x200
[ 1112.806563] ? __ia32_sys_read+0xc0/0xc0
[ 1112.811757] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.817348] ? rcu_is_watching+0x15/0xd0
[ 1112.822546] do_syscall_64+0xf3/0x5e0
[ 1112.827454] ? exc_page_fault+0x9e/0xb0
[ 1112.832555] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.839021] RIP: 0033:0x7fce6b948c5e
[ 1112.843831] RSP: 002b:00007ffeff462170 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.853126] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce6b948c5e
[ 1112.861932] RDX: 0000000000000001 RSI: 000055ee29a7a110 RDI: 0000000000000007
[ 1112.870737] RBP: 00007ffeff462180 R08: 0000000000000000 R09: 0000000000000000
[ 1112.879544] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce6b7e3e80
[ 1112.888352] R13: 000055ee29a7a110 R14: 0000000000000007 R15: 00007fce6c049b98
[ 1112.897155]
[ 1112.900428] INFO: task python3:5051 is blocked on a mutex likely owned by task python3:3118.
[ 1112.910700] task:python3 state:D stack:24512 pid:3118 tgid:3118 ppid:3117 task_flags:0x400100 flags:0x00080802
[ 1112.923903] Call Trace:
[ 1112.927442]
[ 1112.930591] __schedule+0xad9/0x1490
[ 1112.935403] ? io_schedule_timeout+0x130/0x130
[ 1112.941183] ? find_held_lock+0x2b/0x80
[ 1112.946287] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.952466] schedule+0xd4/0x260
[ 1112.956882] schedule_timeout+0x103/0x260
[ 1112.962177] ? rcu_is_watching+0x15/0xd0
[ 1112.967377] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.973747] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.979438] ? ww_mutex_lock+0x160/0x160
[ 1112.984639] msleep+0x1b/0x30
[ 1112.988765] napi_set_threaded+0x376/0x410
[ 1112.994151] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.999644] netif_set_threaded+0x254/0x400
[ 1113.005138] ? sysfs_file_ops+0x140/0x140
[ 1113.010433] threaded_store+0x1bb/0x220
[ 1113.015534] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.021025] ? sysfs_file_ops+0x140/0x140
[ 1113.026320] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.031616] ? sysfs_kf_write+0x65/0x160
[ 1113.036816] kernfs_fop_write_iter+0x335/0x510
[ 1113.042601] ? kernfs_ops+0xf0/0xf0
[ 1113.047309] new_sync_write+0x308/0x6f0
[ 1113.052410] ? new_sync_read+0x6f0/0x6f0
[ 1113.057608] ? lock_acquire.part.0+0xbc/0x260
[ 1113.063294] ? ksys_write+0xff/0x200
[ 1113.068105] vfs_write+0x62a/0x980
[ 1113.072719] ksys_write+0xff/0x200
[ 1113.077334] ? __ia32_sys_read+0xc0/0xc0
[ 1113.082531] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.088119] ? rcu_is_watching+0x15/0xd0
[ 1113.093317] do_syscall_64+0xf3/0x5e0
[ 1113.098222] ? irq_exit_rcu+0x39/0xf0
[ 1113.103130] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.109595] RIP: 0033:0x7fc91937fc5e
[ 1113.114400] RSP: 002b:00007ffc2aad16c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.123694] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc91937fc5e
[ 1113.132503] RDX: 0000000000000001 RSI: 0000560e21701110 RDI: 0000000000000007
[ 1113.141311] RBP: 00007ffc2aad16d0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.150109] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc91921ae80
[ 1113.158915] R13: 0000560e21701110 R14: 0000000000000007 R15: 00007fc9191aa480
[ 1113.167726]
[ 1113.170994] \x0aShowing all locks held in the system:
[ 1113.179528] 1 lock held by khungtaskd/185:
[ 1113.184919] #0: ffffffffab8ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.196400] 4 locks held by python3/3118:
[ 1113.201693] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.211485] #1: ff11000140a6b888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.222444] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.233601] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.243692] 4 locks held by python3/5051:
[ 1113.248987] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.258775] #1: ff1100019f3a2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.269734] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.280890] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.290984]
[ 1113.293449] =============================================\x0a
[ 1235.505366] INFO: task python3:5051 blocked for more than 368 seconds.
[ 1235.513513] Not tainted 7.0.0-rc4-bnjr-g5d9b6383bcf3 #1
[ 1235.520755] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.530346] task:python3 state:D stack:25312 pid:5051 tgid:5051 ppid:5050 task_flags:0x400100 flags:0x00080002
[ 1235.543554] Call Trace:
[ 1235.547092]
[ 1235.550243] __schedule+0xad9/0x1490
[ 1235.555062] ? io_schedule_timeout+0x130/0x130
[ 1235.560848] ? find_held_lock+0x2b/0x80
[ 1235.565957] ? __lock_release.isra.0+0x59/0x170
[ 1235.571841] schedule+0xd4/0x260
[ 1235.576251] schedule_preempt_disabled+0x18/0x30
[ 1235.582232] __mutex_lock+0xd76/0x1f20
[ 1235.587241] ? threaded_store+0x132/0x220
[ 1235.592542] ? ww_mutex_lock+0x160/0x160
[ 1235.597743] ? selinux_inode_free_security+0x310/0x310
[ 1235.604312] ? cap_capable+0x1ed/0x3f0
[ 1235.609320] ? sysfs_file_ops+0x140/0x140
[ 1235.614621] ? threaded_store+0x132/0x220
[ 1235.619918] threaded_store+0x132/0x220
[ 1235.625020] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.630506] ? sysfs_file_ops+0x140/0x140
[ 1235.635804] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.641104] ? sysfs_kf_write+0x65/0x160
[ 1235.646305] kernfs_fop_write_iter+0x335/0x510
[ 1235.652091] ? kernfs_ops+0xf0/0xf0
[ 1235.656802] new_sync_write+0x308/0x6f0
[ 1235.661910] ? new_sync_read+0x6f0/0x6f0
[ 1235.667111] ? lock_acquire.part.0+0xbc/0x260
[ 1235.672796] ? ksys_write+0xff/0x200
[ 1235.677610] vfs_write+0x62a/0x980
[ 1235.682225] ksys_write+0xff/0x200
[ 1235.686837] ? __ia32_sys_read+0xc0/0xc0
[ 1235.692037] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.697628] ? rcu_is_watching+0x15/0xd0
[ 1235.702832] do_syscall_64+0xf3/0x5e0
[ 1235.707736] ? exc_page_fault+0x9e/0xb0
[ 1235.712841] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.719310] RIP: 0033:0x7fce6b948c5e
[ 1235.724122] RSP: 002b:00007ffeff462170 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.733420] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce6b948c5e
[ 1235.742231] RDX: 0000000000000001 RSI: 000055ee29a7a110 RDI: 0000000000000007
[ 1235.751040] RBP: 00007ffeff462180 R08: 0000000000000000 R09: 0000000000000000
[ 1235.759847] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce6b7e3e80
[ 1235.768656] R13: 000055ee29a7a110 R14: 0000000000000007 R15: 00007fce6c049b98
[ 1235.777472]
[ 1235.780732] INFO: task python3:5051 is blocked on a mutex likely owned by task python3:3118.
[ 1235.791004] task:python3 state:D stack:24512 pid:3118 tgid:3118 ppid:3117 task_flags:0x400100 flags:0x00080802
[ 1235.804208] Call Trace:
[ 1235.807745]
[ 1235.810897] __schedule+0xad9/0x1490
[ 1235.815708] ? io_schedule_timeout+0x130/0x130
[ 1235.821492] ? find_held_lock+0x2b/0x80
[ 1235.826588] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.832767] schedule+0xd4/0x260
[ 1235.837188] schedule_timeout+0x103/0x260
[ 1235.842487] ? rcu_is_watching+0x15/0xd0
[ 1235.847688] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.854058] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.859749] ? ww_mutex_lock+0x160/0x160
[ 1235.864947] msleep+0x1b/0x30
[ 1235.869074] napi_set_threaded+0x376/0x410
[ 1235.874462] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.879950] netif_set_threaded+0x254/0x400
[ 1235.885445] ? sysfs_file_ops+0x140/0x140
[ 1235.890743] threaded_store+0x1bb/0x220
[ 1235.895846] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.901337] ? sysfs_file_ops+0x140/0x140
[ 1235.906634] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.911933] ? sysfs_kf_write+0x65/0x160
[ 1235.917132] kernfs_fop_write_iter+0x335/0x510
[ 1235.922916] ? kernfs_ops+0xf0/0xf0
[ 1235.927628] new_sync_write+0x308/0x6f0
[ 1235.932732] ? new_sync_read+0x6f0/0x6f0
[ 1235.937932] ? lock_acquire.part.0+0xbc/0x260
[ 1235.943617] ? ksys_write+0xff/0x200
[ 1235.948429] vfs_write+0x62a/0x980
[ 1235.953043] ksys_write+0xff/0x200
[ 1235.957659] ? __ia32_sys_read+0xc0/0xc0
[ 1235.962860] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.968449] ? rcu_is_watching+0x15/0xd0
[ 1235.973652] do_syscall_64+0xf3/0x5e0
[ 1235.978560] ? irq_exit_rcu+0x39/0xf0
[ 1235.983466] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.989935] RIP: 0033:0x7fc91937fc5e
[ 1235.994746] RSP: 002b:00007ffc2aad16c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.004044] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc91937fc5e
[ 1236.012852] RDX: 0000000000000001 RSI: 0000560e21701110 RDI: 0000000000000007
[ 1236.021660] RBP: 00007ffc2aad16d0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.030459] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc91921ae80
[ 1236.039268] R13: 0000560e21701110 R14: 0000000000000007 R15: 00007fc9191aa480
[ 1236.048084]
[ 1236.051349] \x0aShowing all locks held in the system:
[ 1236.059888] 1 lock held by khungtaskd/185:
[ 1236.065283] #0: ffffffffab8ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.076765] 4 locks held by python3/3118:
[ 1236.082063] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.091847] #1: ff11000140a6b888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.102811] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.113969] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.124062] 4 locks held by python3/5051:
[ 1236.129358] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.139147] #1: ff1100019f3a2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.150109] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.161265] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.171358]
[ 1236.173825] =============================================\x0a
[ 1247.794473] kworker/u129:10 (290) used greatest stack depth: 21688 bytes left
[ 1358.386591] INFO: task python3:5051 blocked for more than 491 seconds.
[ 1358.394738] Not tainted 7.0.0-rc4-bnjr-g5d9b6383bcf3 #1
[ 1358.401977] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.411559] task:python3 state:D stack:25312 pid:5051 tgid:5051 ppid:5050 task_flags:0x400100 flags:0x00080002
[ 1358.424766] Call Trace:
[ 1358.428307]
[ 1358.431458] __schedule+0xad9/0x1490
[ 1358.436276] ? io_schedule_timeout+0x130/0x130
[ 1358.442062] ? find_held_lock+0x2b/0x80
[ 1358.447169] ? __lock_release.isra.0+0x59/0x170
[ 1358.453055] schedule+0xd4/0x260
[ 1358.457475] schedule_preempt_disabled+0x18/0x30
[ 1358.463453] __mutex_lock+0xd76/0x1f20
[ 1358.468458] ? threaded_store+0x132/0x220
[ 1358.473757] ? ww_mutex_lock+0x160/0x160
[ 1358.478957] ? selinux_inode_free_security+0x310/0x310
[ 1358.485526] ? cap_capable+0x1ed/0x3f0
[ 1358.490534] ? sysfs_file_ops+0x140/0x140
[ 1358.495834] ? threaded_store+0x132/0x220
[ 1358.501120] threaded_store+0x132/0x220
[ 1358.506223] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.511721] ? sysfs_file_ops+0x140/0x140
[ 1358.517022] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.522318] ? sysfs_kf_write+0x65/0x160
[ 1358.527519] kernfs_fop_write_iter+0x335/0x510
[ 1358.533305] ? kernfs_ops+0xf0/0xf0
[ 1358.538017] new_sync_write+0x308/0x6f0
[ 1358.543124] ? new_sync_read+0x6f0/0x6f0
[ 1358.548325] ? lock_acquire.part.0+0xbc/0x260
[ 1358.554011] ? ksys_write+0xff/0x200
[ 1358.558825] vfs_write+0x62a/0x980
[ 1358.563443] ksys_write+0xff/0x200
[ 1358.568059] ? __ia32_sys_read+0xc0/0xc0
[ 1358.573260] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.578850] ? rcu_is_watching+0x15/0xd0
[ 1358.584051] do_syscall_64+0xf3/0x5e0
[ 1358.588960] ? exc_page_fault+0x9e/0xb0
[ 1358.594062] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.600522] RIP: 0033:0x7fce6b948c5e
[ 1358.605331] RSP: 002b:00007ffeff462170 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.614629] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce6b948c5e
[ 1358.623434] RDX: 0000000000000001 RSI: 000055ee29a7a110 RDI: 0000000000000007
[ 1358.632240] RBP: 00007ffeff462180 R08: 0000000000000000 R09: 0000000000000000
[ 1358.641050] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce6b7e3e80
[ 1358.649860] R13: 000055ee29a7a110 R14: 0000000000000007 R15: 00007fce6c049b98
[ 1358.658675]
[ 1358.661954] INFO: task python3:5051 is blocked on a mutex likely owned by task python3:3118.
[ 1358.672226] task:python3 state:D stack:24512 pid:3118 tgid:3118 ppid:3117 task_flags:0x400100 flags:0x00080802
[ 1358.685432] Call Trace:
[ 1358.688973]
[ 1358.692125] __schedule+0xad9/0x1490
[ 1358.696937] ? io_schedule_timeout+0x130/0x130
[ 1358.702720] ? find_held_lock+0x2b/0x80
[ 1358.707824] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.714004] schedule+0xd4/0x260
[ 1358.718423] schedule_timeout+0x103/0x260
[ 1358.723723] ? rcu_is_watching+0x15/0xd0
[ 1358.728924] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.735295] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.740985] ? ww_mutex_lock+0x160/0x160
[ 1358.746185] msleep+0x1b/0x30
[ 1358.750302] napi_set_threaded+0x376/0x410
[ 1358.755697] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.761186] netif_set_threaded+0x254/0x400
[ 1358.766680] ? sysfs_file_ops+0x140/0x140
[ 1358.771974] threaded_store+0x1bb/0x220
[ 1358.777080] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.782570] ? sysfs_file_ops+0x140/0x140
[ 1358.787867] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.793165] ? sysfs_kf_write+0x65/0x160
[ 1358.798364] kernfs_fop_write_iter+0x335/0x510
[ 1358.804147] ? kernfs_ops+0xf0/0xf0
[ 1358.808858] new_sync_write+0x308/0x6f0
[ 1358.813959] ? new_sync_read+0x6f0/0x6f0
[ 1358.819158] ? lock_acquire.part.0+0xbc/0x260
[ 1358.824843] ? ksys_write+0xff/0x200
[ 1358.829657] vfs_write+0x62a/0x980
[ 1358.834271] ksys_write+0xff/0x200
[ 1358.838886] ? __ia32_sys_read+0xc0/0xc0
[ 1358.844087] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.849677] ? rcu_is_watching+0x15/0xd0
[ 1358.854868] do_syscall_64+0xf3/0x5e0
[ 1358.859772] ? irq_exit_rcu+0x39/0xf0
[ 1358.864680] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.871148] RIP: 0033:0x7fc91937fc5e
[ 1358.875954] RSP: 002b:00007ffc2aad16c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.885250] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc91937fc5e
[ 1358.894050] RDX: 0000000000000001 RSI: 0000560e21701110 RDI: 0000000000000007
[ 1358.902858] RBP: 00007ffc2aad16d0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.911668] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc91921ae80
[ 1358.920477] R13: 0000560e21701110 R14: 0000000000000007 R15: 00007fc9191aa480
[ 1358.929290]
[ 1358.932561] \x0aShowing all locks held in the system:
[ 1358.941100] 1 lock held by khungtaskd/185:
[ 1358.946495] #0: ffffffffab8ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.957976] 4 locks held by python3/3118:
[ 1358.963271] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.973063] #1: ff11000140a6b888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.984026] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.995182] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.005276] 4 locks held by python3/5051:
[ 1359.010573] #0: ff1100012e6013f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.020365] #1: ff1100019f3a2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.031326] #2: ff11000121c3d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.042484] #3: ff11000121cb1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.052578]
[ 1359.055045] =============================================\x0a