[ 760.807346] nipa-hw-worker: drivers/net:napi_threaded.py: timed out [ 760.810317] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py [ 760.969902] kselftest: Running tests in drivers/net [ 989.741383] INFO: task python3:5046 blocked for more than 122 seconds. [ 989.749608] Not tainted 7.0.0-rc4-hfxo-gba95301fad08 #1 [ 989.756857] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.766449] task:python3 state:D stack:25248 pid:5046 tgid:5046 ppid:5045 task_flags:0x400100 flags:0x00080000 [ 989.779652] Call Trace: [ 989.783188] [ 989.786340] __schedule+0xad9/0x1490 [ 989.791154] ? io_schedule_timeout+0x130/0x130 [ 989.796936] ? find_held_lock+0x2b/0x80 [ 989.802040] ? __lock_release.isra.0+0x59/0x170 [ 989.807926] schedule+0xd4/0x260 [ 989.812343] schedule_preempt_disabled+0x18/0x30 [ 989.818320] __mutex_lock+0xd76/0x1f20 [ 989.823325] ? threaded_store+0x132/0x220 [ 989.828624] ? ww_mutex_lock+0x160/0x160 [ 989.833824] ? selinux_inode_free_security+0x310/0x310 [ 989.840394] ? cap_capable+0x1ed/0x3f0 [ 989.845399] ? sysfs_file_ops+0x140/0x140 [ 989.850695] ? threaded_store+0x132/0x220 [ 989.855991] threaded_store+0x132/0x220 [ 989.861092] ? tx_maxrate_store+0x4e0/0x4e0 [ 989.866587] ? sysfs_file_ops+0x140/0x140 [ 989.871883] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.877179] ? sysfs_kf_write+0x65/0x160 [ 989.882378] kernfs_fop_write_iter+0x335/0x510 [ 989.888161] ? kernfs_ops+0xf0/0xf0 [ 989.892871] new_sync_write+0x308/0x6f0 [ 989.897975] ? new_sync_read+0x6f0/0x6f0 [ 989.903164] ? lock_acquire.part.0+0xbc/0x260 [ 989.908849] ? ksys_write+0xff/0x200 [ 989.913658] vfs_write+0x62a/0x980 [ 989.918270] ksys_write+0xff/0x200 [ 989.922881] ? __ia32_sys_read+0xc0/0xc0 [ 989.928079] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.933667] ? rcu_is_watching+0x15/0xd0 [ 989.938869] do_syscall_64+0xf3/0x5e0 [ 989.943774] ? exc_page_fault+0x9e/0xb0 [ 989.948874] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.955342] RIP: 0033:0x7f05a1680c5e [ 989.960149] RSP: 002b:00007ffd9ec9f150 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.969451] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05a1680c5e [ 989.978257] RDX: 0000000000000001 RSI: 0000562fd5f59110 RDI: 0000000000000007 [ 989.987062] RBP: 00007ffd9ec9f160 R08: 0000000000000000 R09: 0000000000000000 [ 989.995867] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05a151be80 [ 990.004675] R13: 0000562fd5f59110 R14: 0000000000000007 R15: 00007f05a1d81b98 [ 990.013489] [ 990.016762] INFO: task python3:5046 is blocked on a mutex likely owned by task python3:3102. [ 990.027034] task:python3 state:D stack:25312 pid:3102 tgid:3102 ppid:3101 task_flags:0x400100 flags:0x00080802 [ 990.040237] Call Trace: [ 990.043774] [ 990.046925] __schedule+0xad9/0x1490 [ 990.051734] ? io_schedule_timeout+0x130/0x130 [ 990.057508] ? find_held_lock+0x2b/0x80 [ 990.062610] ? __try_to_del_timer_sync+0x154/0x1f0 [ 990.068788] schedule+0xd4/0x260 [ 990.073207] schedule_timeout+0x103/0x260 [ 990.078501] ? rcu_is_watching+0x15/0xd0 [ 990.083699] ? hrtimer_nanosleep_restart+0x180/0x180 [ 990.090067] ? hrtimers_cpu_dying+0x250/0x250 [ 990.095757] ? ww_mutex_lock+0x160/0x160 [ 990.100955] msleep+0x1b/0x30 [ 990.105079] napi_set_threaded+0x376/0x410 [ 990.110475] ? napi_resume_irqs+0x1a0/0x1a0 [ 990.115970] netif_set_threaded+0x254/0x400 [ 990.121463] ? sysfs_file_ops+0x140/0x140 [ 990.126759] threaded_store+0x1bb/0x220 [ 990.131860] ? tx_maxrate_store+0x4e0/0x4e0 [ 990.137352] ? sysfs_file_ops+0x140/0x140 [ 990.142639] ? sysfs_file_kobj+0xbd/0x1e0 [ 990.147936] ? sysfs_kf_write+0x65/0x160 [ 990.153136] kernfs_fop_write_iter+0x335/0x510 [ 990.158920] ? kernfs_ops+0xf0/0xf0 [ 990.163631] new_sync_write+0x308/0x6f0 [ 990.168731] ? new_sync_read+0x6f0/0x6f0 [ 990.173932] ? lock_acquire.part.0+0xbc/0x260 [ 990.179616] ? ksys_write+0xff/0x200 [ 990.184426] vfs_write+0x62a/0x980 [ 990.189038] ksys_write+0xff/0x200 [ 990.193650] ? __ia32_sys_read+0xc0/0xc0 [ 990.198850] ? kernfs_fop_llseek+0x160/0x1f0 [ 990.204440] ? rcu_is_watching+0x15/0xd0 [ 990.209640] do_syscall_64+0xf3/0x5e0 [ 990.214543] ? irq_exit_rcu+0x39/0xf0 [ 990.219449] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 990.225916] RIP: 0033:0x7faf46debc5e [ 990.230723] RSP: 002b:00007ffd05ad07e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 990.240018] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faf46debc5e [ 990.248826] RDX: 0000000000000001 RSI: 000055b1b5515110 RDI: 0000000000000007 [ 990.257625] RBP: 00007ffd05ad07f0 R08: 0000000000000000 R09: 0000000000000000 [ 990.266432] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faf46c86e80 [ 990.275232] R13: 000055b1b5515110 R14: 0000000000000007 R15: 00007faf46c16480 [ 990.284046] [ 990.287304] \x0aShowing all locks held in the system: [ 990.295841] 1 lock held by khungtaskd/184: [ 990.301235] #0: ffffffff91ace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 990.312714] 4 locks held by python3/3102: [ 990.318009] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 990.327800] #1: ff1100014a15fa88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 990.338763] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 990.349920] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 990.360014] 4 locks held by python3/5046: [ 990.365306] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 990.375096] #1: ff110001c4e7c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 990.386058] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 990.397217] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 990.407309] [ 990.409777] =============================================\x0a [ 1112.622698] INFO: task python3:5046 blocked for more than 245 seconds. [ 1112.630847] Not tainted 7.0.0-rc4-hfxo-gba95301fad08 #1 [ 1112.638097] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.647688] task:python3 state:D stack:25248 pid:5046 tgid:5046 ppid:5045 task_flags:0x400100 flags:0x00080000 [ 1112.660893] Call Trace: [ 1112.664432] [ 1112.667585] __schedule+0xad9/0x1490 [ 1112.672402] ? io_schedule_timeout+0x130/0x130 [ 1112.678187] ? find_held_lock+0x2b/0x80 [ 1112.683293] ? __lock_release.isra.0+0x59/0x170 [ 1112.689177] schedule+0xd4/0x260 [ 1112.693599] schedule_preempt_disabled+0x18/0x30 [ 1112.699579] __mutex_lock+0xd76/0x1f20 [ 1112.704578] ? threaded_store+0x132/0x220 [ 1112.709878] ? ww_mutex_lock+0x160/0x160 [ 1112.715067] ? selinux_inode_free_security+0x310/0x310 [ 1112.721631] ? cap_capable+0x1ed/0x3f0 [ 1112.726661] ? sysfs_file_ops+0x140/0x140 [ 1112.731987] ? threaded_store+0x132/0x220 [ 1112.737285] threaded_store+0x132/0x220 [ 1112.742384] ? tx_maxrate_store+0x4e0/0x4e0 [ 1112.747875] ? sysfs_file_ops+0x140/0x140 [ 1112.753245] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.758540] ? sysfs_kf_write+0x65/0x160 [ 1112.763741] kernfs_fop_write_iter+0x335/0x510 [ 1112.769532] ? kernfs_ops+0xf0/0xf0 [ 1112.774243] new_sync_write+0x308/0x6f0 [ 1112.779348] ? new_sync_read+0x6f0/0x6f0 [ 1112.784549] ? lock_acquire.part.0+0xbc/0x260 [ 1112.790236] ? ksys_write+0xff/0x200 [ 1112.795047] vfs_write+0x62a/0x980 [ 1112.799652] ksys_write+0xff/0x200 [ 1112.804267] ? __ia32_sys_read+0xc0/0xc0 [ 1112.809466] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.815056] ? rcu_is_watching+0x15/0xd0 [ 1112.820259] do_syscall_64+0xf3/0x5e0 [ 1112.825164] ? exc_page_fault+0x9e/0xb0 [ 1112.830265] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.836733] RIP: 0033:0x7f05a1680c5e [ 1112.841542] RSP: 002b:00007ffd9ec9f150 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.850835] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05a1680c5e [ 1112.859646] RDX: 0000000000000001 RSI: 0000562fd5f59110 RDI: 0000000000000007 [ 1112.868529] RBP: 00007ffd9ec9f160 R08: 0000000000000000 R09: 0000000000000000 [ 1112.877337] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05a151be80 [ 1112.886147] R13: 0000562fd5f59110 R14: 0000000000000007 R15: 00007f05a1d81b98 [ 1112.894960] [ 1112.898342] INFO: task python3:5046 is blocked on a mutex likely owned by task python3:3102. [ 1112.908634] task:python3 state:D stack:25312 pid:3102 tgid:3102 ppid:3101 task_flags:0x400100 flags:0x00080802 [ 1112.921843] Call Trace: [ 1112.925384] [ 1112.928535] __schedule+0xad9/0x1490 [ 1112.933349] ? io_schedule_timeout+0x130/0x130 [ 1112.939135] ? find_held_lock+0x2b/0x80 [ 1112.944311] ? __try_to_del_timer_sync+0x154/0x1f0 [ 1112.950489] schedule+0xd4/0x260 [ 1112.954907] schedule_timeout+0x103/0x260 [ 1112.960202] ? rcu_is_watching+0x15/0xd0 [ 1112.965401] ? hrtimer_nanosleep_restart+0x180/0x180 [ 1112.971771] ? hrtimers_cpu_dying+0x250/0x250 [ 1112.977453] ? ww_mutex_lock+0x160/0x160 [ 1112.982719] msleep+0x1b/0x30 [ 1112.986844] napi_set_threaded+0x376/0x410 [ 1112.992242] ? napi_resume_irqs+0x1a0/0x1a0 [ 1112.997805] netif_set_threaded+0x254/0x400 [ 1113.003296] ? sysfs_file_ops+0x140/0x140 [ 1113.008594] threaded_store+0x1bb/0x220 [ 1113.013688] ? tx_maxrate_store+0x4e0/0x4e0 [ 1113.019170] ? sysfs_file_ops+0x140/0x140 [ 1113.024468] ? sysfs_file_kobj+0xbd/0x1e0 [ 1113.029765] ? sysfs_kf_write+0x65/0x160 [ 1113.034965] kernfs_fop_write_iter+0x335/0x510 [ 1113.040753] ? kernfs_ops+0xf0/0xf0 [ 1113.045465] new_sync_write+0x308/0x6f0 [ 1113.050565] ? new_sync_read+0x6f0/0x6f0 [ 1113.055766] ? lock_acquire.part.0+0xbc/0x260 [ 1113.061450] ? ksys_write+0xff/0x200 [ 1113.066262] vfs_write+0x62a/0x980 [ 1113.070876] ksys_write+0xff/0x200 [ 1113.075490] ? __ia32_sys_read+0xc0/0xc0 [ 1113.080687] ? kernfs_fop_llseek+0x160/0x1f0 [ 1113.086277] ? rcu_is_watching+0x15/0xd0 [ 1113.091475] do_syscall_64+0xf3/0x5e0 [ 1113.096383] ? irq_exit_rcu+0x39/0xf0 [ 1113.101288] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1113.107756] RIP: 0033:0x7faf46debc5e [ 1113.112564] RSP: 002b:00007ffd05ad07e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1113.121864] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faf46debc5e [ 1113.130673] RDX: 0000000000000001 RSI: 000055b1b5515110 RDI: 0000000000000007 [ 1113.139483] RBP: 00007ffd05ad07f0 R08: 0000000000000000 R09: 0000000000000000 [ 1113.148293] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faf46c86e80 [ 1113.157102] R13: 000055b1b5515110 R14: 0000000000000007 R15: 00007faf46c16480 [ 1113.165922] [ 1113.169187] \x0aShowing all locks held in the system: [ 1113.177728] 1 lock held by khungtaskd/184: [ 1113.183123] #0: ffffffff91ace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1113.194625] 4 locks held by python3/3102: [ 1113.199919] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1113.209710] #1: ff1100014a15fa88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1113.220672] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1113.231830] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1113.241945] 4 locks held by python3/5046: [ 1113.247240] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1113.257033] #1: ff110001c4e7c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1113.267993] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1113.279148] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1113.289239] [ 1113.291707] =============================================\x0a [ 1235.502979] INFO: task python3:5046 blocked for more than 368 seconds. [ 1235.511127] Not tainted 7.0.0-rc4-hfxo-gba95301fad08 #1 [ 1235.518377] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.527968] task:python3 state:D stack:25248 pid:5046 tgid:5046 ppid:5045 task_flags:0x400100 flags:0x00080002 [ 1235.541177] Call Trace: [ 1235.544718] [ 1235.547871] __schedule+0xad9/0x1490 [ 1235.552691] ? io_schedule_timeout+0x130/0x130 [ 1235.558475] ? find_held_lock+0x2b/0x80 [ 1235.563582] ? __lock_release.isra.0+0x59/0x170 [ 1235.569468] schedule+0xd4/0x260 [ 1235.573889] schedule_preempt_disabled+0x18/0x30 [ 1235.579869] __mutex_lock+0xd76/0x1f20 [ 1235.584877] ? threaded_store+0x132/0x220 [ 1235.590179] ? ww_mutex_lock+0x160/0x160 [ 1235.595377] ? selinux_inode_free_security+0x310/0x310 [ 1235.601951] ? cap_capable+0x1ed/0x3f0 [ 1235.606959] ? sysfs_file_ops+0x140/0x140 [ 1235.612261] ? threaded_store+0x132/0x220 [ 1235.617562] threaded_store+0x132/0x220 [ 1235.622664] ? tx_maxrate_store+0x4e0/0x4e0 [ 1235.628158] ? sysfs_file_ops+0x140/0x140 [ 1235.633455] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.638754] ? sysfs_kf_write+0x65/0x160 [ 1235.643955] kernfs_fop_write_iter+0x335/0x510 [ 1235.649742] ? kernfs_ops+0xf0/0xf0 [ 1235.654455] new_sync_write+0x308/0x6f0 [ 1235.659559] ? new_sync_read+0x6f0/0x6f0 [ 1235.664751] ? lock_acquire.part.0+0xbc/0x260 [ 1235.670436] ? ksys_write+0xff/0x200 [ 1235.675251] vfs_write+0x62a/0x980 [ 1235.679869] ksys_write+0xff/0x200 [ 1235.684486] ? __ia32_sys_read+0xc0/0xc0 [ 1235.689687] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.695277] ? rcu_is_watching+0x15/0xd0 [ 1235.700473] do_syscall_64+0xf3/0x5e0 [ 1235.705381] ? exc_page_fault+0x9e/0xb0 [ 1235.710482] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.716952] RIP: 0033:0x7f05a1680c5e [ 1235.721763] RSP: 002b:00007ffd9ec9f150 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.731064] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05a1680c5e [ 1235.739874] RDX: 0000000000000001 RSI: 0000562fd5f59110 RDI: 0000000000000007 [ 1235.748680] RBP: 00007ffd9ec9f160 R08: 0000000000000000 R09: 0000000000000000 [ 1235.757489] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05a151be80 [ 1235.766297] R13: 0000562fd5f59110 R14: 0000000000000007 R15: 00007f05a1d81b98 [ 1235.775115] [ 1235.778385] INFO: task python3:5046 is blocked on a mutex likely owned by task python3:3102. [ 1235.788659] task:python3 state:D stack:25312 pid:3102 tgid:3102 ppid:3101 task_flags:0x400100 flags:0x00080802 [ 1235.801865] Call Trace: [ 1235.805407] [ 1235.808549] __schedule+0xad9/0x1490 [ 1235.813362] ? io_schedule_timeout+0x130/0x130 [ 1235.819144] ? find_held_lock+0x2b/0x80 [ 1235.824247] ? __try_to_del_timer_sync+0x154/0x1f0 [ 1235.830429] schedule+0xd4/0x260 [ 1235.834848] schedule_timeout+0x103/0x260 [ 1235.840148] ? rcu_is_watching+0x15/0xd0 [ 1235.845349] ? hrtimer_nanosleep_restart+0x180/0x180 [ 1235.851719] ? hrtimers_cpu_dying+0x250/0x250 [ 1235.857410] ? ww_mutex_lock+0x160/0x160 [ 1235.862609] msleep+0x1b/0x30 [ 1235.866734] napi_set_threaded+0x376/0x410 [ 1235.872130] ? napi_resume_irqs+0x1a0/0x1a0 [ 1235.877625] netif_set_threaded+0x254/0x400 [ 1235.883117] ? sysfs_file_ops+0x140/0x140 [ 1235.888407] threaded_store+0x1bb/0x220 [ 1235.893513] ? tx_maxrate_store+0x4e0/0x4e0 [ 1235.899006] ? sysfs_file_ops+0x140/0x140 [ 1235.904301] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.909599] ? sysfs_kf_write+0x65/0x160 [ 1235.914799] kernfs_fop_write_iter+0x335/0x510 [ 1235.920580] ? kernfs_ops+0xf0/0xf0 [ 1235.925293] new_sync_write+0x308/0x6f0 [ 1235.930398] ? new_sync_read+0x6f0/0x6f0 [ 1235.935598] ? lock_acquire.part.0+0xbc/0x260 [ 1235.941278] ? ksys_write+0xff/0x200 [ 1235.946092] vfs_write+0x62a/0x980 [ 1235.950710] ksys_write+0xff/0x200 [ 1235.955327] ? __ia32_sys_read+0xc0/0xc0 [ 1235.960527] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.966117] ? rcu_is_watching+0x15/0xd0 [ 1235.971318] do_syscall_64+0xf3/0x5e0 [ 1235.976224] ? irq_exit_rcu+0x39/0xf0 [ 1235.981135] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.987602] RIP: 0033:0x7faf46debc5e [ 1235.992410] RSP: 002b:00007ffd05ad07e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1236.001709] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faf46debc5e [ 1236.010517] RDX: 0000000000000001 RSI: 000055b1b5515110 RDI: 0000000000000007 [ 1236.019324] RBP: 00007ffd05ad07f0 R08: 0000000000000000 R09: 0000000000000000 [ 1236.028127] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faf46c86e80 [ 1236.036934] R13: 000055b1b5515110 R14: 0000000000000007 R15: 00007faf46c16480 [ 1236.045747] [ 1236.049011] \x0aShowing all locks held in the system: [ 1236.057550] 1 lock held by khungtaskd/184: [ 1236.062945] #0: ffffffff91ace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1236.074429] 4 locks held by python3/3102: [ 1236.079724] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1236.089519] #1: ff1100014a15fa88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1236.100481] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1236.111641] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1236.121736] 4 locks held by python3/5046: [ 1236.127032] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1236.136830] #1: ff110001c4e7c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1236.147793] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1236.158953] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1236.169050] [ 1236.171515] =============================================\x0a [ 1358.384262] INFO: task python3:5046 blocked for more than 491 seconds. [ 1358.392410] Not tainted 7.0.0-rc4-hfxo-gba95301fad08 #1 [ 1358.399660] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.409250] task:python3 state:D stack:25248 pid:5046 tgid:5046 ppid:5045 task_flags:0x400100 flags:0x00080002 [ 1358.422456] Call Trace: [ 1358.425996] [ 1358.429148] __schedule+0xad9/0x1490 [ 1358.433965] ? io_schedule_timeout+0x130/0x130 [ 1358.439748] ? find_held_lock+0x2b/0x80 [ 1358.444853] ? __lock_release.isra.0+0x59/0x170 [ 1358.450755] schedule+0xd4/0x260 [ 1358.455398] schedule_preempt_disabled+0x18/0x30 [ 1358.461378] __mutex_lock+0xd76/0x1f20 [ 1358.466374] ? threaded_store+0x132/0x220 [ 1358.471673] ? ww_mutex_lock+0x160/0x160 [ 1358.476869] ? selinux_inode_free_security+0x310/0x310 [ 1358.483441] ? cap_capable+0x1ed/0x3f0 [ 1358.488447] ? sysfs_file_ops+0x140/0x140 [ 1358.493746] ? threaded_store+0x132/0x220 [ 1358.499043] threaded_store+0x132/0x220 [ 1358.504136] ? tx_maxrate_store+0x4e0/0x4e0 [ 1358.509624] ? sysfs_file_ops+0x140/0x140 [ 1358.514918] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.520213] ? sysfs_kf_write+0x65/0x160 [ 1358.525414] kernfs_fop_write_iter+0x335/0x510 [ 1358.531188] ? kernfs_ops+0xf0/0xf0 [ 1358.535901] new_sync_write+0x308/0x6f0 [ 1358.541002] ? new_sync_read+0x6f0/0x6f0 [ 1358.546202] ? lock_acquire.part.0+0xbc/0x260 [ 1358.551878] ? ksys_write+0xff/0x200 [ 1358.556687] vfs_write+0x62a/0x980 [ 1358.561300] ksys_write+0xff/0x200 [ 1358.565913] ? __ia32_sys_read+0xc0/0xc0 [ 1358.571115] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.576705] ? rcu_is_watching+0x15/0xd0 [ 1358.581903] do_syscall_64+0xf3/0x5e0 [ 1358.586810] ? exc_page_fault+0x9e/0xb0 [ 1358.591902] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.598371] RIP: 0033:0x7f05a1680c5e [ 1358.603182] RSP: 002b:00007ffd9ec9f150 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.612481] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05a1680c5e [ 1358.621289] RDX: 0000000000000001 RSI: 0000562fd5f59110 RDI: 0000000000000007 [ 1358.630097] RBP: 00007ffd9ec9f160 R08: 0000000000000000 R09: 0000000000000000 [ 1358.638906] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05a151be80 [ 1358.647714] R13: 0000562fd5f59110 R14: 0000000000000007 R15: 00007f05a1d81b98 [ 1358.656519] [ 1358.659796] INFO: task python3:5046 is blocked on a mutex likely owned by task python3:3102. [ 1358.670071] task:python3 state:D stack:25312 pid:3102 tgid:3102 ppid:3101 task_flags:0x400100 flags:0x00080802 [ 1358.683273] Call Trace: [ 1358.686811] [ 1358.689963] __schedule+0xad9/0x1490 [ 1358.694764] ? io_schedule_timeout+0x130/0x130 [ 1358.700538] ? find_held_lock+0x2b/0x80 [ 1358.705642] ? __try_to_del_timer_sync+0x154/0x1f0 [ 1358.711820] schedule+0xd4/0x260 [ 1358.716238] schedule_timeout+0x103/0x260 [ 1358.721534] ? rcu_is_watching+0x15/0xd0 [ 1358.726731] ? hrtimer_nanosleep_restart+0x180/0x180 [ 1358.733100] ? hrtimers_cpu_dying+0x250/0x250 [ 1358.738789] ? ww_mutex_lock+0x160/0x160 [ 1358.743978] msleep+0x1b/0x30 [ 1358.748104] napi_set_threaded+0x376/0x410 [ 1358.753502] ? napi_resume_irqs+0x1a0/0x1a0 [ 1358.758996] netif_set_threaded+0x254/0x400 [ 1358.764490] ? sysfs_file_ops+0x140/0x140 [ 1358.769785] threaded_store+0x1bb/0x220 [ 1358.774886] ? tx_maxrate_store+0x4e0/0x4e0 [ 1358.780377] ? sysfs_file_ops+0x140/0x140 [ 1358.785674] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.790960] ? sysfs_kf_write+0x65/0x160 [ 1358.796161] kernfs_fop_write_iter+0x335/0x510 [ 1358.801946] ? kernfs_ops+0xf0/0xf0 [ 1358.806657] new_sync_write+0x308/0x6f0 [ 1358.811758] ? new_sync_read+0x6f0/0x6f0 [ 1358.816959] ? lock_acquire.part.0+0xbc/0x260 [ 1358.822646] ? ksys_write+0xff/0x200 [ 1358.827456] vfs_write+0x62a/0x980 [ 1358.832072] ksys_write+0xff/0x200 [ 1358.836687] ? __ia32_sys_read+0xc0/0xc0 [ 1358.841883] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.847469] ? rcu_is_watching+0x15/0xd0 [ 1358.852667] do_syscall_64+0xf3/0x5e0 [ 1358.857570] ? irq_exit_rcu+0x39/0xf0 [ 1358.862477] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.868946] RIP: 0033:0x7faf46debc5e [ 1358.873754] RSP: 002b:00007ffd05ad07e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.883049] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faf46debc5e [ 1358.891859] RDX: 0000000000000001 RSI: 000055b1b5515110 RDI: 0000000000000007 [ 1358.900668] RBP: 00007ffd05ad07f0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.909476] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faf46c86e80 [ 1358.918285] R13: 000055b1b5515110 R14: 0000000000000007 R15: 00007faf46c16480 [ 1358.927099] [ 1358.930365] \x0aShowing all locks held in the system: [ 1358.938894] 1 lock held by khungtaskd/184: [ 1358.944285] #0: ffffffff91ace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1358.955755] 2 locks held by systemd-journal/804: [ 1358.961733] #0: ff1100180e6b7220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490 [ 1358.971618] #1: ffffffff91cc8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120 [ 1358.984446] 4 locks held by python3/3102: [ 1358.989740] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1358.999552] #1: ff1100014a15fa88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1359.010554] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1359.021716] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1359.031824] 4 locks held by python3/5046: [ 1359.037122] #0: ff1100012e4613f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200 [ 1359.046915] #1: ff110001c4e7c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 [ 1359.057877] #2: ff11000120e590f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1359.069034] #3: ff11000120f11cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1359.079143] [ 1359.081614] =============================================\x0a