[ 760.729936] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.733881] nipa-hw-worker: [5/40] Retrying drivers/net:napi_threaded.py
[ 760.897649] kselftest: Running tests in drivers/net
[ 872.436103] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 989.749159] INFO: task python3:5197 blocked for more than 122 seconds.
[ 989.757381] Not tainted 7.0.0-rc5-oukr-g8a73fac8834f #1
[ 989.764631] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.774218] task:python3 state:D stack:25312 pid:5197 tgid:5197 ppid:5196 task_flags:0x400100 flags:0x00080000
[ 989.787425] Call Trace:
[ 989.790965]
[ 989.794115] __schedule+0xad9/0x1490
[ 989.798929] ? io_schedule_timeout+0x130/0x130
[ 989.804712] ? find_held_lock+0x2b/0x80
[ 989.809815] ? __lock_release.isra.0+0x59/0x170
[ 989.815701] schedule+0xd4/0x260
[ 989.820119] schedule_preempt_disabled+0x18/0x30
[ 989.826095] __mutex_lock+0xd76/0x1f20
[ 989.831099] ? threaded_store+0x132/0x220
[ 989.836399] ? ww_mutex_lock+0x160/0x160
[ 989.841589] ? selinux_inode_free_security+0x310/0x310
[ 989.848159] ? cap_capable+0x1ed/0x3f0
[ 989.853167] ? sysfs_file_ops+0x140/0x140
[ 989.858464] ? threaded_store+0x132/0x220
[ 989.863760] threaded_store+0x132/0x220
[ 989.868862] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.874355] ? sysfs_file_ops+0x140/0x140
[ 989.879649] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.884946] ? sysfs_kf_write+0x65/0x160
[ 989.890145] kernfs_fop_write_iter+0x335/0x510
[ 989.895931] ? kernfs_ops+0xf0/0xf0
[ 989.900642] new_sync_write+0x308/0x6f0
[ 989.905744] ? new_sync_read+0x6f0/0x6f0
[ 989.910942] ? lock_acquire.part.0+0xbc/0x260
[ 989.916626] ? ksys_write+0xff/0x200
[ 989.921437] vfs_write+0x62a/0x980
[ 989.926053] ksys_write+0xff/0x200
[ 989.930668] ? __ia32_sys_read+0xc0/0xc0
[ 989.935866] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.941454] ? rcu_is_watching+0x15/0xd0
[ 989.946655] do_syscall_64+0xf3/0x5e0
[ 989.951561] ? exc_page_fault+0x9e/0xb0
[ 989.956659] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.963125] RIP: 0033:0x7faa047acc5e
[ 989.967933] RSP: 002b:00007fff1c7e8ce0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.977234] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faa047acc5e
[ 989.986039] RDX: 0000000000000001 RSI: 000055bd46a24760 RDI: 0000000000000007
[ 989.994845] RBP: 00007fff1c7e8cf0 R08: 0000000000000000 R09: 0000000000000000
[ 990.003650] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faa04647e80
[ 990.012456] R13: 000055bd46a24760 R14: 0000000000000007 R15: 00007faa04eadb98
[ 990.021271]
[ 990.024561] INFO: task python3:5197 is blocked on a mutex likely owned by task python3:3220.
[ 990.034832] task:python3 state:D stack:25312 pid:3220 tgid:3220 ppid:3219 task_flags:0x400100 flags:0x00080802
[ 990.048035] Call Trace:
[ 990.051573]
[ 990.054722] __schedule+0xad9/0x1490
[ 990.059531] ? io_schedule_timeout+0x130/0x130
[ 990.065312] ? find_held_lock+0x2b/0x80
[ 990.070413] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.076593] schedule+0xd4/0x260
[ 990.081009] schedule_timeout+0x103/0x260
[ 990.086306] ? rcu_is_watching+0x15/0xd0
[ 990.091504] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.097872] ? hrtimers_cpu_dying+0x250/0x250
[ 990.103561] ? ww_mutex_lock+0x160/0x160
[ 990.108757] msleep+0x1b/0x30
[ 990.112880] napi_set_threaded+0x376/0x410
[ 990.118275] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.123768] netif_set_threaded+0x254/0x400
[ 990.129260] ? sysfs_file_ops+0x140/0x140
[ 990.134548] threaded_store+0x1bb/0x220
[ 990.139648] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.145140] ? sysfs_file_ops+0x140/0x140
[ 990.150436] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.155733] ? sysfs_kf_write+0x65/0x160
[ 990.160931] kernfs_fop_write_iter+0x335/0x510
[ 990.166713] ? kernfs_ops+0xf0/0xf0
[ 990.171424] new_sync_write+0x308/0x6f0
[ 990.176527] ? new_sync_read+0x6f0/0x6f0
[ 990.181725] ? lock_acquire.part.0+0xbc/0x260
[ 990.187409] ? ksys_write+0xff/0x200
[ 990.192218] vfs_write+0x62a/0x980
[ 990.196834] ksys_write+0xff/0x200
[ 990.201449] ? __ia32_sys_read+0xc0/0xc0
[ 990.206648] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.212236] ? rcu_is_watching+0x15/0xd0
[ 990.217436] do_syscall_64+0xf3/0x5e0
[ 990.222333] ? exc_page_fault+0x9e/0xb0
[ 990.227431] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.233897] RIP: 0033:0x7effbabfbc5e
[ 990.238702] RSP: 002b:00007ffefe31f950 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.247997] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007effbabfbc5e
[ 990.256804] RDX: 0000000000000001 RSI: 00005592f62b2760 RDI: 0000000000000007
[ 990.265600] RBP: 00007ffefe31f960 R08: 0000000000000000 R09: 0000000000000000
[ 990.274407] R10: 0000000000000000 R11: 0000000000000202 R12: 00007effbaa96e80
[ 990.283203] R13: 00005592f62b2760 R14: 0000000000000007 R15: 00007effbaa26480
[ 990.292018]
[ 990.295281] \x0aShowing all locks held in the system:
[ 990.303816] 1 lock held by khungtaskd/185:
[ 990.309206] #0: ffffffff9f2ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.320687] 4 locks held by python3/3220:
[ 990.325981] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.335776] #1: ff11000150c5ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.346739] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.357894] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.367992] 4 locks held by python3/5197:
[ 990.373283] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.383070] #1: ff110001c7c93288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.394029] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.405188] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.415279]
[ 990.417745] =============================================\x0a
[ 1112.631495] INFO: task python3:5197 blocked for more than 245 seconds.
[ 1112.639692] Not tainted 7.0.0-rc5-oukr-g8a73fac8834f #1
[ 1112.647000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.656619] task:python3 state:D stack:25312 pid:5197 tgid:5197 ppid:5196 task_flags:0x400100 flags:0x00080000
[ 1112.669855] Call Trace:
[ 1112.673406]
[ 1112.676554] __schedule+0xad9/0x1490
[ 1112.681382] ? io_schedule_timeout+0x130/0x130
[ 1112.687167] ? find_held_lock+0x2b/0x80
[ 1112.692273] ? __lock_release.isra.0+0x59/0x170
[ 1112.698155] schedule+0xd4/0x260
[ 1112.702574] schedule_preempt_disabled+0x18/0x30
[ 1112.708561] __mutex_lock+0xd76/0x1f20
[ 1112.713568] ? threaded_store+0x132/0x220
[ 1112.718866] ? ww_mutex_lock+0x160/0x160
[ 1112.724075] ? selinux_inode_free_security+0x310/0x310
[ 1112.730642] ? cap_capable+0x1ed/0x3f0
[ 1112.735649] ? sysfs_file_ops+0x140/0x140
[ 1112.740945] ? threaded_store+0x132/0x220
[ 1112.746242] threaded_store+0x132/0x220
[ 1112.751390] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.756882] ? sysfs_file_ops+0x140/0x140
[ 1112.762178] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.767486] ? sysfs_kf_write+0x65/0x160
[ 1112.772684] kernfs_fop_write_iter+0x335/0x510
[ 1112.778468] ? kernfs_ops+0xf0/0xf0
[ 1112.783181] new_sync_write+0x308/0x6f0
[ 1112.788288] ? new_sync_read+0x6f0/0x6f0
[ 1112.793488] ? lock_acquire.part.0+0xbc/0x260
[ 1112.799165] ? ksys_write+0xff/0x200
[ 1112.803980] vfs_write+0x62a/0x980
[ 1112.808597] ksys_write+0xff/0x200
[ 1112.813209] ? __ia32_sys_read+0xc0/0xc0
[ 1112.818408] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.823990] ? rcu_is_watching+0x15/0xd0
[ 1112.829193] do_syscall_64+0xf3/0x5e0
[ 1112.834102] ? exc_page_fault+0x9e/0xb0
[ 1112.839201] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.845672] RIP: 0033:0x7faa047acc5e
[ 1112.850483] RSP: 002b:00007fff1c7e8ce0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.859781] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faa047acc5e
[ 1112.859785] RDX: 0000000000000001 RSI: 000055bd46a24760 RDI: 0000000000000007
[ 1112.859786] RBP: 00007fff1c7e8cf0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.859788] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faa04647e80
[ 1112.859789] R13: 000055bd46a24760 R14: 0000000000000007 R15: 00007faa04eadb98
[ 1112.859797]
[ 1112.859883] INFO: task python3:5197 is blocked on a mutex likely owned by task python3:3220.
[ 1112.917399] task:python3 state:D stack:25312 pid:3220 tgid:3220 ppid:3219 task_flags:0x400100 flags:0x00080802
[ 1112.930600] Call Trace:
[ 1112.934137]
[ 1112.937287] __schedule+0xad9/0x1490
[ 1112.942098] ? io_schedule_timeout+0x130/0x130
[ 1112.947884] ? find_held_lock+0x2b/0x80
[ 1112.952988] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.959167] schedule+0xd4/0x260
[ 1112.963588] schedule_timeout+0x103/0x260
[ 1112.968887] ? rcu_is_watching+0x15/0xd0
[ 1112.974086] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.980458] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.986149] ? ww_mutex_lock+0x160/0x160
[ 1112.991352] msleep+0x1b/0x30
[ 1112.995481] napi_set_threaded+0x376/0x410
[ 1113.000876] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.006371] netif_set_threaded+0x254/0x400
[ 1113.011866] ? sysfs_file_ops+0x140/0x140
[ 1113.017163] threaded_store+0x1bb/0x220
[ 1113.022268] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.027760] ? sysfs_file_ops+0x140/0x140
[ 1113.033059] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.038356] ? sysfs_kf_write+0x65/0x160
[ 1113.043555] kernfs_fop_write_iter+0x335/0x510
[ 1113.049346] ? kernfs_ops+0xf0/0xf0
[ 1113.054057] new_sync_write+0x308/0x6f0
[ 1113.059160] ? new_sync_read+0x6f0/0x6f0
[ 1113.064353] ? lock_acquire.part.0+0xbc/0x260
[ 1113.070042] ? ksys_write+0xff/0x200
[ 1113.074854] vfs_write+0x62a/0x980
[ 1113.079472] ksys_write+0xff/0x200
[ 1113.084086] ? __ia32_sys_read+0xc0/0xc0
[ 1113.089284] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.094874] ? rcu_is_watching+0x15/0xd0
[ 1113.100075] do_syscall_64+0xf3/0x5e0
[ 1113.104980] ? exc_page_fault+0x9e/0xb0
[ 1113.110084] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.116549] RIP: 0033:0x7effbabfbc5e
[ 1113.121359] RSP: 002b:00007ffefe31f950 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.130658] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007effbabfbc5e
[ 1113.139468] RDX: 0000000000000001 RSI: 00005592f62b2760 RDI: 0000000000000007
[ 1113.148282] RBP: 00007ffefe31f960 R08: 0000000000000000 R09: 0000000000000000
[ 1113.157091] R10: 0000000000000000 R11: 0000000000000202 R12: 00007effbaa96e80
[ 1113.165900] R13: 00005592f62b2760 R14: 0000000000000007 R15: 00007effbaa26480
[ 1113.174715]
[ 1113.177981] \x0aShowing all locks held in the system:
[ 1113.186530] 1 lock held by khungtaskd/185:
[ 1113.191922] #0: ffffffff9f2ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.203407] 4 locks held by python3/3220:
[ 1113.208705] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.218498] #1: ff11000150c5ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.229463] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.240619] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.250718] 4 locks held by python3/5197:
[ 1113.256012] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.265801] #1: ff110001c7c93288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.276764] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.287921] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.298004] 5 locks held by (time-dir)/6308:
[ 1113.303592] #0: ff1100012dc413f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.313382] #1: ff1100013d496888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.324348] #2: ffffffff9f337248 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1113.335018] #3: ffffffff9f168f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1113.346664] #4: ffffffff9f336f50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1113.359091]
[ 1113.361567] =============================================\x0a
[ 1235.512825] INFO: task python3:5197 blocked for more than 368 seconds.
[ 1235.520973] Not tainted 7.0.0-rc5-oukr-g8a73fac8834f #1
[ 1235.528221] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.537810] task:python3 state:D stack:25312 pid:5197 tgid:5197 ppid:5196 task_flags:0x400100 flags:0x00080002
[ 1235.551017] Call Trace:
[ 1235.554556]
[ 1235.557705] __schedule+0xad9/0x1490
[ 1235.562520] ? io_schedule_timeout+0x130/0x130
[ 1235.568305] ? find_held_lock+0x2b/0x80
[ 1235.573411] ? __lock_release.isra.0+0x59/0x170
[ 1235.579294] schedule+0xd4/0x260
[ 1235.583705] schedule_preempt_disabled+0x18/0x30
[ 1235.589676] __mutex_lock+0xd76/0x1f20
[ 1235.594679] ? threaded_store+0x132/0x220
[ 1235.599977] ? ww_mutex_lock+0x160/0x160
[ 1235.605176] ? selinux_inode_free_security+0x310/0x310
[ 1235.611745] ? cap_capable+0x1ed/0x3f0
[ 1235.616751] ? sysfs_file_ops+0x140/0x140
[ 1235.622050] ? threaded_store+0x132/0x220
[ 1235.627344] threaded_store+0x132/0x220
[ 1235.632449] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.637941] ? sysfs_file_ops+0x140/0x140
[ 1235.643229] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.648523] ? sysfs_kf_write+0x65/0x160
[ 1235.653724] kernfs_fop_write_iter+0x335/0x510
[ 1235.659510] ? kernfs_ops+0xf0/0xf0
[ 1235.664222] new_sync_write+0x308/0x6f0
[ 1235.669315] ? new_sync_read+0x6f0/0x6f0
[ 1235.674515] ? lock_acquire.part.0+0xbc/0x260
[ 1235.680201] ? ksys_write+0xff/0x200
[ 1235.685012] vfs_write+0x62a/0x980
[ 1235.689625] ksys_write+0xff/0x200
[ 1235.694238] ? __ia32_sys_read+0xc0/0xc0
[ 1235.699434] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.705021] ? rcu_is_watching+0x15/0xd0
[ 1235.710221] do_syscall_64+0xf3/0x5e0
[ 1235.715126] ? exc_page_fault+0x9e/0xb0
[ 1235.720228] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.726688] RIP: 0033:0x7faa047acc5e
[ 1235.731498] RSP: 002b:00007fff1c7e8ce0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.740795] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faa047acc5e
[ 1235.749604] RDX: 0000000000000001 RSI: 000055bd46a24760 RDI: 0000000000000007
[ 1235.758412] RBP: 00007fff1c7e8cf0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.767216] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faa04647e80
[ 1235.776024] R13: 000055bd46a24760 R14: 0000000000000007 R15: 00007faa04eadb98
[ 1235.784830]
[ 1235.788114] INFO: task python3:5197 is blocked on a mutex likely owned by task python3:3220.
[ 1235.798384] task:python3 state:D stack:25312 pid:3220 tgid:3220 ppid:3219 task_flags:0x400100 flags:0x00080802
[ 1235.811587] Call Trace:
[ 1235.815125]
[ 1235.818274] __schedule+0xad9/0x1490
[ 1235.823086] ? io_schedule_timeout+0x130/0x130
[ 1235.828869] ? find_held_lock+0x2b/0x80
[ 1235.833969] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.840148] schedule+0xd4/0x260
[ 1235.844566] schedule_timeout+0x103/0x260
[ 1235.849862] ? rcu_is_watching+0x15/0xd0
[ 1235.855060] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.861431] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.867118] ? ww_mutex_lock+0x160/0x160
[ 1235.872318] msleep+0x1b/0x30
[ 1235.876444] napi_set_threaded+0x376/0x410
[ 1235.881837] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.887329] netif_set_threaded+0x254/0x400
[ 1235.892813] ? sysfs_file_ops+0x140/0x140
[ 1235.898107] threaded_store+0x1bb/0x220
[ 1235.903211] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.908702] ? sysfs_file_ops+0x140/0x140
[ 1235.913995] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.919290] ? sysfs_kf_write+0x65/0x160
[ 1235.924491] kernfs_fop_write_iter+0x335/0x510
[ 1235.930276] ? kernfs_ops+0xf0/0xf0
[ 1235.934975] new_sync_write+0x308/0x6f0
[ 1235.940077] ? new_sync_read+0x6f0/0x6f0
[ 1235.945273] ? lock_acquire.part.0+0xbc/0x260
[ 1235.950960] ? ksys_write+0xff/0x200
[ 1235.955772] vfs_write+0x62a/0x980
[ 1235.960386] ksys_write+0xff/0x200
[ 1235.964999] ? __ia32_sys_read+0xc0/0xc0
[ 1235.970197] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.975785] ? rcu_is_watching+0x15/0xd0
[ 1235.980985] do_syscall_64+0xf3/0x5e0
[ 1235.985890] ? exc_page_fault+0x9e/0xb0
[ 1235.990988] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.997452] RIP: 0033:0x7effbabfbc5e
[ 1236.002257] RSP: 002b:00007ffefe31f950 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.011554] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007effbabfbc5e
[ 1236.020362] RDX: 0000000000000001 RSI: 00005592f62b2760 RDI: 0000000000000007
[ 1236.029162] RBP: 00007ffefe31f960 R08: 0000000000000000 R09: 0000000000000000
[ 1236.037968] R10: 0000000000000000 R11: 0000000000000202 R12: 00007effbaa96e80
[ 1236.046774] R13: 00005592f62b2760 R14: 0000000000000007 R15: 00007effbaa26480
[ 1236.055585]
[ 1236.058853] \x0aShowing all locks held in the system:
[ 1236.067388] 1 lock held by khungtaskd/185:
[ 1236.072781] #0: ffffffff9f2ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.084263] 4 locks held by python3/3220:
[ 1236.089556] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.099349] #1: ff11000150c5ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.110313] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.121468] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.131561] 4 locks held by python3/5197:
[ 1236.136856] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.146646] #1: ff110001c7c93288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.157608] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.168766] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.178859]
[ 1236.181323] =============================================\x0a
[ 1358.394157] INFO: task python3:5197 blocked for more than 491 seconds.
[ 1358.402313] Not tainted 7.0.0-rc5-oukr-g8a73fac8834f #1
[ 1358.409562] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.419152] task:python3 state:D stack:25312 pid:5197 tgid:5197 ppid:5196 task_flags:0x400100 flags:0x00080002
[ 1358.432359] Call Trace:
[ 1358.435896]
[ 1358.439048] __schedule+0xad9/0x1490
[ 1358.443863] ? io_schedule_timeout+0x130/0x130
[ 1358.449648] ? find_held_lock+0x2b/0x80
[ 1358.454753] ? __lock_release.isra.0+0x59/0x170
[ 1358.460634] schedule+0xd4/0x260
[ 1358.465054] schedule_preempt_disabled+0x18/0x30
[ 1358.471033] __mutex_lock+0xd76/0x1f20
[ 1358.476039] ? threaded_store+0x132/0x220
[ 1358.481337] ? ww_mutex_lock+0x160/0x160
[ 1358.486535] ? selinux_inode_free_security+0x310/0x310
[ 1358.493094] ? cap_capable+0x1ed/0x3f0
[ 1358.498101] ? sysfs_file_ops+0x140/0x140
[ 1358.503400] ? threaded_store+0x132/0x220
[ 1358.508684] threaded_store+0x132/0x220
[ 1358.513786] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.519276] ? sysfs_file_ops+0x140/0x140
[ 1358.524574] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.529868] ? sysfs_kf_write+0x65/0x160
[ 1358.535068] kernfs_fop_write_iter+0x335/0x510
[ 1358.540843] ? kernfs_ops+0xf0/0xf0
[ 1358.545554] new_sync_write+0x308/0x6f0
[ 1358.550657] ? new_sync_read+0x6f0/0x6f0
[ 1358.555857] ? lock_acquire.part.0+0xbc/0x260
[ 1358.561542] ? ksys_write+0xff/0x200
[ 1358.566352] vfs_write+0x62a/0x980
[ 1358.570956] ksys_write+0xff/0x200
[ 1358.575569] ? __ia32_sys_read+0xc0/0xc0
[ 1358.580769] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.586355] ? rcu_is_watching+0x15/0xd0
[ 1358.591554] do_syscall_64+0xf3/0x5e0
[ 1358.596458] ? exc_page_fault+0x9e/0xb0
[ 1358.601559] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.608025] RIP: 0033:0x7faa047acc5e
[ 1358.612835] RSP: 002b:00007fff1c7e8ce0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.622132] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007faa047acc5e
[ 1358.630942] RDX: 0000000000000001 RSI: 000055bd46a24760 RDI: 0000000000000007
[ 1358.639749] RBP: 00007fff1c7e8cf0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.648549] R10: 0000000000000000 R11: 0000000000000202 R12: 00007faa04647e80
[ 1358.657347] R13: 000055bd46a24760 R14: 0000000000000007 R15: 00007faa04eadb98
[ 1358.666161]
[ 1358.669446] INFO: task python3:5197 is blocked on a mutex likely owned by task python3:3220.
[ 1358.679718] task:python3 state:D stack:25312 pid:3220 tgid:3220 ppid:3219 task_flags:0x400100 flags:0x00080802
[ 1358.692920] Call Trace:
[ 1358.696458]
[ 1358.699605] __schedule+0xad9/0x1490
[ 1358.704417] ? io_schedule_timeout+0x130/0x130
[ 1358.710200] ? find_held_lock+0x2b/0x80
[ 1358.715301] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.721477] schedule+0xd4/0x260
[ 1358.725895] schedule_timeout+0x103/0x260
[ 1358.731191] ? rcu_is_watching+0x15/0xd0
[ 1358.736387] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.742758] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.748449] ? ww_mutex_lock+0x160/0x160
[ 1358.753648] msleep+0x1b/0x30
[ 1358.757774] napi_set_threaded+0x376/0x410
[ 1358.763168] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.768661] netif_set_threaded+0x254/0x400
[ 1358.774150] ? sysfs_file_ops+0x140/0x140
[ 1358.779446] threaded_store+0x1bb/0x220
[ 1358.784549] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.790031] ? sysfs_file_ops+0x140/0x140
[ 1358.795323] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.800618] ? sysfs_kf_write+0x65/0x160
[ 1358.805819] kernfs_fop_write_iter+0x335/0x510
[ 1358.811595] ? kernfs_ops+0xf0/0xf0
[ 1358.816304] new_sync_write+0x308/0x6f0
[ 1358.821405] ? new_sync_read+0x6f0/0x6f0
[ 1358.826604] ? lock_acquire.part.0+0xbc/0x260
[ 1358.832290] ? ksys_write+0xff/0x200
[ 1358.837100] vfs_write+0x62a/0x980
[ 1358.841715] ksys_write+0xff/0x200
[ 1358.846319] ? __ia32_sys_read+0xc0/0xc0
[ 1358.851516] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.857103] ? rcu_is_watching+0x15/0xd0
[ 1358.862303] do_syscall_64+0xf3/0x5e0
[ 1358.867198] ? exc_page_fault+0x9e/0xb0
[ 1358.872297] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.878762] RIP: 0033:0x7effbabfbc5e
[ 1358.883567] RSP: 002b:00007ffefe31f950 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.892864] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007effbabfbc5e
[ 1358.901669] RDX: 0000000000000001 RSI: 00005592f62b2760 RDI: 0000000000000007
[ 1358.910474] RBP: 00007ffefe31f960 R08: 0000000000000000 R09: 0000000000000000
[ 1358.919281] R10: 0000000000000000 R11: 0000000000000202 R12: 00007effbaa96e80
[ 1358.928085] R13: 00005592f62b2760 R14: 0000000000000007 R15: 00007effbaa26480
[ 1358.936896]
[ 1358.940164] \x0aShowing all locks held in the system:
[ 1358.948700] 1 lock held by khungtaskd/185:
[ 1358.954093] #0: ffffffff9f2ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.965572] 4 locks held by python3/3220:
[ 1358.970865] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.980654] #1: ff11000150c5ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.991614] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.002769] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.012864] 4 locks held by python3/5197:
[ 1359.018159] #0: ff1100012db593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.027949] #1: ff110001c7c93288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.038911] #2: ff110001203810f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.050069] #3: ff11000120499d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.060161]
[ 1359.062626] =============================================\x0a