[ 782.368043] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 782.370568] nipa-hw-worker: [5/43] Retrying drivers/net:napi_threaded.py
[ 782.526180] kselftest: Running tests in drivers/net
[ 989.699620] INFO: task python3:5770 blocked for more than 122 seconds.
[ 989.707853] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1
[ 989.715792] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.725384] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080000
[ 989.738591] Call Trace:
[ 989.742132]
[ 989.745285] __schedule+0xcba/0x1940
[ 989.750105] ? io_schedule_timeout+0x140/0x140
[ 989.755891] ? find_held_lock+0x2b/0x80
[ 989.760998] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.766883] schedule+0xd4/0x260
[ 989.771302] schedule_preempt_disabled+0x18/0x30
[ 989.777281] __mutex_lock+0x6a3/0x2000
[ 989.782288] ? threaded_store+0x132/0x220
[ 989.787589] ? ww_mutex_lock+0x160/0x160
[ 989.792787] ? selinux_inode_free_security+0x330/0x330
[ 989.799348] ? cap_capable+0x1d6/0x3e0
[ 989.804357] ? threaded_store+0x132/0x220
[ 989.809652] threaded_store+0x132/0x220
[ 989.814753] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.820054] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.825353] ? sysfs_kf_write+0x65/0x160
[ 989.830547] ? sysfs_file_ops+0x140/0x140
[ 989.835844] kernfs_fop_write_iter+0x335/0x510
[ 989.841622] ? kernfs_ops+0xf0/0xf0
[ 989.846332] new_sync_write+0x333/0x750
[ 989.851436] ? __lock_acquire+0x508/0xc10
[ 989.856736] ? new_sync_read+0x740/0x740
[ 989.861937] ? lock_acquire.part.0+0xbc/0x260
[ 989.867624] ? ksys_write+0x116/0x250
[ 989.872537] vfs_write+0x657/0x9b0
[ 989.877152] ksys_write+0x116/0x250
[ 989.881856] ? __ia32_sys_read+0xc0/0xc0
[ 989.887053] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.892644] ? rcu_is_watching+0x15/0xd0
[ 989.897844] do_syscall_64+0xf3/0x650
[ 989.902754] ? trace_hardirqs_off+0xd/0x30
[ 989.908151] ? exc_page_fault+0xda/0xf0
[ 989.913256] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.919723] RIP: 0033:0x7f66b1cc622e
[ 989.924533] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.933821] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e
[ 989.942628] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007
[ 989.951429] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000
[ 989.960239] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390
[ 989.969054] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003
[ 989.977868]
[ 989.981144] INFO: task python3:5770 is blocked on a mutex likely owned by task python3:3679.
[ 989.991419] task:python3 state:D stack:25672 pid:3679 tgid:3679 ppid:3677 task_flags:0x400100 flags:0x00080802
[ 990.004613] Call Trace:
[ 990.008154]
[ 990.011306] __schedule+0xcba/0x1940
[ 990.016117] ? io_schedule_timeout+0x140/0x140
[ 990.021902] ? find_held_lock+0x2b/0x80
[ 990.027007] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.033188] schedule+0xd4/0x260
[ 990.037607] schedule_timeout+0x13f/0x290
[ 990.042895] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.049264] ? trace_contention_end+0xb3/0x1a0
[ 990.055051] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.060743] ? ww_mutex_lock+0x160/0x160
[ 990.065943] msleep+0x1b/0x30
[ 990.070071] napi_set_threaded+0x3a5/0x440
[ 990.075466] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.080962] netif_set_threaded+0x257/0x400
[ 990.086460] threaded_store+0x1b8/0x220
[ 990.091565] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.096864] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.102161] ? sysfs_kf_write+0x65/0x160
[ 990.107361] ? sysfs_file_ops+0x140/0x140
[ 990.112655] kernfs_fop_write_iter+0x335/0x510
[ 990.118439] ? kernfs_ops+0xf0/0xf0
[ 990.123152] new_sync_write+0x333/0x750
[ 990.128245] ? __lock_acquire+0x508/0xc10
[ 990.133543] ? new_sync_read+0x740/0x740
[ 990.138743] ? lock_acquire.part.0+0xbc/0x260
[ 990.144419] ? ksys_write+0x116/0x250
[ 990.149328] vfs_write+0x657/0x9b0
[ 990.153942] ksys_write+0x116/0x250
[ 990.158655] ? __ia32_sys_read+0xc0/0xc0
[ 990.163847] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.169439] ? rcu_is_watching+0x15/0xd0
[ 990.174640] do_syscall_64+0xf3/0x650
[ 990.179545] ? trace_hardirqs_off+0xd/0x30
[ 990.184939] ? exc_page_fault+0xda/0xf0
[ 990.190042] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.196500] RIP: 0033:0x7f4d5eead22e
[ 990.201311] RSP: 002b:00007ffe6d4ca7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.210607] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d5eead22e
[ 990.219404] RDX: 0000000000000001 RSI: 000055dc2ae19a10 RDI: 0000000000000007
[ 990.228215] RBP: 00007ffe6d4ca800 R08: 0000000000000000 R09: 0000000000000000
[ 990.237024] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d5ed25390
[ 990.245833] R13: 000055dc2ae19a10 R14: 0000000000000007 R15: 0000000000000003
[ 990.254646]
[ 990.257906] \x0aShowing all locks held in the system:
[ 990.266444] 1 lock held by khungtaskd/185:
[ 990.271841] #0: ffffffffb42fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.283315] 2 locks held by systemd-journal/803:
[ 990.289294] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.299184] #1: ff110001a2818378 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.309962] 4 locks held by python3/3679:
[ 990.315256] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.325145] #1: ff1100016809a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.336111] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.347270] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.357364] 4 locks held by python3/5770:
[ 990.362660] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.372550] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.383511] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.394662] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.404750]
[ 990.407215] =============================================\x0a
[ 1112.579716] INFO: task python3:5770 blocked for more than 245 seconds.
[ 1112.587859] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1
[ 1112.595109] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.604699] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080000
[ 1112.617908] Call Trace:
[ 1112.621450]
[ 1112.624603] __schedule+0xcba/0x1940
[ 1112.629421] ? io_schedule_timeout+0x140/0x140
[ 1112.635207] ? find_held_lock+0x2b/0x80
[ 1112.640315] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.646202] schedule+0xd4/0x260
[ 1112.650624] schedule_preempt_disabled+0x18/0x30
[ 1112.656605] __mutex_lock+0x6a3/0x2000
[ 1112.661612] ? threaded_store+0x132/0x220
[ 1112.666913] ? ww_mutex_lock+0x160/0x160
[ 1112.672112] ? selinux_inode_free_security+0x330/0x330
[ 1112.678674] ? cap_capable+0x1d6/0x3e0
[ 1112.683685] ? threaded_store+0x132/0x220
[ 1112.688984] threaded_store+0x132/0x220
[ 1112.694088] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.699389] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.704690] ? sysfs_kf_write+0x65/0x160
[ 1112.709891] ? sysfs_file_ops+0x140/0x140
[ 1112.715189] kernfs_fop_write_iter+0x335/0x510
[ 1112.720974] ? kernfs_ops+0xf0/0xf0
[ 1112.725685] new_sync_write+0x333/0x750
[ 1112.730790] ? __lock_acquire+0x508/0xc10
[ 1112.736089] ? new_sync_read+0x740/0x740
[ 1112.741294] ? lock_acquire.part.0+0xbc/0x260
[ 1112.746980] ? ksys_write+0x116/0x250
[ 1112.751891] vfs_write+0x657/0x9b0
[ 1112.756506] ksys_write+0x116/0x250
[ 1112.761209] ? __ia32_sys_read+0xc0/0xc0
[ 1112.766409] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.771990] ? rcu_is_watching+0x15/0xd0
[ 1112.777183] do_syscall_64+0xf3/0x650
[ 1112.782091] ? trace_hardirqs_off+0xd/0x30
[ 1112.787488] ? exc_page_fault+0xda/0xf0
[ 1112.792592] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.799061] RIP: 0033:0x7f66b1cc622e
[ 1112.803871] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.813173] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e
[ 1112.821982] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007
[ 1112.830793] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.839601] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390
[ 1112.848410] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003
[ 1112.857223]
[ 1112.860508] INFO: task python3:5770 is blocked on a mutex likely owned by task python3:3679.
[ 1112.870782] task:python3 state:D stack:25672 pid:3679 tgid:3679 ppid:3677 task_flags:0x400100 flags:0x00080802
[ 1112.883986] Call Trace:
[ 1112.887525]
[ 1112.890678] __schedule+0xcba/0x1940
[ 1112.895492] ? io_schedule_timeout+0x140/0x140
[ 1112.901279] ? find_held_lock+0x2b/0x80
[ 1112.906384] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.912564] schedule+0xd4/0x260
[ 1112.916983] schedule_timeout+0x13f/0x290
[ 1112.922281] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.928652] ? trace_contention_end+0xb3/0x1a0
[ 1112.934436] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.940126] ? ww_mutex_lock+0x160/0x160
[ 1112.945327] msleep+0x1b/0x30
[ 1112.949443] napi_set_threaded+0x3a5/0x440
[ 1112.954842] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.960336] netif_set_threaded+0x257/0x400
[ 1112.965831] threaded_store+0x1b8/0x220
[ 1112.970933] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.976221] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.981518] ? sysfs_kf_write+0x65/0x160
[ 1112.986717] ? sysfs_file_ops+0x140/0x140
[ 1112.992005] kernfs_fop_write_iter+0x335/0x510
[ 1112.997791] ? kernfs_ops+0xf0/0xf0
[ 1113.002505] new_sync_write+0x333/0x750
[ 1113.007609] ? __lock_acquire+0x508/0xc10
[ 1113.012908] ? new_sync_read+0x740/0x740
[ 1113.018108] ? lock_acquire.part.0+0xbc/0x260
[ 1113.023794] ? ksys_write+0x116/0x250
[ 1113.028706] vfs_write+0x657/0x9b0
[ 1113.033323] ksys_write+0x116/0x250
[ 1113.038038] ? __ia32_sys_read+0xc0/0xc0
[ 1113.043239] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.048828] ? rcu_is_watching+0x15/0xd0
[ 1113.054027] do_syscall_64+0xf3/0x650
[ 1113.058935] ? trace_hardirqs_off+0xd/0x30
[ 1113.064320] ? exc_page_fault+0xda/0xf0
[ 1113.069421] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.075888] RIP: 0033:0x7f4d5eead22e
[ 1113.080690] RSP: 002b:00007ffe6d4ca7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.089987] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d5eead22e
[ 1113.098795] RDX: 0000000000000001 RSI: 000055dc2ae19a10 RDI: 0000000000000007
[ 1113.107595] RBP: 00007ffe6d4ca800 R08: 0000000000000000 R09: 0000000000000000
[ 1113.116404] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d5ed25390
[ 1113.125210] R13: 000055dc2ae19a10 R14: 0000000000000007 R15: 0000000000000003
[ 1113.134026]
[ 1113.137289] \x0aShowing all locks held in the system:
[ 1113.145829] 1 lock held by khungtaskd/185:
[ 1113.151225] #0: ffffffffb42fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.162710] 4 locks held by python3/3679:
[ 1113.168006] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.177896] #1: ff1100016809a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.188859] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.200019] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.210114] 4 locks held by python3/5770:
[ 1113.215409] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.225298] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.236324] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.247483] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.257572] 2 locks held by systemd/6823:
[ 1113.262869]
[ 1113.265339] =============================================\x0a
[ 1210.884555] kworker/u130:6 (850) used greatest stack depth: 21456 bytes left
[ 1235.461831] INFO: task python3:5770 blocked for more than 368 seconds.
[ 1235.469980] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1
[ 1235.477230] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.486823] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080002
[ 1235.500030] Call Trace:
[ 1235.503570]
[ 1235.506723] __schedule+0xcba/0x1940
[ 1235.511542] ? io_schedule_timeout+0x140/0x140
[ 1235.517328] ? find_held_lock+0x2b/0x80
[ 1235.522435] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.528320] schedule+0xd4/0x260
[ 1235.532741] schedule_preempt_disabled+0x18/0x30
[ 1235.538723] __mutex_lock+0x6a3/0x2000
[ 1235.543731] ? threaded_store+0x132/0x220
[ 1235.549033] ? ww_mutex_lock+0x160/0x160
[ 1235.554232] ? selinux_inode_free_security+0x330/0x330
[ 1235.560801] ? cap_capable+0x1d6/0x3e0
[ 1235.565811] ? threaded_store+0x132/0x220
[ 1235.571108] threaded_store+0x132/0x220
[ 1235.576212] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.581510] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.586813] ? sysfs_kf_write+0x65/0x160
[ 1235.592016] ? sysfs_file_ops+0x140/0x140
[ 1235.597313] kernfs_fop_write_iter+0x335/0x510
[ 1235.603090] ? kernfs_ops+0xf0/0xf0
[ 1235.607801] new_sync_write+0x333/0x750
[ 1235.612905] ? __lock_acquire+0x508/0xc10
[ 1235.618201] ? new_sync_read+0x740/0x740
[ 1235.623403] ? lock_acquire.part.0+0xbc/0x260
[ 1235.629089] ? ksys_write+0x116/0x250
[ 1235.633998] vfs_write+0x657/0x9b0
[ 1235.638615] ksys_write+0x116/0x250
[ 1235.643328] ? __ia32_sys_read+0xc0/0xc0
[ 1235.648529] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.654109] ? rcu_is_watching+0x15/0xd0
[ 1235.659304] do_syscall_64+0xf3/0x650
[ 1235.664214] ? trace_hardirqs_off+0xd/0x30
[ 1235.669610] ? exc_page_fault+0xda/0xf0
[ 1235.674704] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.681166] RIP: 0033:0x7f66b1cc622e
[ 1235.685976] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.695266] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e
[ 1235.704074] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007
[ 1235.712874] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.721684] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390
[ 1235.730494] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.739308]
[ 1235.742577] INFO: task python3:5770 is blocked on a mutex likely owned by task python3:3679.
[ 1235.752851] task:python3 state:D stack:25672 pid:3679 tgid:3679 ppid:3677 task_flags:0x400100 flags:0x00080802
[ 1235.766054] Call Trace:
[ 1235.769592]
[ 1235.772744] __schedule+0xcba/0x1940
[ 1235.777558] ? io_schedule_timeout+0x140/0x140
[ 1235.783342] ? find_held_lock+0x2b/0x80
[ 1235.788447] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.794625] schedule+0xd4/0x260
[ 1235.799043] schedule_timeout+0x13f/0x290
[ 1235.804340] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.810709] ? trace_contention_end+0xb3/0x1a0
[ 1235.816496] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.822187] ? ww_mutex_lock+0x160/0x160
[ 1235.827388] msleep+0x1b/0x30
[ 1235.831505] napi_set_threaded+0x3a5/0x440
[ 1235.836900] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.842393] netif_set_threaded+0x257/0x400
[ 1235.847888] threaded_store+0x1b8/0x220
[ 1235.852993] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.858291] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.863581] ? sysfs_kf_write+0x65/0x160
[ 1235.868780] ? sysfs_file_ops+0x140/0x140
[ 1235.874077] kernfs_fop_write_iter+0x335/0x510
[ 1235.879856] ? kernfs_ops+0xf0/0xf0
[ 1235.884567] new_sync_write+0x333/0x750
[ 1235.889674] ? __lock_acquire+0x508/0xc10
[ 1235.894970] ? new_sync_read+0x740/0x740
[ 1235.900171] ? lock_acquire.part.0+0xbc/0x260
[ 1235.905858] ? ksys_write+0x116/0x250
[ 1235.910768] vfs_write+0x657/0x9b0
[ 1235.915386] ksys_write+0x116/0x250
[ 1235.920100] ? __ia32_sys_read+0xc0/0xc0
[ 1235.925296] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.930887] ? rcu_is_watching+0x15/0xd0
[ 1235.936085] do_syscall_64+0xf3/0x650
[ 1235.940991] ? trace_hardirqs_off+0xd/0x30
[ 1235.946386] ? exc_page_fault+0xda/0xf0
[ 1235.951488] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.957956] RIP: 0033:0x7f4d5eead22e
[ 1235.962765] RSP: 002b:00007ffe6d4ca7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.972062] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d5eead22e
[ 1235.980871] RDX: 0000000000000001 RSI: 000055dc2ae19a10 RDI: 0000000000000007
[ 1235.989680] RBP: 00007ffe6d4ca800 R08: 0000000000000000 R09: 0000000000000000
[ 1235.998491] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d5ed25390
[ 1236.007299] R13: 000055dc2ae19a10 R14: 0000000000000007 R15: 0000000000000003
[ 1236.016113]
[ 1236.019382] \x0aShowing all locks held in the system:
[ 1236.027920] 1 lock held by khungtaskd/185:
[ 1236.033313] #0: ffffffffb42fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.044793] 4 locks held by python3/3679:
[ 1236.050090] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.059983] #1: ff1100016809a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.070945] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.082100] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.092193] 4 locks held by python3/5770:
[ 1236.097489] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.107379] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.118333] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.129494] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.139587]
[ 1236.142054] =============================================\x0a
[ 1358.342954] INFO: task python3:5770 blocked for more than 491 seconds.
[ 1358.351121] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1
[ 1358.358392] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.368004] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080002
[ 1358.381234] Call Trace:
[ 1358.384777]
[ 1358.388475] __schedule+0xcba/0x1940
[ 1358.393305] ? io_schedule_timeout+0x140/0x140
[ 1358.399091] ? find_held_lock+0x2b/0x80
[ 1358.404196] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.410080] schedule+0xd4/0x260
[ 1358.414500] schedule_preempt_disabled+0x18/0x30
[ 1358.420471] __mutex_lock+0x6a3/0x2000
[ 1358.425465] ? threaded_store+0x132/0x220
[ 1358.430764] ? ww_mutex_lock+0x160/0x160
[ 1358.435953] ? selinux_inode_free_security+0x330/0x330
[ 1358.442540] ? cap_capable+0x1d6/0x3e0
[ 1358.447585] ? threaded_store+0x132/0x220
[ 1358.452885] threaded_store+0x132/0x220
[ 1358.457990] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.463289] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.468589] ? sysfs_kf_write+0x65/0x160
[ 1358.473797] ? sysfs_file_ops+0x140/0x140
[ 1358.479100] kernfs_fop_write_iter+0x335/0x510
[ 1358.484890] ? kernfs_ops+0xf0/0xf0
[ 1358.489604] new_sync_write+0x333/0x750
[ 1358.494712] ? __lock_acquire+0x508/0xc10
[ 1358.500014] ? new_sync_read+0x740/0x740
[ 1358.505218] ? lock_acquire.part.0+0xbc/0x260
[ 1358.510908] ? ksys_write+0x116/0x250
[ 1358.515823] vfs_write+0x657/0x9b0
[ 1358.520443] ksys_write+0x116/0x250
[ 1358.525226] ? __ia32_sys_read+0xc0/0xc0
[ 1358.530430] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.536018] ? rcu_is_watching+0x15/0xd0
[ 1358.541213] do_syscall_64+0xf3/0x650
[ 1358.546124] ? trace_hardirqs_off+0xd/0x30
[ 1358.551520] ? exc_page_fault+0xda/0xf0
[ 1358.556622] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.563083] RIP: 0033:0x7f66b1cc622e
[ 1358.567896] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.577198] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e
[ 1358.586009] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007
[ 1358.594819] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.603628] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390
[ 1358.612436] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.621256]
[ 1358.624668] INFO: task python3:5770 is blocked on a mutex likely owned by task python3:3679.
[ 1358.634945] task:python3 state:D stack:25672 pid:3679 tgid:3679 ppid:3677 task_flags:0x400100 flags:0x00080802
[ 1358.648151] Call Trace:
[ 1358.651692]
[ 1358.654846] __schedule+0xcba/0x1940
[ 1358.659662] ? io_schedule_timeout+0x140/0x140
[ 1358.665446] ? find_held_lock+0x2b/0x80
[ 1358.670539] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.676721] schedule+0xd4/0x260
[ 1358.681143] schedule_timeout+0x13f/0x290
[ 1358.686444] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.692813] ? trace_contention_end+0xb3/0x1a0
[ 1358.698599] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.704290] ? ww_mutex_lock+0x160/0x160
[ 1358.709492] msleep+0x1b/0x30
[ 1358.713619] napi_set_threaded+0x3a5/0x440
[ 1358.719017] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.724515] netif_set_threaded+0x257/0x400
[ 1358.730009] threaded_store+0x1b8/0x220
[ 1358.735112] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.740411] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.745710] ? sysfs_kf_write+0x65/0x160
[ 1358.750910] ? sysfs_file_ops+0x140/0x140
[ 1358.756198] kernfs_fop_write_iter+0x335/0x510
[ 1358.761987] ? kernfs_ops+0xf0/0xf0
[ 1358.766698] new_sync_write+0x333/0x750
[ 1358.771804] ? __lock_acquire+0x508/0xc10
[ 1358.777102] ? new_sync_read+0x740/0x740
[ 1358.782361] ? lock_acquire.part.0+0xbc/0x260
[ 1358.788051] ? ksys_write+0x116/0x250
[ 1358.792965] vfs_write+0x657/0x9b0
[ 1358.797582] ksys_write+0x116/0x250
[ 1358.802298] ? __ia32_sys_read+0xc0/0xc0
[ 1358.807500] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.813093] ? rcu_is_watching+0x15/0xd0
[ 1358.818294] do_syscall_64+0xf3/0x650
[ 1358.823202] ? trace_hardirqs_off+0xd/0x30
[ 1358.828600] ? exc_page_fault+0xda/0xf0
[ 1358.833704] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.840173] RIP: 0033:0x7f4d5eead22e
[ 1358.844982] RSP: 002b:00007ffe6d4ca7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.854282] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d5eead22e
[ 1358.863089] RDX: 0000000000000001 RSI: 000055dc2ae19a10 RDI: 0000000000000007
[ 1358.871901] RBP: 00007ffe6d4ca800 R08: 0000000000000000 R09: 0000000000000000
[ 1358.880713] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d5ed25390
[ 1358.889522] R13: 000055dc2ae19a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.898339]
[ 1358.901600] \x0aShowing all locks held in the system:
[ 1358.910141] 1 lock held by khungtaskd/185:
[ 1358.915538] #0: ffffffffb42fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.927028] 4 locks held by python3/3679:
[ 1358.932326] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.942222] #1: ff1100016809a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.953186] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.964347] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.974454] 4 locks held by python3/5770:
[ 1358.979753] #0: ff110001303e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.989636] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.000612] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.011774] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.021870] 2 locks held by 30-systemd-envi/7624:
[ 1359.027952]
[ 1359.030424] =============================================\x0a