[ 770.099318] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 770.102631] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 770.233929] kselftest: Running tests in drivers/net
[ 989.698981] INFO: task python3:5506 blocked for more than 122 seconds.
[ 989.707206] Not tainted 7.1.0-rc6-oxyj-g40dde3f80b9d #1
[ 989.715081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.724672] task:python3 state:D stack:25672 pid:5506 tgid:5506 ppid:5505 task_flags:0x400100 flags:0x00080000
[ 989.737879] Call Trace:
[ 989.741419]
[ 989.744573] __schedule+0xcc3/0x19c0
[ 989.749391] ? io_schedule_timeout+0x140/0x140
[ 989.755175] ? find_held_lock+0x2b/0x80
[ 989.760282] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.766165] schedule+0xd8/0x260
[ 989.770585] schedule_preempt_disabled+0x18/0x30
[ 989.776564] __mutex_lock+0x6af/0x2010
[ 989.781570] ? threaded_store+0x132/0x220
[ 989.786871] ? ww_mutex_lock+0x160/0x160
[ 989.792069] ? selinux_inode_free_security+0x330/0x330
[ 989.798642] ? cap_capable+0x1d6/0x3e0
[ 989.803658] ? threaded_store+0x132/0x220
[ 989.809068] threaded_store+0x132/0x220
[ 989.814176] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.819473] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.824774] ? sysfs_kf_write+0x65/0x160
[ 989.829966] ? sysfs_file_ops+0x140/0x140
[ 989.835263] kernfs_fop_write_iter+0x335/0x510
[ 989.841052] ? kernfs_ops+0xf0/0xf0
[ 989.845763] new_sync_write+0x333/0x750
[ 989.850859] ? __lock_acquire+0x508/0xc10
[ 989.856155] ? new_sync_read+0x740/0x740
[ 989.861358] ? lock_acquire.part.0+0xbc/0x260
[ 989.867044] ? ksys_write+0x116/0x250
[ 989.871953] vfs_write+0x657/0x9b0
[ 989.876570] ksys_write+0x116/0x250
[ 989.881283] ? __ia32_sys_read+0xc0/0xc0
[ 989.886480] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.892071] ? rcu_is_watching+0x15/0xd0
[ 989.897271] do_syscall_64+0xf3/0x650
[ 989.902172] ? trace_hardirqs_off+0xd/0x30
[ 989.907568] ? exc_page_fault+0xda/0xf0
[ 989.912672] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.919141] RIP: 0033:0x7f068846b64e
[ 989.923958] RSP: 002b:00007ffc8b777550 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.933257] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f068846b64e
[ 989.942067] RDX: 0000000000000001 RSI: 0000557e0e5fbbf0 RDI: 0000000000000007
[ 989.950876] RBP: 00007ffc8b777560 R08: 0000000000000000 R09: 0000000000000000
[ 989.959685] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f06882e4390
[ 989.968494] R13: 0000557e0e5fbbf0 R14: 0000000000000007 R15: 00007f0688279120
[ 989.977308]
[ 989.980578] INFO: task python3:5506 is blocked on a mutex likely owned by task python3:3521.
[ 989.990849] task:python3 state:D stack:25672 pid:3521 tgid:3521 ppid:3520 task_flags:0x400100 flags:0x00080802
[ 990.004052] Call Trace:
[ 990.007590]
[ 990.010741] __schedule+0xcc3/0x19c0
[ 990.015554] ? io_schedule_timeout+0x140/0x140
[ 990.021338] ? find_held_lock+0x2b/0x80
[ 990.026441] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.032619] schedule+0xd8/0x260
[ 990.037037] schedule_timeout+0x13f/0x290
[ 990.042334] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.048704] ? trace_contention_end+0xb3/0x1a0
[ 990.054490] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.060182] ? ww_mutex_lock+0x160/0x160
[ 990.065383] msleep+0x1b/0x30
[ 990.069508] napi_set_threaded+0x3a5/0x440
[ 990.074903] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.080397] netif_set_threaded+0x257/0x400
[ 990.085891] threaded_store+0x1b8/0x220
[ 990.090995] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.096292] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.101580] ? sysfs_kf_write+0x65/0x160
[ 990.106780] ? sysfs_file_ops+0x140/0x140
[ 990.112069] kernfs_fop_write_iter+0x335/0x510
[ 990.117855] ? kernfs_ops+0xf0/0xf0
[ 990.122567] new_sync_write+0x333/0x750
[ 990.127670] ? __lock_acquire+0x508/0xc10
[ 990.132956] ? new_sync_read+0x740/0x740
[ 990.138158] ? lock_acquire.part.0+0xbc/0x260
[ 990.143845] ? ksys_write+0x116/0x250
[ 990.148757] vfs_write+0x657/0x9b0
[ 990.153375] ksys_write+0x116/0x250
[ 990.158086] ? __ia32_sys_read+0xc0/0xc0
[ 990.163284] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.168876] ? rcu_is_watching+0x15/0xd0
[ 990.174075] do_syscall_64+0xf3/0x650
[ 990.178984] ? irq_exit_rcu+0x1a/0x30
[ 990.183891] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.190360] RIP: 0033:0x7f2bde04164e
[ 990.195170] RSP: 002b:00007ffc2b90eed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.204457] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2bde04164e
[ 990.213266] RDX: 0000000000000001 RSI: 0000562f6ddbbbf0 RDI: 0000000000000007
[ 990.222075] RBP: 00007ffc2b90eee0 R08: 0000000000000000 R09: 0000000000000000
[ 990.230884] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2bddeba390
[ 990.239693] R13: 0000562f6ddbbbf0 R14: 0000000000000007 R15: 00007f2bdde4d120
[ 990.248507]
[ 990.251764] \x0aShowing all locks held in the system:
[ 990.260293] 1 lock held by khungtaskd/184:
[ 990.265684] #0: ffffffff950fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.277168] 4 locks held by python3/3521:
[ 990.282464] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.292355] #1: ff1100013e21b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.303317] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.314464] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.324560] 4 locks held by python3/5506:
[ 990.329855] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.339745] #1: ff11000119f74a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.350705] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.361861] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.371951]
[ 990.374407] =============================================\x0a
[ 1112.580146] INFO: task python3:5506 blocked for more than 245 seconds.
[ 1112.588295] Not tainted 7.1.0-rc6-oxyj-g40dde3f80b9d #1
[ 1112.595545] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.605136] task:python3 state:D stack:25672 pid:5506 tgid:5506 ppid:5505 task_flags:0x400100 flags:0x00080000
[ 1112.618342] Call Trace:
[ 1112.621881]
[ 1112.625030] __schedule+0xcc3/0x19c0
[ 1112.629844] ? io_schedule_timeout+0x140/0x140
[ 1112.635621] ? find_held_lock+0x2b/0x80
[ 1112.640723] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.646608] schedule+0xd8/0x260
[ 1112.651025] schedule_preempt_disabled+0x18/0x30
[ 1112.657002] __mutex_lock+0x6af/0x2010
[ 1112.662005] ? threaded_store+0x132/0x220
[ 1112.667304] ? ww_mutex_lock+0x160/0x160
[ 1112.672494] ? selinux_inode_free_security+0x330/0x330
[ 1112.679065] ? cap_capable+0x1d6/0x3e0
[ 1112.684074] ? threaded_store+0x132/0x220
[ 1112.689368] threaded_store+0x132/0x220
[ 1112.694469] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.699767] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.705065] ? sysfs_kf_write+0x65/0x160
[ 1112.710265] ? sysfs_file_ops+0x140/0x140
[ 1112.715558] kernfs_fop_write_iter+0x335/0x510
[ 1112.721343] ? kernfs_ops+0xf0/0xf0
[ 1112.726054] new_sync_write+0x333/0x750
[ 1112.731156] ? __lock_acquire+0x508/0xc10
[ 1112.736453] ? new_sync_read+0x740/0x740
[ 1112.741646] ? lock_acquire.part.0+0xbc/0x260
[ 1112.747331] ? ksys_write+0x116/0x250
[ 1112.752241] vfs_write+0x657/0x9b0
[ 1112.756854] ksys_write+0x116/0x250
[ 1112.761562] ? __ia32_sys_read+0xc0/0xc0
[ 1112.766760] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.772346] ? rcu_is_watching+0x15/0xd0
[ 1112.777548] do_syscall_64+0xf3/0x650
[ 1112.782454] ? trace_hardirqs_off+0xd/0x30
[ 1112.787846] ? exc_page_fault+0xda/0xf0
[ 1112.792949] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.799415] RIP: 0033:0x7f068846b64e
[ 1112.804222] RSP: 002b:00007ffc8b777550 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.813521] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f068846b64e
[ 1112.822327] RDX: 0000000000000001 RSI: 0000557e0e5fbbf0 RDI: 0000000000000007
[ 1112.831132] RBP: 00007ffc8b777560 R08: 0000000000000000 R09: 0000000000000000
[ 1112.839937] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f06882e4390
[ 1112.848746] R13: 0000557e0e5fbbf0 R14: 0000000000000007 R15: 00007f0688279120
[ 1112.857559]
[ 1112.860864] INFO: task python3:5506 is blocked on a mutex likely owned by task python3:3521.
[ 1112.871137] task:python3 state:D stack:25672 pid:3521 tgid:3521 ppid:3520 task_flags:0x400100 flags:0x00080802
[ 1112.884339] Call Trace:
[ 1112.887876]
[ 1112.891024] __schedule+0xcc3/0x19c0
[ 1112.895833] ? io_schedule_timeout+0x140/0x140
[ 1112.901618] ? find_held_lock+0x2b/0x80
[ 1112.906709] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.912888] schedule+0xd8/0x260
[ 1112.917307] schedule_timeout+0x13f/0x290
[ 1112.922603] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.928972] ? trace_contention_end+0xb3/0x1a0
[ 1112.934748] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.940437] ? ww_mutex_lock+0x160/0x160
[ 1112.945634] msleep+0x1b/0x30
[ 1112.949756] napi_set_threaded+0x3a5/0x440
[ 1112.955151] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.960646] netif_set_threaded+0x257/0x400
[ 1112.966137] threaded_store+0x1b8/0x220
[ 1112.971239] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.976534] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.981830] ? sysfs_kf_write+0x65/0x160
[ 1112.987026] ? sysfs_file_ops+0x140/0x140
[ 1112.992320] kernfs_fop_write_iter+0x335/0x510
[ 1112.998104] ? kernfs_ops+0xf0/0xf0
[ 1113.002814] new_sync_write+0x333/0x750
[ 1113.007917] ? __lock_acquire+0x508/0xc10
[ 1113.013204] ? new_sync_read+0x740/0x740
[ 1113.018402] ? lock_acquire.part.0+0xbc/0x260
[ 1113.024085] ? ksys_write+0x116/0x250
[ 1113.028997] vfs_write+0x657/0x9b0
[ 1113.033612] ksys_write+0x116/0x250
[ 1113.038321] ? __ia32_sys_read+0xc0/0xc0
[ 1113.043521] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.049108] ? rcu_is_watching+0x15/0xd0
[ 1113.054308] do_syscall_64+0xf3/0x650
[ 1113.059207] ? irq_exit_rcu+0x1a/0x30
[ 1113.064113] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.070580] RIP: 0033:0x7f2bde04164e
[ 1113.075376] RSP: 002b:00007ffc2b90eed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.084670] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2bde04164e
[ 1113.093476] RDX: 0000000000000001 RSI: 0000562f6ddbbbf0 RDI: 0000000000000007
[ 1113.102283] RBP: 00007ffc2b90eee0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.111091] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2bddeba390
[ 1113.119898] R13: 0000562f6ddbbbf0 R14: 0000000000000007 R15: 00007f2bdde4d120
[ 1113.128710]
[ 1113.131972] \x0aShowing all locks held in the system:
[ 1113.140513] 1 lock held by khungtaskd/184:
[ 1113.145906] #0: ffffffff950fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.157388] 4 locks held by python3/3521:
[ 1113.162681] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.172569] #1: ff1100013e21b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.183528] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.194684] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.204780] 4 locks held by python3/5506:
[ 1113.210072] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.219960] #1: ff11000119f74a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.230918] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.242073] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.252164]
[ 1113.254631] =============================================\x0a
[ 1235.461324] INFO: task python3:5506 blocked for more than 368 seconds.
[ 1235.469473] Not tainted 7.1.0-rc6-oxyj-g40dde3f80b9d #1
[ 1235.476724] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.486316] task:python3 state:D stack:25672 pid:5506 tgid:5506 ppid:5505 task_flags:0x400100 flags:0x00080002
[ 1235.499524] Call Trace:
[ 1235.503066]
[ 1235.506219] __schedule+0xcc3/0x19c0
[ 1235.511038] ? io_schedule_timeout+0x140/0x140
[ 1235.516826] ? find_held_lock+0x2b/0x80
[ 1235.521932] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.527816] schedule+0xd8/0x260
[ 1235.532234] schedule_preempt_disabled+0x18/0x30
[ 1235.538212] __mutex_lock+0x6af/0x2010
[ 1235.543216] ? threaded_store+0x132/0x220
[ 1235.548515] ? ww_mutex_lock+0x160/0x160
[ 1235.553717] ? selinux_inode_free_security+0x330/0x330
[ 1235.560287] ? cap_capable+0x1d6/0x3e0
[ 1235.565296] ? threaded_store+0x132/0x220
[ 1235.570593] threaded_store+0x132/0x220
[ 1235.575694] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.580991] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.586293] ? sysfs_kf_write+0x65/0x160
[ 1235.591495] ? sysfs_file_ops+0x140/0x140
[ 1235.596792] kernfs_fop_write_iter+0x335/0x510
[ 1235.602570] ? kernfs_ops+0xf0/0xf0
[ 1235.607282] new_sync_write+0x333/0x750
[ 1235.612387] ? __lock_acquire+0x508/0xc10
[ 1235.617684] ? new_sync_read+0x740/0x740
[ 1235.622877] ? lock_acquire.part.0+0xbc/0x260
[ 1235.628565] ? ksys_write+0x116/0x250
[ 1235.633465] vfs_write+0x657/0x9b0
[ 1235.638084] ksys_write+0x116/0x250
[ 1235.642797] ? __ia32_sys_read+0xc0/0xc0
[ 1235.647995] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.653586] ? rcu_is_watching+0x15/0xd0
[ 1235.658787] do_syscall_64+0xf3/0x650
[ 1235.663693] ? trace_hardirqs_off+0xd/0x30
[ 1235.669089] ? exc_page_fault+0xda/0xf0
[ 1235.674192] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.680658] RIP: 0033:0x7f068846b64e
[ 1235.685469] RSP: 002b:00007ffc8b777550 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.694767] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f068846b64e
[ 1235.703577] RDX: 0000000000000001 RSI: 0000557e0e5fbbf0 RDI: 0000000000000007
[ 1235.712387] RBP: 00007ffc8b777560 R08: 0000000000000000 R09: 0000000000000000
[ 1235.721197] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f06882e4390
[ 1235.730006] R13: 0000557e0e5fbbf0 R14: 0000000000000007 R15: 00007f0688279120
[ 1235.738820]
[ 1235.742111] INFO: task python3:5506 is blocked on a mutex likely owned by task python3:3521.
[ 1235.752378] task:python3 state:D stack:25672 pid:3521 tgid:3521 ppid:3520 task_flags:0x400100 flags:0x00080802
[ 1235.765584] Call Trace:
[ 1235.769122]
[ 1235.772274] __schedule+0xcc3/0x19c0
[ 1235.777086] ? io_schedule_timeout+0x140/0x140
[ 1235.782872] ? find_held_lock+0x2b/0x80
[ 1235.787976] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.794154] schedule+0xd8/0x260
[ 1235.798578] schedule_timeout+0x13f/0x290
[ 1235.803874] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.810242] ? trace_contention_end+0xb3/0x1a0
[ 1235.816029] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.821720] ? ww_mutex_lock+0x160/0x160
[ 1235.826921] msleep+0x1b/0x30
[ 1235.831047] napi_set_threaded+0x3a5/0x440
[ 1235.836445] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.841939] netif_set_threaded+0x257/0x400
[ 1235.847436] threaded_store+0x1b8/0x220
[ 1235.852537] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.857834] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.863123] ? sysfs_kf_write+0x65/0x160
[ 1235.868323] ? sysfs_file_ops+0x140/0x140
[ 1235.873620] kernfs_fop_write_iter+0x335/0x510
[ 1235.879397] ? kernfs_ops+0xf0/0xf0
[ 1235.884100] new_sync_write+0x333/0x750
[ 1235.889203] ? __lock_acquire+0x508/0xc10
[ 1235.894490] ? new_sync_read+0x740/0x740
[ 1235.899691] ? lock_acquire.part.0+0xbc/0x260
[ 1235.905378] ? ksys_write+0x116/0x250
[ 1235.910286] vfs_write+0x657/0x9b0
[ 1235.914901] ksys_write+0x116/0x250
[ 1235.919613] ? __ia32_sys_read+0xc0/0xc0
[ 1235.924811] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.930401] ? rcu_is_watching+0x15/0xd0
[ 1235.935601] do_syscall_64+0xf3/0x650
[ 1235.940501] ? irq_exit_rcu+0x1a/0x30
[ 1235.945410] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.951870] RIP: 0033:0x7f2bde04164e
[ 1235.956679] RSP: 002b:00007ffc2b90eed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.965967] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2bde04164e
[ 1235.974777] RDX: 0000000000000001 RSI: 0000562f6ddbbbf0 RDI: 0000000000000007
[ 1235.983587] RBP: 00007ffc2b90eee0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.992398] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2bddeba390
[ 1236.001207] R13: 0000562f6ddbbbf0 R14: 0000000000000007 R15: 00007f2bdde4d120
[ 1236.010019]
[ 1236.013286] \x0aShowing all locks held in the system:
[ 1236.021825] 1 lock held by khungtaskd/184:
[ 1236.027221] #0: ffffffff950fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.038697] 4 locks held by python3/3521:
[ 1236.043994] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.053884] #1: ff1100013e21b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.064846] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.076003] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.086099] 4 locks held by python3/5506:
[ 1236.091396] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.101286] #1: ff11000119f74a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.112249] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.123407] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.133491]
[ 1236.135960] =============================================\x0a
[ 1264.133620] kworker/u129:14 (308) used greatest stack depth: 21936 bytes left
[ 1358.342517] INFO: task python3:5506 blocked for more than 491 seconds.
[ 1358.350673] Not tainted 7.1.0-rc6-oxyj-g40dde3f80b9d #1
[ 1358.357937] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.367541] task:python3 state:D stack:25672 pid:5506 tgid:5506 ppid:5505 task_flags:0x400100 flags:0x00080002
[ 1358.380764] Call Trace:
[ 1358.384310]
[ 1358.387469] __schedule+0xcc3/0x19c0
[ 1358.392297] ? io_schedule_timeout+0x140/0x140
[ 1358.398109] ? find_held_lock+0x2b/0x80
[ 1358.403225] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.409118] schedule+0xd8/0x260
[ 1358.413548] schedule_preempt_disabled+0x18/0x30
[ 1358.419537] __mutex_lock+0x6af/0x2010
[ 1358.424543] ? threaded_store+0x132/0x220
[ 1358.429830] ? ww_mutex_lock+0x160/0x160
[ 1358.435029] ? selinux_inode_free_security+0x330/0x330
[ 1358.441598] ? cap_capable+0x1d6/0x3e0
[ 1358.446606] ? threaded_store+0x132/0x220
[ 1358.451898] threaded_store+0x132/0x220
[ 1358.456998] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.462294] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.467594] ? sysfs_kf_write+0x65/0x160
[ 1358.472793] ? sysfs_file_ops+0x140/0x140
[ 1358.478090] kernfs_fop_write_iter+0x335/0x510
[ 1358.483865] ? kernfs_ops+0xf0/0xf0
[ 1358.488575] new_sync_write+0x333/0x750
[ 1358.493676] ? __lock_acquire+0x508/0xc10
[ 1358.498971] ? new_sync_read+0x740/0x740
[ 1358.504172] ? lock_acquire.part.0+0xbc/0x260
[ 1358.509858] ? ksys_write+0x116/0x250
[ 1358.514767] vfs_write+0x657/0x9b0
[ 1358.519380] ksys_write+0x116/0x250
[ 1358.524089] ? __ia32_sys_read+0xc0/0xc0
[ 1358.529287] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.534874] ? rcu_is_watching+0x15/0xd0
[ 1358.540074] do_syscall_64+0xf3/0x650
[ 1358.544980] ? trace_hardirqs_off+0xd/0x30
[ 1358.550372] ? exc_page_fault+0xda/0xf0
[ 1358.555470] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.561935] RIP: 0033:0x7f068846b64e
[ 1358.566743] RSP: 002b:00007ffc8b777550 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.576043] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f068846b64e
[ 1358.584849] RDX: 0000000000000001 RSI: 0000557e0e5fbbf0 RDI: 0000000000000007
[ 1358.593657] RBP: 00007ffc8b777560 R08: 0000000000000000 R09: 0000000000000000
[ 1358.602465] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f06882e4390
[ 1358.611262] R13: 0000557e0e5fbbf0 R14: 0000000000000007 R15: 00007f0688279120
[ 1358.620076]
[ 1358.623400] INFO: task python3:5506 is blocked on a mutex likely owned by task python3:3521.
[ 1358.633670] task:python3 state:D stack:25672 pid:3521 tgid:3521 ppid:3520 task_flags:0x400100 flags:0x00080802
[ 1358.646874] Call Trace:
[ 1358.650412]
[ 1358.653560] __schedule+0xcc3/0x19c0
[ 1358.658371] ? io_schedule_timeout+0x140/0x140
[ 1358.664156] ? find_held_lock+0x2b/0x80
[ 1358.669260] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.675439] schedule+0xd8/0x260
[ 1358.679856] schedule_timeout+0x13f/0x290
[ 1358.685153] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.691523] ? trace_contention_end+0xb3/0x1a0
[ 1358.697304] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.702993] ? ww_mutex_lock+0x160/0x160
[ 1358.708193] msleep+0x1b/0x30
[ 1358.712309] napi_set_threaded+0x3a5/0x440
[ 1358.717704] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.723197] netif_set_threaded+0x257/0x400
[ 1358.728677] threaded_store+0x1b8/0x220
[ 1358.733777] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.739073] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.744367] ? sysfs_kf_write+0x65/0x160
[ 1358.749564] ? sysfs_file_ops+0x140/0x140
[ 1358.754860] kernfs_fop_write_iter+0x335/0x510
[ 1358.760643] ? kernfs_ops+0xf0/0xf0
[ 1358.765355] new_sync_write+0x333/0x750
[ 1358.770449] ? __lock_acquire+0x508/0xc10
[ 1358.775746] ? new_sync_read+0x740/0x740
[ 1358.780934] ? lock_acquire.part.0+0xbc/0x260
[ 1358.786621] ? ksys_write+0x116/0x250
[ 1358.791532] vfs_write+0x657/0x9b0
[ 1358.796144] ksys_write+0x116/0x250
[ 1358.800854] ? __ia32_sys_read+0xc0/0xc0
[ 1358.806052] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.811638] ? rcu_is_watching+0x15/0xd0
[ 1358.816839] do_syscall_64+0xf3/0x650
[ 1358.821745] ? irq_exit_rcu+0x1a/0x30
[ 1358.826653] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.833118] RIP: 0033:0x7f2bde04164e
[ 1358.837927] RSP: 002b:00007ffc2b90eed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.847221] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2bde04164e
[ 1358.856026] RDX: 0000000000000001 RSI: 0000562f6ddbbbf0 RDI: 0000000000000007
[ 1358.864830] RBP: 00007ffc2b90eee0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.873637] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2bddeba390
[ 1358.882441] R13: 0000562f6ddbbbf0 R14: 0000000000000007 R15: 00007f2bdde4d120
[ 1358.891321]
[ 1358.894587] \x0aShowing all locks held in the system:
[ 1358.903116] 1 lock held by khungtaskd/184:
[ 1358.908506] #0: ffffffff950fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.919985] 4 locks held by python3/3521:
[ 1358.925280] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.935166] #1: ff1100013e21b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.946128] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.957275] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.967376] 4 locks held by python3/5506:
[ 1358.972668] #0: ff1100012f7b43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.982556] #1: ff11000119f74a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.993516] #2: ff11000123582b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.004672] #3: ff110001235e9db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.014763]
[ 1359.017226] =============================================\x0a