[ 779.691831] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 779.694178] nipa-hw-worker: [4/40] Retrying drivers/net:napi_threaded.py
[ 779.847452] kselftest: Running tests in drivers/net
[ 989.664781] INFO: task python3:5575 blocked for more than 122 seconds.
[ 989.673002] Not tainted 7.0.0-rc6-yvgy-gf3ebf9fb7be9 #1
[ 989.680256] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.689846] task:python3 state:D stack:25336 pid:5575 tgid:5575 ppid:5574 task_flags:0x400100 flags:0x00080000
[ 989.703053] Call Trace:
[ 989.706593]
[ 989.709742] __schedule+0xae3/0x14d0
[ 989.714559] ? io_schedule_timeout+0x140/0x140
[ 989.720346] ? find_held_lock+0x2b/0x80
[ 989.725453] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.731339] schedule+0xd4/0x260
[ 989.735759] schedule_preempt_disabled+0x18/0x30
[ 989.741737] __mutex_lock+0x6b2/0x1ee0
[ 989.746744] ? rcu_is_watching+0x15/0xd0
[ 989.751944] ? threaded_store+0x132/0x220
[ 989.757247] ? ww_mutex_lock+0x160/0x160
[ 989.762447] ? selinux_inode_free_security+0x330/0x330
[ 989.769022] ? cap_capable+0x1ed/0x3f0
[ 989.774026] ? threaded_store+0x132/0x220
[ 989.779321] threaded_store+0x132/0x220
[ 989.784423] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.789720] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.795020] ? sysfs_kf_write+0x65/0x160
[ 989.800221] ? sysfs_file_ops+0x140/0x140
[ 989.805518] kernfs_fop_write_iter+0x335/0x510
[ 989.811304] ? kernfs_ops+0xf0/0xf0
[ 989.816007] new_sync_write+0x333/0x750
[ 989.821113] ? __lock_acquire+0x508/0xc10
[ 989.826412] ? new_sync_read+0x740/0x740
[ 989.831619] ? lock_acquire.part.0+0xbc/0x260
[ 989.837307] ? ksys_write+0x116/0x250
[ 989.842219] vfs_write+0x657/0x9b0
[ 989.846833] ksys_write+0x116/0x250
[ 989.851543] ? __ia32_sys_read+0xc0/0xc0
[ 989.856744] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.862332] ? rcu_is_watching+0x15/0xd0
[ 989.867531] do_syscall_64+0xf3/0x5e0
[ 989.872436] ? trace_hardirqs_off+0xd/0x30
[ 989.877830] ? exc_page_fault+0xda/0xf0
[ 989.882933] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.889402] RIP: 0033:0x7f25e9c3322e
[ 989.894213] RSP: 002b:00007ffcbad75df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.903510] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25e9c3322e
[ 989.912310] RDX: 0000000000000001 RSI: 000055ae480a8f40 RDI: 0000000000000007
[ 989.921120] RBP: 00007ffcbad75e00 R08: 0000000000000000 R09: 0000000000000000
[ 989.929928] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25e9aab390
[ 989.938740] R13: 000055ae480a8f40 R14: 0000000000000007 R15: 0000000000000003
[ 989.947552]
[ 989.950827] INFO: task python3:5575 is blocked on a mutex likely owned by task python3:3504.
[ 989.961101] task:python3 state:D stack:25336 pid:3504 tgid:3504 ppid:3503 task_flags:0x400100 flags:0x00080802
[ 989.974302] Call Trace:
[ 989.977842]
[ 989.980991] __schedule+0xae3/0x14d0
[ 989.985802] ? io_schedule_timeout+0x140/0x140
[ 989.991585] ? find_held_lock+0x2b/0x80
[ 989.996687] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.002860] schedule+0xd4/0x260
[ 990.007277] schedule_timeout+0x13f/0x290
[ 990.012576] ? hrtimer_nanosleep_restart+0x1c0/0x1c0
[ 990.018944] ? trace_contention_end+0xb3/0x1a0
[ 990.024730] ? hrtimers_cpu_dying+0x260/0x260
[ 990.030420] ? ww_mutex_lock+0x160/0x160
[ 990.035623] msleep+0x1b/0x30
[ 990.039751] napi_set_threaded+0x3a5/0x440
[ 990.045147] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.050634] netif_set_threaded+0x257/0x400
[ 990.056126] threaded_store+0x1b8/0x220
[ 990.061228] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.066523] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.071819] ? sysfs_kf_write+0x65/0x160
[ 990.077017] ? sysfs_file_ops+0x140/0x140
[ 990.082315] kernfs_fop_write_iter+0x335/0x510
[ 990.088100] ? kernfs_ops+0xf0/0xf0
[ 990.092815] new_sync_write+0x333/0x750
[ 990.097916] ? __lock_acquire+0x508/0xc10
[ 990.103214] ? new_sync_read+0x740/0x740
[ 990.108412] ? lock_acquire.part.0+0xbc/0x260
[ 990.114101] ? ksys_write+0x116/0x250
[ 990.119013] vfs_write+0x657/0x9b0
[ 990.123628] ksys_write+0x116/0x250
[ 990.128340] ? __ia32_sys_read+0xc0/0xc0
[ 990.133529] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.139118] ? rcu_is_watching+0x15/0xd0
[ 990.144319] do_syscall_64+0xf3/0x5e0
[ 990.149224] ? irq_exit_rcu+0x39/0xf0
[ 990.154133] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.160599] RIP: 0033:0x7f9c2b97722e
[ 990.165409] RSP: 002b:00007ffe6eb3eac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.174699] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9c2b97722e
[ 990.183508] RDX: 0000000000000001 RSI: 00005593c9a09f40 RDI: 0000000000000007
[ 990.192316] RBP: 00007ffe6eb3ead0 R08: 0000000000000000 R09: 0000000000000000
[ 990.201122] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9c2b7ef390
[ 990.209930] R13: 00005593c9a09f40 R14: 0000000000000007 R15: 0000000000000003
[ 990.218734]
[ 990.221996] \x0aShowing all locks held in the system:
[ 990.230535] 1 lock held by khungtaskd/185:
[ 990.235929] #0: ffffffffb58cdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.247411] 4 locks held by python3/3504:
[ 990.252705] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.262597] #1: ff11000154cc2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.273561] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.284717] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.294812] 4 locks held by python3/5575:
[ 990.300106] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.309998] #1: ff110001a074f488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.320962] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.332122] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.342214]
[ 990.344681] =============================================\x0a
[ 1112.546483] INFO: task python3:5575 blocked for more than 245 seconds.
[ 1112.554628] Not tainted 7.0.0-rc6-yvgy-gf3ebf9fb7be9 #1
[ 1112.561902] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.571492] task:python3 state:D stack:25336 pid:5575 tgid:5575 ppid:5574 task_flags:0x400100 flags:0x00080000
[ 1112.584696] Call Trace:
[ 1112.588233]
[ 1112.591384] __schedule+0xae3/0x14d0
[ 1112.596201] ? io_schedule_timeout+0x140/0x140
[ 1112.601984] ? find_held_lock+0x2b/0x80
[ 1112.607088] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.612965] schedule+0xd4/0x260
[ 1112.617384] schedule_preempt_disabled+0x18/0x30
[ 1112.623364] __mutex_lock+0x6b2/0x1ee0
[ 1112.628370] ? rcu_is_watching+0x15/0xd0
[ 1112.633570] ? threaded_store+0x132/0x220
[ 1112.638869] ? ww_mutex_lock+0x160/0x160
[ 1112.644059] ? selinux_inode_free_security+0x330/0x330
[ 1112.650629] ? cap_capable+0x1ed/0x3f0
[ 1112.655636] ? threaded_store+0x132/0x220
[ 1112.660935] threaded_store+0x132/0x220
[ 1112.666040] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.671337] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.676637] ? sysfs_kf_write+0x65/0x160
[ 1112.681826] ? sysfs_file_ops+0x140/0x140
[ 1112.687121] kernfs_fop_write_iter+0x335/0x510
[ 1112.692907] ? kernfs_ops+0xf0/0xf0
[ 1112.697619] new_sync_write+0x333/0x750
[ 1112.702713] ? __lock_acquire+0x508/0xc10
[ 1112.708008] ? new_sync_read+0x740/0x740
[ 1112.713208] ? lock_acquire.part.0+0xbc/0x260
[ 1112.718893] ? ksys_write+0x116/0x250
[ 1112.723802] vfs_write+0x657/0x9b0
[ 1112.728417] ksys_write+0x116/0x250
[ 1112.733121] ? __ia32_sys_read+0xc0/0xc0
[ 1112.738318] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.743908] ? rcu_is_watching+0x15/0xd0
[ 1112.749106] do_syscall_64+0xf3/0x5e0
[ 1112.754009] ? trace_hardirqs_off+0xd/0x30
[ 1112.759403] ? exc_page_fault+0xda/0xf0
[ 1112.764504] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.770972] RIP: 0033:0x7f25e9c3322e
[ 1112.775782] RSP: 002b:00007ffcbad75df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.785078] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25e9c3322e
[ 1112.793884] RDX: 0000000000000001 RSI: 000055ae480a8f40 RDI: 0000000000000007
[ 1112.802692] RBP: 00007ffcbad75e00 R08: 0000000000000000 R09: 0000000000000000
[ 1112.811489] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25e9aab390
[ 1112.820294] R13: 000055ae480a8f40 R14: 0000000000000007 R15: 0000000000000003
[ 1112.829107]
[ 1112.832412] INFO: task python3:5575 is blocked on a mutex likely owned by task python3:3504.
[ 1112.842683] task:python3 state:D stack:25336 pid:3504 tgid:3504 ppid:3503 task_flags:0x400100 flags:0x00080802
[ 1112.855884] Call Trace:
[ 1112.859422]
[ 1112.862573] __schedule+0xae3/0x14d0
[ 1112.867385] ? io_schedule_timeout+0x140/0x140
[ 1112.873169] ? find_held_lock+0x2b/0x80
[ 1112.878269] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.884445] schedule+0xd4/0x260
[ 1112.888863] schedule_timeout+0x13f/0x290
[ 1112.894160] ? hrtimer_nanosleep_restart+0x1c0/0x1c0
[ 1112.900528] ? trace_contention_end+0xb3/0x1a0
[ 1112.906313] ? hrtimers_cpu_dying+0x260/0x260
[ 1112.911996] ? ww_mutex_lock+0x160/0x160
[ 1112.917196] msleep+0x1b/0x30
[ 1112.921312] napi_set_threaded+0x3a5/0x440
[ 1112.926706] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.932200] netif_set_threaded+0x257/0x400
[ 1112.937690] threaded_store+0x1b8/0x220
[ 1112.942793] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.948090] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.953384] ? sysfs_kf_write+0x65/0x160
[ 1112.958583] ? sysfs_file_ops+0x140/0x140
[ 1112.963879] kernfs_fop_write_iter+0x335/0x510
[ 1112.969662] ? kernfs_ops+0xf0/0xf0
[ 1112.974372] new_sync_write+0x333/0x750
[ 1112.979474] ? __lock_acquire+0x508/0xc10
[ 1112.984768] ? new_sync_read+0x740/0x740
[ 1112.989969] ? lock_acquire.part.0+0xbc/0x260
[ 1112.995645] ? ksys_write+0x116/0x250
[ 1113.000554] vfs_write+0x657/0x9b0
[ 1113.005166] ksys_write+0x116/0x250
[ 1113.009875] ? __ia32_sys_read+0xc0/0xc0
[ 1113.015073] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.020663] ? rcu_is_watching+0x15/0xd0
[ 1113.025853] do_syscall_64+0xf3/0x5e0
[ 1113.030757] ? irq_exit_rcu+0x39/0xf0
[ 1113.035665] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.042133] RIP: 0033:0x7f9c2b97722e
[ 1113.046933] RSP: 002b:00007ffe6eb3eac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.056231] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9c2b97722e
[ 1113.065040] RDX: 0000000000000001 RSI: 00005593c9a09f40 RDI: 0000000000000007
[ 1113.073849] RBP: 00007ffe6eb3ead0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.082653] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9c2b7ef390
[ 1113.091462] R13: 00005593c9a09f40 R14: 0000000000000007 R15: 0000000000000003
[ 1113.100275]
[ 1113.103538] \x0aShowing all locks held in the system:
[ 1113.112076] 1 lock held by khungtaskd/185:
[ 1113.117467] #0: ffffffffb58cdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.128955] 4 locks held by python3/3504:
[ 1113.134246] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.144135] #1: ff11000154cc2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.155086] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.166241] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.176338] 4 locks held by python3/5575:
[ 1113.181633] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.191521] #1: ff110001a074f488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.202482] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.213637] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.223726]
[ 1113.226190] =============================================\x0a
[ 1235.427380] INFO: task python3:5575 blocked for more than 368 seconds.
[ 1235.435577] Not tainted 7.0.0-rc6-yvgy-gf3ebf9fb7be9 #1
[ 1235.442826] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.452405] task:python3 state:D stack:25336 pid:5575 tgid:5575 ppid:5574 task_flags:0x400100 flags:0x00080002
[ 1235.465609] Call Trace:
[ 1235.469147]
[ 1235.472300] __schedule+0xae3/0x14d0
[ 1235.477116] ? io_schedule_timeout+0x140/0x140
[ 1235.482900] ? find_held_lock+0x2b/0x80
[ 1235.488006] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.493888] schedule+0xd4/0x260
[ 1235.498306] schedule_preempt_disabled+0x18/0x30
[ 1235.504284] __mutex_lock+0x6b2/0x1ee0
[ 1235.509289] ? rcu_is_watching+0x15/0xd0
[ 1235.514487] ? threaded_store+0x132/0x220
[ 1235.519786] ? ww_mutex_lock+0x160/0x160
[ 1235.524976] ? selinux_inode_free_security+0x330/0x330
[ 1235.531537] ? cap_capable+0x1ed/0x3f0
[ 1235.536546] ? threaded_store+0x132/0x220
[ 1235.541839] threaded_store+0x132/0x220
[ 1235.546940] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.552238] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.557533] ? sysfs_kf_write+0x65/0x160
[ 1235.562733] ? sysfs_file_ops+0x140/0x140
[ 1235.568027] kernfs_fop_write_iter+0x335/0x510
[ 1235.573809] ? kernfs_ops+0xf0/0xf0
[ 1235.578519] new_sync_write+0x333/0x750
[ 1235.583618] ? __lock_acquire+0x508/0xc10
[ 1235.588911] ? new_sync_read+0x740/0x740
[ 1235.594111] ? lock_acquire.part.0+0xbc/0x260
[ 1235.599788] ? ksys_write+0x116/0x250
[ 1235.604695] vfs_write+0x657/0x9b0
[ 1235.609302] ksys_write+0x116/0x250
[ 1235.614005] ? __ia32_sys_read+0xc0/0xc0
[ 1235.619203] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.624790] ? rcu_is_watching+0x15/0xd0
[ 1235.629988] do_syscall_64+0xf3/0x5e0
[ 1235.634893] ? trace_hardirqs_off+0xd/0x30
[ 1235.640288] ? exc_page_fault+0xda/0xf0
[ 1235.645387] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.651854] RIP: 0033:0x7f25e9c3322e
[ 1235.656664] RSP: 002b:00007ffcbad75df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.665960] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25e9c3322e
[ 1235.674768] RDX: 0000000000000001 RSI: 000055ae480a8f40 RDI: 0000000000000007
[ 1235.683569] RBP: 00007ffcbad75e00 R08: 0000000000000000 R09: 0000000000000000
[ 1235.692376] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25e9aab390
[ 1235.701184] R13: 000055ae480a8f40 R14: 0000000000000007 R15: 0000000000000003
[ 1235.709995]
[ 1235.713285] INFO: task python3:5575 is blocked on a mutex likely owned by task python3:3504.
[ 1235.723555] task:python3 state:D stack:25336 pid:3504 tgid:3504 ppid:3503 task_flags:0x400100 flags:0x00080802
[ 1235.736757] Call Trace:
[ 1235.740296]
[ 1235.743442] __schedule+0xae3/0x14d0
[ 1235.748252] ? io_schedule_timeout+0x140/0x140
[ 1235.754036] ? find_held_lock+0x2b/0x80
[ 1235.759136] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.765314] schedule+0xd4/0x260
[ 1235.769733] schedule_timeout+0x13f/0x290
[ 1235.775031] ? hrtimer_nanosleep_restart+0x1c0/0x1c0
[ 1235.781398] ? trace_contention_end+0xb3/0x1a0
[ 1235.787180] ? hrtimers_cpu_dying+0x260/0x260
[ 1235.792868] ? ww_mutex_lock+0x160/0x160
[ 1235.798065] msleep+0x1b/0x30
[ 1235.802191] napi_set_threaded+0x3a5/0x440
[ 1235.807585] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.813078] netif_set_threaded+0x257/0x400
[ 1235.818569] threaded_store+0x1b8/0x220
[ 1235.823671] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.828957] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.834252] ? sysfs_kf_write+0x65/0x160
[ 1235.839453] ? sysfs_file_ops+0x140/0x140
[ 1235.844746] kernfs_fop_write_iter+0x335/0x510
[ 1235.850532] ? kernfs_ops+0xf0/0xf0
[ 1235.855237] new_sync_write+0x333/0x750
[ 1235.860337] ? __lock_acquire+0x508/0xc10
[ 1235.865634] ? new_sync_read+0x740/0x740
[ 1235.870831] ? lock_acquire.part.0+0xbc/0x260
[ 1235.876518] ? ksys_write+0x116/0x250
[ 1235.881419] vfs_write+0x657/0x9b0
[ 1235.886032] ksys_write+0x116/0x250
[ 1235.890746] ? __ia32_sys_read+0xc0/0xc0
[ 1235.895944] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.901531] ? rcu_is_watching+0x15/0xd0
[ 1235.906730] do_syscall_64+0xf3/0x5e0
[ 1235.911627] ? irq_exit_rcu+0x39/0xf0
[ 1235.916533] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.922998] RIP: 0033:0x7f9c2b97722e
[ 1235.927803] RSP: 002b:00007ffe6eb3eac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.937100] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9c2b97722e
[ 1235.945909] RDX: 0000000000000001 RSI: 00005593c9a09f40 RDI: 0000000000000007
[ 1235.954714] RBP: 00007ffe6eb3ead0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.963519] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9c2b7ef390
[ 1235.972327] R13: 00005593c9a09f40 R14: 0000000000000007 R15: 0000000000000003
[ 1235.981132]
[ 1235.984396] \x0aShowing all locks held in the system:
[ 1235.993531] 1 lock held by migration/8/57:
[ 1235.998930] #0: ff1100180e0372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x194/0x14d0
[ 1236.008836] 1 lock held by khungtaskd/185:
[ 1236.014227] #0: ffffffffb58cdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.025718] 4 locks held by python3/3504:
[ 1236.031010] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.040899] #1: ff11000154cc2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.051853] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.063011] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.073108] 4 locks held by python3/5575:
[ 1236.078403] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.088289] #1: ff110001a074f488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.099253] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.110413] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.120504]
[ 1236.122972] =============================================\x0a
[ 1358.308677] INFO: task python3:5575 blocked for more than 491 seconds.
[ 1358.316837] Not tainted 7.0.0-rc6-yvgy-gf3ebf9fb7be9 #1
[ 1358.324091] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.333679] task:python3 state:D stack:25336 pid:5575 tgid:5575 ppid:5574 task_flags:0x400100 flags:0x00080002
[ 1358.346884] Call Trace:
[ 1358.350423]
[ 1358.353570] __schedule+0xae3/0x14d0
[ 1358.358383] ? io_schedule_timeout+0x140/0x140
[ 1358.364167] ? find_held_lock+0x2b/0x80
[ 1358.369264] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.375149] schedule+0xd4/0x260
[ 1358.379569] schedule_preempt_disabled+0x18/0x30
[ 1358.385548] __mutex_lock+0x6b2/0x1ee0
[ 1358.390554] ? rcu_is_watching+0x15/0xd0
[ 1358.395754] ? threaded_store+0x132/0x220
[ 1358.401054] ? ww_mutex_lock+0x160/0x160
[ 1358.406252] ? selinux_inode_free_security+0x330/0x330
[ 1358.412812] ? cap_capable+0x1ed/0x3f0
[ 1358.417818] ? threaded_store+0x132/0x220
[ 1358.423114] threaded_store+0x132/0x220
[ 1358.428214] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.433509] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.438804] ? sysfs_kf_write+0x65/0x160
[ 1358.444004] ? sysfs_file_ops+0x140/0x140
[ 1358.449288] kernfs_fop_write_iter+0x335/0x510
[ 1358.455070] ? kernfs_ops+0xf0/0xf0
[ 1358.459781] new_sync_write+0x333/0x750
[ 1358.464876] ? __lock_acquire+0x508/0xc10
[ 1358.470170] ? new_sync_read+0x740/0x740
[ 1358.475371] ? lock_acquire.part.0+0xbc/0x260
[ 1358.481059] ? ksys_write+0x116/0x250
[ 1358.485967] vfs_write+0x657/0x9b0
[ 1358.490570] ksys_write+0x116/0x250
[ 1358.495279] ? __ia32_sys_read+0xc0/0xc0
[ 1358.500476] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.506064] ? rcu_is_watching+0x15/0xd0
[ 1358.511263] do_syscall_64+0xf3/0x5e0
[ 1358.516158] ? trace_hardirqs_off+0xd/0x30
[ 1358.521553] ? exc_page_fault+0xda/0xf0
[ 1358.526655] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.533121] RIP: 0033:0x7f25e9c3322e
[ 1358.537929] RSP: 002b:00007ffcbad75df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.547227] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25e9c3322e
[ 1358.556034] RDX: 0000000000000001 RSI: 000055ae480a8f40 RDI: 0000000000000007
[ 1358.564843] RBP: 00007ffcbad75e00 R08: 0000000000000000 R09: 0000000000000000
[ 1358.573650] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25e9aab390
[ 1358.582455] R13: 000055ae480a8f40 R14: 0000000000000007 R15: 0000000000000003
[ 1358.591266]
[ 1358.594564] INFO: task python3:5575 is blocked on a mutex likely owned by task python3:3504.
[ 1358.604835] task:python3 state:D stack:25336 pid:3504 tgid:3504 ppid:3503 task_flags:0x400100 flags:0x00080802
[ 1358.618038] Call Trace:
[ 1358.621577]
[ 1358.624725] __schedule+0xae3/0x14d0
[ 1358.629534] ? io_schedule_timeout+0x140/0x140
[ 1358.635320] ? find_held_lock+0x2b/0x80
[ 1358.640423] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.646600] schedule+0xd4/0x260
[ 1358.651010] schedule_timeout+0x13f/0x290
[ 1358.656308] ? hrtimer_nanosleep_restart+0x1c0/0x1c0
[ 1358.662678] ? trace_contention_end+0xb3/0x1a0
[ 1358.668460] ? hrtimers_cpu_dying+0x260/0x260
[ 1358.674148] ? ww_mutex_lock+0x160/0x160
[ 1358.679349] msleep+0x1b/0x30
[ 1358.683476] napi_set_threaded+0x3a5/0x440
[ 1358.688872] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.694365] netif_set_threaded+0x257/0x400
[ 1358.699856] threaded_store+0x1b8/0x220
[ 1358.704958] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.710255] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.715549] ? sysfs_kf_write+0x65/0x160
[ 1358.720745] ? sysfs_file_ops+0x140/0x140
[ 1358.726038] kernfs_fop_write_iter+0x335/0x510
[ 1358.731820] ? kernfs_ops+0xf0/0xf0
[ 1358.736533] new_sync_write+0x333/0x750
[ 1358.741627] ? __lock_acquire+0x508/0xc10
[ 1358.746915] ? new_sync_read+0x740/0x740
[ 1358.752114] ? lock_acquire.part.0+0xbc/0x260
[ 1358.757797] ? ksys_write+0x116/0x250
[ 1358.762708] vfs_write+0x657/0x9b0
[ 1358.767323] ksys_write+0x116/0x250
[ 1358.772032] ? __ia32_sys_read+0xc0/0xc0
[ 1358.777229] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.782818] ? rcu_is_watching+0x15/0xd0
[ 1358.788018] do_syscall_64+0xf3/0x5e0
[ 1358.792915] ? irq_exit_rcu+0x39/0xf0
[ 1358.797820] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.804284] RIP: 0033:0x7f9c2b97722e
[ 1358.809090] RSP: 002b:00007ffe6eb3eac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.818385] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9c2b97722e
[ 1358.827190] RDX: 0000000000000001 RSI: 00005593c9a09f40 RDI: 0000000000000007
[ 1358.835996] RBP: 00007ffe6eb3ead0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.844804] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9c2b7ef390
[ 1358.853611] R13: 00005593c9a09f40 R14: 0000000000000007 R15: 0000000000000003
[ 1358.862422]
[ 1358.865688] \x0aShowing all locks held in the system:
[ 1358.874226] 1 lock held by khungtaskd/185:
[ 1358.879619] #0: ffffffffb58cdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.891102] 4 locks held by python3/3504:
[ 1358.896396] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.906285] #1: ff11000154cc2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.917246] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.928400] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.938490] 4 locks held by python3/5575:
[ 1358.943783] #0: ff1100012ea593f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.953671] #1: ff110001a074f488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.964624] #2: ff110001216890f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.975780] #3: ff110001216e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.985871]
[ 1358.988327] =============================================\x0a