[ 782.500031] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 782.502483] nipa-hw-worker: [5/40] Retrying drivers/net:napi_threaded.py
[ 782.636363] kselftest: Running tests in drivers/net
[ 989.740848] INFO: task python3:5630 blocked for more than 122 seconds.
[ 989.749065] Not tainted 7.0.0-rc5-epkv-gb850f67b3183 #1
[ 989.756315] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.765905] task:python3 state:D stack:25312 pid:5630 tgid:5630 ppid:5629 task_flags:0x400100 flags:0x00080000
[ 989.779115] Call Trace:
[ 989.782655]
[ 989.785806] __schedule+0xad9/0x1490
[ 989.790623] ? io_schedule_timeout+0x130/0x130
[ 989.796411] ? find_held_lock+0x2b/0x80
[ 989.801517] ? __lock_release.isra.0+0x59/0x170
[ 989.807405] schedule+0xd4/0x260
[ 989.811826] schedule_preempt_disabled+0x18/0x30
[ 989.817806] __mutex_lock+0xd76/0x1f20
[ 989.822805] ? threaded_store+0x132/0x220
[ 989.828106] ? ww_mutex_lock+0x160/0x160
[ 989.833308] ? selinux_inode_free_security+0x310/0x310
[ 989.839881] ? cap_capable+0x1ed/0x3f0
[ 989.844889] ? sysfs_file_ops+0x140/0x140
[ 989.850187] ? threaded_store+0x132/0x220
[ 989.855486] threaded_store+0x132/0x220
[ 989.860590] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.866084] ? sysfs_file_ops+0x140/0x140
[ 989.871382] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.876676] ? sysfs_kf_write+0x65/0x160
[ 989.881876] kernfs_fop_write_iter+0x335/0x510
[ 989.887652] ? kernfs_ops+0xf0/0xf0
[ 989.892365] new_sync_write+0x308/0x6f0
[ 989.897470] ? new_sync_read+0x6f0/0x6f0
[ 989.902677] ? lock_acquire.part.0+0xbc/0x260
[ 989.908366] ? ksys_write+0xff/0x200
[ 989.913180] vfs_write+0x62a/0x980
[ 989.917797] ksys_write+0xff/0x200
[ 989.922412] ? __ia32_sys_read+0xc0/0xc0
[ 989.927609] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.933202] ? rcu_is_watching+0x15/0xd0
[ 989.938406] do_syscall_64+0xf3/0x5e0
[ 989.943311] ? irq_exit_rcu+0x39/0xf0
[ 989.948220] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.954687] RIP: 0033:0x7f17ff967c5e
[ 989.959487] RSP: 002b:00007fffc3b0cb90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.968785] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f17ff967c5e
[ 989.977585] RDX: 0000000000000001 RSI: 00005557151bb760 RDI: 0000000000000007
[ 989.986392] RBP: 00007fffc3b0cba0 R08: 0000000000000000 R09: 0000000000000000
[ 989.995200] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f17ff802e80
[ 990.004009] R13: 00005557151bb760 R14: 0000000000000007 R15: 00007f1800068b98
[ 990.012824]
[ 990.016093] INFO: task python3:5630 is blocked on a mutex likely owned by task python3:3629.
[ 990.026373] task:python3 state:D stack:25312 pid:3629 tgid:3629 ppid:3628 task_flags:0x400100 flags:0x00080802
[ 990.039576] Call Trace:
[ 990.043118]
[ 990.046267] __schedule+0xad9/0x1490
[ 990.051078] ? io_schedule_timeout+0x130/0x130
[ 990.056864] ? find_held_lock+0x2b/0x80
[ 990.061966] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.068148] schedule+0xd4/0x260
[ 990.072570] schedule_timeout+0x103/0x260
[ 990.077867] ? rcu_is_watching+0x15/0xd0
[ 990.083066] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.089431] ? hrtimers_cpu_dying+0x250/0x250
[ 990.095124] ? ww_mutex_lock+0x160/0x160
[ 990.100324] msleep+0x1b/0x30
[ 990.104450] napi_set_threaded+0x376/0x410
[ 990.109845] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.115341] netif_set_threaded+0x254/0x400
[ 990.120833] ? sysfs_file_ops+0x140/0x140
[ 990.126129] threaded_store+0x1bb/0x220
[ 990.131233] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.136726] ? sysfs_file_ops+0x140/0x140
[ 990.142025] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.147322] ? sysfs_kf_write+0x65/0x160
[ 990.152515] kernfs_fop_write_iter+0x335/0x510
[ 990.158303] ? kernfs_ops+0xf0/0xf0
[ 990.163013] new_sync_write+0x308/0x6f0
[ 990.168115] ? new_sync_read+0x6f0/0x6f0
[ 990.173316] ? lock_acquire.part.0+0xbc/0x260
[ 990.179005] ? ksys_write+0xff/0x200
[ 990.183817] vfs_write+0x62a/0x980
[ 990.188432] ksys_write+0xff/0x200
[ 990.193046] ? __ia32_sys_read+0xc0/0xc0
[ 990.198248] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.203836] ? rcu_is_watching+0x15/0xd0
[ 990.209036] do_syscall_64+0xf3/0x5e0
[ 990.213933] ? irq_exit_rcu+0x39/0xf0
[ 990.218842] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.225309] RIP: 0033:0x7fd33897bc5e
[ 990.230117] RSP: 002b:00007fff33824190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.239416] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd33897bc5e
[ 990.248224] RDX: 0000000000000001 RSI: 0000558354729760 RDI: 0000000000000007
[ 990.257024] RBP: 00007fff338241a0 R08: 0000000000000000 R09: 0000000000000000
[ 990.265832] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd338816e80
[ 990.274639] R13: 0000558354729760 R14: 0000000000000007 R15: 00007fd3387a6480
[ 990.283453]
[ 990.286713] \x0aShowing all locks held in the system:
[ 990.295251] 1 lock held by khungtaskd/185:
[ 990.300644] #0: ffffffff8eace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.312128] 4 locks held by python3/3629:
[ 990.317416] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.327207] #1: ff11000164993e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.338171] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.349328] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.359414] 4 locks held by python3/5630:
[ 990.364711] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.374504] #1: ff110001c6fe1488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.385466] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.396624] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.406715]
[ 990.409172] =============================================\x0a
[ 1112.622030] INFO: task python3:5630 blocked for more than 245 seconds.
[ 1112.630178] Not tainted 7.0.0-rc5-epkv-gb850f67b3183 #1
[ 1112.637427] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.647005] task:python3 state:D stack:25312 pid:5630 tgid:5630 ppid:5629 task_flags:0x400100 flags:0x00080000
[ 1112.660212] Call Trace:
[ 1112.663752]
[ 1112.666900] __schedule+0xad9/0x1490
[ 1112.671714] ? io_schedule_timeout+0x130/0x130
[ 1112.677502] ? find_held_lock+0x2b/0x80
[ 1112.682609] ? __lock_release.isra.0+0x59/0x170
[ 1112.688492] schedule+0xd4/0x260
[ 1112.692899] schedule_preempt_disabled+0x18/0x30
[ 1112.698879] __mutex_lock+0xd76/0x1f20
[ 1112.703874] ? threaded_store+0x132/0x220
[ 1112.709173] ? ww_mutex_lock+0x160/0x160
[ 1112.714372] ? selinux_inode_free_security+0x310/0x310
[ 1112.720940] ? cap_capable+0x1ed/0x3f0
[ 1112.725948] ? sysfs_file_ops+0x140/0x140
[ 1112.731250] ? threaded_store+0x132/0x220
[ 1112.736544] threaded_store+0x132/0x220
[ 1112.741646] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.747136] ? sysfs_file_ops+0x140/0x140
[ 1112.752507] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.757804] ? sysfs_kf_write+0x65/0x160
[ 1112.762994] kernfs_fop_write_iter+0x335/0x510
[ 1112.768779] ? kernfs_ops+0xf0/0xf0
[ 1112.773490] new_sync_write+0x308/0x6f0
[ 1112.778585] ? new_sync_read+0x6f0/0x6f0
[ 1112.783784] ? lock_acquire.part.0+0xbc/0x260
[ 1112.789469] ? ksys_write+0xff/0x200
[ 1112.794281] vfs_write+0x62a/0x980
[ 1112.798894] ksys_write+0xff/0x200
[ 1112.803508] ? __ia32_sys_read+0xc0/0xc0
[ 1112.808708] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.814290] ? rcu_is_watching+0x15/0xd0
[ 1112.819493] do_syscall_64+0xf3/0x5e0
[ 1112.824402] ? irq_exit_rcu+0x39/0xf0
[ 1112.829309] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.835777] RIP: 0033:0x7f17ff967c5e
[ 1112.840585] RSP: 002b:00007fffc3b0cb90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.849882] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f17ff967c5e
[ 1112.858682] RDX: 0000000000000001 RSI: 00005557151bb760 RDI: 0000000000000007
[ 1112.867559] RBP: 00007fffc3b0cba0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.876357] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f17ff802e80
[ 1112.885163] R13: 00005557151bb760 R14: 0000000000000007 R15: 00007f1800068b98
[ 1112.893979]
[ 1112.897298] INFO: task python3:5630 is blocked on a mutex likely owned by task python3:3629.
[ 1112.907573] task:python3 state:D stack:25312 pid:3629 tgid:3629 ppid:3628 task_flags:0x400100 flags:0x00080802
[ 1112.920779] Call Trace:
[ 1112.924316]
[ 1112.927465] __schedule+0xad9/0x1490
[ 1112.932278] ? io_schedule_timeout+0x130/0x130
[ 1112.938061] ? find_held_lock+0x2b/0x80
[ 1112.943161] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.949341] schedule+0xd4/0x260
[ 1112.953760] schedule_timeout+0x103/0x260
[ 1112.959055] ? rcu_is_watching+0x15/0xd0
[ 1112.964252] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.970623] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.976311] ? ww_mutex_lock+0x160/0x160
[ 1112.981501] msleep+0x1b/0x30
[ 1112.985628] napi_set_threaded+0x376/0x410
[ 1112.991023] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.996516] netif_set_threaded+0x254/0x400
[ 1113.002011] ? sysfs_file_ops+0x140/0x140
[ 1113.007305] threaded_store+0x1bb/0x220
[ 1113.012409] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.017901] ? sysfs_file_ops+0x140/0x140
[ 1113.023188] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.028484] ? sysfs_kf_write+0x65/0x160
[ 1113.033683] kernfs_fop_write_iter+0x335/0x510
[ 1113.039538] ? kernfs_ops+0xf0/0xf0
[ 1113.044251] new_sync_write+0x308/0x6f0
[ 1113.049413] ? new_sync_read+0x6f0/0x6f0
[ 1113.054612] ? lock_acquire.part.0+0xbc/0x260
[ 1113.060299] ? ksys_write+0xff/0x200
[ 1113.065101] vfs_write+0x62a/0x980
[ 1113.069783] ksys_write+0xff/0x200
[ 1113.074396] ? __ia32_sys_read+0xc0/0xc0
[ 1113.079597] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.085188] ? rcu_is_watching+0x15/0xd0
[ 1113.090379] do_syscall_64+0xf3/0x5e0
[ 1113.095287] ? irq_exit_rcu+0x39/0xf0
[ 1113.100194] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.106663] RIP: 0033:0x7fd33897bc5e
[ 1113.111469] RSP: 002b:00007fff33824190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.120764] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd33897bc5e
[ 1113.129569] RDX: 0000000000000001 RSI: 0000558354729760 RDI: 0000000000000007
[ 1113.138374] RBP: 00007fff338241a0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.147180] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd338816e80
[ 1113.155985] R13: 0000558354729760 R14: 0000000000000007 R15: 00007fd3387a6480
[ 1113.164800]
[ 1113.168064] \x0aShowing all locks held in the system:
[ 1113.176608] 1 lock held by khungtaskd/185:
[ 1113.182004] #0: ffffffff8eace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.193493] 4 locks held by python3/3629:
[ 1113.198790] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.208579] #1: ff11000164993e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.219543] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.230700] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.240788] 4 locks held by python3/5630:
[ 1113.246084] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.255877] #1: ff110001c6fe1488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.266837] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.277996] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.288086] 1 lock held by systemd/6649:
[ 1113.293283]
[ 1113.295748] =============================================\x0a
[ 1235.504250] INFO: task python3:5630 blocked for more than 368 seconds.
[ 1235.512397] Not tainted 7.0.0-rc5-epkv-gb850f67b3183 #1
[ 1235.519640] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.529230] task:python3 state:D stack:25312 pid:5630 tgid:5630 ppid:5629 task_flags:0x400100 flags:0x00080002
[ 1235.542436] Call Trace:
[ 1235.545978]
[ 1235.549127] __schedule+0xad9/0x1490
[ 1235.553947] ? io_schedule_timeout+0x130/0x130
[ 1235.559734] ? find_held_lock+0x2b/0x80
[ 1235.564844] ? __lock_release.isra.0+0x59/0x170
[ 1235.570728] schedule+0xd4/0x260
[ 1235.575146] schedule_preempt_disabled+0x18/0x30
[ 1235.581126] __mutex_lock+0xd76/0x1f20
[ 1235.586131] ? threaded_store+0x132/0x220
[ 1235.591431] ? ww_mutex_lock+0x160/0x160
[ 1235.596631] ? selinux_inode_free_security+0x310/0x310
[ 1235.603202] ? cap_capable+0x1ed/0x3f0
[ 1235.608212] ? sysfs_file_ops+0x140/0x140
[ 1235.613509] ? threaded_store+0x132/0x220
[ 1235.618804] threaded_store+0x132/0x220
[ 1235.623910] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.629404] ? sysfs_file_ops+0x140/0x140
[ 1235.634703] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.639999] ? sysfs_kf_write+0x65/0x160
[ 1235.645200] kernfs_fop_write_iter+0x335/0x510
[ 1235.650989] ? kernfs_ops+0xf0/0xf0
[ 1235.655702] new_sync_write+0x308/0x6f0
[ 1235.660805] ? new_sync_read+0x6f0/0x6f0
[ 1235.666006] ? lock_acquire.part.0+0xbc/0x260
[ 1235.671693] ? ksys_write+0xff/0x200
[ 1235.676504] vfs_write+0x62a/0x980
[ 1235.681119] ksys_write+0xff/0x200
[ 1235.685734] ? __ia32_sys_read+0xc0/0xc0
[ 1235.690926] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.696519] ? rcu_is_watching+0x15/0xd0
[ 1235.701720] do_syscall_64+0xf3/0x5e0
[ 1235.706626] ? irq_exit_rcu+0x39/0xf0
[ 1235.711536] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.718005] RIP: 0033:0x7f17ff967c5e
[ 1235.722816] RSP: 002b:00007fffc3b0cb90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.732115] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f17ff967c5e
[ 1235.740926] RDX: 0000000000000001 RSI: 00005557151bb760 RDI: 0000000000000007
[ 1235.749736] RBP: 00007fffc3b0cba0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.758545] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f17ff802e80
[ 1235.767356] R13: 00005557151bb760 R14: 0000000000000007 R15: 00007f1800068b98
[ 1235.776171]
[ 1235.779440] INFO: task python3:5630 is blocked on a mutex likely owned by task python3:3629.
[ 1235.789716] task:python3 state:D stack:25312 pid:3629 tgid:3629 ppid:3628 task_flags:0x400100 flags:0x00080802
[ 1235.802921] Call Trace:
[ 1235.806463]
[ 1235.809614] __schedule+0xad9/0x1490
[ 1235.814427] ? io_schedule_timeout+0x130/0x130
[ 1235.820213] ? find_held_lock+0x2b/0x80
[ 1235.825318] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.831497] schedule+0xd4/0x260
[ 1235.835915] schedule_timeout+0x103/0x260
[ 1235.841211] ? rcu_is_watching+0x15/0xd0
[ 1235.846412] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.852783] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.858476] ? ww_mutex_lock+0x160/0x160
[ 1235.863675] msleep+0x1b/0x30
[ 1235.867792] napi_set_threaded+0x376/0x410
[ 1235.873189] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.878682] netif_set_threaded+0x254/0x400
[ 1235.884176] ? sysfs_file_ops+0x140/0x140
[ 1235.889471] threaded_store+0x1bb/0x220
[ 1235.894574] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.900069] ? sysfs_file_ops+0x140/0x140
[ 1235.905367] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.910667] ? sysfs_kf_write+0x65/0x160
[ 1235.915869] kernfs_fop_write_iter+0x335/0x510
[ 1235.921654] ? kernfs_ops+0xf0/0xf0
[ 1235.926366] new_sync_write+0x308/0x6f0
[ 1235.931468] ? new_sync_read+0x6f0/0x6f0
[ 1235.936669] ? lock_acquire.part.0+0xbc/0x260
[ 1235.942355] ? ksys_write+0xff/0x200
[ 1235.947169] vfs_write+0x62a/0x980
[ 1235.951784] ksys_write+0xff/0x200
[ 1235.956391] ? __ia32_sys_read+0xc0/0xc0
[ 1235.961594] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.967184] ? rcu_is_watching+0x15/0xd0
[ 1235.972383] do_syscall_64+0xf3/0x5e0
[ 1235.977288] ? irq_exit_rcu+0x39/0xf0
[ 1235.982194] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.988663] RIP: 0033:0x7fd33897bc5e
[ 1235.993472] RSP: 002b:00007fff33824190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.002760] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd33897bc5e
[ 1236.011560] RDX: 0000000000000001 RSI: 0000558354729760 RDI: 0000000000000007
[ 1236.020369] RBP: 00007fff338241a0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.029179] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd338816e80
[ 1236.037987] R13: 0000558354729760 R14: 0000000000000007 R15: 00007fd3387a6480
[ 1236.046794]
[ 1236.050059] \x0aShowing all locks held in the system:
[ 1236.058590] 1 lock held by khungtaskd/185:
[ 1236.063981] #0: ffffffff8eace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.075466] 4 locks held by python3/3629:
[ 1236.080762] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.090554] #1: ff11000164993e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.101518] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.112675] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.122759] 4 locks held by python3/5630:
[ 1236.128057] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.137846] #1: ff110001c6fe1488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.148810] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.159970] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.170062]
[ 1236.172529] =============================================\x0a
[ 1358.385489] INFO: task python3:5630 blocked for more than 491 seconds.
[ 1358.393639] Not tainted 7.0.0-rc5-epkv-gb850f67b3183 #1
[ 1358.400889] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.410479] task:python3 state:D stack:25312 pid:5630 tgid:5630 ppid:5629 task_flags:0x400100 flags:0x00080002
[ 1358.423684] Call Trace:
[ 1358.427223]
[ 1358.430371] __schedule+0xad9/0x1490
[ 1358.435185] ? io_schedule_timeout+0x130/0x130
[ 1358.440970] ? find_held_lock+0x2b/0x80
[ 1358.446076] ? __lock_release.isra.0+0x59/0x170
[ 1358.451959] schedule+0xd4/0x260
[ 1358.456375] schedule_preempt_disabled+0x18/0x30
[ 1358.462351] __mutex_lock+0xd76/0x1f20
[ 1358.467353] ? threaded_store+0x132/0x220
[ 1358.472651] ? ww_mutex_lock+0x160/0x160
[ 1358.477851] ? selinux_inode_free_security+0x310/0x310
[ 1358.484419] ? cap_capable+0x1ed/0x3f0
[ 1358.489427] ? sysfs_file_ops+0x140/0x140
[ 1358.494721] ? threaded_store+0x132/0x220
[ 1358.500017] threaded_store+0x132/0x220
[ 1358.505122] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.510614] ? sysfs_file_ops+0x140/0x140
[ 1358.515908] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.521203] ? sysfs_kf_write+0x65/0x160
[ 1358.526402] kernfs_fop_write_iter+0x335/0x510
[ 1358.532185] ? kernfs_ops+0xf0/0xf0
[ 1358.536897] new_sync_write+0x308/0x6f0
[ 1358.541999] ? new_sync_read+0x6f0/0x6f0
[ 1358.547199] ? lock_acquire.part.0+0xbc/0x260
[ 1358.552876] ? ksys_write+0xff/0x200
[ 1358.557687] vfs_write+0x62a/0x980
[ 1358.562302] ksys_write+0xff/0x200
[ 1358.566915] ? __ia32_sys_read+0xc0/0xc0
[ 1358.572111] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.577702] ? rcu_is_watching+0x15/0xd0
[ 1358.582903] do_syscall_64+0xf3/0x5e0
[ 1358.587798] ? irq_exit_rcu+0x39/0xf0
[ 1358.592706] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.599162] RIP: 0033:0x7f17ff967c5e
[ 1358.603973] RSP: 002b:00007fffc3b0cb90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.613270] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f17ff967c5e
[ 1358.622076] RDX: 0000000000000001 RSI: 00005557151bb760 RDI: 0000000000000007
[ 1358.630881] RBP: 00007fffc3b0cba0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.639686] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f17ff802e80
[ 1358.648492] R13: 00005557151bb760 R14: 0000000000000007 R15: 00007f1800068b98
[ 1358.657309]
[ 1358.660569] INFO: task python3:5630 is blocked on a mutex likely owned by task python3:3629.
[ 1358.670844] task:python3 state:D stack:25312 pid:3629 tgid:3629 ppid:3628 task_flags:0x400100 flags:0x00080802
[ 1358.684045] Call Trace:
[ 1358.687583]
[ 1358.690731] __schedule+0xad9/0x1490
[ 1358.695540] ? io_schedule_timeout+0x130/0x130
[ 1358.701326] ? find_held_lock+0x2b/0x80
[ 1358.706427] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.712604] schedule+0xd4/0x260
[ 1358.717020] schedule_timeout+0x103/0x260
[ 1358.722316] ? rcu_is_watching+0x15/0xd0
[ 1358.727520] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.733888] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.739577] ? ww_mutex_lock+0x160/0x160
[ 1358.744776] msleep+0x1b/0x30
[ 1358.748899] napi_set_threaded+0x376/0x410
[ 1358.754294] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.759789] netif_set_threaded+0x254/0x400
[ 1358.765280] ? sysfs_file_ops+0x140/0x140
[ 1358.770578] threaded_store+0x1bb/0x220
[ 1358.775679] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.781178] ? sysfs_file_ops+0x140/0x140
[ 1358.786550] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.791845] ? sysfs_kf_write+0x65/0x160
[ 1358.797045] kernfs_fop_write_iter+0x335/0x510
[ 1358.802822] ? kernfs_ops+0xf0/0xf0
[ 1358.807530] new_sync_write+0x308/0x6f0
[ 1358.812633] ? new_sync_read+0x6f0/0x6f0
[ 1358.817826] ? lock_acquire.part.0+0xbc/0x260
[ 1358.823512] ? ksys_write+0xff/0x200
[ 1358.828331] vfs_write+0x62a/0x980
[ 1358.832939] ksys_write+0xff/0x200
[ 1358.837553] ? __ia32_sys_read+0xc0/0xc0
[ 1358.842751] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.848340] ? rcu_is_watching+0x15/0xd0
[ 1358.853541] do_syscall_64+0xf3/0x5e0
[ 1358.858448] ? irq_exit_rcu+0x39/0xf0
[ 1358.863358] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.869824] RIP: 0033:0x7fd33897bc5e
[ 1358.874632] RSP: 002b:00007fff33824190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.883933] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd33897bc5e
[ 1358.892741] RDX: 0000000000000001 RSI: 0000558354729760 RDI: 0000000000000007
[ 1358.901549] RBP: 00007fff338241a0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.901552] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd338816e80
[ 1358.901554] R13: 0000558354729760 R14: 0000000000000007 R15: 00007fd3387a6480
[ 1358.901561]
[ 1358.901584] \x0aShowing all locks held in the system:
[ 1358.939825] 1 lock held by khungtaskd/185:
[ 1358.945220] #0: ffffffff8eace120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.956708] 4 locks held by python3/3629:
[ 1358.962005] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.971798] #1: ff11000164993e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.982763] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.993921] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.004020] 4 locks held by python3/5630:
[ 1359.009319] #0: ff1100012ecec3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.019115] #1: ff110001c6fe1488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.030079] #2: ff1100011118b0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.041239] #3: ff11000122921d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.051333] 5 locks held by (time-dir)/7415:
[ 1359.056918] #0: ff1100012efbc3f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.066711] #1: ff1100013f2d2c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.077671] #2: ffffffff8eb37248 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1359.088336] #3: ffffffff8e968f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1359.099980] #4: ffffffff8eb36f50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1359.112408]
[ 1359.114874] =============================================\x0a