[ 759.746190] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 759.748631] nipa-hw-worker: [4/37] Retrying drivers/net:napi_threaded.py
[ 759.888828] kselftest: Running tests in drivers/net
[ 989.735414] INFO: task python3:5024 blocked for more than 122 seconds.
[ 989.743640] Not tainted 7.0.0-rc3-qtkh-g0c88da771712 #1
[ 989.750892] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.760482] task:python3 state:D stack:25312 pid:5024 tgid:5024 ppid:5023 task_flags:0x400100 flags:0x00080002
[ 989.773688] Call Trace:
[ 989.777228]
[ 989.780378] __schedule+0xad9/0x1490
[ 989.785195] ? io_schedule_timeout+0x130/0x130
[ 989.790983] ? find_held_lock+0x2b/0x80
[ 989.796088] ? __lock_release.isra.0+0x59/0x170
[ 989.801976] schedule+0xd4/0x260
[ 989.806394] schedule_preempt_disabled+0x18/0x30
[ 989.812372] __mutex_lock+0xd76/0x1f20
[ 989.817379] ? threaded_store+0x132/0x220
[ 989.822681] ? ww_mutex_lock+0x160/0x160
[ 989.827882] ? selinux_inode_free_security+0x310/0x310
[ 989.834453] ? cap_capable+0x1ed/0x3f0
[ 989.839460] ? sysfs_file_ops+0x140/0x140
[ 989.844757] ? threaded_store+0x132/0x220
[ 989.850054] threaded_store+0x132/0x220
[ 989.855159] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.860652] ? sysfs_file_ops+0x140/0x140
[ 989.865952] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.871251] ? sysfs_kf_write+0x65/0x160
[ 989.876450] kernfs_fop_write_iter+0x335/0x510
[ 989.882235] ? kernfs_ops+0xf0/0xf0
[ 989.886945] new_sync_write+0x308/0x6f0
[ 989.892049] ? new_sync_read+0x6f0/0x6f0
[ 989.897246] ? lock_acquire.part.0+0xbc/0x260
[ 989.902932] ? ksys_write+0xff/0x200
[ 989.907744] vfs_write+0x62a/0x980
[ 989.912359] ksys_write+0xff/0x200
[ 989.916964] ? __ia32_sys_read+0xc0/0xc0
[ 989.922163] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.927753] ? rcu_is_watching+0x15/0xd0
[ 989.932957] do_syscall_64+0xf3/0x5e0
[ 989.937863] ? exc_page_fault+0x9e/0xb0
[ 989.942968] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.949435] RIP: 0033:0x7f9e4a62dc5e
[ 989.954239] RSP: 002b:00007ffc55b04f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.963534] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9e4a62dc5e
[ 989.972333] RDX: 0000000000000001 RSI: 0000560ce7be9110 RDI: 0000000000000007
[ 989.981141] RBP: 00007ffc55b04f60 R08: 0000000000000000 R09: 0000000000000000
[ 989.989939] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9e4a4c8e80
[ 989.998747] R13: 0000560ce7be9110 R14: 0000000000000007 R15: 00007f9e4ad2eb98
[ 990.007550]
[ 990.010832] INFO: task python3:5024 is blocked on a mutex likely owned by task python3:3101.
[ 990.021110] task:python3 state:D stack:25312 pid:3101 tgid:3101 ppid:3100 task_flags:0x400100 flags:0x00080802
[ 990.034313] Call Trace:
[ 990.037852]
[ 990.041002] __schedule+0xad9/0x1490
[ 990.045804] ? io_schedule_timeout+0x130/0x130
[ 990.051589] ? find_held_lock+0x2b/0x80
[ 990.056683] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.062861] schedule+0xd4/0x260
[ 990.067279] schedule_timeout+0x103/0x260
[ 990.072578] ? rcu_is_watching+0x15/0xd0
[ 990.077778] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.084147] ? hrtimers_cpu_dying+0x250/0x250
[ 990.089836] ? ww_mutex_lock+0x160/0x160
[ 990.095038] msleep+0x1b/0x30
[ 990.099162] napi_set_threaded+0x376/0x410
[ 990.104558] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.110045] netif_set_threaded+0x254/0x400
[ 990.115542] ? sysfs_file_ops+0x140/0x140
[ 990.120839] threaded_store+0x1bb/0x220
[ 990.125940] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.131433] ? sysfs_file_ops+0x140/0x140
[ 990.136728] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.142023] ? sysfs_kf_write+0x65/0x160
[ 990.147225] kernfs_fop_write_iter+0x335/0x510
[ 990.153009] ? kernfs_ops+0xf0/0xf0
[ 990.157721] new_sync_write+0x308/0x6f0
[ 990.162824] ? new_sync_read+0x6f0/0x6f0
[ 990.168025] ? lock_acquire.part.0+0xbc/0x260
[ 990.173713] ? ksys_write+0xff/0x200
[ 990.178526] vfs_write+0x62a/0x980
[ 990.183140] ksys_write+0xff/0x200
[ 990.187754] ? __ia32_sys_read+0xc0/0xc0
[ 990.192953] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.198534] ? rcu_is_watching+0x15/0xd0
[ 990.203736] do_syscall_64+0xf3/0x5e0
[ 990.208641] ? irq_exit_rcu+0x39/0xf0
[ 990.213551] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.220019] RIP: 0033:0x7fe83c733c5e
[ 990.224820] RSP: 002b:00007fff928d2ef0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.234120] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe83c733c5e
[ 990.242927] RDX: 0000000000000001 RSI: 0000563f8911c110 RDI: 0000000000000007
[ 990.251735] RBP: 00007fff928d2f00 R08: 0000000000000000 R09: 0000000000000000
[ 990.260533] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe83c5cee80
[ 990.269340] R13: 0000563f8911c110 R14: 0000000000000007 R15: 00007fe83c55e480
[ 990.278154]
[ 990.281413] \x0aShowing all locks held in the system:
[ 990.289952] 1 lock held by khungtaskd/185:
[ 990.295347] #0: ffffffffae2cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.306813] 3 locks held by systemd-journal/804:
[ 990.312783] #0: ff1100180dcb7220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 990.322669] #1: ffffffffae4c8960 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.335487] #2: ff110001a1e84700 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 990.346949] 4 locks held by python3/3101:
[ 990.352244] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.362039] #1: ff1100013b952088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.373000] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.384158] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.394255] 4 locks held by python3/5024:
[ 990.399549] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.409339] #1: ff11000183a0dc88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.420300] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.431458] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.441545]
[ 990.444014] =============================================\x0a
[ 1014.312647] kworker/u130:2 (270) used greatest stack depth: 21192 bytes left
[ 1112.617754] INFO: task python3:5024 blocked for more than 245 seconds.
[ 1112.625904] Not tainted 7.0.0-rc3-qtkh-g0c88da771712 #1
[ 1112.633156] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.642746] task:python3 state:D stack:25312 pid:5024 tgid:5024 ppid:5023 task_flags:0x400100 flags:0x00080002
[ 1112.655952] Call Trace:
[ 1112.659488]
[ 1112.662636] __schedule+0xad9/0x1490
[ 1112.667451] ? io_schedule_timeout+0x130/0x130
[ 1112.673237] ? find_held_lock+0x2b/0x80
[ 1112.678343] ? __lock_release.isra.0+0x59/0x170
[ 1112.684227] schedule+0xd4/0x260
[ 1112.688646] schedule_preempt_disabled+0x18/0x30
[ 1112.694622] __mutex_lock+0xd76/0x1f20
[ 1112.699627] ? threaded_store+0x132/0x220
[ 1112.704924] ? ww_mutex_lock+0x160/0x160
[ 1112.710122] ? selinux_inode_free_security+0x310/0x310
[ 1112.716690] ? cap_capable+0x1ed/0x3f0
[ 1112.721697] ? sysfs_file_ops+0x140/0x140
[ 1112.726995] ? threaded_store+0x132/0x220
[ 1112.732293] threaded_store+0x132/0x220
[ 1112.737387] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.742870] ? sysfs_file_ops+0x140/0x140
[ 1112.748159] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.753452] ? sysfs_kf_write+0x65/0x160
[ 1112.758650] kernfs_fop_write_iter+0x335/0x510
[ 1112.764435] ? kernfs_ops+0xf0/0xf0
[ 1112.769146] new_sync_write+0x308/0x6f0
[ 1112.774238] ? new_sync_read+0x6f0/0x6f0
[ 1112.779437] ? lock_acquire.part.0+0xbc/0x260
[ 1112.785123] ? ksys_write+0xff/0x200
[ 1112.789936] vfs_write+0x62a/0x980
[ 1112.794548] ksys_write+0xff/0x200
[ 1112.799159] ? __ia32_sys_read+0xc0/0xc0
[ 1112.804354] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.809940] ? rcu_is_watching+0x15/0xd0
[ 1112.815141] do_syscall_64+0xf3/0x5e0
[ 1112.820039] ? exc_page_fault+0x9e/0xb0
[ 1112.825137] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.831602] RIP: 0033:0x7f9e4a62dc5e
[ 1112.836412] RSP: 002b:00007ffc55b04f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.845703] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9e4a62dc5e
[ 1112.854511] RDX: 0000000000000001 RSI: 0000560ce7be9110 RDI: 0000000000000007
[ 1112.863319] RBP: 00007ffc55b04f60 R08: 0000000000000000 R09: 0000000000000000
[ 1112.872127] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9e4a4c8e80
[ 1112.880934] R13: 0000560ce7be9110 R14: 0000000000000007 R15: 00007f9e4ad2eb98
[ 1112.889745]
[ 1112.893047] INFO: task python3:5024 is blocked on a mutex likely owned by task python3:3101.
[ 1112.903320] task:python3 state:D stack:25312 pid:3101 tgid:3101 ppid:3100 task_flags:0x400100 flags:0x00080802
[ 1112.916522] Call Trace:
[ 1112.920060]
[ 1112.923208] __schedule+0xad9/0x1490
[ 1112.928020] ? io_schedule_timeout+0x130/0x130
[ 1112.933801] ? find_held_lock+0x2b/0x80
[ 1112.938904] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.945083] schedule+0xd4/0x260
[ 1112.949503] schedule_timeout+0x103/0x260
[ 1112.954797] ? rcu_is_watching+0x15/0xd0
[ 1112.959996] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.966366] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.972054] ? ww_mutex_lock+0x160/0x160
[ 1112.977250] msleep+0x1b/0x30
[ 1112.981376] napi_set_threaded+0x376/0x410
[ 1112.986768] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.992261] netif_set_threaded+0x254/0x400
[ 1112.997745] ? sysfs_file_ops+0x140/0x140
[ 1113.003029] threaded_store+0x1bb/0x220
[ 1113.008131] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.013622] ? sysfs_file_ops+0x140/0x140
[ 1113.018919] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.024214] ? sysfs_kf_write+0x65/0x160
[ 1113.029414] kernfs_fop_write_iter+0x335/0x510
[ 1113.035200] ? kernfs_ops+0xf0/0xf0
[ 1113.039909] new_sync_write+0x308/0x6f0
[ 1113.045011] ? new_sync_read+0x6f0/0x6f0
[ 1113.050211] ? lock_acquire.part.0+0xbc/0x260
[ 1113.055888] ? ksys_write+0xff/0x200
[ 1113.060700] vfs_write+0x62a/0x980
[ 1113.065314] ksys_write+0xff/0x200
[ 1113.069925] ? __ia32_sys_read+0xc0/0xc0
[ 1113.075123] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.080711] ? rcu_is_watching+0x15/0xd0
[ 1113.085910] do_syscall_64+0xf3/0x5e0
[ 1113.090815] ? irq_exit_rcu+0x39/0xf0
[ 1113.095725] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.102190] RIP: 0033:0x7fe83c733c5e
[ 1113.106995] RSP: 002b:00007fff928d2ef0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.116291] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe83c733c5e
[ 1113.125098] RDX: 0000000000000001 RSI: 0000563f8911c110 RDI: 0000000000000007
[ 1113.133904] RBP: 00007fff928d2f00 R08: 0000000000000000 R09: 0000000000000000
[ 1113.142710] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe83c5cee80
[ 1113.151514] R13: 0000563f8911c110 R14: 0000000000000007 R15: 00007fe83c55e480
[ 1113.160325]
[ 1113.163584] \x0aShowing all locks held in the system:
[ 1113.172132] 1 lock held by khungtaskd/185:
[ 1113.177525] #0: ffffffffae2cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.189012] 4 locks held by python3/3101:
[ 1113.194305] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.204095] #1: ff1100013b952088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.215058] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.226212] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.236309] 2 locks held by kworker/15:1/4435:
[ 1113.242091] #0: ff110001000d2748 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 1113.253681] #1: ffa0000025ed7d20 (key_gc_work){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 1113.264159] 4 locks held by python3/5024:
[ 1113.269456] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.279250] #1: ff11000183a0dc88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.290212] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.301370] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.311457] 1 lock held by systemd/6099:
[ 1113.316659]
[ 1113.319124] =============================================\x0a
[ 1235.498099] INFO: task python3:5024 blocked for more than 368 seconds.
[ 1235.506248] Not tainted 7.0.0-rc3-qtkh-g0c88da771712 #1
[ 1235.513496] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.523078] task:python3 state:D stack:25312 pid:5024 tgid:5024 ppid:5023 task_flags:0x400100 flags:0x00080002
[ 1235.536284] Call Trace:
[ 1235.539825]
[ 1235.542977] __schedule+0xad9/0x1490
[ 1235.547795] ? io_schedule_timeout+0x130/0x130
[ 1235.553581] ? find_held_lock+0x2b/0x80
[ 1235.558686] ? __lock_release.isra.0+0x59/0x170
[ 1235.564575] schedule+0xd4/0x260
[ 1235.568995] schedule_preempt_disabled+0x18/0x30
[ 1235.574975] __mutex_lock+0xd76/0x1f20
[ 1235.579972] ? threaded_store+0x132/0x220
[ 1235.585271] ? ww_mutex_lock+0x160/0x160
[ 1235.590468] ? selinux_inode_free_security+0x310/0x310
[ 1235.597037] ? cap_capable+0x1ed/0x3f0
[ 1235.602048] ? sysfs_file_ops+0x140/0x140
[ 1235.607348] ? threaded_store+0x132/0x220
[ 1235.612643] threaded_store+0x132/0x220
[ 1235.617744] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.623235] ? sysfs_file_ops+0x140/0x140
[ 1235.628532] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.633829] ? sysfs_kf_write+0x65/0x160
[ 1235.639021] kernfs_fop_write_iter+0x335/0x510
[ 1235.644797] ? kernfs_ops+0xf0/0xf0
[ 1235.649500] new_sync_write+0x308/0x6f0
[ 1235.654595] ? new_sync_read+0x6f0/0x6f0
[ 1235.659788] ? lock_acquire.part.0+0xbc/0x260
[ 1235.665475] ? ksys_write+0xff/0x200
[ 1235.670277] vfs_write+0x62a/0x980
[ 1235.674892] ksys_write+0xff/0x200
[ 1235.679497] ? __ia32_sys_read+0xc0/0xc0
[ 1235.684697] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.690285] ? rcu_is_watching+0x15/0xd0
[ 1235.695487] do_syscall_64+0xf3/0x5e0
[ 1235.700392] ? exc_page_fault+0x9e/0xb0
[ 1235.705494] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.711965] RIP: 0033:0x7f9e4a62dc5e
[ 1235.716778] RSP: 002b:00007ffc55b04f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.726077] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9e4a62dc5e
[ 1235.734888] RDX: 0000000000000001 RSI: 0000560ce7be9110 RDI: 0000000000000007
[ 1235.743694] RBP: 00007ffc55b04f60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.752503] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9e4a4c8e80
[ 1235.761314] R13: 0000560ce7be9110 R14: 0000000000000007 R15: 00007f9e4ad2eb98
[ 1235.770131]
[ 1235.773401] INFO: task python3:5024 is blocked on a mutex likely owned by task python3:3101.
[ 1235.783675] task:python3 state:D stack:25312 pid:3101 tgid:3101 ppid:3100 task_flags:0x400100 flags:0x00080802
[ 1235.796877] Call Trace:
[ 1235.800417]
[ 1235.803566] __schedule+0xad9/0x1490
[ 1235.808378] ? io_schedule_timeout+0x130/0x130
[ 1235.814162] ? find_held_lock+0x2b/0x80
[ 1235.819267] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.825446] schedule+0xd4/0x260
[ 1235.829864] schedule_timeout+0x103/0x260
[ 1235.835161] ? rcu_is_watching+0x15/0xd0
[ 1235.840359] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.846729] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.852422] ? ww_mutex_lock+0x160/0x160
[ 1235.857622] msleep+0x1b/0x30
[ 1235.861742] napi_set_threaded+0x376/0x410
[ 1235.867137] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.872634] netif_set_threaded+0x254/0x400
[ 1235.878130] ? sysfs_file_ops+0x140/0x140
[ 1235.883425] threaded_store+0x1bb/0x220
[ 1235.888528] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.894013] ? sysfs_file_ops+0x140/0x140
[ 1235.899311] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.904599] ? sysfs_kf_write+0x65/0x160
[ 1235.909800] kernfs_fop_write_iter+0x335/0x510
[ 1235.915586] ? kernfs_ops+0xf0/0xf0
[ 1235.920300] new_sync_write+0x308/0x6f0
[ 1235.925406] ? new_sync_read+0x6f0/0x6f0
[ 1235.930606] ? lock_acquire.part.0+0xbc/0x260
[ 1235.936292] ? ksys_write+0xff/0x200
[ 1235.941106] vfs_write+0x62a/0x980
[ 1235.945721] ksys_write+0xff/0x200
[ 1235.950336] ? __ia32_sys_read+0xc0/0xc0
[ 1235.955533] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.961124] ? rcu_is_watching+0x15/0xd0
[ 1235.966318] do_syscall_64+0xf3/0x5e0
[ 1235.971223] ? irq_exit_rcu+0x39/0xf0
[ 1235.976130] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.982599] RIP: 0033:0x7fe83c733c5e
[ 1235.987408] RSP: 002b:00007fff928d2ef0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.996696] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe83c733c5e
[ 1236.005504] RDX: 0000000000000001 RSI: 0000563f8911c110 RDI: 0000000000000007
[ 1236.014313] RBP: 00007fff928d2f00 R08: 0000000000000000 R09: 0000000000000000
[ 1236.023124] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe83c5cee80
[ 1236.031934] R13: 0000563f8911c110 R14: 0000000000000007 R15: 00007fe83c55e480
[ 1236.040750]
[ 1236.044015] \x0aShowing all locks held in the system:
[ 1236.052547] 1 lock held by khungtaskd/185:
[ 1236.057938] #0: ffffffffae2cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.069423] 4 locks held by python3/3101:
[ 1236.074717] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.084512] #1: ff1100013b952088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.095477] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.106633] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.116726] 4 locks held by python3/5024:
[ 1236.122020] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.131810] #1: ff11000183a0dc88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.142772] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.153932] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.164027]
[ 1236.166494] =============================================\x0a
[ 1358.379403] INFO: task python3:5024 blocked for more than 491 seconds.
[ 1358.387563] Not tainted 7.0.0-rc3-qtkh-g0c88da771712 #1
[ 1358.394813] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.404404] task:python3 state:D stack:25312 pid:5024 tgid:5024 ppid:5023 task_flags:0x400100 flags:0x00080002
[ 1358.417608] Call Trace:
[ 1358.421150]
[ 1358.424302] __schedule+0xad9/0x1490
[ 1358.429116] ? io_schedule_timeout+0x130/0x130
[ 1358.434902] ? find_held_lock+0x2b/0x80
[ 1358.440007] ? __lock_release.isra.0+0x59/0x170
[ 1358.445883] schedule+0xd4/0x260
[ 1358.450301] schedule_preempt_disabled+0x18/0x30
[ 1358.456279] __mutex_lock+0xd76/0x1f20
[ 1358.461285] ? threaded_store+0x132/0x220
[ 1358.466583] ? ww_mutex_lock+0x160/0x160
[ 1358.471780] ? selinux_inode_free_security+0x310/0x310
[ 1358.478339] ? cap_capable+0x1ed/0x3f0
[ 1358.483348] ? sysfs_file_ops+0x140/0x140
[ 1358.488645] ? threaded_store+0x132/0x220
[ 1358.493942] threaded_store+0x132/0x220
[ 1358.499042] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.504533] ? sysfs_file_ops+0x140/0x140
[ 1358.509826] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.515122] ? sysfs_kf_write+0x65/0x160
[ 1358.520320] kernfs_fop_write_iter+0x335/0x510
[ 1358.526103] ? kernfs_ops+0xf0/0xf0
[ 1358.530812] new_sync_write+0x308/0x6f0
[ 1358.535914] ? new_sync_read+0x6f0/0x6f0
[ 1358.541113] ? lock_acquire.part.0+0xbc/0x260
[ 1358.546799] ? ksys_write+0xff/0x200
[ 1358.551609] vfs_write+0x62a/0x980
[ 1358.556213] ksys_write+0xff/0x200
[ 1358.560825] ? __ia32_sys_read+0xc0/0xc0
[ 1358.566020] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.571611] ? rcu_is_watching+0x15/0xd0
[ 1358.576809] do_syscall_64+0xf3/0x5e0
[ 1358.581713] ? exc_page_fault+0x9e/0xb0
[ 1358.586814] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.593282] RIP: 0033:0x7f9e4a62dc5e
[ 1358.598092] RSP: 002b:00007ffc55b04f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.607390] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9e4a62dc5e
[ 1358.616196] RDX: 0000000000000001 RSI: 0000560ce7be9110 RDI: 0000000000000007
[ 1358.625005] RBP: 00007ffc55b04f60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.633812] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9e4a4c8e80
[ 1358.642619] R13: 0000560ce7be9110 R14: 0000000000000007 R15: 00007f9e4ad2eb98
[ 1358.651433]
[ 1358.654699] INFO: task python3:5024 is blocked on a mutex likely owned by task python3:3101.
[ 1358.664962] task:python3 state:D stack:25312 pid:3101 tgid:3101 ppid:3100 task_flags:0x400100 flags:0x00080802
[ 1358.678164] Call Trace:
[ 1358.681702]
[ 1358.684849] __schedule+0xad9/0x1490
[ 1358.689661] ? io_schedule_timeout+0x130/0x130
[ 1358.695445] ? find_held_lock+0x2b/0x80
[ 1358.700544] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.706722] schedule+0xd4/0x260
[ 1358.711139] schedule_timeout+0x103/0x260
[ 1358.716433] ? rcu_is_watching+0x15/0xd0
[ 1358.721632] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.728002] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.733684] ? ww_mutex_lock+0x160/0x160
[ 1358.738884] msleep+0x1b/0x30
[ 1358.743008] napi_set_threaded+0x376/0x410
[ 1358.748402] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.753896] netif_set_threaded+0x254/0x400
[ 1358.759390] ? sysfs_file_ops+0x140/0x140
[ 1358.764684] threaded_store+0x1bb/0x220
[ 1358.769785] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.775274] ? sysfs_file_ops+0x140/0x140
[ 1358.780570] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.785865] ? sysfs_kf_write+0x65/0x160
[ 1358.791065] kernfs_fop_write_iter+0x335/0x510
[ 1358.796840] ? kernfs_ops+0xf0/0xf0
[ 1358.801551] new_sync_write+0x308/0x6f0
[ 1358.806653] ? new_sync_read+0x6f0/0x6f0
[ 1358.811855] ? lock_acquire.part.0+0xbc/0x260
[ 1358.817539] ? ksys_write+0xff/0x200
[ 1358.822350] vfs_write+0x62a/0x980
[ 1358.826965] ksys_write+0xff/0x200
[ 1358.831567] ? __ia32_sys_read+0xc0/0xc0
[ 1358.836763] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.842351] ? rcu_is_watching+0x15/0xd0
[ 1358.847549] do_syscall_64+0xf3/0x5e0
[ 1358.852454] ? irq_exit_rcu+0x39/0xf0
[ 1358.857363] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.863819] RIP: 0033:0x7fe83c733c5e
[ 1358.868623] RSP: 002b:00007fff928d2ef0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.877920] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe83c733c5e
[ 1358.886726] RDX: 0000000000000001 RSI: 0000563f8911c110 RDI: 0000000000000007
[ 1358.895533] RBP: 00007fff928d2f00 R08: 0000000000000000 R09: 0000000000000000
[ 1358.904338] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe83c5cee80
[ 1358.913144] R13: 0000563f8911c110 R14: 0000000000000007 R15: 00007fe83c55e480
[ 1358.921955]
[ 1358.925222] \x0aShowing all locks held in the system:
[ 1358.933760] 1 lock held by khungtaskd/185:
[ 1358.939151] #0: ffffffffae2cde20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.950632] 4 locks held by python3/3101:
[ 1358.955923] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.965712] #1: ff1100013b952088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.976673] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.987830] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.997923] 4 locks held by python3/5024:
[ 1359.003217] #0: ff1100012ce413f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.013009] #1: ff11000183a0dc88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.023969] #2: ff1100011f6ed0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.035124] #3: ff1100011f749cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.045214]
[ 1359.047671] =============================================\x0a