[ 764.019279] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 764.021780] nipa-hw-worker: [5/40] Retrying drivers/net:napi_threaded.py
[ 764.183052] kselftest: Running tests in drivers/net
[ 989.748267] INFO: task python3:5231 blocked for more than 122 seconds.
[ 989.756492] Not tainted 7.0.0-rc5-mbeb-g44f0d433577c #1
[ 989.763744] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.773337] task:python3 state:D stack:25312 pid:5231 tgid:5231 ppid:5230 task_flags:0x400100 flags:0x00080000
[ 989.786544] Call Trace:
[ 989.790084]
[ 989.793237] __schedule+0xad9/0x1490
[ 989.798053] ? io_schedule_timeout+0x130/0x130
[ 989.803837] ? find_held_lock+0x2b/0x80
[ 989.808944] ? __lock_release.isra.0+0x59/0x170
[ 989.814830] schedule+0xd4/0x260
[ 989.819249] schedule_preempt_disabled+0x18/0x30
[ 989.825228] __mutex_lock+0xd76/0x1f20
[ 989.830235] ? threaded_store+0x132/0x220
[ 989.835534] ? ww_mutex_lock+0x160/0x160
[ 989.840736] ? selinux_inode_free_security+0x310/0x310
[ 989.847309] ? cap_capable+0x1ed/0x3f0
[ 989.852319] ? sysfs_file_ops+0x140/0x140
[ 989.857617] ? threaded_store+0x132/0x220
[ 989.862914] threaded_store+0x132/0x220
[ 989.868019] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.873516] ? sysfs_file_ops+0x140/0x140
[ 989.878816] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.884114] ? sysfs_kf_write+0x65/0x160
[ 989.889314] kernfs_fop_write_iter+0x335/0x510
[ 989.895101] ? kernfs_ops+0xf0/0xf0
[ 989.899816] new_sync_write+0x308/0x6f0
[ 989.904919] ? new_sync_read+0x6f0/0x6f0
[ 989.910119] ? lock_acquire.part.0+0xbc/0x260
[ 989.915797] ? ksys_write+0xff/0x200
[ 989.920601] vfs_write+0x62a/0x980
[ 989.925215] ksys_write+0xff/0x200
[ 989.929831] ? __ia32_sys_read+0xc0/0xc0
[ 989.935031] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.940621] ? rcu_is_watching+0x15/0xd0
[ 989.945823] do_syscall_64+0xf3/0x5e0
[ 989.950730] ? exc_page_fault+0x9e/0xb0
[ 989.955834] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.962302] RIP: 0033:0x7f10d6cfec5e
[ 989.967113] RSP: 002b:00007ffe4f028ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.976411] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f10d6cfec5e
[ 989.985218] RDX: 0000000000000001 RSI: 0000561612579760 RDI: 0000000000000007
[ 989.994028] RBP: 00007ffe4f028ad0 R08: 0000000000000000 R09: 0000000000000000
[ 990.002837] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f10d6b99e80
[ 990.011645] R13: 0000561612579760 R14: 0000000000000007 R15: 00007f10d73ffb98
[ 990.020453]
[ 990.023715] INFO: task python3:5231 is blocked on a mutex likely owned by task python3:3251.
[ 990.033995] task:python3 state:D stack:25312 pid:3251 tgid:3251 ppid:3250 task_flags:0x400100 flags:0x00080802
[ 990.047196] Call Trace:
[ 990.050735]
[ 990.053886] __schedule+0xad9/0x1490
[ 990.058689] ? io_schedule_timeout+0x130/0x130
[ 990.064472] ? find_held_lock+0x2b/0x80
[ 990.069575] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.075757] schedule+0xd4/0x260
[ 990.080176] schedule_timeout+0x103/0x260
[ 990.085477] ? rcu_is_watching+0x15/0xd0
[ 990.090674] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.097044] ? hrtimers_cpu_dying+0x250/0x250
[ 990.102737] ? ww_mutex_lock+0x160/0x160
[ 990.107939] msleep+0x1b/0x30
[ 990.112067] napi_set_threaded+0x376/0x410
[ 990.117463] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.122957] netif_set_threaded+0x254/0x400
[ 990.128448] ? sysfs_file_ops+0x140/0x140
[ 990.133735] threaded_store+0x1bb/0x220
[ 990.138841] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.144334] ? sysfs_file_ops+0x140/0x140
[ 990.149632] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.154928] ? sysfs_kf_write+0x65/0x160
[ 990.160130] kernfs_fop_write_iter+0x335/0x510
[ 990.165918] ? kernfs_ops+0xf0/0xf0
[ 990.170632] new_sync_write+0x308/0x6f0
[ 990.175733] ? new_sync_read+0x6f0/0x6f0
[ 990.180936] ? lock_acquire.part.0+0xbc/0x260
[ 990.186624] ? ksys_write+0xff/0x200
[ 990.191428] vfs_write+0x62a/0x980
[ 990.196043] ksys_write+0xff/0x200
[ 990.200650] ? __ia32_sys_read+0xc0/0xc0
[ 990.205849] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.211438] ? rcu_is_watching+0x15/0xd0
[ 990.216638] do_syscall_64+0xf3/0x5e0
[ 990.221544] ? irq_exit_rcu+0x39/0xf0
[ 990.226455] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.232921] RIP: 0033:0x7f907c20bc5e
[ 990.237730] RSP: 002b:00007ffd5a736a80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.247021] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f907c20bc5e
[ 990.255831] RDX: 0000000000000001 RSI: 00005639ecf78760 RDI: 0000000000000007
[ 990.264638] RBP: 00007ffd5a736a90 R08: 0000000000000000 R09: 0000000000000000
[ 990.273445] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f907c0a6e80
[ 990.282252] R13: 00005639ecf78760 R14: 0000000000000007 R15: 00007f907c036480
[ 990.291064]
[ 990.294323] \x0aShowing all locks held in the system:
[ 990.302863] 1 lock held by khungtaskd/185:
[ 990.308257] #0: ffffffffa10ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.319732] 1 lock held by systemd-journal/805:
[ 990.325607] #0: ff1100180e7b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 990.335507] 4 locks held by python3/3251:
[ 990.340805] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.350596] #1: ff1100013c880e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.361551] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.372710] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.382808] 4 locks held by python3/5231:
[ 990.388104] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.397895] #1: ff110001c25ab288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.408860] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.420019] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.430112]
[ 990.432580] =============================================\x0a
[ 1112.629459] INFO: task python3:5231 blocked for more than 245 seconds.
[ 1112.637608] Not tainted 7.0.0-rc5-mbeb-g44f0d433577c #1
[ 1112.644858] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.654447] task:python3 state:D stack:25312 pid:5231 tgid:5231 ppid:5230 task_flags:0x400100 flags:0x00080000
[ 1112.667647] Call Trace:
[ 1112.671187]
[ 1112.674334] __schedule+0xad9/0x1490
[ 1112.679150] ? io_schedule_timeout+0x130/0x130
[ 1112.684937] ? find_held_lock+0x2b/0x80
[ 1112.690044] ? __lock_release.isra.0+0x59/0x170
[ 1112.695929] schedule+0xd4/0x260
[ 1112.700349] schedule_preempt_disabled+0x18/0x30
[ 1112.706332] __mutex_lock+0xd76/0x1f20
[ 1112.711339] ? threaded_store+0x132/0x220
[ 1112.716715] ? ww_mutex_lock+0x160/0x160
[ 1112.721913] ? selinux_inode_free_security+0x310/0x310
[ 1112.728481] ? cap_capable+0x1ed/0x3f0
[ 1112.733494] ? sysfs_file_ops+0x140/0x140
[ 1112.738797] ? threaded_store+0x132/0x220
[ 1112.744096] threaded_store+0x132/0x220
[ 1112.749199] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.754693] ? sysfs_file_ops+0x140/0x140
[ 1112.759989] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.765287] ? sysfs_kf_write+0x65/0x160
[ 1112.770491] kernfs_fop_write_iter+0x335/0x510
[ 1112.776279] ? kernfs_ops+0xf0/0xf0
[ 1112.780993] new_sync_write+0x308/0x6f0
[ 1112.786098] ? new_sync_read+0x6f0/0x6f0
[ 1112.791304] ? lock_acquire.part.0+0xbc/0x260
[ 1112.796988] ? ksys_write+0xff/0x200
[ 1112.801800] vfs_write+0x62a/0x980
[ 1112.806415] ksys_write+0xff/0x200
[ 1112.811029] ? __ia32_sys_read+0xc0/0xc0
[ 1112.816229] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.816235] ? rcu_is_watching+0x15/0xd0
[ 1112.816240] do_syscall_64+0xf3/0x5e0
[ 1112.816244] ? exc_page_fault+0x9e/0xb0
[ 1112.816247] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.816250] RIP: 0033:0x7f10d6cfec5e
[ 1112.848352] RSP: 002b:00007ffe4f028ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.857652] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f10d6cfec5e
[ 1112.866459] RDX: 0000000000000001 RSI: 0000561612579760 RDI: 0000000000000007
[ 1112.875266] RBP: 00007ffe4f028ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.884073] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f10d6b99e80
[ 1112.892883] R13: 0000561612579760 R14: 0000000000000007 R15: 00007f10d73ffb98
[ 1112.901699]
[ 1112.905016] INFO: task python3:5231 is blocked on a mutex likely owned by task python3:3251.
[ 1112.915288] task:python3 state:D stack:25312 pid:3251 tgid:3251 ppid:3250 task_flags:0x400100 flags:0x00080802
[ 1112.928497] Call Trace:
[ 1112.932036]
[ 1112.935188] __schedule+0xad9/0x1490
[ 1112.939999] ? io_schedule_timeout+0x130/0x130
[ 1112.945782] ? find_held_lock+0x2b/0x80
[ 1112.950885] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.957064] schedule+0xd4/0x260
[ 1112.961483] schedule_timeout+0x103/0x260
[ 1112.966783] ? rcu_is_watching+0x15/0xd0
[ 1112.971983] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.978344] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.984027] ? ww_mutex_lock+0x160/0x160
[ 1112.989227] msleep+0x1b/0x30
[ 1112.993344] napi_set_threaded+0x376/0x410
[ 1112.998739] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.004232] netif_set_threaded+0x254/0x400
[ 1113.009726] ? sysfs_file_ops+0x140/0x140
[ 1113.015024] threaded_store+0x1bb/0x220
[ 1113.020119] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.025613] ? sysfs_file_ops+0x140/0x140
[ 1113.030910] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.036197] ? sysfs_kf_write+0x65/0x160
[ 1113.041396] kernfs_fop_write_iter+0x335/0x510
[ 1113.047183] ? kernfs_ops+0xf0/0xf0
[ 1113.051896] new_sync_write+0x308/0x6f0
[ 1113.056997] ? new_sync_read+0x6f0/0x6f0
[ 1113.062198] ? lock_acquire.part.0+0xbc/0x260
[ 1113.067883] ? ksys_write+0xff/0x200
[ 1113.072697] vfs_write+0x62a/0x980
[ 1113.077312] ksys_write+0xff/0x200
[ 1113.081917] ? __ia32_sys_read+0xc0/0xc0
[ 1113.087116] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.092708] ? rcu_is_watching+0x15/0xd0
[ 1113.097911] do_syscall_64+0xf3/0x5e0
[ 1113.102820] ? irq_exit_rcu+0x39/0xf0
[ 1113.107728] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.114198] RIP: 0033:0x7f907c20bc5e
[ 1113.119007] RSP: 002b:00007ffd5a736a80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.128305] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f907c20bc5e
[ 1113.137110] RDX: 0000000000000001 RSI: 00005639ecf78760 RDI: 0000000000000007
[ 1113.145920] RBP: 00007ffd5a736a90 R08: 0000000000000000 R09: 0000000000000000
[ 1113.154730] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f907c0a6e80
[ 1113.163540] R13: 00005639ecf78760 R14: 0000000000000007 R15: 00007f907c036480
[ 1113.172355]
[ 1113.175617] \x0aShowing all locks held in the system:
[ 1113.184157] 1 lock held by khungtaskd/185:
[ 1113.189552] #0: ffffffffa10ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.201017] 3 locks held by systemd-journal/805:
[ 1113.206995] #0: ff1100180dcb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1113.216882] #1: ffffffffa12c91e0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.229701] #2: ff110001410c1f10 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1113.241165] 4 locks held by python3/3251:
[ 1113.246463] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.256254] #1: ff1100013c880e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.267207] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.278354] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.288456] 4 locks held by python3/5231:
[ 1113.293752] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.303545] #1: ff110001c25ab288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.314509] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.325664] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.335753] 5 locks held by (time-dir)/6300:
[ 1113.341342] #0: ff110017db48c3f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.351134] #1: ff110001271f6e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.362097] #2: ffffffffa1137248 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1113.372765] #3: ffffffffa0f68f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1113.384408] #4: ffffffffa1136f50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1113.396834]
[ 1113.399304] =============================================\x0a
[ 1235.511653] INFO: task python3:5231 blocked for more than 368 seconds.
[ 1235.519798] Not tainted 7.0.0-rc5-mbeb-g44f0d433577c #1
[ 1235.527049] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.536635] task:python3 state:D stack:25312 pid:5231 tgid:5231 ppid:5230 task_flags:0x400100 flags:0x00080002
[ 1235.549838] Call Trace:
[ 1235.553377]
[ 1235.556525] __schedule+0xad9/0x1490
[ 1235.561339] ? io_schedule_timeout+0x130/0x130
[ 1235.567124] ? find_held_lock+0x2b/0x80
[ 1235.572227] ? __lock_release.isra.0+0x59/0x170
[ 1235.578110] schedule+0xd4/0x260
[ 1235.582526] schedule_preempt_disabled+0x18/0x30
[ 1235.588508] __mutex_lock+0xd76/0x1f20
[ 1235.593512] ? threaded_store+0x132/0x220
[ 1235.598810] ? ww_mutex_lock+0x160/0x160
[ 1235.604007] ? selinux_inode_free_security+0x310/0x310
[ 1235.610575] ? cap_capable+0x1ed/0x3f0
[ 1235.615579] ? sysfs_file_ops+0x140/0x140
[ 1235.620868] ? threaded_store+0x132/0x220
[ 1235.626162] threaded_store+0x132/0x220
[ 1235.631264] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.636755] ? sysfs_file_ops+0x140/0x140
[ 1235.642051] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.647347] ? sysfs_kf_write+0x65/0x160
[ 1235.652546] kernfs_fop_write_iter+0x335/0x510
[ 1235.658328] ? kernfs_ops+0xf0/0xf0
[ 1235.663037] new_sync_write+0x308/0x6f0
[ 1235.668139] ? new_sync_read+0x6f0/0x6f0
[ 1235.673340] ? lock_acquire.part.0+0xbc/0x260
[ 1235.679026] ? ksys_write+0xff/0x200
[ 1235.683836] vfs_write+0x62a/0x980
[ 1235.688441] ksys_write+0xff/0x200
[ 1235.693053] ? __ia32_sys_read+0xc0/0xc0
[ 1235.698248] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.703835] ? rcu_is_watching+0x15/0xd0
[ 1235.709036] do_syscall_64+0xf3/0x5e0
[ 1235.713942] ? exc_page_fault+0x9e/0xb0
[ 1235.719044] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.725511] RIP: 0033:0x7f10d6cfec5e
[ 1235.730309] RSP: 002b:00007ffe4f028ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.739608] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f10d6cfec5e
[ 1235.748416] RDX: 0000000000000001 RSI: 0000561612579760 RDI: 0000000000000007
[ 1235.757213] RBP: 00007ffe4f028ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.766018] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f10d6b99e80
[ 1235.774826] R13: 0000561612579760 R14: 0000000000000007 R15: 00007f10d73ffb98
[ 1235.783637]
[ 1235.786923] INFO: task python3:5231 is blocked on a mutex likely owned by task python3:3251.
[ 1235.797196] task:python3 state:D stack:25312 pid:3251 tgid:3251 ppid:3250 task_flags:0x400100 flags:0x00080802
[ 1235.810397] Call Trace:
[ 1235.813934]
[ 1235.817085] __schedule+0xad9/0x1490
[ 1235.821892] ? io_schedule_timeout+0x130/0x130
[ 1235.827677] ? find_held_lock+0x2b/0x80
[ 1235.832769] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.838950] schedule+0xd4/0x260
[ 1235.843368] schedule_timeout+0x103/0x260
[ 1235.848664] ? rcu_is_watching+0x15/0xd0
[ 1235.853861] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.860229] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.865917] ? ww_mutex_lock+0x160/0x160
[ 1235.871114] msleep+0x1b/0x30
[ 1235.875237] napi_set_threaded+0x376/0x410
[ 1235.880631] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.886124] netif_set_threaded+0x254/0x400
[ 1235.891615] ? sysfs_file_ops+0x140/0x140
[ 1235.896910] threaded_store+0x1bb/0x220
[ 1235.902013] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.907509] ? sysfs_file_ops+0x140/0x140
[ 1235.912804] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.918101] ? sysfs_kf_write+0x65/0x160
[ 1235.923298] kernfs_fop_write_iter+0x335/0x510
[ 1235.929084] ? kernfs_ops+0xf0/0xf0
[ 1235.933795] new_sync_write+0x308/0x6f0
[ 1235.938894] ? new_sync_read+0x6f0/0x6f0
[ 1235.944091] ? lock_acquire.part.0+0xbc/0x260
[ 1235.949778] ? ksys_write+0xff/0x200
[ 1235.954591] vfs_write+0x62a/0x980
[ 1235.959202] ksys_write+0xff/0x200
[ 1235.963817] ? __ia32_sys_read+0xc0/0xc0
[ 1235.969013] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.974601] ? rcu_is_watching+0x15/0xd0
[ 1235.979801] do_syscall_64+0xf3/0x5e0
[ 1235.984696] ? irq_exit_rcu+0x39/0xf0
[ 1235.989602] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.996069] RIP: 0033:0x7f907c20bc5e
[ 1236.000874] RSP: 002b:00007ffd5a736a80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.010172] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f907c20bc5e
[ 1236.018980] RDX: 0000000000000001 RSI: 00005639ecf78760 RDI: 0000000000000007
[ 1236.027779] RBP: 00007ffd5a736a90 R08: 0000000000000000 R09: 0000000000000000
[ 1236.036588] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f907c0a6e80
[ 1236.045395] R13: 00005639ecf78760 R14: 0000000000000007 R15: 00007f907c036480
[ 1236.054209]
[ 1236.057470] \x0aShowing all locks held in the system:
[ 1236.066006] 1 lock held by khungtaskd/185:
[ 1236.071398] #0: ffffffffa10ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.082880] 4 locks held by python3/3251:
[ 1236.088173] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.097962] #1: ff1100013c880e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.108923] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.120070] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.130166] 4 locks held by python3/5231:
[ 1236.135460] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.145248] #1: ff110001c25ab288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.156208] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.167365] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.177456]
[ 1236.179921] =============================================\x0a
[ 1358.391868] INFO: task python3:5231 blocked for more than 491 seconds.
[ 1358.400015] Not tainted 7.0.0-rc5-mbeb-g44f0d433577c #1
[ 1358.407265] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.416847] task:python3 state:D stack:25312 pid:5231 tgid:5231 ppid:5230 task_flags:0x400100 flags:0x00080002
[ 1358.430053] Call Trace:
[ 1358.433590]
[ 1358.436740] __schedule+0xad9/0x1490
[ 1358.441557] ? io_schedule_timeout+0x130/0x130
[ 1358.447342] ? find_held_lock+0x2b/0x80
[ 1358.452447] ? __lock_release.isra.0+0x59/0x170
[ 1358.458332] schedule+0xd4/0x260
[ 1358.462750] schedule_preempt_disabled+0x18/0x30
[ 1358.468730] __mutex_lock+0xd76/0x1f20
[ 1358.473735] ? threaded_store+0x132/0x220
[ 1358.479033] ? ww_mutex_lock+0x160/0x160
[ 1358.484229] ? selinux_inode_free_security+0x310/0x310
[ 1358.490797] ? cap_capable+0x1ed/0x3f0
[ 1358.495804] ? sysfs_file_ops+0x140/0x140
[ 1358.501104] ? threaded_store+0x132/0x220
[ 1358.506397] threaded_store+0x132/0x220
[ 1358.511497] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.516989] ? sysfs_file_ops+0x140/0x140
[ 1358.522284] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.527577] ? sysfs_kf_write+0x65/0x160
[ 1358.532776] kernfs_fop_write_iter+0x335/0x510
[ 1358.538562] ? kernfs_ops+0xf0/0xf0
[ 1358.543274] new_sync_write+0x308/0x6f0
[ 1358.548379] ? new_sync_read+0x6f0/0x6f0
[ 1358.553580] ? lock_acquire.part.0+0xbc/0x260
[ 1358.559267] ? ksys_write+0xff/0x200
[ 1358.564080] vfs_write+0x62a/0x980
[ 1358.568693] ksys_write+0xff/0x200
[ 1358.573310] ? __ia32_sys_read+0xc0/0xc0
[ 1358.578505] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.584094] ? rcu_is_watching+0x15/0xd0
[ 1358.589292] do_syscall_64+0xf3/0x5e0
[ 1358.594199] ? exc_page_fault+0x9e/0xb0
[ 1358.599300] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.605760] RIP: 0033:0x7f10d6cfec5e
[ 1358.610570] RSP: 002b:00007ffe4f028ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.619866] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f10d6cfec5e
[ 1358.628676] RDX: 0000000000000001 RSI: 0000561612579760 RDI: 0000000000000007
[ 1358.637483] RBP: 00007ffe4f028ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.646291] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f10d6b99e80
[ 1358.655089] R13: 0000561612579760 R14: 0000000000000007 R15: 00007f10d73ffb98
[ 1358.663900]
[ 1358.667182] INFO: task python3:5231 is blocked on a mutex likely owned by task python3:3251.
[ 1358.677454] task:python3 state:D stack:25312 pid:3251 tgid:3251 ppid:3250 task_flags:0x400100 flags:0x00080802
[ 1358.690654] Call Trace:
[ 1358.694184]
[ 1358.697332] __schedule+0xad9/0x1490
[ 1358.702143] ? io_schedule_timeout+0x130/0x130
[ 1358.707926] ? find_held_lock+0x2b/0x80
[ 1358.713029] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.719205] schedule+0xd4/0x260
[ 1358.723621] schedule_timeout+0x103/0x260
[ 1358.728916] ? rcu_is_watching+0x15/0xd0
[ 1358.734113] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.740483] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.746165] ? ww_mutex_lock+0x160/0x160
[ 1358.751363] msleep+0x1b/0x30
[ 1358.755489] napi_set_threaded+0x376/0x410
[ 1358.760882] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.766376] netif_set_threaded+0x254/0x400
[ 1358.771868] ? sysfs_file_ops+0x140/0x140
[ 1358.777154] threaded_store+0x1bb/0x220
[ 1358.782254] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.787744] ? sysfs_file_ops+0x140/0x140
[ 1358.793040] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.798335] ? sysfs_kf_write+0x65/0x160
[ 1358.803534] kernfs_fop_write_iter+0x335/0x510
[ 1358.809319] ? kernfs_ops+0xf0/0xf0
[ 1358.814019] new_sync_write+0x308/0x6f0
[ 1358.819119] ? new_sync_read+0x6f0/0x6f0
[ 1358.824318] ? lock_acquire.part.0+0xbc/0x260
[ 1358.830003] ? ksys_write+0xff/0x200
[ 1358.834814] vfs_write+0x62a/0x980
[ 1358.839429] ksys_write+0xff/0x200
[ 1358.844032] ? __ia32_sys_read+0xc0/0xc0
[ 1358.849228] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.854816] ? rcu_is_watching+0x15/0xd0
[ 1358.860015] do_syscall_64+0xf3/0x5e0
[ 1358.864919] ? irq_exit_rcu+0x39/0xf0
[ 1358.869826] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.876292] RIP: 0033:0x7f907c20bc5e
[ 1358.881101] RSP: 002b:00007ffd5a736a80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.890399] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f907c20bc5e
[ 1358.899204] RDX: 0000000000000001 RSI: 00005639ecf78760 RDI: 0000000000000007
[ 1358.908009] RBP: 00007ffd5a736a90 R08: 0000000000000000 R09: 0000000000000000
[ 1358.916815] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f907c0a6e80
[ 1358.925621] R13: 00005639ecf78760 R14: 0000000000000007 R15: 00007f907c036480
[ 1358.934432]
[ 1358.937696] \x0aShowing all locks held in the system:
[ 1358.946235] 1 lock held by khungtaskd/185:
[ 1358.951617] #0: ffffffffa10ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.963095] 4 locks held by python3/3251:
[ 1358.968388] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.978177] #1: ff1100013c880e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.989138] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.000291] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.010384] 4 locks held by python3/5231:
[ 1359.015676] #0: ff1100012ebc43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.025467] #1: ff110001c25ab288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.036420] #2: ff110001225230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.047576] #3: ff110001224f9d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.057665]
[ 1359.060130] =============================================\x0a