[ 760.021164] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.023821] nipa-hw-worker: [4/37] Retrying drivers/net:napi_threaded.py
[ 760.187911] kselftest: Running tests in drivers/net
[ 989.743294] INFO: task python3:5040 blocked for more than 122 seconds.
[ 989.752051] Not tainted 7.0.0-rc4-xwog-g1102106afb28 #1
[ 989.759290] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.768877] task:python3 state:D stack:25312 pid:5040 tgid:5040 ppid:5039 task_flags:0x400100 flags:0x00080000
[ 989.782082] Call Trace:
[ 989.785618]
[ 989.788766] __schedule+0xad9/0x1490
[ 989.793583] ? io_schedule_timeout+0x130/0x130
[ 989.799366] ? find_held_lock+0x2b/0x80
[ 989.804462] ? __lock_release.isra.0+0x59/0x170
[ 989.810345] schedule+0xd4/0x260
[ 989.814762] schedule_preempt_disabled+0x18/0x30
[ 989.820740] __mutex_lock+0xd76/0x1f20
[ 989.825743] ? threaded_store+0x132/0x220
[ 989.831040] ? ww_mutex_lock+0x160/0x160
[ 989.836235] ? selinux_inode_free_security+0x310/0x310
[ 989.842805] ? cap_capable+0x1ed/0x3f0
[ 989.847813] ? sysfs_file_ops+0x140/0x140
[ 989.853112] ? threaded_store+0x132/0x220
[ 989.858406] threaded_store+0x132/0x220
[ 989.863508] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.868998] ? sysfs_file_ops+0x140/0x140
[ 989.874295] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.879591] ? sysfs_kf_write+0x65/0x160
[ 989.884792] kernfs_fop_write_iter+0x335/0x510
[ 989.890577] ? kernfs_ops+0xf0/0xf0
[ 989.895286] new_sync_write+0x308/0x6f0
[ 989.900388] ? new_sync_read+0x6f0/0x6f0
[ 989.905588] ? lock_acquire.part.0+0xbc/0x260
[ 989.911273] ? ksys_write+0xff/0x200
[ 989.916084] vfs_write+0x62a/0x980
[ 989.920698] ksys_write+0xff/0x200
[ 989.925310] ? __ia32_sys_read+0xc0/0xc0
[ 989.930506] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.936096] ? rcu_is_watching+0x15/0xd0
[ 989.941296] do_syscall_64+0xf3/0x5e0
[ 989.946201] ? exc_page_fault+0x9e/0xb0
[ 989.951304] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.957769] RIP: 0033:0x7fa2f9ff9c5e
[ 989.962578] RSP: 002b:00007ffd94c06630 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.971875] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa2f9ff9c5e
[ 989.980672] RDX: 0000000000000001 RSI: 000055a8acfa2110 RDI: 0000000000000007
[ 989.989481] RBP: 00007ffd94c06640 R08: 0000000000000000 R09: 0000000000000000
[ 989.998286] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa2f9e94e80
[ 990.007095] R13: 000055a8acfa2110 R14: 0000000000000007 R15: 00007fa2fa6fab98
[ 990.015906]
[ 990.019192] INFO: task python3:5040 is blocked on a mutex likely owned by task python3:3091.
[ 990.029471] task:python3 state:D stack:25312 pid:3091 tgid:3091 ppid:3090 task_flags:0x400100 flags:0x00080802
[ 990.042673] Call Trace:
[ 990.046211]
[ 990.049361] __schedule+0xad9/0x1490
[ 990.054173] ? io_schedule_timeout+0x130/0x130
[ 990.059957] ? find_held_lock+0x2b/0x80
[ 990.065052] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.071229] schedule+0xd4/0x260
[ 990.075636] schedule_timeout+0x103/0x260
[ 990.080933] ? rcu_is_watching+0x15/0xd0
[ 990.086132] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.092500] ? hrtimers_cpu_dying+0x250/0x250
[ 990.098190] ? ww_mutex_lock+0x160/0x160
[ 990.103387] msleep+0x1b/0x30
[ 990.107511] napi_set_threaded+0x376/0x410
[ 990.112906] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.118398] netif_set_threaded+0x254/0x400
[ 990.123892] ? sysfs_file_ops+0x140/0x140
[ 990.129186] threaded_store+0x1bb/0x220
[ 990.134285] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.139775] ? sysfs_file_ops+0x140/0x140
[ 990.145071] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.150368] ? sysfs_kf_write+0x65/0x160
[ 990.155568] kernfs_fop_write_iter+0x335/0x510
[ 990.161345] ? kernfs_ops+0xf0/0xf0
[ 990.166056] new_sync_write+0x308/0x6f0
[ 990.171157] ? new_sync_read+0x6f0/0x6f0
[ 990.176356] ? lock_acquire.part.0+0xbc/0x260
[ 990.182043] ? ksys_write+0xff/0x200
[ 990.186853] vfs_write+0x62a/0x980
[ 990.191459] ksys_write+0xff/0x200
[ 990.196073] ? __ia32_sys_read+0xc0/0xc0
[ 990.201271] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.206859] ? rcu_is_watching+0x15/0xd0
[ 990.212057] do_syscall_64+0xf3/0x5e0
[ 990.216964] ? exc_page_fault+0x9e/0xb0
[ 990.222057] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.228523] RIP: 0033:0x7efffec0ec5e
[ 990.233328] RSP: 002b:00007ffc269ae850 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.242622] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efffec0ec5e
[ 990.251428] RDX: 0000000000000001 RSI: 0000563a446ae110 RDI: 0000000000000007
[ 990.260234] RBP: 00007ffc269ae860 R08: 0000000000000000 R09: 0000000000000000
[ 990.269042] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efffeaa9e80
[ 990.277838] R13: 0000563a446ae110 R14: 0000000000000007 R15: 00007efffea3a480
[ 990.286650]
[ 990.289906] \x0aShowing all locks held in the system:
[ 990.298441] 1 lock held by khungtaskd/184:
[ 990.303833] #0: ffffffff9dace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.315317] 4 locks held by python3/3091:
[ 990.320601] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.330391] #1: ff1100014857ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.341354] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.352509] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.362603] 4 locks held by python3/5040:
[ 990.367897] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.377685] #1: ff110001bc98e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.388643] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.399800] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.409889]
[ 990.412353] =============================================\x0a
[ 1112.624540] INFO: task python3:5040 blocked for more than 245 seconds.
[ 1112.632692] Not tainted 7.0.0-rc4-xwog-g1102106afb28 #1
[ 1112.639944] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.649533] task:python3 state:D stack:25312 pid:5040 tgid:5040 ppid:5039 task_flags:0x400100 flags:0x00080000
[ 1112.662738] Call Trace:
[ 1112.666279]
[ 1112.669431] __schedule+0xad9/0x1490
[ 1112.674248] ? io_schedule_timeout+0x130/0x130
[ 1112.680135] ? find_held_lock+0x2b/0x80
[ 1112.685243] ? __lock_release.isra.0+0x59/0x170
[ 1112.691127] schedule+0xd4/0x260
[ 1112.695542] schedule_preempt_disabled+0x18/0x30
[ 1112.701520] __mutex_lock+0xd76/0x1f20
[ 1112.706526] ? threaded_store+0x132/0x220
[ 1112.711894] ? ww_mutex_lock+0x160/0x160
[ 1112.717089] ? selinux_inode_free_security+0x310/0x310
[ 1112.723658] ? cap_capable+0x1ed/0x3f0
[ 1112.728666] ? sysfs_file_ops+0x140/0x140
[ 1112.733968] ? threaded_store+0x132/0x220
[ 1112.739265] threaded_store+0x132/0x220
[ 1112.744368] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.749866] ? sysfs_file_ops+0x140/0x140
[ 1112.755155] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.760519] ? sysfs_kf_write+0x65/0x160
[ 1112.765718] kernfs_fop_write_iter+0x335/0x510
[ 1112.771504] ? kernfs_ops+0xf0/0xf0
[ 1112.771510] new_sync_write+0x308/0x6f0
[ 1112.771515] ? new_sync_read+0x6f0/0x6f0
[ 1112.771520] ? lock_acquire.part.0+0xbc/0x260
[ 1112.771523] ? ksys_write+0xff/0x200
[ 1112.771530] vfs_write+0x62a/0x980
[ 1112.801667] ksys_write+0xff/0x200
[ 1112.806281] ? __ia32_sys_read+0xc0/0xc0
[ 1112.811479] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.817071] ? rcu_is_watching+0x15/0xd0
[ 1112.822273] do_syscall_64+0xf3/0x5e0
[ 1112.827179] ? exc_page_fault+0x9e/0xb0
[ 1112.832283] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.838749] RIP: 0033:0x7fa2f9ff9c5e
[ 1112.843553] RSP: 002b:00007ffd94c06630 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.852850] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa2f9ff9c5e
[ 1112.861659] RDX: 0000000000000001 RSI: 000055a8acfa2110 RDI: 0000000000000007
[ 1112.870466] RBP: 00007ffd94c06640 R08: 0000000000000000 R09: 0000000000000000
[ 1112.879274] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa2f9e94e80
[ 1112.888074] R13: 000055a8acfa2110 R14: 0000000000000007 R15: 00007fa2fa6fab98
[ 1112.896888]
[ 1112.900200] INFO: task python3:5040 is blocked on a mutex likely owned by task python3:3091.
[ 1112.910472] task:python3 state:D stack:25312 pid:3091 tgid:3091 ppid:3090 task_flags:0x400100 flags:0x00080802
[ 1112.923675] Call Trace:
[ 1112.927213]
[ 1112.930362] __schedule+0xad9/0x1490
[ 1112.935175] ? io_schedule_timeout+0x130/0x130
[ 1112.940960] ? find_held_lock+0x2b/0x80
[ 1112.946062] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.952243] schedule+0xd4/0x260
[ 1112.956661] schedule_timeout+0x103/0x260
[ 1112.961959] ? rcu_is_watching+0x15/0xd0
[ 1112.967160] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.973532] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.979225] ? ww_mutex_lock+0x160/0x160
[ 1112.984426] msleep+0x1b/0x30
[ 1112.988551] napi_set_threaded+0x376/0x410
[ 1112.993945] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.999440] netif_set_threaded+0x254/0x400
[ 1113.004932] ? sysfs_file_ops+0x140/0x140
[ 1113.010228] threaded_store+0x1bb/0x220
[ 1113.015333] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.020823] ? sysfs_file_ops+0x140/0x140
[ 1113.026121] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.031418] ? sysfs_kf_write+0x65/0x160
[ 1113.036616] kernfs_fop_write_iter+0x335/0x510
[ 1113.042400] ? kernfs_ops+0xf0/0xf0
[ 1113.047111] new_sync_write+0x308/0x6f0
[ 1113.052213] ? new_sync_read+0x6f0/0x6f0
[ 1113.057414] ? lock_acquire.part.0+0xbc/0x260
[ 1113.063101] ? ksys_write+0xff/0x200
[ 1113.067904] vfs_write+0x62a/0x980
[ 1113.072518] ksys_write+0xff/0x200
[ 1113.077132] ? __ia32_sys_read+0xc0/0xc0
[ 1113.082335] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.087922] ? rcu_is_watching+0x15/0xd0
[ 1113.093123] do_syscall_64+0xf3/0x5e0
[ 1113.098031] ? exc_page_fault+0x9e/0xb0
[ 1113.103126] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.109591] RIP: 0033:0x7efffec0ec5e
[ 1113.114398] RSP: 002b:00007ffc269ae850 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.123694] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efffec0ec5e
[ 1113.132502] RDX: 0000000000000001 RSI: 0000563a446ae110 RDI: 0000000000000007
[ 1113.141305] RBP: 00007ffc269ae860 R08: 0000000000000000 R09: 0000000000000000
[ 1113.150112] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efffeaa9e80
[ 1113.158918] R13: 0000563a446ae110 R14: 0000000000000007 R15: 00007efffea3a480
[ 1113.167730]
[ 1113.170996] \x0aShowing all locks held in the system:
[ 1113.179528] 1 lock held by khungtaskd/184:
[ 1113.184921] #0: ffffffff9dace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.196410] 4 locks held by python3/3091:
[ 1113.201707] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.211491] #1: ff1100014857ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.222446] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.233602] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.243699] 4 locks held by python3/5040:
[ 1113.248995] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.258787] #1: ff110001bc98e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.269738] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.280897] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.290991] 5 locks held by (time-dir)/6118:
[ 1113.296580] #0: ff1100012e3a93f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.306369] #1: ff110001f4a46e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.317338] #2: ffffffff9db36e48 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1113.328009] #3: ffffffff9d968e90 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1113.339655] #4: ffffffff9db36b50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1113.352083]
[ 1113.354554] =============================================\x0a
[ 1235.505804] INFO: task python3:5040 blocked for more than 368 seconds.
[ 1235.513951] Not tainted 7.0.0-rc4-xwog-g1102106afb28 #1
[ 1235.521203] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.530791] task:python3 state:D stack:25312 pid:5040 tgid:5040 ppid:5039 task_flags:0x400100 flags:0x00080002
[ 1235.543997] Call Trace:
[ 1235.547536]
[ 1235.550685] __schedule+0xad9/0x1490
[ 1235.555498] ? io_schedule_timeout+0x130/0x130
[ 1235.561280] ? find_held_lock+0x2b/0x80
[ 1235.566376] ? __lock_release.isra.0+0x59/0x170
[ 1235.572259] schedule+0xd4/0x260
[ 1235.576674] schedule_preempt_disabled+0x18/0x30
[ 1235.582653] __mutex_lock+0xd76/0x1f20
[ 1235.587660] ? threaded_store+0x132/0x220
[ 1235.592957] ? ww_mutex_lock+0x160/0x160
[ 1235.598155] ? selinux_inode_free_security+0x310/0x310
[ 1235.604713] ? cap_capable+0x1ed/0x3f0
[ 1235.609720] ? sysfs_file_ops+0x140/0x140
[ 1235.615018] ? threaded_store+0x132/0x220
[ 1235.620310] threaded_store+0x132/0x220
[ 1235.625415] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.630910] ? sysfs_file_ops+0x140/0x140
[ 1235.636208] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.641502] ? sysfs_kf_write+0x65/0x160
[ 1235.646701] kernfs_fop_write_iter+0x335/0x510
[ 1235.652487] ? kernfs_ops+0xf0/0xf0
[ 1235.657200] new_sync_write+0x308/0x6f0
[ 1235.662302] ? new_sync_read+0x6f0/0x6f0
[ 1235.667500] ? lock_acquire.part.0+0xbc/0x260
[ 1235.673184] ? ksys_write+0xff/0x200
[ 1235.677998] vfs_write+0x62a/0x980
[ 1235.682612] ksys_write+0xff/0x200
[ 1235.687224] ? __ia32_sys_read+0xc0/0xc0
[ 1235.692419] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.698009] ? rcu_is_watching+0x15/0xd0
[ 1235.703209] do_syscall_64+0xf3/0x5e0
[ 1235.708114] ? exc_page_fault+0x9e/0xb0
[ 1235.713215] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.719681] RIP: 0033:0x7fa2f9ff9c5e
[ 1235.724490] RSP: 002b:00007ffd94c06630 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.733789] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa2f9ff9c5e
[ 1235.742593] RDX: 0000000000000001 RSI: 000055a8acfa2110 RDI: 0000000000000007
[ 1235.751398] RBP: 00007ffd94c06640 R08: 0000000000000000 R09: 0000000000000000
[ 1235.760207] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa2f9e94e80
[ 1235.769015] R13: 000055a8acfa2110 R14: 0000000000000007 R15: 00007fa2fa6fab98
[ 1235.777830]
[ 1235.781112] INFO: task python3:5040 is blocked on a mutex likely owned by task python3:3091.
[ 1235.791383] task:python3 state:D stack:25312 pid:3091 tgid:3091 ppid:3090 task_flags:0x400100 flags:0x00080802
[ 1235.804584] Call Trace:
[ 1235.808121]
[ 1235.811269] __schedule+0xad9/0x1490
[ 1235.816078] ? io_schedule_timeout+0x130/0x130
[ 1235.821861] ? find_held_lock+0x2b/0x80
[ 1235.826962] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.833141] schedule+0xd4/0x260
[ 1235.837559] schedule_timeout+0x103/0x260
[ 1235.842855] ? rcu_is_watching+0x15/0xd0
[ 1235.848055] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.854425] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.860116] ? ww_mutex_lock+0x160/0x160
[ 1235.865316] msleep+0x1b/0x30
[ 1235.869432] napi_set_threaded+0x376/0x410
[ 1235.874826] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.880319] netif_set_threaded+0x254/0x400
[ 1235.885814] ? sysfs_file_ops+0x140/0x140
[ 1235.891108] threaded_store+0x1bb/0x220
[ 1235.896210] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.901700] ? sysfs_file_ops+0x140/0x140
[ 1235.906997] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.912291] ? sysfs_kf_write+0x65/0x160
[ 1235.917492] kernfs_fop_write_iter+0x335/0x510
[ 1235.923277] ? kernfs_ops+0xf0/0xf0
[ 1235.927980] new_sync_write+0x308/0x6f0
[ 1235.933082] ? new_sync_read+0x6f0/0x6f0
[ 1235.938282] ? lock_acquire.part.0+0xbc/0x260
[ 1235.943968] ? ksys_write+0xff/0x200
[ 1235.948778] vfs_write+0x62a/0x980
[ 1235.953382] ksys_write+0xff/0x200
[ 1235.957995] ? __ia32_sys_read+0xc0/0xc0
[ 1235.963193] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.968784] ? rcu_is_watching+0x15/0xd0
[ 1235.973982] do_syscall_64+0xf3/0x5e0
[ 1235.978885] ? exc_page_fault+0x9e/0xb0
[ 1235.983984] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.990449] RIP: 0033:0x7efffec0ec5e
[ 1235.995259] RSP: 002b:00007ffc269ae850 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.004546] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efffec0ec5e
[ 1236.013351] RDX: 0000000000000001 RSI: 0000563a446ae110 RDI: 0000000000000007
[ 1236.022157] RBP: 00007ffc269ae860 R08: 0000000000000000 R09: 0000000000000000
[ 1236.030962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efffeaa9e80
[ 1236.039768] R13: 0000563a446ae110 R14: 0000000000000007 R15: 00007efffea3a480
[ 1236.048580]
[ 1236.051848] \x0aShowing all locks held in the system:
[ 1236.060382] 1 lock held by khungtaskd/184:
[ 1236.065774] #0: ffffffff9dace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.077247] 3 locks held by systemd-journal/802:
[ 1236.083222] #0: ff1100180e037220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1236.093108] #1: ffffffff9dcc8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.105922] #2: ffffffff9dace020 (rcu_read_lock){....}-{1:3}, at: percpu_ref_tryget_many.constprop.0+0x1c/0x1c0
[ 1236.118153] 4 locks held by python3/3091:
[ 1236.123447] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.133238] #1: ff1100014857ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.144198] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.155352] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.165446] 4 locks held by python3/5040:
[ 1236.170744] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.180535] #1: ff110001bc98e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.191497] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.202656] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.212744]
[ 1236.215207] =============================================\x0a
[ 1358.388117] INFO: task python3:5040 blocked for more than 491 seconds.
[ 1358.396262] Not tainted 7.0.0-rc4-xwog-g1102106afb28 #1
[ 1358.403503] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.413095] task:python3 state:D stack:25312 pid:5040 tgid:5040 ppid:5039 task_flags:0x400100 flags:0x00080002
[ 1358.426302] Call Trace:
[ 1358.429844]
[ 1358.432996] __schedule+0xad9/0x1490
[ 1358.437814] ? io_schedule_timeout+0x130/0x130
[ 1358.443599] ? find_held_lock+0x2b/0x80
[ 1358.448706] ? __lock_release.isra.0+0x59/0x170
[ 1358.454602] schedule+0xd4/0x260
[ 1358.459022] schedule_preempt_disabled+0x18/0x30
[ 1358.464994] __mutex_lock+0xd76/0x1f20
[ 1358.470001] ? threaded_store+0x132/0x220
[ 1358.475299] ? ww_mutex_lock+0x160/0x160
[ 1358.480498] ? selinux_inode_free_security+0x310/0x310
[ 1358.487067] ? cap_capable+0x1ed/0x3f0
[ 1358.492074] ? sysfs_file_ops+0x140/0x140
[ 1358.497375] ? threaded_store+0x132/0x220
[ 1358.502670] threaded_store+0x132/0x220
[ 1358.507770] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.513265] ? sysfs_file_ops+0x140/0x140
[ 1358.518562] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.523857] ? sysfs_kf_write+0x65/0x160
[ 1358.529058] kernfs_fop_write_iter+0x335/0x510
[ 1358.534845] ? kernfs_ops+0xf0/0xf0
[ 1358.539558] new_sync_write+0x308/0x6f0
[ 1358.544664] ? new_sync_read+0x6f0/0x6f0
[ 1358.549864] ? lock_acquire.part.0+0xbc/0x260
[ 1358.555550] ? ksys_write+0xff/0x200
[ 1358.560360] vfs_write+0x62a/0x980
[ 1358.564976] ksys_write+0xff/0x200
[ 1358.569589] ? __ia32_sys_read+0xc0/0xc0
[ 1358.574786] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.580377] ? rcu_is_watching+0x15/0xd0
[ 1358.585581] do_syscall_64+0xf3/0x5e0
[ 1358.590488] ? exc_page_fault+0x9e/0xb0
[ 1358.595580] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.602049] RIP: 0033:0x7fa2f9ff9c5e
[ 1358.606861] RSP: 002b:00007ffd94c06630 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.616158] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa2f9ff9c5e
[ 1358.624965] RDX: 0000000000000001 RSI: 000055a8acfa2110 RDI: 0000000000000007
[ 1358.633775] RBP: 00007ffd94c06640 R08: 0000000000000000 R09: 0000000000000000
[ 1358.642583] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa2f9e94e80
[ 1358.651392] R13: 000055a8acfa2110 R14: 0000000000000007 R15: 00007fa2fa6fab98
[ 1358.660209]
[ 1358.663480] INFO: task python3:5040 is blocked on a mutex likely owned by task python3:3091.
[ 1358.673752] task:python3 state:D stack:25312 pid:3091 tgid:3091 ppid:3090 task_flags:0x400100 flags:0x00080802
[ 1358.686957] Call Trace:
[ 1358.690498]
[ 1358.693649] __schedule+0xad9/0x1490
[ 1358.698450] ? io_schedule_timeout+0x130/0x130
[ 1358.704225] ? find_held_lock+0x2b/0x80
[ 1358.709330] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.715510] schedule+0xd4/0x260
[ 1358.719927] schedule_timeout+0x103/0x260
[ 1358.725224] ? rcu_is_watching+0x15/0xd0
[ 1358.730422] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.736793] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.742485] ? ww_mutex_lock+0x160/0x160
[ 1358.747684] msleep+0x1b/0x30
[ 1358.751810] napi_set_threaded+0x376/0x410
[ 1358.757197] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.762695] netif_set_threaded+0x254/0x400
[ 1358.768188] ? sysfs_file_ops+0x140/0x140
[ 1358.773487] threaded_store+0x1bb/0x220
[ 1358.778590] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.784083] ? sysfs_file_ops+0x140/0x140
[ 1358.789382] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.794681] ? sysfs_kf_write+0x65/0x160
[ 1358.799881] kernfs_fop_write_iter+0x335/0x510
[ 1358.805658] ? kernfs_ops+0xf0/0xf0
[ 1358.810369] new_sync_write+0x308/0x6f0
[ 1358.815473] ? new_sync_read+0x6f0/0x6f0
[ 1358.820673] ? lock_acquire.part.0+0xbc/0x260
[ 1358.826359] ? ksys_write+0xff/0x200
[ 1358.831170] vfs_write+0x62a/0x980
[ 1358.835784] ksys_write+0xff/0x200
[ 1358.840399] ? __ia32_sys_read+0xc0/0xc0
[ 1358.845600] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.851191] ? rcu_is_watching+0x15/0xd0
[ 1358.856390] do_syscall_64+0xf3/0x5e0
[ 1358.861298] ? exc_page_fault+0x9e/0xb0
[ 1358.866400] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.872868] RIP: 0033:0x7efffec0ec5e
[ 1358.877678] RSP: 002b:00007ffc269ae850 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.886974] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efffec0ec5e
[ 1358.895783] RDX: 0000000000000001 RSI: 0000563a446ae110 RDI: 0000000000000007
[ 1358.904590] RBP: 00007ffc269ae860 R08: 0000000000000000 R09: 0000000000000000
[ 1358.913390] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efffeaa9e80
[ 1358.922199] R13: 0000563a446ae110 R14: 0000000000000007 R15: 00007efffea3a480
[ 1358.931015]
[ 1358.934282] \x0aShowing all locks held in the system:
[ 1358.942819] 1 lock held by khungtaskd/184:
[ 1358.948214] #0: ffffffff9dace020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.959692] 4 locks held by python3/3091:
[ 1358.964986] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.974780] #1: ff1100014857ee88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.985744] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.996903] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.007000] 4 locks held by python3/5040:
[ 1359.012295] #0: ff1100012e2c13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.022084] #1: ff110001bc98e288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.033048] #2: ff11000120b430f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.044207] #3: ff11000120b79cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.054302]
[ 1359.056767] =============================================\x0a