[ 760.574487] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.577048] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py
[ 760.713034] kselftest: Running tests in drivers/net
[ 989.749678] INFO: task python3:5050 blocked for more than 122 seconds.
[ 989.757895] Not tainted 7.0.0-rc4-qcuq-g586b837e88ac #1
[ 989.765148] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.774744] task:python3 state:D stack:25312 pid:5050 tgid:5050 ppid:5049 task_flags:0x400100 flags:0x00080000
[ 989.787958] Call Trace:
[ 989.791501]
[ 989.794657] __schedule+0xad9/0x1490
[ 989.799476] ? io_schedule_timeout+0x130/0x130
[ 989.805264] ? find_held_lock+0x2b/0x80
[ 989.810375] ? __lock_release.isra.0+0x59/0x170
[ 989.816269] schedule+0xd4/0x260
[ 989.820692] schedule_preempt_disabled+0x18/0x30
[ 989.826675] __mutex_lock+0xd76/0x1f20
[ 989.831682] ? threaded_store+0x132/0x220
[ 989.836986] ? ww_mutex_lock+0x160/0x160
[ 989.842189] ? selinux_inode_free_security+0x310/0x310
[ 989.848768] ? cap_capable+0x1ed/0x3f0
[ 989.853781] ? sysfs_file_ops+0x140/0x140
[ 989.859077] ? threaded_store+0x132/0x220
[ 989.864377] threaded_store+0x132/0x220
[ 989.869488] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.874985] ? sysfs_file_ops+0x140/0x140
[ 989.880290] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.885592] ? sysfs_kf_write+0x65/0x160
[ 989.890798] kernfs_fop_write_iter+0x335/0x510
[ 989.896588] ? kernfs_ops+0xf0/0xf0
[ 989.901305] new_sync_write+0x308/0x6f0
[ 989.906410] ? new_sync_read+0x6f0/0x6f0
[ 989.911616] ? lock_acquire.part.0+0xbc/0x260
[ 989.917305] ? ksys_write+0xff/0x200
[ 989.922124] vfs_write+0x62a/0x980
[ 989.926742] ksys_write+0xff/0x200
[ 989.931362] ? __ia32_sys_read+0xc0/0xc0
[ 989.936566] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.942162] ? rcu_is_watching+0x15/0xd0
[ 989.947359] do_syscall_64+0xf3/0x5e0
[ 989.952271] ? exc_page_fault+0x9e/0xb0
[ 989.957379] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.963851] RIP: 0033:0x7fcb06af7c5e
[ 989.968667] RSP: 002b:00007ffd67f6bed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.977973] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb06af7c5e
[ 989.986784] RDX: 0000000000000001 RSI: 00005624c5e86110 RDI: 0000000000000007
[ 989.995599] RBP: 00007ffd67f6bee0 R08: 0000000000000000 R09: 0000000000000000
[ 990.004409] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb06992e80
[ 990.013223] R13: 00005624c5e86110 R14: 0000000000000007 R15: 00007fcb071f8b98
[ 990.022044]
[ 990.025343] INFO: task python3:5050 is blocked on a mutex likely owned by task python3:3085.
[ 990.035626] task:python3 state:D stack:25312 pid:3085 tgid:3085 ppid:3084 task_flags:0x400100 flags:0x00080802
[ 990.048838] Call Trace:
[ 990.052381]
[ 990.055529] __schedule+0xad9/0x1490
[ 990.060344] ? io_schedule_timeout+0x130/0x130
[ 990.066132] ? find_held_lock+0x2b/0x80
[ 990.071241] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.077429] schedule+0xd4/0x260
[ 990.081853] schedule_timeout+0x103/0x260
[ 990.087153] ? rcu_is_watching+0x15/0xd0
[ 990.092354] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.098730] ? hrtimers_cpu_dying+0x250/0x250
[ 990.104426] ? ww_mutex_lock+0x160/0x160
[ 990.109633] msleep+0x1b/0x30
[ 990.113760] napi_set_threaded+0x376/0x410
[ 990.119154] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.124651] netif_set_threaded+0x254/0x400
[ 990.130151] ? sysfs_file_ops+0x140/0x140
[ 990.135449] threaded_store+0x1bb/0x220
[ 990.140558] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.146054] ? sysfs_file_ops+0x140/0x140
[ 990.151353] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.156654] ? sysfs_kf_write+0x65/0x160
[ 990.161859] kernfs_fop_write_iter+0x335/0x510
[ 990.167646] ? kernfs_ops+0xf0/0xf0
[ 990.172361] new_sync_write+0x308/0x6f0
[ 990.177467] ? new_sync_read+0x6f0/0x6f0
[ 990.182673] ? lock_acquire.part.0+0xbc/0x260
[ 990.188361] ? ksys_write+0xff/0x200
[ 990.193182] vfs_write+0x62a/0x980
[ 990.197801] ksys_write+0xff/0x200
[ 990.202417] ? __ia32_sys_read+0xc0/0xc0
[ 990.207620] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.213216] ? rcu_is_watching+0x15/0xd0
[ 990.218419] do_syscall_64+0xf3/0x5e0
[ 990.223329] ? exc_page_fault+0x9e/0xb0
[ 990.228435] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.234906] RIP: 0033:0x7f4e1c123c5e
[ 990.239717] RSP: 002b:00007ffeb9acf740 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.249019] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4e1c123c5e
[ 990.257828] RDX: 0000000000000001 RSI: 000055e634d2a110 RDI: 0000000000000007
[ 990.266633] RBP: 00007ffeb9acf750 R08: 0000000000000000 R09: 0000000000000000
[ 990.275442] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4e1bfbee80
[ 990.284254] R13: 000055e634d2a110 R14: 0000000000000007 R15: 00007f4e1bf4e480
[ 990.293074]
[ 990.296343] \x0aShowing all locks held in the system:
[ 990.304887] 1 lock held by khungtaskd/185:
[ 990.310284] #0: ffffffff910ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.321777] 4 locks held by python3/3085:
[ 990.327077] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.336869] #1: ff1100013c633e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.347842] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.359007] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.369116] 4 locks held by python3/5050:
[ 990.374416] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.384212] #1: ff1100019d680e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.395182] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.406352] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.416456]
[ 990.418925] =============================================\x0a
[ 1112.632019] INFO: task python3:5050 blocked for more than 245 seconds.
[ 1112.640159] Not tainted 7.0.0-rc4-qcuq-g586b837e88ac #1
[ 1112.647400] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.656988] task:python3 state:D stack:25312 pid:5050 tgid:5050 ppid:5049 task_flags:0x400100 flags:0x00080000
[ 1112.670197] Call Trace:
[ 1112.673738]
[ 1112.676887] __schedule+0xad9/0x1490
[ 1112.681704] ? io_schedule_timeout+0x130/0x130
[ 1112.687491] ? find_held_lock+0x2b/0x80
[ 1112.692598] ? __lock_release.isra.0+0x59/0x170
[ 1112.698482] schedule+0xd4/0x260
[ 1112.702899] schedule_preempt_disabled+0x18/0x30
[ 1112.708876] __mutex_lock+0xd76/0x1f20
[ 1112.713880] ? threaded_store+0x132/0x220
[ 1112.719179] ? ww_mutex_lock+0x160/0x160
[ 1112.724377] ? selinux_inode_free_security+0x310/0x310
[ 1112.730948] ? cap_capable+0x1ed/0x3f0
[ 1112.735957] ? sysfs_file_ops+0x140/0x140
[ 1112.741260] ? threaded_store+0x132/0x220
[ 1112.746555] threaded_store+0x132/0x220
[ 1112.751658] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.757149] ? sysfs_file_ops+0x140/0x140
[ 1112.762446] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.767745] ? sysfs_kf_write+0x65/0x160
[ 1112.772946] kernfs_fop_write_iter+0x335/0x510
[ 1112.778734] ? kernfs_ops+0xf0/0xf0
[ 1112.783445] new_sync_write+0x308/0x6f0
[ 1112.788542] ? new_sync_read+0x6f0/0x6f0
[ 1112.793743] ? lock_acquire.part.0+0xbc/0x260
[ 1112.799428] ? ksys_write+0xff/0x200
[ 1112.804240] vfs_write+0x62a/0x980
[ 1112.808857] ksys_write+0xff/0x200
[ 1112.813473] ? __ia32_sys_read+0xc0/0xc0
[ 1112.818673] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.824264] ? rcu_is_watching+0x15/0xd0
[ 1112.829470] do_syscall_64+0xf3/0x5e0
[ 1112.834377] ? exc_page_fault+0x9e/0xb0
[ 1112.839470] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.845939] RIP: 0033:0x7fcb06af7c5e
[ 1112.850751] RSP: 002b:00007ffd67f6bed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.860048] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb06af7c5e
[ 1112.868858] RDX: 0000000000000001 RSI: 00005624c5e86110 RDI: 0000000000000007
[ 1112.877663] RBP: 00007ffd67f6bee0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.886473] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb06992e80
[ 1112.895282] R13: 00005624c5e86110 R14: 0000000000000007 R15: 00007fcb071f8b98
[ 1112.904098]
[ 1112.907365] INFO: task python3:5050 is blocked on a mutex likely owned by task python3:3085.
[ 1112.917627] task:python3 state:D stack:25312 pid:3085 tgid:3085 ppid:3084 task_flags:0x400100 flags:0x00080802
[ 1112.930829] Call Trace:
[ 1112.934368]
[ 1112.937517] __schedule+0xad9/0x1490
[ 1112.942331] ? io_schedule_timeout+0x130/0x130
[ 1112.948115] ? find_held_lock+0x2b/0x80
[ 1112.953216] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.959398] schedule+0xd4/0x260
[ 1112.963817] schedule_timeout+0x103/0x260
[ 1112.969114] ? rcu_is_watching+0x15/0xd0
[ 1112.974315] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.980684] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.986369] ? ww_mutex_lock+0x160/0x160
[ 1112.991568] msleep+0x1b/0x30
[ 1112.995686] napi_set_threaded+0x376/0x410
[ 1113.001074] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.006572] netif_set_threaded+0x254/0x400
[ 1113.012065] ? sysfs_file_ops+0x140/0x140
[ 1113.017363] threaded_store+0x1bb/0x220
[ 1113.022467] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.027961] ? sysfs_file_ops+0x140/0x140
[ 1113.033258] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.038555] ? sysfs_kf_write+0x65/0x160
[ 1113.043755] kernfs_fop_write_iter+0x335/0x510
[ 1113.049540] ? kernfs_ops+0xf0/0xf0
[ 1113.054245] new_sync_write+0x308/0x6f0
[ 1113.059351] ? new_sync_read+0x6f0/0x6f0
[ 1113.064552] ? lock_acquire.part.0+0xbc/0x260
[ 1113.070237] ? ksys_write+0xff/0x200
[ 1113.075050] vfs_write+0x62a/0x980
[ 1113.079666] ksys_write+0xff/0x200
[ 1113.084278] ? __ia32_sys_read+0xc0/0xc0
[ 1113.089479] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.095067] ? rcu_is_watching+0x15/0xd0
[ 1113.100266] do_syscall_64+0xf3/0x5e0
[ 1113.105174] ? exc_page_fault+0x9e/0xb0
[ 1113.110277] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.116737] RIP: 0033:0x7f4e1c123c5e
[ 1113.121545] RSP: 002b:00007ffeb9acf740 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.130842] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4e1c123c5e
[ 1113.139653] RDX: 0000000000000001 RSI: 000055e634d2a110 RDI: 0000000000000007
[ 1113.148462] RBP: 00007ffeb9acf750 R08: 0000000000000000 R09: 0000000000000000
[ 1113.157270] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4e1bfbee80
[ 1113.166079] R13: 000055e634d2a110 R14: 0000000000000007 R15: 00007f4e1bf4e480
[ 1113.174895]
[ 1113.178153] \x0aShowing all locks held in the system:
[ 1113.186690] 1 lock held by khungtaskd/185:
[ 1113.192085] #0: ffffffff910ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.203558] 4 locks held by python3/3085:
[ 1113.208856] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.218640] #1: ff1100013c633e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.229605] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.240761] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.250862] 4 locks held by python3/5050:
[ 1113.256154] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.265945] #1: ff1100019d680e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.276901] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.288059] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.298154]
[ 1113.300620] =============================================\x0a
[ 1235.512387] INFO: task python3:5050 blocked for more than 368 seconds.
[ 1235.520527] Not tainted 7.0.0-rc4-qcuq-g586b837e88ac #1
[ 1235.527779] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.537370] task:python3 state:D stack:25312 pid:5050 tgid:5050 ppid:5049 task_flags:0x400100 flags:0x00080002
[ 1235.550574] Call Trace:
[ 1235.554116]
[ 1235.557270] __schedule+0xad9/0x1490
[ 1235.562087] ? io_schedule_timeout+0x130/0x130
[ 1235.567875] ? find_held_lock+0x2b/0x80
[ 1235.572980] ? __lock_release.isra.0+0x59/0x170
[ 1235.578867] schedule+0xd4/0x260
[ 1235.583287] schedule_preempt_disabled+0x18/0x30
[ 1235.589268] __mutex_lock+0xd76/0x1f20
[ 1235.594276] ? threaded_store+0x132/0x220
[ 1235.599578] ? ww_mutex_lock+0x160/0x160
[ 1235.604777] ? selinux_inode_free_security+0x310/0x310
[ 1235.611348] ? cap_capable+0x1ed/0x3f0
[ 1235.616358] ? sysfs_file_ops+0x140/0x140
[ 1235.621660] ? threaded_store+0x132/0x220
[ 1235.626954] threaded_store+0x132/0x220
[ 1235.632056] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.637549] ? sysfs_file_ops+0x140/0x140
[ 1235.642848] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.648143] ? sysfs_kf_write+0x65/0x160
[ 1235.653342] kernfs_fop_write_iter+0x335/0x510
[ 1235.659127] ? kernfs_ops+0xf0/0xf0
[ 1235.663831] new_sync_write+0x308/0x6f0
[ 1235.668936] ? new_sync_read+0x6f0/0x6f0
[ 1235.674136] ? lock_acquire.part.0+0xbc/0x260
[ 1235.679822] ? ksys_write+0xff/0x200
[ 1235.684633] vfs_write+0x62a/0x980
[ 1235.689250] ksys_write+0xff/0x200
[ 1235.693862] ? __ia32_sys_read+0xc0/0xc0
[ 1235.699062] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.704653] ? rcu_is_watching+0x15/0xd0
[ 1235.709853] do_syscall_64+0xf3/0x5e0
[ 1235.714753] ? exc_page_fault+0x9e/0xb0
[ 1235.719854] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.726325] RIP: 0033:0x7fcb06af7c5e
[ 1235.731133] RSP: 002b:00007ffd67f6bed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.740431] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb06af7c5e
[ 1235.749241] RDX: 0000000000000001 RSI: 00005624c5e86110 RDI: 0000000000000007
[ 1235.758048] RBP: 00007ffd67f6bee0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.766857] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb06992e80
[ 1235.775667] R13: 00005624c5e86110 R14: 0000000000000007 R15: 00007fcb071f8b98
[ 1235.784483]
[ 1235.787772] INFO: task python3:5050 is blocked on a mutex likely owned by task python3:3085.
[ 1235.798044] task:python3 state:D stack:25312 pid:3085 tgid:3085 ppid:3084 task_flags:0x400100 flags:0x00080802
[ 1235.811249] Call Trace:
[ 1235.814790]
[ 1235.817943] __schedule+0xad9/0x1490
[ 1235.822754] ? io_schedule_timeout+0x130/0x130
[ 1235.828529] ? find_held_lock+0x2b/0x80
[ 1235.833634] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.839817] schedule+0xd4/0x260
[ 1235.844234] schedule_timeout+0x103/0x260
[ 1235.849530] ? rcu_is_watching+0x15/0xd0
[ 1235.854731] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.861101] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.866791] ? ww_mutex_lock+0x160/0x160
[ 1235.871989] msleep+0x1b/0x30
[ 1235.876118] napi_set_threaded+0x376/0x410
[ 1235.881515] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.887011] netif_set_threaded+0x254/0x400
[ 1235.892506] ? sysfs_file_ops+0x140/0x140
[ 1235.897804] threaded_store+0x1bb/0x220
[ 1235.902905] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.908399] ? sysfs_file_ops+0x140/0x140
[ 1235.913695] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.918994] ? sysfs_kf_write+0x65/0x160
[ 1235.924196] kernfs_fop_write_iter+0x335/0x510
[ 1235.929980] ? kernfs_ops+0xf0/0xf0
[ 1235.934692] new_sync_write+0x308/0x6f0
[ 1235.939795] ? new_sync_read+0x6f0/0x6f0
[ 1235.944995] ? lock_acquire.part.0+0xbc/0x260
[ 1235.950680] ? ksys_write+0xff/0x200
[ 1235.955493] vfs_write+0x62a/0x980
[ 1235.960107] ksys_write+0xff/0x200
[ 1235.964721] ? __ia32_sys_read+0xc0/0xc0
[ 1235.969919] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.975508] ? rcu_is_watching+0x15/0xd0
[ 1235.980711] do_syscall_64+0xf3/0x5e0
[ 1235.985619] ? exc_page_fault+0x9e/0xb0
[ 1235.990720] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.997187] RIP: 0033:0x7f4e1c123c5e
[ 1236.001994] RSP: 002b:00007ffeb9acf740 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.011293] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4e1c123c5e
[ 1236.020100] RDX: 0000000000000001 RSI: 000055e634d2a110 RDI: 0000000000000007
[ 1236.028907] RBP: 00007ffeb9acf750 R08: 0000000000000000 R09: 0000000000000000
[ 1236.037715] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4e1bfbee80
[ 1236.046525] R13: 000055e634d2a110 R14: 0000000000000007 R15: 00007f4e1bf4e480
[ 1236.055339]
[ 1236.058610] \x0aShowing all locks held in the system:
[ 1236.067150] 1 lock held by khungtaskd/185:
[ 1236.072545] #0: ffffffff910ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.084020] 3 locks held by systemd-journal/804:
[ 1236.090000] #0: ff1100180e437220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1236.099890] #1: ffffffff912c8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.112710] #2: ff110001a3e2c180 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1236.124171] 4 locks held by python3/3085:
[ 1236.129466] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.139259] #1: ff1100013c633e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.150220] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.161384] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.171470] 4 locks held by python3/5050:
[ 1236.176769] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.186560] #1: ff1100019d680e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.197522] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.208671] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.218763]
[ 1236.221233] =============================================\x0a
[ 1358.394722] INFO: task python3:5050 blocked for more than 491 seconds.
[ 1358.402867] Not tainted 7.0.0-rc4-qcuq-g586b837e88ac #1
[ 1358.410116] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.419693] task:python3 state:D stack:25312 pid:5050 tgid:5050 ppid:5049 task_flags:0x400100 flags:0x00080002
[ 1358.432899] Call Trace:
[ 1358.436439]
[ 1358.439589] __schedule+0xad9/0x1490
[ 1358.444405] ? io_schedule_timeout+0x130/0x130
[ 1358.450191] ? find_held_lock+0x2b/0x80
[ 1358.455296] ? __lock_release.isra.0+0x59/0x170
[ 1358.461193] schedule+0xd4/0x260
[ 1358.465611] schedule_preempt_disabled+0x18/0x30
[ 1358.471592] __mutex_lock+0xd76/0x1f20
[ 1358.476588] ? threaded_store+0x132/0x220
[ 1358.481885] ? ww_mutex_lock+0x160/0x160
[ 1358.487082] ? selinux_inode_free_security+0x310/0x310
[ 1358.493651] ? cap_capable+0x1ed/0x3f0
[ 1358.498659] ? sysfs_file_ops+0x140/0x140
[ 1358.503958] ? threaded_store+0x132/0x220
[ 1358.509252] threaded_store+0x132/0x220
[ 1358.514353] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.519842] ? sysfs_file_ops+0x140/0x140
[ 1358.525140] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.530437] ? sysfs_kf_write+0x65/0x160
[ 1358.535628] kernfs_fop_write_iter+0x335/0x510
[ 1358.541402] ? kernfs_ops+0xf0/0xf0
[ 1358.546111] new_sync_write+0x308/0x6f0
[ 1358.551212] ? new_sync_read+0x6f0/0x6f0
[ 1358.556412] ? lock_acquire.part.0+0xbc/0x260
[ 1358.562098] ? ksys_write+0xff/0x200
[ 1358.566908] vfs_write+0x62a/0x980
[ 1358.571524] ksys_write+0xff/0x200
[ 1358.576137] ? __ia32_sys_read+0xc0/0xc0
[ 1358.581333] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.586924] ? rcu_is_watching+0x15/0xd0
[ 1358.592126] do_syscall_64+0xf3/0x5e0
[ 1358.597031] ? exc_page_fault+0x9e/0xb0
[ 1358.602133] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.608597] RIP: 0033:0x7fcb06af7c5e
[ 1358.613408] RSP: 002b:00007ffd67f6bed0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.622707] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb06af7c5e
[ 1358.631513] RDX: 0000000000000001 RSI: 00005624c5e86110 RDI: 0000000000000007
[ 1358.640318] RBP: 00007ffd67f6bee0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.649126] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb06992e80
[ 1358.657932] R13: 00005624c5e86110 R14: 0000000000000007 R15: 00007fcb071f8b98
[ 1358.666744]
[ 1358.670025] INFO: task python3:5050 is blocked on a mutex likely owned by task python3:3085.
[ 1358.680296] task:python3 state:D stack:25312 pid:3085 tgid:3085 ppid:3084 task_flags:0x400100 flags:0x00080802
[ 1358.693495] Call Trace:
[ 1358.697031]
[ 1358.700179] __schedule+0xad9/0x1490
[ 1358.704989] ? io_schedule_timeout+0x130/0x130
[ 1358.710760] ? find_held_lock+0x2b/0x80
[ 1358.715862] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.722041] schedule+0xd4/0x260
[ 1358.726461] schedule_timeout+0x103/0x260
[ 1358.731757] ? rcu_is_watching+0x15/0xd0
[ 1358.736955] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.743323] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.749014] ? ww_mutex_lock+0x160/0x160
[ 1358.754211] msleep+0x1b/0x30
[ 1358.758336] napi_set_threaded+0x376/0x410
[ 1358.763729] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.769223] netif_set_threaded+0x254/0x400
[ 1358.774714] ? sysfs_file_ops+0x140/0x140
[ 1358.780009] threaded_store+0x1bb/0x220
[ 1358.785112] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.790604] ? sysfs_file_ops+0x140/0x140
[ 1358.795897] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.801194] ? sysfs_kf_write+0x65/0x160
[ 1358.806391] kernfs_fop_write_iter+0x335/0x510
[ 1358.812175] ? kernfs_ops+0xf0/0xf0
[ 1358.816887] new_sync_write+0x308/0x6f0
[ 1358.821981] ? new_sync_read+0x6f0/0x6f0
[ 1358.827180] ? lock_acquire.part.0+0xbc/0x260
[ 1358.832866] ? ksys_write+0xff/0x200
[ 1358.837678] vfs_write+0x62a/0x980
[ 1358.842293] ksys_write+0xff/0x200
[ 1358.846906] ? __ia32_sys_read+0xc0/0xc0
[ 1358.852105] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.857684] ? rcu_is_watching+0x15/0xd0
[ 1358.862883] do_syscall_64+0xf3/0x5e0
[ 1358.867787] ? exc_page_fault+0x9e/0xb0
[ 1358.872885] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.879351] RIP: 0033:0x7f4e1c123c5e
[ 1358.884156] RSP: 002b:00007ffeb9acf740 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.893453] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4e1c123c5e
[ 1358.902259] RDX: 0000000000000001 RSI: 000055e634d2a110 RDI: 0000000000000007
[ 1358.911066] RBP: 00007ffeb9acf750 R08: 0000000000000000 R09: 0000000000000000
[ 1358.919873] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4e1bfbee80
[ 1358.928679] R13: 000055e634d2a110 R14: 0000000000000007 R15: 00007f4e1bf4e480
[ 1358.937493]
[ 1358.940761] \x0aShowing all locks held in the system:
[ 1358.949296] 1 lock held by khungtaskd/185:
[ 1358.954689] #0: ffffffff910ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.966170] 4 locks held by python3/3085:
[ 1358.971463] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.981253] #1: ff1100013c633e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.992216] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.003373] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.013457] 4 locks held by python3/5050:
[ 1359.018750] #0: ff1100012dfe93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.028540] #1: ff1100019d680e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.039491] #2: ff11000120c570f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.050648] #3: ff11000120c29cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.060741]
[ 1359.063204] =============================================\x0a