[ 785.486926] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 785.489405] nipa-hw-worker: [4/40] Retrying drivers/net:napi_threaded.py
[ 785.626324] kselftest: Running tests in drivers/net
[ 989.701576] INFO: task python3:5445 blocked for more than 122 seconds.
[ 989.709809] Not tainted 7.0.0-rc6-grwl-g15fe156fd79f #1
[ 989.717061] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.726653] task:python3 state:D stack:25312 pid:5445 tgid:5445 ppid:5444 task_flags:0x400100 flags:0x00080000
[ 989.739857] Call Trace:
[ 989.743399]
[ 989.746548] __schedule+0xad9/0x1490
[ 989.751364] ? io_schedule_timeout+0x130/0x130
[ 989.757149] ? find_held_lock+0x2b/0x80
[ 989.762256] ? __lock_release.isra.0+0x59/0x170
[ 989.768142] schedule+0xd4/0x260
[ 989.772560] schedule_preempt_disabled+0x18/0x30
[ 989.778539] __mutex_lock+0xd76/0x1f20
[ 989.783546] ? threaded_store+0x132/0x220
[ 989.788846] ? ww_mutex_lock+0x160/0x160
[ 989.794047] ? selinux_inode_free_security+0x310/0x310
[ 989.800619] ? cap_capable+0x1ed/0x3f0
[ 989.805629] ? sysfs_file_ops+0x140/0x140
[ 989.810929] ? threaded_store+0x132/0x220
[ 989.816225] threaded_store+0x132/0x220
[ 989.821329] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.826824] ? sysfs_file_ops+0x140/0x140
[ 989.832122] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.837409] ? sysfs_kf_write+0x65/0x160
[ 989.842606] kernfs_fop_write_iter+0x335/0x510
[ 989.848397] ? kernfs_ops+0xf0/0xf0
[ 989.853108] new_sync_write+0x308/0x6f0
[ 989.858204] ? new_sync_read+0x6f0/0x6f0
[ 989.863407] ? lock_acquire.part.0+0xbc/0x260
[ 989.869092] ? ksys_write+0xff/0x200
[ 989.873903] vfs_write+0x62a/0x980
[ 989.878521] ksys_write+0xff/0x200
[ 989.883137] ? __ia32_sys_read+0xc0/0xc0
[ 989.888335] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.893924] ? rcu_is_watching+0x15/0xd0
[ 989.899119] do_syscall_64+0xf3/0x5e0
[ 989.904025] ? exc_page_fault+0x9e/0xb0
[ 989.909129] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.915597] RIP: 0033:0x7fc76265fc5e
[ 989.920406] RSP: 002b:00007ffeaeddcd90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.929695] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc76265fc5e
[ 989.938495] RDX: 0000000000000001 RSI: 000055c9ed3fa760 RDI: 0000000000000007
[ 989.947303] RBP: 00007ffeaeddcda0 R08: 0000000000000000 R09: 0000000000000000
[ 989.956103] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc7624fae80
[ 989.964911] R13: 000055c9ed3fa760 R14: 0000000000000007 R15: 00007fc762d60b98
[ 989.973726]
[ 989.976997] INFO: task python3:5445 is blocked on a mutex likely owned by task python3:3506.
[ 989.987274] task:python3 state:D stack:25312 pid:3506 tgid:3506 ppid:3505 task_flags:0x400100 flags:0x00080802
[ 990.000477] Call Trace:
[ 990.004017]
[ 990.007167] __schedule+0xad9/0x1490
[ 990.011978] ? io_schedule_timeout+0x130/0x130
[ 990.017760] ? find_held_lock+0x2b/0x80
[ 990.022862] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.029035] schedule+0xd4/0x260
[ 990.033455] schedule_timeout+0x103/0x260
[ 990.038745] ? rcu_is_watching+0x15/0xd0
[ 990.043946] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.050319] ? hrtimers_cpu_dying+0x250/0x250
[ 990.056008] ? ww_mutex_lock+0x160/0x160
[ 990.061209] msleep+0x1b/0x30
[ 990.065336] napi_set_threaded+0x376/0x410
[ 990.070726] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.076220] netif_set_threaded+0x254/0x400
[ 990.081717] ? sysfs_file_ops+0x140/0x140
[ 990.087014] threaded_store+0x1bb/0x220
[ 990.092112] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.097605] ? sysfs_file_ops+0x140/0x140
[ 990.102904] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.108202] ? sysfs_kf_write+0x65/0x160
[ 990.113404] kernfs_fop_write_iter+0x335/0x510
[ 990.119191] ? kernfs_ops+0xf0/0xf0
[ 990.123903] new_sync_write+0x308/0x6f0
[ 990.129007] ? new_sync_read+0x6f0/0x6f0
[ 990.134210] ? lock_acquire.part.0+0xbc/0x260
[ 990.139898] ? ksys_write+0xff/0x200
[ 990.144709] vfs_write+0x62a/0x980
[ 990.149326] ksys_write+0xff/0x200
[ 990.153940] ? __ia32_sys_read+0xc0/0xc0
[ 990.159140] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.164720] ? rcu_is_watching+0x15/0xd0
[ 990.169921] do_syscall_64+0xf3/0x5e0
[ 990.174826] ? irq_exit_rcu+0x39/0xf0
[ 990.179733] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.186200] RIP: 0033:0x7f4ac958ac5e
[ 990.191010] RSP: 002b:00007ffe7b904e90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.200306] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ac958ac5e
[ 990.209115] RDX: 0000000000000001 RSI: 0000563f4037c760 RDI: 0000000000000007
[ 990.217922] RBP: 00007ffe7b904ea0 R08: 0000000000000000 R09: 0000000000000000
[ 990.226731] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ac9425e80
[ 990.235538] R13: 0000563f4037c760 R14: 0000000000000007 R15: 00007f4ac93b6480
[ 990.244351]
[ 990.247610] \x0aShowing all locks held in the system:
[ 990.256151] 1 lock held by khungtaskd/185:
[ 990.261544] #0: ffffffffadece120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.273029] 4 locks held by python3/3506:
[ 990.278322] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.288113] #1: ff1100016430be88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.299068] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.310223] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.320318] 4 locks held by python3/5445:
[ 990.325615] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.335409] #1: ff110001b3b0c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.346371] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.357529] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.367621]
[ 990.370088] =============================================\x0a
[ 1112.582806] INFO: task python3:5445 blocked for more than 245 seconds.
[ 1112.590954] Not tainted 7.0.0-rc6-grwl-g15fe156fd79f #1
[ 1112.598204] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.607792] task:python3 state:D stack:25312 pid:5445 tgid:5445 ppid:5444 task_flags:0x400100 flags:0x00080000
[ 1112.621063] Call Trace:
[ 1112.624600]
[ 1112.627748] __schedule+0xad9/0x1490
[ 1112.632565] ? io_schedule_timeout+0x130/0x130
[ 1112.632570] ? find_held_lock+0x2b/0x80
[ 1112.632577] ? __lock_release.isra.0+0x59/0x170
[ 1112.632583] schedule+0xd4/0x260
[ 1112.632586] schedule_preempt_disabled+0x18/0x30
[ 1112.659796] __mutex_lock+0xd76/0x1f20
[ 1112.664800] ? threaded_store+0x132/0x220
[ 1112.670100] ? ww_mutex_lock+0x160/0x160
[ 1112.675299] ? selinux_inode_free_security+0x310/0x310
[ 1112.681868] ? cap_capable+0x1ed/0x3f0
[ 1112.686875] ? sysfs_file_ops+0x140/0x140
[ 1112.692176] ? threaded_store+0x132/0x220
[ 1112.697472] threaded_store+0x132/0x220
[ 1112.702575] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.708065] ? sysfs_file_ops+0x140/0x140
[ 1112.713363] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.718658] ? sysfs_kf_write+0x65/0x160
[ 1112.723859] kernfs_fop_write_iter+0x335/0x510
[ 1112.729645] ? kernfs_ops+0xf0/0xf0
[ 1112.734356] new_sync_write+0x308/0x6f0
[ 1112.739459] ? new_sync_read+0x6f0/0x6f0
[ 1112.744657] ? lock_acquire.part.0+0xbc/0x260
[ 1112.750343] ? ksys_write+0xff/0x200
[ 1112.755155] vfs_write+0x62a/0x980
[ 1112.759769] ksys_write+0xff/0x200
[ 1112.764381] ? __ia32_sys_read+0xc0/0xc0
[ 1112.769576] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.775163] ? rcu_is_watching+0x15/0xd0
[ 1112.780363] do_syscall_64+0xf3/0x5e0
[ 1112.785267] ? exc_page_fault+0x9e/0xb0
[ 1112.790368] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.796834] RIP: 0033:0x7fc76265fc5e
[ 1112.801639] RSP: 002b:00007ffeaeddcd90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.810937] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc76265fc5e
[ 1112.819742] RDX: 0000000000000001 RSI: 000055c9ed3fa760 RDI: 0000000000000007
[ 1112.828549] RBP: 00007ffeaeddcda0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.837354] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc7624fae80
[ 1112.846160] R13: 000055c9ed3fa760 R14: 0000000000000007 R15: 00007fc762d60b98
[ 1112.854972]
[ 1112.858284] INFO: task python3:5445 is blocked on a mutex likely owned by task python3:3506.
[ 1112.868554] task:python3 state:D stack:25312 pid:3506 tgid:3506 ppid:3505 task_flags:0x400100 flags:0x00080802
[ 1112.881755] Call Trace:
[ 1112.885291]
[ 1112.888440] __schedule+0xad9/0x1490
[ 1112.893248] ? io_schedule_timeout+0x130/0x130
[ 1112.899032] ? find_held_lock+0x2b/0x80
[ 1112.904131] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.910310] schedule+0xd4/0x260
[ 1112.914727] schedule_timeout+0x103/0x260
[ 1112.920022] ? rcu_is_watching+0x15/0xd0
[ 1112.925220] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.931591] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.937282] ? ww_mutex_lock+0x160/0x160
[ 1112.942482] msleep+0x1b/0x30
[ 1112.946598] napi_set_threaded+0x376/0x410
[ 1112.951992] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.957484] netif_set_threaded+0x254/0x400
[ 1112.962978] ? sysfs_file_ops+0x140/0x140
[ 1112.968272] threaded_store+0x1bb/0x220
[ 1112.973376] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.978866] ? sysfs_file_ops+0x140/0x140
[ 1112.984158] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.989453] ? sysfs_kf_write+0x65/0x160
[ 1112.994650] kernfs_fop_write_iter+0x335/0x510
[ 1113.000432] ? kernfs_ops+0xf0/0xf0
[ 1113.005141] new_sync_write+0x308/0x6f0
[ 1113.010242] ? new_sync_read+0x6f0/0x6f0
[ 1113.015444] ? lock_acquire.part.0+0xbc/0x260
[ 1113.021130] ? ksys_write+0xff/0x200
[ 1113.025942] vfs_write+0x62a/0x980
[ 1113.030556] ksys_write+0xff/0x200
[ 1113.035169] ? __ia32_sys_read+0xc0/0xc0
[ 1113.040365] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.045952] ? rcu_is_watching+0x15/0xd0
[ 1113.051151] do_syscall_64+0xf3/0x5e0
[ 1113.056055] ? irq_exit_rcu+0x39/0xf0
[ 1113.060963] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.067429] RIP: 0033:0x7f4ac958ac5e
[ 1113.072238] RSP: 002b:00007ffe7b904e90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.081534] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ac958ac5e
[ 1113.090331] RDX: 0000000000000001 RSI: 0000563f4037c760 RDI: 0000000000000007
[ 1113.099139] RBP: 00007ffe7b904ea0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.107944] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ac9425e80
[ 1113.116751] R13: 0000563f4037c760 R14: 0000000000000007 R15: 00007f4ac93b6480
[ 1113.125564]
[ 1113.128825] \x0aShowing all locks held in the system:
[ 1113.137364] 1 lock held by khungtaskd/185:
[ 1113.142755] #0: ffffffffadece120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.154230] 2 locks held by systemd-journal/804:
[ 1113.160205] #0: ff1100180e3b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1113.170091] #1: ffffffffae0c9340 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.182915] 4 locks held by python3/3506:
[ 1113.188209] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.197997] #1: ff1100016430be88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.208959] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.220116] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.230213] 4 locks held by python3/5445:
[ 1113.235509] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.245299] #1: ff110001b3b0c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.256258] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.267416] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.277504] 5 locks held by (systemd)/6471:
[ 1113.282994] #0: ff1100012d9b43f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.292785] #1: ff1100012ed1c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.303745] #2: ffffffffadf372c8 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0
[ 1113.314411] #3: ffffffffadd68f30 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640
[ 1113.326054] #4: ffffffffadf36fd0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640
[ 1113.338477]
[ 1113.340942] =============================================\x0a
[ 1235.464042] INFO: task python3:5445 blocked for more than 368 seconds.
[ 1235.472188] Not tainted 7.0.0-rc6-grwl-g15fe156fd79f #1
[ 1235.479437] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.489027] task:python3 state:D stack:25312 pid:5445 tgid:5445 ppid:5444 task_flags:0x400100 flags:0x00080002
[ 1235.502232] Call Trace:
[ 1235.505771]
[ 1235.508920] __schedule+0xad9/0x1490
[ 1235.513736] ? io_schedule_timeout+0x130/0x130
[ 1235.519521] ? find_held_lock+0x2b/0x80
[ 1235.524626] ? __lock_release.isra.0+0x59/0x170
[ 1235.530501] schedule+0xd4/0x260
[ 1235.534917] schedule_preempt_disabled+0x18/0x30
[ 1235.540896] __mutex_lock+0xd76/0x1f20
[ 1235.545903] ? threaded_store+0x132/0x220
[ 1235.551203] ? ww_mutex_lock+0x160/0x160
[ 1235.556400] ? selinux_inode_free_security+0x310/0x310
[ 1235.562969] ? cap_capable+0x1ed/0x3f0
[ 1235.567977] ? sysfs_file_ops+0x140/0x140
[ 1235.573277] ? threaded_store+0x132/0x220
[ 1235.578562] threaded_store+0x132/0x220
[ 1235.583663] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.589152] ? sysfs_file_ops+0x140/0x140
[ 1235.594449] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.599738] ? sysfs_kf_write+0x65/0x160
[ 1235.604936] kernfs_fop_write_iter+0x335/0x510
[ 1235.610722] ? kernfs_ops+0xf0/0xf0
[ 1235.615433] new_sync_write+0x308/0x6f0
[ 1235.620535] ? new_sync_read+0x6f0/0x6f0
[ 1235.625735] ? lock_acquire.part.0+0xbc/0x260
[ 1235.631421] ? ksys_write+0xff/0x200
[ 1235.636232] vfs_write+0x62a/0x980
[ 1235.640847] ksys_write+0xff/0x200
[ 1235.645458] ? __ia32_sys_read+0xc0/0xc0
[ 1235.650653] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.656244] ? rcu_is_watching+0x15/0xd0
[ 1235.661444] do_syscall_64+0xf3/0x5e0
[ 1235.666348] ? exc_page_fault+0x9e/0xb0
[ 1235.671450] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.677916] RIP: 0033:0x7fc76265fc5e
[ 1235.682726] RSP: 002b:00007ffeaeddcd90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.692024] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc76265fc5e
[ 1235.700834] RDX: 0000000000000001 RSI: 000055c9ed3fa760 RDI: 0000000000000007
[ 1235.709642] RBP: 00007ffeaeddcda0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.718450] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc7624fae80
[ 1235.727259] R13: 000055c9ed3fa760 R14: 0000000000000007 R15: 00007fc762d60b98
[ 1235.736070]
[ 1235.739351] INFO: task python3:5445 is blocked on a mutex likely owned by task python3:3506.
[ 1235.749624] task:python3 state:D stack:25312 pid:3506 tgid:3506 ppid:3505 task_flags:0x400100 flags:0x00080802
[ 1235.762824] Call Trace:
[ 1235.766355]
[ 1235.769503] __schedule+0xad9/0x1490
[ 1235.774313] ? io_schedule_timeout+0x130/0x130
[ 1235.780098] ? find_held_lock+0x2b/0x80
[ 1235.785202] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.791383] schedule+0xd4/0x260
[ 1235.795799] schedule_timeout+0x103/0x260
[ 1235.801094] ? rcu_is_watching+0x15/0xd0
[ 1235.806293] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.812656] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.818346] ? ww_mutex_lock+0x160/0x160
[ 1235.823546] msleep+0x1b/0x30
[ 1235.827662] napi_set_threaded+0x376/0x410
[ 1235.833055] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.838548] netif_set_threaded+0x254/0x400
[ 1235.844042] ? sysfs_file_ops+0x140/0x140
[ 1235.849336] threaded_store+0x1bb/0x220
[ 1235.854440] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.859931] ? sysfs_file_ops+0x140/0x140
[ 1235.865224] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.870520] ? sysfs_kf_write+0x65/0x160
[ 1235.875719] kernfs_fop_write_iter+0x335/0x510
[ 1235.881503] ? kernfs_ops+0xf0/0xf0
[ 1235.886215] new_sync_write+0x308/0x6f0
[ 1235.891316] ? new_sync_read+0x6f0/0x6f0
[ 1235.896517] ? lock_acquire.part.0+0xbc/0x260
[ 1235.902204] ? ksys_write+0xff/0x200
[ 1235.907014] vfs_write+0x62a/0x980
[ 1235.911620] ksys_write+0xff/0x200
[ 1235.916233] ? __ia32_sys_read+0xc0/0xc0
[ 1235.921430] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.927021] ? rcu_is_watching+0x15/0xd0
[ 1235.932218] do_syscall_64+0xf3/0x5e0
[ 1235.937123] ? irq_exit_rcu+0x39/0xf0
[ 1235.942030] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.948496] RIP: 0033:0x7f4ac958ac5e
[ 1235.953303] RSP: 002b:00007ffe7b904e90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.962601] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ac958ac5e
[ 1235.971407] RDX: 0000000000000001 RSI: 0000563f4037c760 RDI: 0000000000000007
[ 1235.980211] RBP: 00007ffe7b904ea0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.989015] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ac9425e80
[ 1235.997824] R13: 0000563f4037c760 R14: 0000000000000007 R15: 00007f4ac93b6480
[ 1236.006638]
[ 1236.009905] \x0aShowing all locks held in the system:
[ 1236.018440] 1 lock held by khungtaskd/185:
[ 1236.023832] #0: ffffffffadece120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.035311] 4 locks held by python3/3506:
[ 1236.040604] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.050396] #1: ff1100016430be88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.061358] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.072515] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.082608] 4 locks held by python3/5445:
[ 1236.087900] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.097690] #1: ff110001b3b0c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.108650] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.119806] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.129901]
[ 1236.132366] =============================================\x0a
[ 1358.345295] INFO: task python3:5445 blocked for more than 491 seconds.
[ 1358.353443] Not tainted 7.0.0-rc6-grwl-g15fe156fd79f #1
[ 1358.360694] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.370286] task:python3 state:D stack:25312 pid:5445 tgid:5445 ppid:5444 task_flags:0x400100 flags:0x00080002
[ 1358.383493] Call Trace:
[ 1358.387033]
[ 1358.390187] __schedule+0xad9/0x1490
[ 1358.395003] ? io_schedule_timeout+0x130/0x130
[ 1358.400789] ? find_held_lock+0x2b/0x80
[ 1358.405896] ? __lock_release.isra.0+0x59/0x170
[ 1358.411780] schedule+0xd4/0x260
[ 1358.416201] schedule_preempt_disabled+0x18/0x30
[ 1358.422183] __mutex_lock+0xd76/0x1f20
[ 1358.427191] ? threaded_store+0x132/0x220
[ 1358.432493] ? ww_mutex_lock+0x160/0x160
[ 1358.437691] ? selinux_inode_free_security+0x310/0x310
[ 1358.444251] ? cap_capable+0x1ed/0x3f0
[ 1358.449259] ? sysfs_file_ops+0x140/0x140
[ 1358.454558] ? threaded_store+0x132/0x220
[ 1358.459853] threaded_store+0x132/0x220
[ 1358.464959] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.470452] ? sysfs_file_ops+0x140/0x140
[ 1358.475749] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.481047] ? sysfs_kf_write+0x65/0x160
[ 1358.486238] kernfs_fop_write_iter+0x335/0x510
[ 1358.492024] ? kernfs_ops+0xf0/0xf0
[ 1358.496736] new_sync_write+0x308/0x6f0
[ 1358.501842] ? new_sync_read+0x6f0/0x6f0
[ 1358.507043] ? lock_acquire.part.0+0xbc/0x260
[ 1358.512729] ? ksys_write+0xff/0x200
[ 1358.517544] vfs_write+0x62a/0x980
[ 1358.522158] ksys_write+0xff/0x200
[ 1358.526771] ? __ia32_sys_read+0xc0/0xc0
[ 1358.531971] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.537561] ? rcu_is_watching+0x15/0xd0
[ 1358.542765] do_syscall_64+0xf3/0x5e0
[ 1358.547674] ? exc_page_fault+0x9e/0xb0
[ 1358.552775] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.559236] RIP: 0033:0x7fc76265fc5e
[ 1358.564046] RSP: 002b:00007ffeaeddcd90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.573342] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc76265fc5e
[ 1358.582149] RDX: 0000000000000001 RSI: 000055c9ed3fa760 RDI: 0000000000000007
[ 1358.590958] RBP: 00007ffeaeddcda0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.599769] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc7624fae80
[ 1358.608578] R13: 000055c9ed3fa760 R14: 0000000000000007 R15: 00007fc762d60b98
[ 1358.617393]
[ 1358.620662] INFO: task python3:5445 is blocked on a mutex likely owned by task python3:3506.
[ 1358.630934] task:python3 state:D stack:25312 pid:3506 tgid:3506 ppid:3505 task_flags:0x400100 flags:0x00080802
[ 1358.644140] Call Trace:
[ 1358.647681]
[ 1358.650832] __schedule+0xad9/0x1490
[ 1358.655643] ? io_schedule_timeout+0x130/0x130
[ 1358.661426] ? find_held_lock+0x2b/0x80
[ 1358.666531] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.672713] schedule+0xd4/0x260
[ 1358.677135] schedule_timeout+0x103/0x260
[ 1358.682430] ? rcu_is_watching+0x15/0xd0
[ 1358.687632] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.694003] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.699693] ? ww_mutex_lock+0x160/0x160
[ 1358.704892] msleep+0x1b/0x30
[ 1358.709017] napi_set_threaded+0x376/0x410
[ 1358.714413] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.719902] netif_set_threaded+0x254/0x400
[ 1358.725394] ? sysfs_file_ops+0x140/0x140
[ 1358.730693] threaded_store+0x1bb/0x220
[ 1358.735797] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.741292] ? sysfs_file_ops+0x140/0x140
[ 1358.746588] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.751886] ? sysfs_kf_write+0x65/0x160
[ 1358.757085] kernfs_fop_write_iter+0x335/0x510
[ 1358.762868] ? kernfs_ops+0xf0/0xf0
[ 1358.767580] new_sync_write+0x308/0x6f0
[ 1358.772685] ? new_sync_read+0x6f0/0x6f0
[ 1358.777885] ? lock_acquire.part.0+0xbc/0x260
[ 1358.783571] ? ksys_write+0xff/0x200
[ 1358.788386] vfs_write+0x62a/0x980
[ 1358.793002] ksys_write+0xff/0x200
[ 1358.797617] ? __ia32_sys_read+0xc0/0xc0
[ 1358.802816] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.808397] ? rcu_is_watching+0x15/0xd0
[ 1358.813599] do_syscall_64+0xf3/0x5e0
[ 1358.818506] ? irq_exit_rcu+0x39/0xf0
[ 1358.823413] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.829880] RIP: 0033:0x7f4ac958ac5e
[ 1358.834690] RSP: 002b:00007ffe7b904e90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.843990] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ac958ac5e
[ 1358.852799] RDX: 0000000000000001 RSI: 0000563f4037c760 RDI: 0000000000000007
[ 1358.861607] RBP: 00007ffe7b904ea0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.870406] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ac9425e80
[ 1358.879206] R13: 0000563f4037c760 R14: 0000000000000007 R15: 00007f4ac93b6480
[ 1358.888021]
[ 1358.891289] \x0aShowing all locks held in the system:
[ 1358.899826] 1 lock held by khungtaskd/185:
[ 1358.905221] #0: ffffffffadece120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.916694] 4 locks held by python3/3506:
[ 1358.921988] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.931782] #1: ff1100016430be88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.942744] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.953902] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.963997] 4 locks held by python3/5445:
[ 1358.969294] #0: ff110001123443f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.979084] #1: ff110001b3b0c488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.990048] #2: ff110001204fb0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.001207] #3: ff11000120581d38 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.011299]
[ 1359.013767] =============================================\x0a