[ 787.136560] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 787.138967] nipa-hw-worker: [5/43] Retrying drivers/net:napi_threaded.py
[ 787.291008] kselftest: Running tests in drivers/net
[ 989.710127] INFO: task python3:5912 blocked for more than 122 seconds.
[ 989.718353] Not tainted 7.1.0-rc1-jcpg-g7773fb5e3fe2 #1
[ 989.726188] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.735777] task:python3 state:D stack:25672 pid:5912 tgid:5912 ppid:5911 task_flags:0x400100 flags:0x00080000
[ 989.748986] Call Trace:
[ 989.752527]
[ 989.755677] __schedule+0xcba/0x1940
[ 989.760496] ? io_schedule_timeout+0x140/0x140
[ 989.766284] ? find_held_lock+0x2b/0x80
[ 989.771391] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.777277] schedule+0xd4/0x260
[ 989.781698] schedule_preempt_disabled+0x18/0x30
[ 989.787678] __mutex_lock+0x6a3/0x2000
[ 989.792684] ? threaded_store+0x132/0x220
[ 989.797986] ? ww_mutex_lock+0x160/0x160
[ 989.803186] ? selinux_inode_free_security+0x330/0x330
[ 989.809756] ? cap_capable+0x1d6/0x3e0
[ 989.814763] ? threaded_store+0x132/0x220
[ 989.820062] threaded_store+0x132/0x220
[ 989.825165] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.830455] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.835751] ? sysfs_kf_write+0x65/0x160
[ 989.840952] ? sysfs_file_ops+0x140/0x140
[ 989.846254] kernfs_fop_write_iter+0x335/0x510
[ 989.852042] ? kernfs_ops+0xf0/0xf0
[ 989.856753] new_sync_write+0x333/0x750
[ 989.861847] ? __lock_acquire+0x508/0xc10
[ 989.867143] ? new_sync_read+0x740/0x740
[ 989.872345] ? lock_acquire.part.0+0xbc/0x260
[ 989.878033] ? ksys_write+0x116/0x250
[ 989.882933] vfs_write+0x657/0x9b0
[ 989.887550] ksys_write+0x116/0x250
[ 989.892263] ? __ia32_sys_read+0xc0/0xc0
[ 989.897465] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.903056] ? rcu_is_watching+0x15/0xd0
[ 989.908257] do_syscall_64+0xf3/0x650
[ 989.913162] ? trace_hardirqs_off+0xd/0x30
[ 989.918559] ? exc_page_fault+0xda/0xf0
[ 989.923661] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.930131] RIP: 0033:0x7f2d450f822e
[ 989.934941] RSP: 002b:00007ffd1207c660 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.944241] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d450f822e
[ 989.953051] RDX: 0000000000000001 RSI: 000055ec61ca2a10 RDI: 0000000000000007
[ 989.961858] RBP: 00007ffd1207c670 R08: 0000000000000000 R09: 0000000000000000
[ 989.970666] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d44f70390
[ 989.979475] R13: 000055ec61ca2a10 R14: 0000000000000007 R15: 0000000000000003
[ 989.988288]
[ 989.991586] INFO: task python3:5912 is blocked on a mutex likely owned by task python3:3770.
[ 990.001859] task:python3 state:D stack:25672 pid:3770 tgid:3770 ppid:3769 task_flags:0x400100 flags:0x00080802
[ 990.015063] Call Trace:
[ 990.018600]
[ 990.021752] __schedule+0xcba/0x1940
[ 990.026563] ? io_schedule_timeout+0x140/0x140
[ 990.032338] ? find_held_lock+0x2b/0x80
[ 990.037443] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.043620] schedule+0xd4/0x260
[ 990.048038] schedule_timeout+0x13f/0x290
[ 990.053334] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.059704] ? trace_contention_end+0xb3/0x1a0
[ 990.065481] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.071165] ? ww_mutex_lock+0x160/0x160
[ 990.076375] msleep+0x1b/0x30
[ 990.080501] napi_set_threaded+0x3a5/0x440
[ 990.085899] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.091395] netif_set_threaded+0x257/0x400
[ 990.096888] threaded_store+0x1b8/0x220
[ 990.101993] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.107291] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.112589] ? sysfs_kf_write+0x65/0x160
[ 990.117789] ? sysfs_file_ops+0x140/0x140
[ 990.123083] kernfs_fop_write_iter+0x335/0x510
[ 990.128869] ? kernfs_ops+0xf0/0xf0
[ 990.133583] new_sync_write+0x333/0x750
[ 990.138685] ? __lock_acquire+0x508/0xc10
[ 990.143983] ? new_sync_read+0x740/0x740
[ 990.149184] ? lock_acquire.part.0+0xbc/0x260
[ 990.154870] ? ksys_write+0x116/0x250
[ 990.159781] vfs_write+0x657/0x9b0
[ 990.164396] ksys_write+0x116/0x250
[ 990.169100] ? __ia32_sys_read+0xc0/0xc0
[ 990.174291] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.179873] ? rcu_is_watching+0x15/0xd0
[ 990.185066] do_syscall_64+0xf3/0x650
[ 990.189975] ? irq_exit_rcu+0x1a/0x30
[ 990.194884] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.201342] RIP: 0033:0x7f35abcf922e
[ 990.206141] RSP: 002b:00007ffdbc5b6c90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.215438] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f35abcf922e
[ 990.224247] RDX: 0000000000000001 RSI: 0000560e99493a10 RDI: 0000000000000007
[ 990.233058] RBP: 00007ffdbc5b6ca0 R08: 0000000000000000 R09: 0000000000000000
[ 990.241868] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f35abb71390
[ 990.250678] R13: 0000560e99493a10 R14: 0000000000000007 R15: 0000000000000003
[ 990.259493]
[ 990.262754] \x0aShowing all locks held in the system:
[ 990.271293] 1 lock held by khungtaskd/184:
[ 990.276685] #0: ffffffff970fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.288159] 2 locks held by systemd-journal/804:
[ 990.294130] #0: ff1100180dbb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.304021] #1: ffffffff973030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.316849] 4 locks held by python3/3770:
[ 990.322143] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.332032] #1: ff1100016b0d0880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.342995] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.354143] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.364240] 4 locks held by python3/5912:
[ 990.369537] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.379427] #1: ff11000133faf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.390391] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.401550] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.411639]
[ 990.414103] =============================================\x0a
[ 1112.591258] INFO: task python3:5912 blocked for more than 245 seconds.
[ 1112.599406] Not tainted 7.1.0-rc1-jcpg-g7773fb5e3fe2 #1
[ 1112.606656] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.616243] task:python3 state:D stack:25672 pid:5912 tgid:5912 ppid:5911 task_flags:0x400100 flags:0x00080000
[ 1112.629448] Call Trace:
[ 1112.632988]
[ 1112.636136] __schedule+0xcba/0x1940
[ 1112.640949] ? io_schedule_timeout+0x140/0x140
[ 1112.646732] ? find_held_lock+0x2b/0x80
[ 1112.651834] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.657721] schedule+0xd4/0x260
[ 1112.662138] schedule_preempt_disabled+0x18/0x30
[ 1112.668114] __mutex_lock+0x6a3/0x2000
[ 1112.673117] ? threaded_store+0x132/0x220
[ 1112.678416] ? ww_mutex_lock+0x160/0x160
[ 1112.683615] ? selinux_inode_free_security+0x330/0x330
[ 1112.690184] ? cap_capable+0x1d6/0x3e0
[ 1112.695195] ? threaded_store+0x132/0x220
[ 1112.700490] threaded_store+0x132/0x220
[ 1112.705591] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.710888] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.716183] ? sysfs_kf_write+0x65/0x160
[ 1112.721385] ? sysfs_file_ops+0x140/0x140
[ 1112.726678] kernfs_fop_write_iter+0x335/0x510
[ 1112.732460] ? kernfs_ops+0xf0/0xf0
[ 1112.737171] new_sync_write+0x333/0x750
[ 1112.742271] ? __lock_acquire+0x508/0xc10
[ 1112.747567] ? new_sync_read+0x740/0x740
[ 1112.752769] ? lock_acquire.part.0+0xbc/0x260
[ 1112.758456] ? ksys_write+0x116/0x250
[ 1112.763364] vfs_write+0x657/0x9b0
[ 1112.767976] ksys_write+0x116/0x250
[ 1112.772685] ? __ia32_sys_read+0xc0/0xc0
[ 1112.777883] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.783468] ? rcu_is_watching+0x15/0xd0
[ 1112.788671] do_syscall_64+0xf3/0x650
[ 1112.793576] ? trace_hardirqs_off+0xd/0x30
[ 1112.798971] ? exc_page_fault+0xda/0xf0
[ 1112.804074] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.810543] RIP: 0033:0x7f2d450f822e
[ 1112.815354] RSP: 002b:00007ffd1207c660 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.824649] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d450f822e
[ 1112.833455] RDX: 0000000000000001 RSI: 000055ec61ca2a10 RDI: 0000000000000007
[ 1112.842260] RBP: 00007ffd1207c670 R08: 0000000000000000 R09: 0000000000000000
[ 1112.851066] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d44f70390
[ 1112.859874] R13: 000055ec61ca2a10 R14: 0000000000000007 R15: 0000000000000003
[ 1112.868679]
[ 1112.871978] INFO: task python3:5912 is blocked on a mutex likely owned by task python3:3770.
[ 1112.882249] task:python3 state:D stack:25672 pid:3770 tgid:3770 ppid:3769 task_flags:0x400100 flags:0x00080802
[ 1112.895450] Call Trace:
[ 1112.898988]
[ 1112.902139] __schedule+0xcba/0x1940
[ 1112.906938] ? io_schedule_timeout+0x140/0x140
[ 1112.912723] ? find_held_lock+0x2b/0x80
[ 1112.917815] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.923994] schedule+0xd4/0x260
[ 1112.928413] schedule_timeout+0x13f/0x290
[ 1112.933710] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.940071] ? trace_contention_end+0xb3/0x1a0
[ 1112.945854] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.951542] ? ww_mutex_lock+0x160/0x160
[ 1112.956739] msleep+0x1b/0x30
[ 1112.960866] napi_set_threaded+0x3a5/0x440
[ 1112.966260] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.971755] netif_set_threaded+0x257/0x400
[ 1112.977245] threaded_store+0x1b8/0x220
[ 1112.982348] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.987634] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.992929] ? sysfs_kf_write+0x65/0x160
[ 1112.998129] ? sysfs_file_ops+0x140/0x140
[ 1113.003414] kernfs_fop_write_iter+0x335/0x510
[ 1113.009198] ? kernfs_ops+0xf0/0xf0
[ 1113.013906] new_sync_write+0x333/0x750
[ 1113.019010] ? __lock_acquire+0x508/0xc10
[ 1113.024307] ? new_sync_read+0x740/0x740
[ 1113.029497] ? lock_acquire.part.0+0xbc/0x260
[ 1113.035180] ? ksys_write+0x116/0x250
[ 1113.040091] vfs_write+0x657/0x9b0
[ 1113.044707] ksys_write+0x116/0x250
[ 1113.049417] ? __ia32_sys_read+0xc0/0xc0
[ 1113.054617] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.060204] ? rcu_is_watching+0x15/0xd0
[ 1113.065405] do_syscall_64+0xf3/0x650
[ 1113.070311] ? irq_exit_rcu+0x1a/0x30
[ 1113.075216] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.081681] RIP: 0033:0x7f35abcf922e
[ 1113.086487] RSP: 002b:00007ffdbc5b6c90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.095783] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f35abcf922e
[ 1113.104589] RDX: 0000000000000001 RSI: 0000560e99493a10 RDI: 0000000000000007
[ 1113.113396] RBP: 00007ffdbc5b6ca0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.122204] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f35abb71390
[ 1113.131011] R13: 0000560e99493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1113.139823]
[ 1113.143090] \x0aShowing all locks held in the system:
[ 1113.151628] 1 lock held by khungtaskd/184:
[ 1113.157022] #0: ffffffff970fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.168504] 4 locks held by python3/3770:
[ 1113.173799] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.183689] #1: ff1100016b0d0880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.194650] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.205804] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.215900] 4 locks held by python3/5912:
[ 1113.221192] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.231085] #1: ff11000133faf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.242045] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.253201] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.263294]
[ 1113.265759] =============================================\x0a
[ 1235.473370] INFO: task python3:5912 blocked for more than 368 seconds.
[ 1235.481518] Not tainted 7.1.0-rc1-jcpg-g7773fb5e3fe2 #1
[ 1235.488769] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.498357] task:python3 state:D stack:25672 pid:5912 tgid:5912 ppid:5911 task_flags:0x400100 flags:0x00080002
[ 1235.511562] Call Trace:
[ 1235.515101]
[ 1235.518249] __schedule+0xcba/0x1940
[ 1235.523063] ? io_schedule_timeout+0x140/0x140
[ 1235.528849] ? find_held_lock+0x2b/0x80
[ 1235.533955] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.539840] schedule+0xd4/0x260
[ 1235.544256] schedule_preempt_disabled+0x18/0x30
[ 1235.550233] __mutex_lock+0x6a3/0x2000
[ 1235.555237] ? threaded_store+0x132/0x220
[ 1235.560535] ? ww_mutex_lock+0x160/0x160
[ 1235.565734] ? selinux_inode_free_security+0x330/0x330
[ 1235.572303] ? cap_capable+0x1d6/0x3e0
[ 1235.577311] ? threaded_store+0x132/0x220
[ 1235.582605] threaded_store+0x132/0x220
[ 1235.587705] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.593003] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.598302] ? sysfs_kf_write+0x65/0x160
[ 1235.603501] ? sysfs_file_ops+0x140/0x140
[ 1235.608794] kernfs_fop_write_iter+0x335/0x510
[ 1235.614576] ? kernfs_ops+0xf0/0xf0
[ 1235.619287] new_sync_write+0x333/0x750
[ 1235.624388] ? __lock_acquire+0x508/0xc10
[ 1235.629684] ? new_sync_read+0x740/0x740
[ 1235.634883] ? lock_acquire.part.0+0xbc/0x260
[ 1235.640568] ? ksys_write+0x116/0x250
[ 1235.645477] vfs_write+0x657/0x9b0
[ 1235.650090] ksys_write+0x116/0x250
[ 1235.654799] ? __ia32_sys_read+0xc0/0xc0
[ 1235.659995] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.665582] ? rcu_is_watching+0x15/0xd0
[ 1235.670783] do_syscall_64+0xf3/0x650
[ 1235.675688] ? trace_hardirqs_off+0xd/0x30
[ 1235.681084] ? exc_page_fault+0xda/0xf0
[ 1235.686188] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.692654] RIP: 0033:0x7f2d450f822e
[ 1235.697465] RSP: 002b:00007ffd1207c660 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.706763] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d450f822e
[ 1235.715568] RDX: 0000000000000001 RSI: 000055ec61ca2a10 RDI: 0000000000000007
[ 1235.724374] RBP: 00007ffd1207c670 R08: 0000000000000000 R09: 0000000000000000
[ 1235.733179] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d44f70390
[ 1235.741988] R13: 000055ec61ca2a10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.750799]
[ 1235.754086] INFO: task python3:5912 is blocked on a mutex likely owned by task python3:3770.
[ 1235.764357] task:python3 state:D stack:25672 pid:3770 tgid:3770 ppid:3769 task_flags:0x400100 flags:0x00080802
[ 1235.777560] Call Trace:
[ 1235.781099]
[ 1235.784250] __schedule+0xcba/0x1940
[ 1235.789054] ? io_schedule_timeout+0x140/0x140
[ 1235.794838] ? find_held_lock+0x2b/0x80
[ 1235.799942] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.806120] schedule+0xd4/0x260
[ 1235.810538] schedule_timeout+0x13f/0x290
[ 1235.815835] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.822196] ? trace_contention_end+0xb3/0x1a0
[ 1235.827984] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.833672] ? ww_mutex_lock+0x160/0x160
[ 1235.838872] msleep+0x1b/0x30
[ 1235.842999] napi_set_threaded+0x3a5/0x440
[ 1235.848393] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.853886] netif_set_threaded+0x257/0x400
[ 1235.859375] threaded_store+0x1b8/0x220
[ 1235.864478] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.869764] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.875059] ? sysfs_kf_write+0x65/0x160
[ 1235.880259] ? sysfs_file_ops+0x140/0x140
[ 1235.885543] kernfs_fop_write_iter+0x335/0x510
[ 1235.891328] ? kernfs_ops+0xf0/0xf0
[ 1235.896035] new_sync_write+0x333/0x750
[ 1235.901135] ? __lock_acquire+0x508/0xc10
[ 1235.906431] ? new_sync_read+0x740/0x740
[ 1235.911629] ? lock_acquire.part.0+0xbc/0x260
[ 1235.917313] ? ksys_write+0x116/0x250
[ 1235.922223] vfs_write+0x657/0x9b0
[ 1235.926837] ksys_write+0x116/0x250
[ 1235.931548] ? __ia32_sys_read+0xc0/0xc0
[ 1235.936747] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.942334] ? rcu_is_watching+0x15/0xd0
[ 1235.947535] do_syscall_64+0xf3/0x650
[ 1235.952443] ? irq_exit_rcu+0x1a/0x30
[ 1235.957349] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.963816] RIP: 0033:0x7f35abcf922e
[ 1235.968620] RSP: 002b:00007ffdbc5b6c90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.977918] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f35abcf922e
[ 1235.986724] RDX: 0000000000000001 RSI: 0000560e99493a10 RDI: 0000000000000007
[ 1235.995530] RBP: 00007ffdbc5b6ca0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.004338] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f35abb71390
[ 1236.013145] R13: 0000560e99493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1236.021956]
[ 1236.025224] \x0aShowing all locks held in the system:
[ 1236.033762] 1 lock held by khungtaskd/184:
[ 1236.039155] #0: ffffffff970fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.050624] 2 locks held by systemd-journal/804:
[ 1236.056601] #0: ff1100180e7b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1236.066485] #1: ffffffff973030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.079311] 4 locks held by python3/3770:
[ 1236.084603] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.094489] #1: ff1100016b0d0880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.105451] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.116596] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.126690] 4 locks held by python3/5912:
[ 1236.131986] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.141874] #1: ff11000133faf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.152835] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.163982] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.174070]
[ 1236.176533] =============================================\x0a
[ 1358.353477] INFO: task python3:5912 blocked for more than 491 seconds.
[ 1358.361624] Not tainted 7.1.0-rc1-jcpg-g7773fb5e3fe2 #1
[ 1358.368874] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.378461] task:python3 state:D stack:25672 pid:5912 tgid:5912 ppid:5911 task_flags:0x400100 flags:0x00080002
[ 1358.391665] Call Trace:
[ 1358.395204]
[ 1358.398352] __schedule+0xcba/0x1940
[ 1358.403166] ? io_schedule_timeout+0x140/0x140
[ 1358.408944] ? find_held_lock+0x2b/0x80
[ 1358.414046] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.419929] schedule+0xd4/0x260
[ 1358.424338] schedule_preempt_disabled+0x18/0x30
[ 1358.430320] __mutex_lock+0x6a3/0x2000
[ 1358.435324] ? threaded_store+0x132/0x220
[ 1358.440623] ? ww_mutex_lock+0x160/0x160
[ 1358.445818] ? selinux_inode_free_security+0x330/0x330
[ 1358.452385] ? cap_capable+0x1d6/0x3e0
[ 1358.457380] ? threaded_store+0x132/0x220
[ 1358.462673] threaded_store+0x132/0x220
[ 1358.467776] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.473065] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.478366] ? sysfs_kf_write+0x65/0x160
[ 1358.483565] ? sysfs_file_ops+0x140/0x140
[ 1358.488860] kernfs_fop_write_iter+0x335/0x510
[ 1358.494644] ? kernfs_ops+0xf0/0xf0
[ 1358.499352] new_sync_write+0x333/0x750
[ 1358.504454] ? __lock_acquire+0x508/0xc10
[ 1358.509751] ? new_sync_read+0x740/0x740
[ 1358.514941] ? lock_acquire.part.0+0xbc/0x260
[ 1358.520624] ? ksys_write+0x116/0x250
[ 1358.525534] vfs_write+0x657/0x9b0
[ 1358.530147] ksys_write+0x116/0x250
[ 1358.534858] ? __ia32_sys_read+0xc0/0xc0
[ 1358.540056] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.545644] ? rcu_is_watching+0x15/0xd0
[ 1358.550846] do_syscall_64+0xf3/0x650
[ 1358.555752] ? trace_hardirqs_off+0xd/0x30
[ 1358.561144] ? exc_page_fault+0xda/0xf0
[ 1358.566243] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.572710] RIP: 0033:0x7f2d450f822e
[ 1358.577518] RSP: 002b:00007ffd1207c660 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.586814] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d450f822e
[ 1358.595623] RDX: 0000000000000001 RSI: 000055ec61ca2a10 RDI: 0000000000000007
[ 1358.604421] RBP: 00007ffd1207c670 R08: 0000000000000000 R09: 0000000000000000
[ 1358.613229] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d44f70390
[ 1358.622036] R13: 000055ec61ca2a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.630847]
[ 1358.634138] INFO: task python3:5912 is blocked on a mutex likely owned by task python3:3770.
[ 1358.644411] task:python3 state:D stack:25672 pid:3770 tgid:3770 ppid:3769 task_flags:0x400100 flags:0x00080802
[ 1358.657614] Call Trace:
[ 1358.661153]
[ 1358.664301] __schedule+0xcba/0x1940
[ 1358.669111] ? io_schedule_timeout+0x140/0x140
[ 1358.674893] ? find_held_lock+0x2b/0x80
[ 1358.679995] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.686174] schedule+0xd4/0x260
[ 1358.690589] schedule_timeout+0x13f/0x290
[ 1358.695884] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.702254] ? trace_contention_end+0xb3/0x1a0
[ 1358.708036] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.713727] ? ww_mutex_lock+0x160/0x160
[ 1358.718925] msleep+0x1b/0x30
[ 1358.723048] napi_set_threaded+0x3a5/0x440
[ 1358.728444] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.733930] netif_set_threaded+0x257/0x400
[ 1358.739424] threaded_store+0x1b8/0x220
[ 1358.744526] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.749813] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.755106] ? sysfs_kf_write+0x65/0x160
[ 1358.760303] ? sysfs_file_ops+0x140/0x140
[ 1358.765599] kernfs_fop_write_iter+0x335/0x510
[ 1358.771380] ? kernfs_ops+0xf0/0xf0
[ 1358.776089] new_sync_write+0x333/0x750
[ 1358.781190] ? __lock_acquire+0x508/0xc10
[ 1358.786487] ? new_sync_read+0x740/0x740
[ 1358.791687] ? lock_acquire.part.0+0xbc/0x260
[ 1358.797363] ? ksys_write+0x116/0x250
[ 1358.802270] vfs_write+0x657/0x9b0
[ 1358.806886] ksys_write+0x116/0x250
[ 1358.811598] ? __ia32_sys_read+0xc0/0xc0
[ 1358.816794] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.822382] ? rcu_is_watching+0x15/0xd0
[ 1358.827580] do_syscall_64+0xf3/0x650
[ 1358.832483] ? irq_exit_rcu+0x1a/0x30
[ 1358.837391] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.843854] RIP: 0033:0x7f35abcf922e
[ 1358.848662] RSP: 002b:00007ffdbc5b6c90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.857958] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f35abcf922e
[ 1358.866767] RDX: 0000000000000001 RSI: 0000560e99493a10 RDI: 0000000000000007
[ 1358.875571] RBP: 00007ffdbc5b6ca0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.884377] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f35abb71390
[ 1358.893182] R13: 0000560e99493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.901995]
[ 1358.905264] \x0aShowing all locks held in the system:
[ 1358.913803] 1 lock held by khungtaskd/184:
[ 1358.919197] #0: ffffffff970fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.930668] 2 locks held by systemd-journal/804:
[ 1358.936646] #0: ff1100180e0b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.946533] #1: ff110001a21c0378 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.957306] 4 locks held by python3/3770:
[ 1358.962600] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.972488] #1: ff1100016b0d0880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.983448] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.994604] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.004701] 4 locks held by python3/5912:
[ 1359.009998] #0: ff1100012f8893e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.019886] #1: ff11000133faf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.030846] #2: ff11000123538b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.041999] #3: ff11000123519d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.052091]
[ 1359.054556] =============================================\x0a