[ 766.868687] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 766.871087] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 767.031882] kselftest: Running tests in drivers/net
[ 834.078282] kworker/u129:15 (312) used greatest stack depth: 21456 bytes left
[ 989.727729] INFO: task python3:5450 blocked for more than 122 seconds.
[ 989.735967] Not tainted 7.1.0-rc7-acex-g2c092311e30d #1
[ 989.743879] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.753469] task:python3 state:D stack:25672 pid:5450 tgid:5450 ppid:5449 task_flags:0x400100 flags:0x00080000
[ 989.766666] Call Trace:
[ 989.770204]
[ 989.773356] __schedule+0xcc3/0x19c0
[ 989.778175] ? io_schedule_timeout+0x140/0x140
[ 989.783962] ? find_held_lock+0x2b/0x80
[ 989.789068] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.794954] schedule+0xd8/0x260
[ 989.799373] schedule_preempt_disabled+0x18/0x30
[ 989.805351] __mutex_lock+0x6af/0x2010
[ 989.810358] ? threaded_store+0x132/0x220
[ 989.815657] ? ww_mutex_lock+0x160/0x160
[ 989.820856] ? selinux_inode_free_security+0x330/0x330
[ 989.827418] ? cap_capable+0x1d6/0x3e0
[ 989.832429] ? threaded_store+0x132/0x220
[ 989.837726] threaded_store+0x132/0x220
[ 989.842818] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.848117] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.853417] ? sysfs_kf_write+0x65/0x160
[ 989.858607] ? sysfs_file_ops+0x140/0x140
[ 989.863902] kernfs_fop_write_iter+0x335/0x510
[ 989.869687] ? kernfs_ops+0xf0/0xf0
[ 989.874393] new_sync_write+0x333/0x750
[ 989.879498] ? __lock_acquire+0x508/0xc10
[ 989.884795] ? new_sync_read+0x740/0x740
[ 989.889988] ? lock_acquire.part.0+0xbc/0x260
[ 989.895676] ? ksys_write+0x116/0x250
[ 989.900579] vfs_write+0x657/0x9b0
[ 989.905193] ksys_write+0x116/0x250
[ 989.909903] ? __ia32_sys_read+0xc0/0xc0
[ 989.915101] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.920691] ? rcu_is_watching+0x15/0xd0
[ 989.925893] do_syscall_64+0xf3/0x650
[ 989.930802] ? trace_hardirqs_off+0xd/0x30
[ 989.936197] ? exc_page_fault+0xda/0xf0
[ 989.941300] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.947769] RIP: 0033:0x7f2d7486e64e
[ 989.952581] RSP: 002b:00007ffddaf60940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.961879] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d7486e64e
[ 989.970689] RDX: 0000000000000001 RSI: 00005572d4726bf0 RDI: 0000000000000007
[ 989.979497] RBP: 00007ffddaf60950 R08: 0000000000000000 R09: 0000000000000000
[ 989.988306] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d746e7390
[ 989.997114] R13: 00005572d4726bf0 R14: 0000000000000007 R15: 00007f2d7467d120
[ 990.005936]
[ 990.009221] INFO: task python3:5450 is blocked on a mutex likely owned by task python3:3473.
[ 990.019497] task:python3 state:D stack:25672 pid:3473 tgid:3473 ppid:3472 task_flags:0x400100 flags:0x00080802
[ 990.032692] Call Trace:
[ 990.036233]
[ 990.039385] __schedule+0xcc3/0x19c0
[ 990.044196] ? io_schedule_timeout+0x140/0x140
[ 990.049979] ? find_held_lock+0x2b/0x80
[ 990.055085] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.061263] schedule+0xd8/0x260
[ 990.065682] schedule_timeout+0x13f/0x290
[ 990.070980] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.077352] ? trace_contention_end+0xb3/0x1a0
[ 990.083136] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.088827] ? ww_mutex_lock+0x160/0x160
[ 990.094026] msleep+0x1b/0x30
[ 990.098150] napi_set_threaded+0x3a5/0x440
[ 990.103545] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.109040] netif_set_threaded+0x257/0x400
[ 990.114532] threaded_store+0x1b8/0x220
[ 990.119629] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.124925] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.130223] ? sysfs_kf_write+0x65/0x160
[ 990.135423] ? sysfs_file_ops+0x140/0x140
[ 990.140718] kernfs_fop_write_iter+0x335/0x510
[ 990.146503] ? kernfs_ops+0xf0/0xf0
[ 990.151205] new_sync_write+0x333/0x750
[ 990.156306] ? __lock_acquire+0x508/0xc10
[ 990.161604] ? new_sync_read+0x740/0x740
[ 990.166803] ? lock_acquire.part.0+0xbc/0x260
[ 990.172493] ? ksys_write+0x116/0x250
[ 990.177401] vfs_write+0x657/0x9b0
[ 990.182017] ksys_write+0x116/0x250
[ 990.186722] ? __ia32_sys_read+0xc0/0xc0
[ 990.191920] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.197511] ? rcu_is_watching+0x15/0xd0
[ 990.202713] do_syscall_64+0xf3/0x650
[ 990.207620] ? trace_hardirqs_off+0xd/0x30
[ 990.213006] ? exc_page_fault+0xda/0xf0
[ 990.218106] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.224578] RIP: 0033:0x7f5f545b664e
[ 990.229387] RSP: 002b:00007ffe8af5a3f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.238684] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5f545b664e
[ 990.247481] RDX: 0000000000000001 RSI: 000055e63a15ebf0 RDI: 0000000000000007
[ 990.256293] RBP: 00007ffe8af5a400 R08: 0000000000000000 R09: 0000000000000000
[ 990.265101] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5f5442f390
[ 990.273909] R13: 000055e63a15ebf0 R14: 0000000000000007 R15: 00007f5f543c5120
[ 990.282723]
[ 990.285987] \x0aShowing all locks held in the system:
[ 990.294523] 1 lock held by khungtaskd/185:
[ 990.299917] #0: ffffffff9eafdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.311390] 3 locks held by systemd-journal/803:
[ 990.317367] #0: ff1100180dcb74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.327258] #1: ffffffff9ed02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.340077] #2: ff110001a3acdba0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.351633] 4 locks held by python3/3473:
[ 990.356930] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.366820] #1: ff11000142810e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.377781] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.388938] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.399036] 4 locks held by python3/5450:
[ 990.404334] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.414221] #1: ff11000186cb7a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.425183] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.436329] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.446419]
[ 990.448877] =============================================\x0a
[ 1112.608907] INFO: task python3:5450 blocked for more than 245 seconds.
[ 1112.617053] Not tainted 7.1.0-rc7-acex-g2c092311e30d #1
[ 1112.624293] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.633874] task:python3 state:D stack:25672 pid:5450 tgid:5450 ppid:5449 task_flags:0x400100 flags:0x00080000
[ 1112.647083] Call Trace:
[ 1112.650621]
[ 1112.653773] __schedule+0xcc3/0x19c0
[ 1112.658592] ? io_schedule_timeout+0x140/0x140
[ 1112.664380] ? find_held_lock+0x2b/0x80
[ 1112.669484] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.675370] schedule+0xd8/0x260
[ 1112.679789] schedule_preempt_disabled+0x18/0x30
[ 1112.685760] __mutex_lock+0x6af/0x2010
[ 1112.690759] ? threaded_store+0x132/0x220
[ 1112.696060] ? ww_mutex_lock+0x160/0x160
[ 1112.701262] ? selinux_inode_free_security+0x330/0x330
[ 1112.707832] ? cap_capable+0x1d6/0x3e0
[ 1112.712839] ? threaded_store+0x132/0x220
[ 1112.718138] threaded_store+0x132/0x220
[ 1112.723241] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.728541] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.733841] ? sysfs_kf_write+0x65/0x160
[ 1112.739044] ? sysfs_file_ops+0x140/0x140
[ 1112.744342] kernfs_fop_write_iter+0x335/0x510
[ 1112.750126] ? kernfs_ops+0xf0/0xf0
[ 1112.754839] new_sync_write+0x333/0x750
[ 1112.759941] ? __lock_acquire+0x508/0xc10
[ 1112.765236] ? new_sync_read+0x740/0x740
[ 1112.770440] ? lock_acquire.part.0+0xbc/0x260
[ 1112.776128] ? ksys_write+0x116/0x250
[ 1112.781037] vfs_write+0x657/0x9b0
[ 1112.785654] ksys_write+0x116/0x250
[ 1112.790366] ? __ia32_sys_read+0xc0/0xc0
[ 1112.795556] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.801147] ? rcu_is_watching+0x15/0xd0
[ 1112.806352] do_syscall_64+0xf3/0x650
[ 1112.811258] ? trace_hardirqs_off+0xd/0x30
[ 1112.816655] ? exc_page_fault+0xda/0xf0
[ 1112.821753] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.828223] RIP: 0033:0x7f2d7486e64e
[ 1112.833035] RSP: 002b:00007ffddaf60940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.842332] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d7486e64e
[ 1112.851140] RDX: 0000000000000001 RSI: 00005572d4726bf0 RDI: 0000000000000007
[ 1112.859946] RBP: 00007ffddaf60950 R08: 0000000000000000 R09: 0000000000000000
[ 1112.868760] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d746e7390
[ 1112.877568] R13: 00005572d4726bf0 R14: 0000000000000007 R15: 00007f2d7467d120
[ 1112.886381]
[ 1112.889668] INFO: task python3:5450 is blocked on a mutex likely owned by task python3:3473.
[ 1112.899941] task:python3 state:D stack:25672 pid:3473 tgid:3473 ppid:3472 task_flags:0x400100 flags:0x00080802
[ 1112.913146] Call Trace:
[ 1112.916685]
[ 1112.919834] __schedule+0xcc3/0x19c0
[ 1112.924647] ? io_schedule_timeout+0x140/0x140
[ 1112.930432] ? find_held_lock+0x2b/0x80
[ 1112.935527] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.941705] schedule+0xd8/0x260
[ 1112.946122] schedule_timeout+0x13f/0x290
[ 1112.951421] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.957790] ? trace_contention_end+0xb3/0x1a0
[ 1112.963578] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.969270] ? ww_mutex_lock+0x160/0x160
[ 1112.974471] msleep+0x1b/0x30
[ 1112.978595] napi_set_threaded+0x3a5/0x440
[ 1112.983993] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.989487] netif_set_threaded+0x257/0x400
[ 1112.994981] threaded_store+0x1b8/0x220
[ 1113.000083] ? xps_rxqs_store+0x2e0/0x2e0
[ 1113.005383] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.010681] ? sysfs_kf_write+0x65/0x160
[ 1113.015881] ? sysfs_file_ops+0x140/0x140
[ 1113.021166] kernfs_fop_write_iter+0x335/0x510
[ 1113.026953] ? kernfs_ops+0xf0/0xf0
[ 1113.031667] new_sync_write+0x333/0x750
[ 1113.036771] ? __lock_acquire+0x508/0xc10
[ 1113.042066] ? new_sync_read+0x740/0x740
[ 1113.047265] ? lock_acquire.part.0+0xbc/0x260
[ 1113.052951] ? ksys_write+0x116/0x250
[ 1113.057861] vfs_write+0x657/0x9b0
[ 1113.062477] ksys_write+0x116/0x250
[ 1113.067192] ? __ia32_sys_read+0xc0/0xc0
[ 1113.072392] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.077983] ? rcu_is_watching+0x15/0xd0
[ 1113.083182] do_syscall_64+0xf3/0x650
[ 1113.088092] ? trace_hardirqs_off+0xd/0x30
[ 1113.093485] ? exc_page_fault+0xda/0xf0
[ 1113.098588] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.105057] RIP: 0033:0x7f5f545b664e
[ 1113.109865] RSP: 002b:00007ffe8af5a3f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.119163] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5f545b664e
[ 1113.127969] RDX: 0000000000000001 RSI: 000055e63a15ebf0 RDI: 0000000000000007
[ 1113.136780] RBP: 00007ffe8af5a400 R08: 0000000000000000 R09: 0000000000000000
[ 1113.145592] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5f5442f390
[ 1113.154399] R13: 000055e63a15ebf0 R14: 0000000000000007 R15: 00007f5f543c5120
[ 1113.163214]
[ 1113.166479] \x0aShowing all locks held in the system:
[ 1113.175016] 1 lock held by khungtaskd/185:
[ 1113.180412] #0: ffffffff9eafdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.191883] 4 locks held by python3/3473:
[ 1113.197180] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.207071] #1: ff11000142810e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.218034] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.229190] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.239285] 4 locks held by python3/5450:
[ 1113.244582] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.254472] #1: ff11000186cb7a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.265436] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.276597] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.286687]
[ 1113.289156] =============================================\x0a
[ 1235.490111] INFO: task python3:5450 blocked for more than 368 seconds.
[ 1235.498260] Not tainted 7.1.0-rc7-acex-g2c092311e30d #1
[ 1235.505510] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.515098] task:python3 state:D stack:25672 pid:5450 tgid:5450 ppid:5449 task_flags:0x400100 flags:0x00080002
[ 1235.528305] Call Trace:
[ 1235.531844]
[ 1235.534996] __schedule+0xcc3/0x19c0
[ 1235.539815] ? io_schedule_timeout+0x140/0x140
[ 1235.545601] ? find_held_lock+0x2b/0x80
[ 1235.550708] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.556592] schedule+0xd8/0x260
[ 1235.561010] schedule_preempt_disabled+0x18/0x30
[ 1235.566988] __mutex_lock+0x6af/0x2010
[ 1235.571992] ? threaded_store+0x132/0x220
[ 1235.577282] ? ww_mutex_lock+0x160/0x160
[ 1235.582483] ? selinux_inode_free_security+0x330/0x330
[ 1235.589054] ? cap_capable+0x1d6/0x3e0
[ 1235.594064] ? threaded_store+0x132/0x220
[ 1235.599361] threaded_store+0x132/0x220
[ 1235.604462] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.609760] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.615064] ? sysfs_kf_write+0x65/0x160
[ 1235.620264] ? sysfs_file_ops+0x140/0x140
[ 1235.625560] kernfs_fop_write_iter+0x335/0x510
[ 1235.631345] ? kernfs_ops+0xf0/0xf0
[ 1235.636057] new_sync_write+0x333/0x750
[ 1235.641163] ? __lock_acquire+0x508/0xc10
[ 1235.646461] ? new_sync_read+0x740/0x740
[ 1235.651662] ? lock_acquire.part.0+0xbc/0x260
[ 1235.657350] ? ksys_write+0x116/0x250
[ 1235.662258] vfs_write+0x657/0x9b0
[ 1235.666876] ksys_write+0x116/0x250
[ 1235.671587] ? __ia32_sys_read+0xc0/0xc0
[ 1235.676784] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.682375] ? rcu_is_watching+0x15/0xd0
[ 1235.687580] do_syscall_64+0xf3/0x650
[ 1235.692488] ? trace_hardirqs_off+0xd/0x30
[ 1235.697883] ? exc_page_fault+0xda/0xf0
[ 1235.702985] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.709456] RIP: 0033:0x7f2d7486e64e
[ 1235.714266] RSP: 002b:00007ffddaf60940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.723566] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d7486e64e
[ 1235.732377] RDX: 0000000000000001 RSI: 00005572d4726bf0 RDI: 0000000000000007
[ 1235.741185] RBP: 00007ffddaf60950 R08: 0000000000000000 R09: 0000000000000000
[ 1235.749984] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d746e7390
[ 1235.758782] R13: 00005572d4726bf0 R14: 0000000000000007 R15: 00007f2d7467d120
[ 1235.767596]
[ 1235.770880] INFO: task python3:5450 is blocked on a mutex likely owned by task python3:3473.
[ 1235.781154] task:python3 state:D stack:25672 pid:3473 tgid:3473 ppid:3472 task_flags:0x400100 flags:0x00080802
[ 1235.794356] Call Trace:
[ 1235.797894]
[ 1235.801047] __schedule+0xcc3/0x19c0
[ 1235.805860] ? io_schedule_timeout+0x140/0x140
[ 1235.811644] ? find_held_lock+0x2b/0x80
[ 1235.816750] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.822927] schedule+0xd8/0x260
[ 1235.827347] schedule_timeout+0x13f/0x290
[ 1235.832644] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.839013] ? trace_contention_end+0xb3/0x1a0
[ 1235.844793] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.850484] ? ww_mutex_lock+0x160/0x160
[ 1235.855684] msleep+0x1b/0x30
[ 1235.859808] napi_set_threaded+0x3a5/0x440
[ 1235.865206] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.870701] netif_set_threaded+0x257/0x400
[ 1235.876195] threaded_store+0x1b8/0x220
[ 1235.881300] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.886598] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.891892] ? sysfs_kf_write+0x65/0x160
[ 1235.897095] ? sysfs_file_ops+0x140/0x140
[ 1235.902392] kernfs_fop_write_iter+0x335/0x510
[ 1235.908177] ? kernfs_ops+0xf0/0xf0
[ 1235.912879] new_sync_write+0x333/0x750
[ 1235.917980] ? __lock_acquire+0x508/0xc10
[ 1235.923276] ? new_sync_read+0x740/0x740
[ 1235.928478] ? lock_acquire.part.0+0xbc/0x260
[ 1235.934164] ? ksys_write+0x116/0x250
[ 1235.939074] vfs_write+0x657/0x9b0
[ 1235.943690] ksys_write+0x116/0x250
[ 1235.948395] ? __ia32_sys_read+0xc0/0xc0
[ 1235.953594] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.959185] ? rcu_is_watching+0x15/0xd0
[ 1235.964383] do_syscall_64+0xf3/0x650
[ 1235.969289] ? trace_hardirqs_off+0xd/0x30
[ 1235.974684] ? exc_page_fault+0xda/0xf0
[ 1235.979785] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.986253] RIP: 0033:0x7f5f545b664e
[ 1235.991062] RSP: 002b:00007ffe8af5a3f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.000361] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5f545b664e
[ 1236.009167] RDX: 0000000000000001 RSI: 000055e63a15ebf0 RDI: 0000000000000007
[ 1236.017978] RBP: 00007ffe8af5a400 R08: 0000000000000000 R09: 0000000000000000
[ 1236.026784] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5f5442f390
[ 1236.035593] R13: 000055e63a15ebf0 R14: 0000000000000007 R15: 00007f5f543c5120
[ 1236.044405]
[ 1236.047671] \x0aShowing all locks held in the system:
[ 1236.056212] 1 lock held by khungtaskd/185:
[ 1236.061604] #0: ffffffff9eafdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.073084] 4 locks held by python3/3473:
[ 1236.078378] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.088269] #1: ff11000142810e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.099230] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.110387] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.120480] 4 locks held by python3/5450:
[ 1236.125776] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.135662] #1: ff11000186cb7a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.146625] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.157781] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.167874]
[ 1236.170342] =============================================\x0a
[ 1358.371383] INFO: task python3:5450 blocked for more than 491 seconds.
[ 1358.379546] Not tainted 7.1.0-rc7-acex-g2c092311e30d #1
[ 1358.386796] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.396383] task:python3 state:D stack:25672 pid:5450 tgid:5450 ppid:5449 task_flags:0x400100 flags:0x00080002
[ 1358.409590] Call Trace:
[ 1358.413129]
[ 1358.416281] __schedule+0xcc3/0x19c0
[ 1358.421096] ? io_schedule_timeout+0x140/0x140
[ 1358.426880] ? find_held_lock+0x2b/0x80
[ 1358.431982] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.437868] schedule+0xd8/0x260
[ 1358.442284] schedule_preempt_disabled+0x18/0x30
[ 1358.448263] __mutex_lock+0x6af/0x2010
[ 1358.453267] ? threaded_store+0x132/0x220
[ 1358.458558] ? ww_mutex_lock+0x160/0x160
[ 1358.463756] ? selinux_inode_free_security+0x330/0x330
[ 1358.470316] ? cap_capable+0x1d6/0x3e0
[ 1358.475323] ? threaded_store+0x132/0x220
[ 1358.480620] threaded_store+0x132/0x220
[ 1358.485718] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.491014] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.496310] ? sysfs_kf_write+0x65/0x160
[ 1358.501512] ? sysfs_file_ops+0x140/0x140
[ 1358.506806] kernfs_fop_write_iter+0x335/0x510
[ 1358.512589] ? kernfs_ops+0xf0/0xf0
[ 1358.517299] new_sync_write+0x333/0x750
[ 1358.522399] ? __lock_acquire+0x508/0xc10
[ 1358.527693] ? new_sync_read+0x740/0x740
[ 1358.532895] ? lock_acquire.part.0+0xbc/0x260
[ 1358.538580] ? ksys_write+0x116/0x250
[ 1358.543487] vfs_write+0x657/0x9b0
[ 1358.548101] ksys_write+0x116/0x250
[ 1358.552811] ? __ia32_sys_read+0xc0/0xc0
[ 1358.558007] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.563596] ? rcu_is_watching+0x15/0xd0
[ 1358.568797] do_syscall_64+0xf3/0x650
[ 1358.573704] ? trace_hardirqs_off+0xd/0x30
[ 1358.579098] ? exc_page_fault+0xda/0xf0
[ 1358.584197] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.590662] RIP: 0033:0x7f2d7486e64e
[ 1358.595470] RSP: 002b:00007ffddaf60940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.604769] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2d7486e64e
[ 1358.613574] RDX: 0000000000000001 RSI: 00005572d4726bf0 RDI: 0000000000000007
[ 1358.622379] RBP: 00007ffddaf60950 R08: 0000000000000000 R09: 0000000000000000
[ 1358.631183] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2d746e7390
[ 1358.639990] R13: 00005572d4726bf0 R14: 0000000000000007 R15: 00007f2d7467d120
[ 1358.648799]
[ 1358.652105] INFO: task python3:5450 is blocked on a mutex likely owned by task python3:3473.
[ 1358.662375] task:python3 state:D stack:25672 pid:3473 tgid:3473 ppid:3472 task_flags:0x400100 flags:0x00080802
[ 1358.675575] Call Trace:
[ 1358.679114]
[ 1358.682262] __schedule+0xcc3/0x19c0
[ 1358.687073] ? io_schedule_timeout+0x140/0x140
[ 1358.692858] ? find_held_lock+0x2b/0x80
[ 1358.697961] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.704136] schedule+0xd8/0x260
[ 1358.708552] schedule_timeout+0x13f/0x290
[ 1358.713847] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.720219] ? trace_contention_end+0xb3/0x1a0
[ 1358.726002] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.731692] ? ww_mutex_lock+0x160/0x160
[ 1358.736891] msleep+0x1b/0x30
[ 1358.741017] napi_set_threaded+0x3a5/0x440
[ 1358.746411] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.751905] netif_set_threaded+0x257/0x400
[ 1358.757399] threaded_store+0x1b8/0x220
[ 1358.762500] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.767795] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.773090] ? sysfs_kf_write+0x65/0x160
[ 1358.778289] ? sysfs_file_ops+0x140/0x140
[ 1358.783584] kernfs_fop_write_iter+0x335/0x510
[ 1358.789369] ? kernfs_ops+0xf0/0xf0
[ 1358.794072] new_sync_write+0x333/0x750
[ 1358.799174] ? __lock_acquire+0x508/0xc10
[ 1358.804470] ? new_sync_read+0x740/0x740
[ 1358.809671] ? lock_acquire.part.0+0xbc/0x260
[ 1358.815347] ? ksys_write+0x116/0x250
[ 1358.820255] vfs_write+0x657/0x9b0
[ 1358.824867] ksys_write+0x116/0x250
[ 1358.829579] ? __ia32_sys_read+0xc0/0xc0
[ 1358.834768] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.840353] ? rcu_is_watching+0x15/0xd0
[ 1358.845552] do_syscall_64+0xf3/0x650
[ 1358.850457] ? trace_hardirqs_off+0xd/0x30
[ 1358.855853] ? exc_page_fault+0xda/0xf0
[ 1358.860956] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.867421] RIP: 0033:0x7f5f545b664e
[ 1358.872230] RSP: 002b:00007ffe8af5a3f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.881525] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5f545b664e
[ 1358.890331] RDX: 0000000000000001 RSI: 000055e63a15ebf0 RDI: 0000000000000007
[ 1358.899136] RBP: 00007ffe8af5a400 R08: 0000000000000000 R09: 0000000000000000
[ 1358.907943] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5f5442f390
[ 1358.916740] R13: 000055e63a15ebf0 R14: 0000000000000007 R15: 00007f5f543c5120
[ 1358.925553]
[ 1358.928824] \x0aShowing all locks held in the system:
[ 1358.937364] 1 lock held by khungtaskd/185:
[ 1358.942757] #0: ffffffff9eafdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.954239] 3 locks held by systemd-journal/803:
[ 1358.960219] #0: ff1100180e6374e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.970107] #1: ffffffff9ed02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: link_path_walk+0x9a7/0x1830
[ 1358.982724] #2: ff1100019fe5a4f0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.994283] 4 locks held by python3/3473:
[ 1358.999578] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.009463] #1: ff11000142810e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.020423] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.031577] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.041674] 4 locks held by python3/5450:
[ 1359.046970] #0: ff1100012fd593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.056856] #1: ff11000186cb7a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.067818] #2: ff11000121fcab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.078975] #3: ff11000121fa1e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.089064]
[ 1359.091528] =============================================\x0a