[ 787.674965] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 787.677952] nipa-hw-worker: [5/44] Retrying drivers/net:napi_threaded.py
[ 787.803410] kselftest: Running tests in drivers/net
[ 989.700670] INFO: task python3:5943 blocked for more than 122 seconds.
[ 989.708888] Not tainted 7.1.0-rc1-pmpt-g087fd7c22a0c #1
[ 989.716692] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.726285] task:python3 state:D stack:25672 pid:5943 tgid:5943 ppid:5942 task_flags:0x400100 flags:0x00080000
[ 989.739590] Call Trace:
[ 989.743129]
[ 989.746282] __schedule+0xcba/0x1940
[ 989.751099] ? io_schedule_timeout+0x140/0x140
[ 989.756883] ? find_held_lock+0x2b/0x80
[ 989.761978] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.767867] schedule+0xd4/0x260
[ 989.772286] schedule_preempt_disabled+0x18/0x30
[ 989.778264] __mutex_lock+0x6a3/0x2000
[ 989.783270] ? threaded_store+0x132/0x220
[ 989.788570] ? ww_mutex_lock+0x160/0x160
[ 989.793768] ? selinux_inode_free_security+0x330/0x330
[ 989.800340] ? cap_capable+0x1d6/0x3e0
[ 989.805346] ? threaded_store+0x132/0x220
[ 989.810640] threaded_store+0x132/0x220
[ 989.815744] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.821043] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.826344] ? sysfs_kf_write+0x65/0x160
[ 989.831546] ? sysfs_file_ops+0x140/0x140
[ 989.836840] kernfs_fop_write_iter+0x335/0x510
[ 989.842626] ? kernfs_ops+0xf0/0xf0
[ 989.847339] new_sync_write+0x333/0x750
[ 989.852441] ? __lock_acquire+0x508/0xc10
[ 989.857739] ? new_sync_read+0x740/0x740
[ 989.862939] ? lock_acquire.part.0+0xbc/0x260
[ 989.868618] ? ksys_write+0x116/0x250
[ 989.873530] vfs_write+0x657/0x9b0
[ 989.878146] ksys_write+0x116/0x250
[ 989.882857] ? __ia32_sys_read+0xc0/0xc0
[ 989.888056] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.893644] ? rcu_is_watching+0x15/0xd0
[ 989.898846] do_syscall_64+0xf3/0x650
[ 989.903753] ? trace_hardirqs_off+0xd/0x30
[ 989.909139] ? exc_page_fault+0xda/0xf0
[ 989.914244] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.920710] RIP: 0033:0x7ff3c821e22e
[ 989.925519] RSP: 002b:00007ffcc8dd5d50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.934816] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff3c821e22e
[ 989.943623] RDX: 0000000000000001 RSI: 000055c742c7e410 RDI: 0000000000000007
[ 989.952430] RBP: 00007ffcc8dd5d60 R08: 0000000000000000 R09: 0000000000000000
[ 989.961241] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff3c8096390
[ 989.970060] R13: 000055c742c7e410 R14: 0000000000000007 R15: 0000000000000003
[ 989.978897]
[ 989.982191] INFO: task python3:5943 is blocked on a mutex likely owned by task python3:3855.
[ 989.992463] task:python3 state:D stack:25672 pid:3855 tgid:3855 ppid:3854 task_flags:0x400100 flags:0x00080802
[ 990.005669] Call Trace:
[ 990.009210]
[ 990.012364] __schedule+0xcba/0x1940
[ 990.017178] ? io_schedule_timeout+0x140/0x140
[ 990.022962] ? find_held_lock+0x2b/0x80
[ 990.028059] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.034240] schedule+0xd4/0x260
[ 990.038660] schedule_timeout+0x13f/0x290
[ 990.043958] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.050329] ? trace_contention_end+0xb3/0x1a0
[ 990.056116] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.061811] ? ww_mutex_lock+0x160/0x160
[ 990.067013] msleep+0x1b/0x30
[ 990.071141] napi_set_threaded+0x3a5/0x440
[ 990.076539] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.082033] netif_set_threaded+0x257/0x400
[ 990.087528] threaded_store+0x1b8/0x220
[ 990.092630] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.097930] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.103225] ? sysfs_kf_write+0x65/0x160
[ 990.108424] ? sysfs_file_ops+0x140/0x140
[ 990.113722] kernfs_fop_write_iter+0x335/0x510
[ 990.119508] ? kernfs_ops+0xf0/0xf0
[ 990.124221] new_sync_write+0x333/0x750
[ 990.129324] ? __lock_acquire+0x508/0xc10
[ 990.134610] ? new_sync_read+0x740/0x740
[ 990.139812] ? lock_acquire.part.0+0xbc/0x260
[ 990.145504] ? ksys_write+0x116/0x250
[ 990.150414] vfs_write+0x657/0x9b0
[ 990.155031] ksys_write+0x116/0x250
[ 990.159744] ? __ia32_sys_read+0xc0/0xc0
[ 990.164944] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.170536] ? rcu_is_watching+0x15/0xd0
[ 990.175735] do_syscall_64+0xf3/0x650
[ 990.180639] ? trace_hardirqs_off+0xd/0x30
[ 990.186035] ? exc_page_fault+0xda/0xf0
[ 990.191138] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.197597] RIP: 0033:0x7f8f3d0ee22e
[ 990.202408] RSP: 002b:00007fffdafb26a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.211705] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8f3d0ee22e
[ 990.220509] RDX: 0000000000000001 RSI: 0000562e7cf7b410 RDI: 0000000000000007
[ 990.229328] RBP: 00007fffdafb26b0 R08: 0000000000000000 R09: 0000000000000000
[ 990.238139] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8f3cf66390
[ 990.246949] R13: 0000562e7cf7b410 R14: 0000000000000007 R15: 0000000000000003
[ 990.255762]
[ 990.259019] \x0aShowing all locks held in the system:
[ 990.267560] 1 lock held by khungtaskd/185:
[ 990.272953] #0: ffffffff88cfdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.284431] 3 locks held by systemd-journal/807:
[ 990.290409] #0: ff1100180dab72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.300297] #1: ffffffff88f030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.313112] #2: ff110001a59c3990 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.324674] 4 locks held by python3/3855:
[ 990.329970] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.339860] #1: ff1100017fbad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.350820] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.361979] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.372080] 4 locks held by python3/5943:
[ 990.377377] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.387264] #1: ff110001e6cfdc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.398227] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.409385] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.419471]
[ 990.421940] =============================================\x0a
[ 1112.582788] INFO: task python3:5943 blocked for more than 245 seconds.
[ 1112.590938] Not tainted 7.1.0-rc1-pmpt-g087fd7c22a0c #1
[ 1112.598190] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.607781] task:python3 state:D stack:25672 pid:5943 tgid:5943 ppid:5942 task_flags:0x400100 flags:0x00080000
[ 1112.620988] Call Trace:
[ 1112.624529]
[ 1112.627678] __schedule+0xcba/0x1940
[ 1112.632498] ? io_schedule_timeout+0x140/0x140
[ 1112.638282] ? find_held_lock+0x2b/0x80
[ 1112.643391] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.649275] schedule+0xd4/0x260
[ 1112.653687] schedule_preempt_disabled+0x18/0x30
[ 1112.659664] __mutex_lock+0x6a3/0x2000
[ 1112.664669] ? threaded_store+0x132/0x220
[ 1112.669971] ? ww_mutex_lock+0x160/0x160
[ 1112.675171] ? selinux_inode_free_security+0x330/0x330
[ 1112.681740] ? cap_capable+0x1d6/0x3e0
[ 1112.686750] ? threaded_store+0x132/0x220
[ 1112.692050] threaded_store+0x132/0x220
[ 1112.697152] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.702450] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.707748] ? sysfs_kf_write+0x65/0x160
[ 1112.712948] ? sysfs_file_ops+0x140/0x140
[ 1112.718247] kernfs_fop_write_iter+0x335/0x510
[ 1112.724034] ? kernfs_ops+0xf0/0xf0
[ 1112.728745] new_sync_write+0x333/0x750
[ 1112.733850] ? __lock_acquire+0x508/0xc10
[ 1112.739140] ? new_sync_read+0x740/0x740
[ 1112.744342] ? lock_acquire.part.0+0xbc/0x260
[ 1112.750030] ? ksys_write+0x116/0x250
[ 1112.754940] vfs_write+0x657/0x9b0
[ 1112.759557] ksys_write+0x116/0x250
[ 1112.764269] ? __ia32_sys_read+0xc0/0xc0
[ 1112.769468] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.775059] ? rcu_is_watching+0x15/0xd0
[ 1112.780259] do_syscall_64+0xf3/0x650
[ 1112.785168] ? trace_hardirqs_off+0xd/0x30
[ 1112.790565] ? exc_page_fault+0xda/0xf0
[ 1112.795668] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.802139] RIP: 0033:0x7ff3c821e22e
[ 1112.806949] RSP: 002b:00007ffcc8dd5d50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.816237] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff3c821e22e
[ 1112.825038] RDX: 0000000000000001 RSI: 000055c742c7e410 RDI: 0000000000000007
[ 1112.833848] RBP: 00007ffcc8dd5d60 R08: 0000000000000000 R09: 0000000000000000
[ 1112.842657] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff3c8096390
[ 1112.851467] R13: 000055c742c7e410 R14: 0000000000000007 R15: 0000000000000003
[ 1112.860281]
[ 1112.863548] INFO: task python3:5943 is blocked on a mutex likely owned by task python3:3855.
[ 1112.873822] task:python3 state:D stack:25672 pid:3855 tgid:3855 ppid:3854 task_flags:0x400100 flags:0x00080802
[ 1112.887025] Call Trace:
[ 1112.890563]
[ 1112.893716] __schedule+0xcba/0x1940
[ 1112.898528] ? io_schedule_timeout+0x140/0x140
[ 1112.904313] ? find_held_lock+0x2b/0x80
[ 1112.909417] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.915599] schedule+0xd4/0x260
[ 1112.920018] schedule_timeout+0x13f/0x290
[ 1112.925315] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.931684] ? trace_contention_end+0xb3/0x1a0
[ 1112.937463] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.943155] ? ww_mutex_lock+0x160/0x160
[ 1112.948357] msleep+0x1b/0x30
[ 1112.952483] napi_set_threaded+0x3a5/0x440
[ 1112.957881] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.963374] netif_set_threaded+0x257/0x400
[ 1112.968867] threaded_store+0x1b8/0x220
[ 1112.973969] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.979268] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.984566] ? sysfs_kf_write+0x65/0x160
[ 1112.989766] ? sysfs_file_ops+0x140/0x140
[ 1112.995055] kernfs_fop_write_iter+0x335/0x510
[ 1113.000833] ? kernfs_ops+0xf0/0xf0
[ 1113.005544] new_sync_write+0x333/0x750
[ 1113.010646] ? __lock_acquire+0x508/0xc10
[ 1113.015942] ? new_sync_read+0x740/0x740
[ 1113.021144] ? lock_acquire.part.0+0xbc/0x260
[ 1113.026831] ? ksys_write+0x116/0x250
[ 1113.031733] vfs_write+0x657/0x9b0
[ 1113.036350] ksys_write+0x116/0x250
[ 1113.041067] ? __ia32_sys_read+0xc0/0xc0
[ 1113.046269] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.051860] ? rcu_is_watching+0x15/0xd0
[ 1113.057058] do_syscall_64+0xf3/0x650
[ 1113.061967] ? trace_hardirqs_off+0xd/0x30
[ 1113.067361] ? exc_page_fault+0xda/0xf0
[ 1113.072455] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.078915] RIP: 0033:0x7f8f3d0ee22e
[ 1113.083725] RSP: 002b:00007fffdafb26a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.093023] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8f3d0ee22e
[ 1113.101833] RDX: 0000000000000001 RSI: 0000562e7cf7b410 RDI: 0000000000000007
[ 1113.110642] RBP: 00007fffdafb26b0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.119453] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8f3cf66390
[ 1113.128262] R13: 0000562e7cf7b410 R14: 0000000000000007 R15: 0000000000000003
[ 1113.137075]
[ 1113.140335] \x0aShowing all locks held in the system:
[ 1113.148875] 1 lock held by khungtaskd/185:
[ 1113.154267] #0: ffffffff88cfdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.165748] 4 locks held by python3/3855:
[ 1113.171044] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.180937] #1: ff1100017fbad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.191901] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.203056] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.213149] 4 locks held by python3/5943:
[ 1113.218445] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.228333] #1: ff110001e6cfdc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.239294] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.250446] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.260537]
[ 1113.263004] =============================================\x0a
[ 1235.462946] INFO: task python3:5943 blocked for more than 368 seconds.
[ 1235.471095] Not tainted 7.1.0-rc1-pmpt-g087fd7c22a0c #1
[ 1235.478347] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.487938] task:python3 state:D stack:25672 pid:5943 tgid:5943 ppid:5942 task_flags:0x400100 flags:0x00080002
[ 1235.501143] Call Trace:
[ 1235.504682]
[ 1235.507832] __schedule+0xcba/0x1940
[ 1235.512653] ? io_schedule_timeout+0x140/0x140
[ 1235.518439] ? find_held_lock+0x2b/0x80
[ 1235.523546] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.529432] schedule+0xd4/0x260
[ 1235.533853] schedule_preempt_disabled+0x18/0x30
[ 1235.539830] __mutex_lock+0x6a3/0x2000
[ 1235.544837] ? threaded_store+0x132/0x220
[ 1235.550139] ? ww_mutex_lock+0x160/0x160
[ 1235.555338] ? selinux_inode_free_security+0x330/0x330
[ 1235.561908] ? cap_capable+0x1d6/0x3e0
[ 1235.566916] ? threaded_store+0x132/0x220
[ 1235.572213] threaded_store+0x132/0x220
[ 1235.577313] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.577318] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.577323] ? sysfs_kf_write+0x65/0x160
[ 1235.577327] ? sysfs_file_ops+0x140/0x140
[ 1235.577329] kernfs_fop_write_iter+0x335/0x510
[ 1235.604231] ? kernfs_ops+0xf0/0xf0
[ 1235.608941] new_sync_write+0x333/0x750
[ 1235.614047] ? __lock_acquire+0x508/0xc10
[ 1235.619345] ? new_sync_read+0x740/0x740
[ 1235.624545] ? lock_acquire.part.0+0xbc/0x260
[ 1235.630233] ? ksys_write+0x116/0x250
[ 1235.635146] vfs_write+0x657/0x9b0
[ 1235.639760] ksys_write+0x116/0x250
[ 1235.644472] ? __ia32_sys_read+0xc0/0xc0
[ 1235.649671] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.655259] ? rcu_is_watching+0x15/0xd0
[ 1235.660454] do_syscall_64+0xf3/0x650
[ 1235.665362] ? trace_hardirqs_off+0xd/0x30
[ 1235.670757] ? exc_page_fault+0xda/0xf0
[ 1235.675859] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.682327] RIP: 0033:0x7ff3c821e22e
[ 1235.687127] RSP: 002b:00007ffcc8dd5d50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.696424] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff3c821e22e
[ 1235.705232] RDX: 0000000000000001 RSI: 000055c742c7e410 RDI: 0000000000000007
[ 1235.714040] RBP: 00007ffcc8dd5d60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.722840] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff3c8096390
[ 1235.731647] R13: 000055c742c7e410 R14: 0000000000000007 R15: 0000000000000003
[ 1235.740459]
[ 1235.743756] INFO: task python3:5943 is blocked on a mutex likely owned by task python3:3855.
[ 1235.754029] task:python3 state:D stack:25672 pid:3855 tgid:3855 ppid:3854 task_flags:0x400100 flags:0x00080802
[ 1235.767230] Call Trace:
[ 1235.770767]
[ 1235.773917] __schedule+0xcba/0x1940
[ 1235.778728] ? io_schedule_timeout+0x140/0x140
[ 1235.784512] ? find_held_lock+0x2b/0x80
[ 1235.789615] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.795796] schedule+0xd4/0x260
[ 1235.800213] schedule_timeout+0x13f/0x290
[ 1235.805509] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.811877] ? trace_contention_end+0xb3/0x1a0
[ 1235.817662] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.823352] ? ww_mutex_lock+0x160/0x160
[ 1235.828552] msleep+0x1b/0x30
[ 1235.832676] napi_set_threaded+0x3a5/0x440
[ 1235.838071] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.843568] netif_set_threaded+0x257/0x400
[ 1235.849060] threaded_store+0x1b8/0x220
[ 1235.854156] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.859453] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.864756] ? sysfs_kf_write+0x65/0x160
[ 1235.869956] ? sysfs_file_ops+0x140/0x140
[ 1235.875242] kernfs_fop_write_iter+0x335/0x510
[ 1235.881028] ? kernfs_ops+0xf0/0xf0
[ 1235.885729] new_sync_write+0x333/0x750
[ 1235.890831] ? __lock_acquire+0x508/0xc10
[ 1235.896129] ? new_sync_read+0x740/0x740
[ 1235.901329] ? lock_acquire.part.0+0xbc/0x260
[ 1235.907013] ? ksys_write+0x116/0x250
[ 1235.911922] vfs_write+0x657/0x9b0
[ 1235.916539] ksys_write+0x116/0x250
[ 1235.921252] ? __ia32_sys_read+0xc0/0xc0
[ 1235.926453] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.932042] ? rcu_is_watching+0x15/0xd0
[ 1235.937244] do_syscall_64+0xf3/0x650
[ 1235.942151] ? trace_hardirqs_off+0xd/0x30
[ 1235.947545] ? exc_page_fault+0xda/0xf0
[ 1235.952645] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.959112] RIP: 0033:0x7f8f3d0ee22e
[ 1235.963920] RSP: 002b:00007fffdafb26a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.973218] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8f3d0ee22e
[ 1235.982025] RDX: 0000000000000001 RSI: 0000562e7cf7b410 RDI: 0000000000000007
[ 1235.990835] RBP: 00007fffdafb26b0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.999642] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8f3cf66390
[ 1236.008451] R13: 0000562e7cf7b410 R14: 0000000000000007 R15: 0000000000000003
[ 1236.017263]
[ 1236.020528] \x0aShowing all locks held in the system:
[ 1236.029097] 1 lock held by khungtaskd/185:
[ 1236.034491] #0: ffffffff88cfdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.045963] 3 locks held by systemd-journal/807:
[ 1236.051941] #0: ff1100180e3372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1236.061832] #1: ffffffff88f030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.074648] #2: ff110001a59c3990 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.086205] 4 locks held by python3/3855:
[ 1236.091502] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.101389] #1: ff1100017fbad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.112351] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.123508] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.133597] 4 locks held by python3/5943:
[ 1236.138895] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.148774] #1: ff110001e6cfdc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.159736] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.170894] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.180981] 5 locks held by (systemd-user-)/7347:
[ 1236.187055] #0: ff110001309293e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.196943] #1: ff110001d9fae280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.207907] #2: ffffffff88d69c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1236.218574] #3: ffffffff88b68970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0
[ 1236.230217] #4: ffffffff88d69990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0
[ 1236.242641]
[ 1236.245105] =============================================\x0a
[ 1358.345037] INFO: task python3:5943 blocked for more than 491 seconds.
[ 1358.353185] Not tainted 7.1.0-rc1-pmpt-g087fd7c22a0c #1
[ 1358.360436] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.370028] task:python3 state:D stack:25672 pid:5943 tgid:5943 ppid:5942 task_flags:0x400100 flags:0x00080002
[ 1358.383236] Call Trace:
[ 1358.386776]
[ 1358.389930] __schedule+0xcba/0x1940
[ 1358.394747] ? io_schedule_timeout+0x140/0x140
[ 1358.400534] ? find_held_lock+0x2b/0x80
[ 1358.405641] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.411525] schedule+0xd4/0x260
[ 1358.415944] schedule_preempt_disabled+0x18/0x30
[ 1358.421925] __mutex_lock+0x6a3/0x2000
[ 1358.426933] ? threaded_store+0x132/0x220
[ 1358.432231] ? ww_mutex_lock+0x160/0x160
[ 1358.437431] ? selinux_inode_free_security+0x330/0x330
[ 1358.444000] ? cap_capable+0x1d6/0x3e0
[ 1358.449009] ? threaded_store+0x132/0x220
[ 1358.454306] threaded_store+0x132/0x220
[ 1358.459399] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.464698] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.469999] ? sysfs_kf_write+0x65/0x160
[ 1358.475199] ? sysfs_file_ops+0x140/0x140
[ 1358.480486] kernfs_fop_write_iter+0x335/0x510
[ 1358.486270] ? kernfs_ops+0xf0/0xf0
[ 1358.490981] new_sync_write+0x333/0x750
[ 1358.496085] ? __lock_acquire+0x508/0xc10
[ 1358.501381] ? new_sync_read+0x740/0x740
[ 1358.506584] ? lock_acquire.part.0+0xbc/0x260
[ 1358.512270] ? ksys_write+0x116/0x250
[ 1358.517179] vfs_write+0x657/0x9b0
[ 1358.521797] ksys_write+0x116/0x250
[ 1358.526510] ? __ia32_sys_read+0xc0/0xc0
[ 1358.531708] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.537298] ? rcu_is_watching+0x15/0xd0
[ 1358.542498] do_syscall_64+0xf3/0x650
[ 1358.547407] ? trace_hardirqs_off+0xd/0x30
[ 1358.552803] ? exc_page_fault+0xda/0xf0
[ 1358.557906] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.564377] RIP: 0033:0x7ff3c821e22e
[ 1358.569187] RSP: 002b:00007ffcc8dd5d50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.578485] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff3c821e22e
[ 1358.587295] RDX: 0000000000000001 RSI: 000055c742c7e410 RDI: 0000000000000007
[ 1358.596104] RBP: 00007ffcc8dd5d60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.604913] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff3c8096390
[ 1358.613721] R13: 000055c742c7e410 R14: 0000000000000007 R15: 0000000000000003
[ 1358.622534]
[ 1358.625807] INFO: task python3:5943 is blocked on a mutex likely owned by task python3:3855.
[ 1358.636081] task:python3 state:D stack:25672 pid:3855 tgid:3855 ppid:3854 task_flags:0x400100 flags:0x00080802
[ 1358.649283] Call Trace:
[ 1358.652821]
[ 1358.655973] __schedule+0xcba/0x1940
[ 1358.660786] ? io_schedule_timeout+0x140/0x140
[ 1358.666571] ? find_held_lock+0x2b/0x80
[ 1358.671675] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.677855] schedule+0xd4/0x260
[ 1358.682273] schedule_timeout+0x13f/0x290
[ 1358.687570] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.693940] ? trace_contention_end+0xb3/0x1a0
[ 1358.699727] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.705419] ? ww_mutex_lock+0x160/0x160
[ 1358.710618] msleep+0x1b/0x30
[ 1358.714734] napi_set_threaded+0x3a5/0x440
[ 1358.720132] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.725629] netif_set_threaded+0x257/0x400
[ 1358.731122] threaded_store+0x1b8/0x220
[ 1358.736228] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.741525] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.746823] ? sysfs_kf_write+0x65/0x160
[ 1358.752014] ? sysfs_file_ops+0x140/0x140
[ 1358.757302] kernfs_fop_write_iter+0x335/0x510
[ 1358.763089] ? kernfs_ops+0xf0/0xf0
[ 1358.767801] new_sync_write+0x333/0x750
[ 1358.772904] ? __lock_acquire+0x508/0xc10
[ 1358.778199] ? new_sync_read+0x740/0x740
[ 1358.783400] ? lock_acquire.part.0+0xbc/0x260
[ 1358.789085] ? ksys_write+0x116/0x250
[ 1358.793994] vfs_write+0x657/0x9b0
[ 1358.798611] ksys_write+0x116/0x250
[ 1358.803324] ? __ia32_sys_read+0xc0/0xc0
[ 1358.808525] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.814115] ? rcu_is_watching+0x15/0xd0
[ 1358.819314] do_syscall_64+0xf3/0x650
[ 1358.824219] ? trace_hardirqs_off+0xd/0x30
[ 1358.829613] ? exc_page_fault+0xda/0xf0
[ 1358.834716] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.841184] RIP: 0033:0x7f8f3d0ee22e
[ 1358.845992] RSP: 002b:00007fffdafb26a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.855289] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8f3d0ee22e
[ 1358.864090] RDX: 0000000000000001 RSI: 0000562e7cf7b410 RDI: 0000000000000007
[ 1358.872898] RBP: 00007fffdafb26b0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.881708] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8f3cf66390
[ 1358.890516] R13: 0000562e7cf7b410 R14: 0000000000000007 R15: 0000000000000003
[ 1358.899329]
[ 1358.902599] \x0aShowing all locks held in the system:
[ 1358.911138] 1 lock held by khungtaskd/185:
[ 1358.916534] #0: ffffffff88cfdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.928003] 4 locks held by python3/3855:
[ 1358.933301] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.943190] #1: ff1100017fbad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.954151] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.965310] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.975402] 4 locks held by python3/5943:
[ 1358.980700] #0: ff110001307f93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.990590] #1: ff110001e6cfdc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.001555] #2: ff110001230e2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.012711] #3: ff11000123159d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.022805]
[ 1359.025272] =============================================\x0a