[ 786.010669] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 786.013136] nipa-hw-worker: [5/44] Retrying drivers/net:napi_threaded.py
[ 786.169359] kselftest: Running tests in drivers/net
[ 989.707371] INFO: task python3:5878 blocked for more than 122 seconds.
[ 989.715587] Not tainted 7.1.0-rc1-smkz-gc22b47f6489b #1
[ 989.723295] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.732884] task:python3 state:D stack:25672 pid:5878 tgid:5878 ppid:5877 task_flags:0x400100 flags:0x00080000
[ 989.746087] Call Trace:
[ 989.749628]
[ 989.752777] __schedule+0xcba/0x1940
[ 989.757598] ? io_schedule_timeout+0x140/0x140
[ 989.763385] ? find_held_lock+0x2b/0x80
[ 989.768489] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.774374] schedule+0xd4/0x260
[ 989.778789] schedule_preempt_disabled+0x18/0x30
[ 989.784765] __mutex_lock+0x6a3/0x2000
[ 989.789769] ? threaded_store+0x132/0x220
[ 989.795058] ? ww_mutex_lock+0x160/0x160
[ 989.800256] ? selinux_inode_free_security+0x330/0x330
[ 989.806817] ? cap_capable+0x1d6/0x3e0
[ 989.811825] ? threaded_store+0x132/0x220
[ 989.817124] threaded_store+0x132/0x220
[ 989.822223] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.827518] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.832818] ? sysfs_kf_write+0x65/0x160
[ 989.838009] ? sysfs_file_ops+0x140/0x140
[ 989.843302] kernfs_fop_write_iter+0x335/0x510
[ 989.849086] ? kernfs_ops+0xf0/0xf0
[ 989.853796] new_sync_write+0x333/0x750
[ 989.858897] ? __lock_acquire+0x508/0xc10
[ 989.864193] ? new_sync_read+0x740/0x740
[ 989.869398] ? lock_acquire.part.0+0xbc/0x260
[ 989.875077] ? ksys_write+0x116/0x250
[ 989.879978] vfs_write+0x657/0x9b0
[ 989.884591] ksys_write+0x116/0x250
[ 989.889302] ? __ia32_sys_read+0xc0/0xc0
[ 989.894498] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.900085] ? rcu_is_watching+0x15/0xd0
[ 989.905287] do_syscall_64+0xf3/0x650
[ 989.910193] ? trace_hardirqs_off+0xd/0x30
[ 989.915591] ? exc_page_fault+0xda/0xf0
[ 989.920690] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.927156] RIP: 0033:0x7f4cd9f7322e
[ 989.931966] RSP: 002b:00007ffe96b5a5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.941262] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd9f7322e
[ 989.950071] RDX: 0000000000000001 RSI: 0000560cbe2d6a10 RDI: 0000000000000007
[ 989.958868] RBP: 00007ffe96b5a600 R08: 0000000000000000 R09: 0000000000000000
[ 989.967678] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd9deb390
[ 989.976484] R13: 0000560cbe2d6a10 R14: 0000000000000007 R15: 0000000000000003
[ 989.985296]
[ 989.988626] INFO: task python3:5878 is blocked on a mutex likely owned by task python3:3748.
[ 989.998902] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 990.012108] Call Trace:
[ 990.015644]
[ 990.018796] __schedule+0xcba/0x1940
[ 990.023609] ? io_schedule_timeout+0x140/0x140
[ 990.029390] ? find_held_lock+0x2b/0x80
[ 990.034492] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.040669] schedule+0xd4/0x260
[ 990.045087] schedule_timeout+0x13f/0x290
[ 990.050384] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.056754] ? trace_contention_end+0xb3/0x1a0
[ 990.062536] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.068224] ? ww_mutex_lock+0x160/0x160
[ 990.073426] msleep+0x1b/0x30
[ 990.077548] napi_set_threaded+0x3a5/0x440
[ 990.082941] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.088434] netif_set_threaded+0x257/0x400
[ 990.093919] threaded_store+0x1b8/0x220
[ 990.099020] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.104314] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.109611] ? sysfs_kf_write+0x65/0x160
[ 990.114807] ? sysfs_file_ops+0x140/0x140
[ 990.120100] kernfs_fop_write_iter+0x335/0x510
[ 990.125883] ? kernfs_ops+0xf0/0xf0
[ 990.130593] new_sync_write+0x333/0x750
[ 990.135696] ? __lock_acquire+0x508/0xc10
[ 990.140984] ? new_sync_read+0x740/0x740
[ 990.146186] ? lock_acquire.part.0+0xbc/0x260
[ 990.151873] ? ksys_write+0x116/0x250
[ 990.156781] vfs_write+0x657/0x9b0
[ 990.161396] ksys_write+0x116/0x250
[ 990.166106] ? __ia32_sys_read+0xc0/0xc0
[ 990.171303] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.176892] ? rcu_is_watching+0x15/0xd0
[ 990.182082] do_syscall_64+0xf3/0x650
[ 990.186988] ? irq_exit_rcu+0x1a/0x30
[ 990.191895] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.198361] RIP: 0033:0x7f587555422e
[ 990.203158] RSP: 002b:00007ffec392c770 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.212455] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f587555422e
[ 990.221261] RDX: 0000000000000001 RSI: 000055dfc15e8a10 RDI: 0000000000000007
[ 990.230071] RBP: 00007ffec392c780 R08: 0000000000000000 R09: 0000000000000000
[ 990.238877] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f58753cc390
[ 990.247699] R13: 000055dfc15e8a10 R14: 0000000000000007 R15: 0000000000000003
[ 990.256505]
[ 990.259761] \x0aShowing all locks held in the system:
[ 990.268301] 1 lock held by khungtaskd/185:
[ 990.273696] #0: ffffffff9c2fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.285177] 3 locks held by systemd-journal/805:
[ 990.291153] #0: ff1100180e0372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.301042] #1: ffffffff9c503120 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.313858] #2: ff1100019d07dd00 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.325415] 4 locks held by python3/3748:
[ 990.330708] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.340595] #1: ff11000167375680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.351555] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.362712] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.372815] 4 locks held by python3/5878:
[ 990.378106] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.387993] #1: ff110001f369be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.398951] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.410104] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.420191]
[ 990.422658] =============================================\x0a
[ 1112.588615] INFO: task python3:5878 blocked for more than 245 seconds.
[ 1112.596759] Not tainted 7.1.0-rc1-smkz-gc22b47f6489b #1
[ 1112.604009] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.613600] task:python3 state:D stack:25672 pid:5878 tgid:5878 ppid:5877 task_flags:0x400100 flags:0x00080000
[ 1112.626809] Call Trace:
[ 1112.630345]
[ 1112.633498] __schedule+0xcba/0x1940
[ 1112.638315] ? io_schedule_timeout+0x140/0x140
[ 1112.644099] ? find_held_lock+0x2b/0x80
[ 1112.649205] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.655087] schedule+0xd4/0x260
[ 1112.659503] schedule_preempt_disabled+0x18/0x30
[ 1112.665483] __mutex_lock+0x6a3/0x2000
[ 1112.670487] ? threaded_store+0x132/0x220
[ 1112.675775] ? ww_mutex_lock+0x160/0x160
[ 1112.680973] ? selinux_inode_free_security+0x330/0x330
[ 1112.687542] ? cap_capable+0x1d6/0x3e0
[ 1112.692550] ? threaded_store+0x132/0x220
[ 1112.697846] threaded_store+0x132/0x220
[ 1112.702947] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.708243] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.713543] ? sysfs_kf_write+0x65/0x160
[ 1112.718736] ? sysfs_file_ops+0x140/0x140
[ 1112.724033] kernfs_fop_write_iter+0x335/0x510
[ 1112.729819] ? kernfs_ops+0xf0/0xf0
[ 1112.734530] new_sync_write+0x333/0x750
[ 1112.739635] ? __lock_acquire+0x508/0xc10
[ 1112.744928] ? new_sync_read+0x740/0x740
[ 1112.750131] ? lock_acquire.part.0+0xbc/0x260
[ 1112.755817] ? ksys_write+0x116/0x250
[ 1112.760742] vfs_write+0x657/0x9b0
[ 1112.765359] ksys_write+0x116/0x250
[ 1112.770072] ? __ia32_sys_read+0xc0/0xc0
[ 1112.775262] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.780850] ? rcu_is_watching+0x15/0xd0
[ 1112.786050] do_syscall_64+0xf3/0x650
[ 1112.790946] ? trace_hardirqs_off+0xd/0x30
[ 1112.796340] ? exc_page_fault+0xda/0xf0
[ 1112.801443] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.807912] RIP: 0033:0x7f4cd9f7322e
[ 1112.812723] RSP: 002b:00007ffe96b5a5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.822023] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd9f7322e
[ 1112.830832] RDX: 0000000000000001 RSI: 0000560cbe2d6a10 RDI: 0000000000000007
[ 1112.839637] RBP: 00007ffe96b5a600 R08: 0000000000000000 R09: 0000000000000000
[ 1112.848443] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd9deb390
[ 1112.857252] R13: 0000560cbe2d6a10 R14: 0000000000000007 R15: 0000000000000003
[ 1112.866066]
[ 1112.869357] INFO: task python3:5878 is blocked on a mutex likely owned by task python3:3748.
[ 1112.879630] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1112.892834] Call Trace:
[ 1112.896370]
[ 1112.899521] __schedule+0xcba/0x1940
[ 1112.904333] ? io_schedule_timeout+0x140/0x140
[ 1112.910118] ? find_held_lock+0x2b/0x80
[ 1112.915220] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.921395] schedule+0xd4/0x260
[ 1112.925811] schedule_timeout+0x13f/0x290
[ 1112.931108] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.937477] ? trace_contention_end+0xb3/0x1a0
[ 1112.943262] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.948950] ? ww_mutex_lock+0x160/0x160
[ 1112.954146] msleep+0x1b/0x30
[ 1112.958270] napi_set_threaded+0x3a5/0x440
[ 1112.963667] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.969163] netif_set_threaded+0x257/0x400
[ 1112.974655] threaded_store+0x1b8/0x220
[ 1112.979757] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.985055] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.990339] ? sysfs_kf_write+0x65/0x160
[ 1112.995538] ? sysfs_file_ops+0x140/0x140
[ 1113.000827] kernfs_fop_write_iter+0x335/0x510
[ 1113.006609] ? kernfs_ops+0xf0/0xf0
[ 1113.011318] new_sync_write+0x333/0x750
[ 1113.016420] ? __lock_acquire+0x508/0xc10
[ 1113.021714] ? new_sync_read+0x740/0x740
[ 1113.026914] ? lock_acquire.part.0+0xbc/0x260
[ 1113.032590] ? ksys_write+0x116/0x250
[ 1113.037499] vfs_write+0x657/0x9b0
[ 1113.042112] ksys_write+0x116/0x250
[ 1113.046821] ? __ia32_sys_read+0xc0/0xc0
[ 1113.052019] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.057605] ? rcu_is_watching+0x15/0xd0
[ 1113.062806] do_syscall_64+0xf3/0x650
[ 1113.067711] ? irq_exit_rcu+0x1a/0x30
[ 1113.072619] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.079083] RIP: 0033:0x7f587555422e
[ 1113.083893] RSP: 002b:00007ffec392c770 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.093182] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f587555422e
[ 1113.101987] RDX: 0000000000000001 RSI: 000055dfc15e8a10 RDI: 0000000000000007
[ 1113.110793] RBP: 00007ffec392c780 R08: 0000000000000000 R09: 0000000000000000
[ 1113.119599] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f58753cc390
[ 1113.128413] R13: 000055dfc15e8a10 R14: 0000000000000007 R15: 0000000000000003
[ 1113.137222]
[ 1113.140485] \x0aShowing all locks held in the system:
[ 1113.149024] 1 lock held by khungtaskd/185:
[ 1113.154415] #0: ffffffff9c2fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.165903] 4 locks held by python3/3748:
[ 1113.171200] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.181080] #1: ff11000167375680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.192040] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.203194] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.213290] 4 locks held by python3/5878:
[ 1113.218585] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.228473] #1: ff110001f369be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.239432] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.250590] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.260682]
[ 1113.263146] =============================================\x0a
[ 1235.469875] INFO: task python3:5878 blocked for more than 368 seconds.
[ 1235.478022] Not tainted 7.1.0-rc1-smkz-gc22b47f6489b #1
[ 1235.485263] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.494850] task:python3 state:D stack:25672 pid:5878 tgid:5878 ppid:5877 task_flags:0x400100 flags:0x00080002
[ 1235.508057] Call Trace:
[ 1235.511594]
[ 1235.514742] __schedule+0xcba/0x1940
[ 1235.519559] ? io_schedule_timeout+0x140/0x140
[ 1235.525345] ? find_held_lock+0x2b/0x80
[ 1235.530449] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.536324] schedule+0xd4/0x260
[ 1235.540734] schedule_preempt_disabled+0x18/0x30
[ 1235.546713] __mutex_lock+0x6a3/0x2000
[ 1235.551712] ? threaded_store+0x132/0x220
[ 1235.557012] ? ww_mutex_lock+0x160/0x160
[ 1235.562200] ? selinux_inode_free_security+0x330/0x330
[ 1235.568768] ? cap_capable+0x1d6/0x3e0
[ 1235.573776] ? threaded_store+0x132/0x220
[ 1235.579076] threaded_store+0x132/0x220
[ 1235.584179] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.589476] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.594771] ? sysfs_kf_write+0x65/0x160
[ 1235.599969] ? sysfs_file_ops+0x140/0x140
[ 1235.605261] kernfs_fop_write_iter+0x335/0x510
[ 1235.611044] ? kernfs_ops+0xf0/0xf0
[ 1235.615755] new_sync_write+0x333/0x750
[ 1235.620856] ? __lock_acquire+0x508/0xc10
[ 1235.626151] ? new_sync_read+0x740/0x740
[ 1235.631354] ? lock_acquire.part.0+0xbc/0x260
[ 1235.637040] ? ksys_write+0x116/0x250
[ 1235.641949] vfs_write+0x657/0x9b0
[ 1235.646561] ksys_write+0x116/0x250
[ 1235.651273] ? __ia32_sys_read+0xc0/0xc0
[ 1235.656469] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.662055] ? rcu_is_watching+0x15/0xd0
[ 1235.667256] do_syscall_64+0xf3/0x650
[ 1235.672164] ? trace_hardirqs_off+0xd/0x30
[ 1235.677559] ? exc_page_fault+0xda/0xf0
[ 1235.682662] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.689127] RIP: 0033:0x7f4cd9f7322e
[ 1235.693938] RSP: 002b:00007ffe96b5a5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.703235] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd9f7322e
[ 1235.712033] RDX: 0000000000000001 RSI: 0000560cbe2d6a10 RDI: 0000000000000007
[ 1235.720840] RBP: 00007ffe96b5a600 R08: 0000000000000000 R09: 0000000000000000
[ 1235.729647] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd9deb390
[ 1235.738453] R13: 0000560cbe2d6a10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.747265]
[ 1235.750562] INFO: task python3:5878 is blocked on a mutex likely owned by task python3:3748.
[ 1235.760833] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1235.774040] Call Trace:
[ 1235.777577]
[ 1235.780727] __schedule+0xcba/0x1940
[ 1235.785529] ? io_schedule_timeout+0x140/0x140
[ 1235.791315] ? find_held_lock+0x2b/0x80
[ 1235.796419] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.802598] schedule+0xd4/0x260
[ 1235.807017] schedule_timeout+0x13f/0x290
[ 1235.812306] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.818676] ? trace_contention_end+0xb3/0x1a0
[ 1235.824457] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.830145] ? ww_mutex_lock+0x160/0x160
[ 1235.835343] msleep+0x1b/0x30
[ 1235.839468] napi_set_threaded+0x3a5/0x440
[ 1235.844863] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.850356] netif_set_threaded+0x257/0x400
[ 1235.855846] threaded_store+0x1b8/0x220
[ 1235.860948] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.866243] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.871538] ? sysfs_kf_write+0x65/0x160
[ 1235.876737] ? sysfs_file_ops+0x140/0x140
[ 1235.882034] kernfs_fop_write_iter+0x335/0x510
[ 1235.887816] ? kernfs_ops+0xf0/0xf0
[ 1235.892527] new_sync_write+0x333/0x750
[ 1235.897627] ? __lock_acquire+0x508/0xc10
[ 1235.902923] ? new_sync_read+0x740/0x740
[ 1235.908122] ? lock_acquire.part.0+0xbc/0x260
[ 1235.913809] ? ksys_write+0x116/0x250
[ 1235.918721] vfs_write+0x657/0x9b0
[ 1235.923334] ksys_write+0x116/0x250
[ 1235.928043] ? __ia32_sys_read+0xc0/0xc0
[ 1235.933241] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.938831] ? rcu_is_watching+0x15/0xd0
[ 1235.944030] do_syscall_64+0xf3/0x650
[ 1235.948936] ? irq_exit_rcu+0x1a/0x30
[ 1235.953845] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.960301] RIP: 0033:0x7f587555422e
[ 1235.965109] RSP: 002b:00007ffec392c770 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.974407] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f587555422e
[ 1235.983214] RDX: 0000000000000001 RSI: 000055dfc15e8a10 RDI: 0000000000000007
[ 1235.992020] RBP: 00007ffec392c780 R08: 0000000000000000 R09: 0000000000000000
[ 1236.000829] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f58753cc390
[ 1236.009649] R13: 000055dfc15e8a10 R14: 0000000000000007 R15: 0000000000000003
[ 1236.018464]
[ 1236.021734] \x0aShowing all locks held in the system:
[ 1236.030271] 1 lock held by khungtaskd/185:
[ 1236.035663] #0: ffffffff9c2fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.047139] 2 locks held by systemd-journal/805:
[ 1236.053107] #0: ff1100180e8b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1236.062995] #1: ffffffff9c503120 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.075819] 4 locks held by python3/3748:
[ 1236.081115] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.091004] #1: ff11000167375680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.101964] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.113123] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.123218] 4 locks held by python3/5878:
[ 1236.128515] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.138405] #1: ff110001f369be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.149368] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.160524] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.170608]
[ 1236.173074] =============================================\x0a
[ 1358.351151] INFO: task python3:5878 blocked for more than 491 seconds.
[ 1358.359297] Not tainted 7.1.0-rc1-smkz-gc22b47f6489b #1
[ 1358.366548] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.376136] task:python3 state:D stack:25672 pid:5878 tgid:5878 ppid:5877 task_flags:0x400100 flags:0x00080002
[ 1358.389335] Call Trace:
[ 1358.392874]
[ 1358.396094] __schedule+0xcba/0x1940
[ 1358.400908] ? io_schedule_timeout+0x140/0x140
[ 1358.406696] ? find_held_lock+0x2b/0x80
[ 1358.411801] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.417681] schedule+0xd4/0x260
[ 1358.422169] schedule_preempt_disabled+0x18/0x30
[ 1358.428151] __mutex_lock+0x6a3/0x2000
[ 1358.433156] ? threaded_store+0x132/0x220
[ 1358.438458] ? ww_mutex_lock+0x160/0x160
[ 1358.443657] ? selinux_inode_free_security+0x330/0x330
[ 1358.450229] ? cap_capable+0x1d6/0x3e0
[ 1358.455240] ? threaded_store+0x132/0x220
[ 1358.460541] threaded_store+0x132/0x220
[ 1358.465647] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.470945] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.476241] ? sysfs_kf_write+0x65/0x160
[ 1358.481445] ? sysfs_file_ops+0x140/0x140
[ 1358.486741] kernfs_fop_write_iter+0x335/0x510
[ 1358.492525] ? kernfs_ops+0xf0/0xf0
[ 1358.497237] new_sync_write+0x333/0x750
[ 1358.502344] ? __lock_acquire+0x508/0xc10
[ 1358.502349] ? new_sync_read+0x740/0x740
[ 1358.502354] ? lock_acquire.part.0+0xbc/0x260
[ 1358.502357] ? ksys_write+0x116/0x250
[ 1358.502365] vfs_write+0x657/0x9b0
[ 1358.528079] ksys_write+0x116/0x250
[ 1358.532790] ? __ia32_sys_read+0xc0/0xc0
[ 1358.537991] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.543580] ? rcu_is_watching+0x15/0xd0
[ 1358.548781] do_syscall_64+0xf3/0x650
[ 1358.553690] ? trace_hardirqs_off+0xd/0x30
[ 1358.559101] ? exc_page_fault+0xda/0xf0
[ 1358.564222] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.570686] RIP: 0033:0x7f4cd9f7322e
[ 1358.575497] RSP: 002b:00007ffe96b5a5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.584798] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd9f7322e
[ 1358.593607] RDX: 0000000000000001 RSI: 0000560cbe2d6a10 RDI: 0000000000000007
[ 1358.602417] RBP: 00007ffe96b5a600 R08: 0000000000000000 R09: 0000000000000000
[ 1358.611229] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd9deb390
[ 1358.620037] R13: 0000560cbe2d6a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.628850]
[ 1358.632131] INFO: task python3:5878 is blocked on a mutex likely owned by task python3:3748.
[ 1358.642403] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1358.655606] Call Trace:
[ 1358.659144]
[ 1358.662294] __schedule+0xcba/0x1940
[ 1358.667106] ? io_schedule_timeout+0x140/0x140
[ 1358.672891] ? find_held_lock+0x2b/0x80
[ 1358.677996] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.684174] schedule+0xd4/0x260
[ 1358.688592] schedule_timeout+0x13f/0x290
[ 1358.693892] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.700261] ? trace_contention_end+0xb3/0x1a0
[ 1358.706048] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.711739] ? ww_mutex_lock+0x160/0x160
[ 1358.716938] msleep+0x1b/0x30
[ 1358.721064] napi_set_threaded+0x3a5/0x440
[ 1358.726462] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.731958] netif_set_threaded+0x257/0x400
[ 1358.737465] threaded_store+0x1b8/0x220
[ 1358.742571] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.747871] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.753167] ? sysfs_kf_write+0x65/0x160
[ 1358.758367] ? sysfs_file_ops+0x140/0x140
[ 1358.763662] kernfs_fop_write_iter+0x335/0x510
[ 1358.769449] ? kernfs_ops+0xf0/0xf0
[ 1358.774162] new_sync_write+0x333/0x750
[ 1358.779268] ? __lock_acquire+0x508/0xc10
[ 1358.784565] ? new_sync_read+0x740/0x740
[ 1358.789756] ? lock_acquire.part.0+0xbc/0x260
[ 1358.795444] ? ksys_write+0x116/0x250
[ 1358.800358] vfs_write+0x657/0x9b0
[ 1358.804973] ksys_write+0x116/0x250
[ 1358.809701] ? __ia32_sys_read+0xc0/0xc0
[ 1358.814911] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.820504] ? rcu_is_watching+0x15/0xd0
[ 1358.825704] do_syscall_64+0xf3/0x650
[ 1358.830612] ? irq_exit_rcu+0x1a/0x30
[ 1358.835522] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.841989] RIP: 0033:0x7f587555422e
[ 1358.846800] RSP: 002b:00007ffec392c770 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.856100] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f587555422e
[ 1358.864908] RDX: 0000000000000001 RSI: 000055dfc15e8a10 RDI: 0000000000000007
[ 1358.873719] RBP: 00007ffec392c780 R08: 0000000000000000 R09: 0000000000000000
[ 1358.882526] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f58753cc390
[ 1358.891337] R13: 000055dfc15e8a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.900149]
[ 1358.903418] \x0aShowing all locks held in the system:
[ 1358.911959] 1 lock held by khungtaskd/185:
[ 1358.917353] #0: ffffffff9c2fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.928828] 3 locks held by systemd-journal/805:
[ 1358.934809] #0: ff1100180dbb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.944696] #1: ffffffff9c503120 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.957505] #2: ff1100019d07dd00 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.969060] 4 locks held by python3/3748:
[ 1358.974357] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.984246] #1: ff11000167375680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.995207] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.006359] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.016456] 4 locks held by python3/5878:
[ 1359.021751] #0: ff1100012d5413e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.031641] #1: ff110001f369be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.042604] #2: ff110001201b2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.053759] #3: ff11000120169d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.063850] 5 locks held by (systemd-user-)/7726:
[ 1359.069930] #0: ff1100012dae93e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.079826] #1: ff11000196ed1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.090790] #2: ffffffff9c369c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.101460] #3: ffffffff9c168970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0
[ 1359.113099] #4: ffffffff9c369990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0
[ 1359.125528]
[ 1359.127997] =============================================\x0a