[ 765.601665] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 765.603988] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 765.754310] kselftest: Running tests in drivers/net
[ 989.681855] INFO: task python3:5485 blocked for more than 122 seconds.
[ 989.690077] Not tainted 7.1.0-rc6-kazs-gac309bb0374c #1
[ 989.697972] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.707563] task:python3 state:D stack:25672 pid:5485 tgid:5485 ppid:5484 task_flags:0x400100 flags:0x00080000
[ 989.720768] Call Trace:
[ 989.724305]
[ 989.727454] __schedule+0xcc3/0x19c0
[ 989.732269] ? io_schedule_timeout+0x140/0x140
[ 989.738051] ? find_held_lock+0x2b/0x80
[ 989.743157] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.749029] schedule+0xd8/0x260
[ 989.753448] schedule_preempt_disabled+0x18/0x30
[ 989.759417] __mutex_lock+0x6af/0x2010
[ 989.764422] ? threaded_store+0x132/0x220
[ 989.769722] ? ww_mutex_lock+0x160/0x160
[ 989.774919] ? selinux_inode_free_security+0x330/0x330
[ 989.781486] ? cap_capable+0x1d6/0x3e0
[ 989.786491] ? threaded_store+0x132/0x220
[ 989.791777] threaded_store+0x132/0x220
[ 989.796880] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.802166] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.807464] ? sysfs_kf_write+0x65/0x160
[ 989.812663] ? sysfs_file_ops+0x140/0x140
[ 989.817958] kernfs_fop_write_iter+0x335/0x510
[ 989.823740] ? kernfs_ops+0xf0/0xf0
[ 989.828448] new_sync_write+0x333/0x750
[ 989.833550] ? __lock_acquire+0x508/0xc10
[ 989.838848] ? new_sync_read+0x740/0x740
[ 989.844048] ? lock_acquire.part.0+0xbc/0x260
[ 989.849734] ? ksys_write+0x116/0x250
[ 989.854641] vfs_write+0x657/0x9b0
[ 989.859247] ksys_write+0x116/0x250
[ 989.863959] ? __ia32_sys_read+0xc0/0xc0
[ 989.869155] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.874745] ? rcu_is_watching+0x15/0xd0
[ 989.879944] do_syscall_64+0xf3/0x650
[ 989.884848] ? trace_hardirqs_off+0xd/0x30
[ 989.890244] ? exc_page_fault+0xda/0xf0
[ 989.895344] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.901811] RIP: 0033:0x7f0896da964e
[ 989.906620] RSP: 002b:00007fffc91f63e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.915915] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0896da964e
[ 989.924721] RDX: 0000000000000001 RSI: 0000555dfaf2ebf0 RDI: 0000000000000007
[ 989.933528] RBP: 00007fffc91f63f0 R08: 0000000000000000 R09: 0000000000000000
[ 989.942327] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0896c22390
[ 989.951125] R13: 0000555dfaf2ebf0 R14: 0000000000000007 R15: 00007f0896bb5120
[ 989.959946]
[ 989.963256] INFO: task python3:5485 is blocked on a mutex likely owned by task python3:3466.
[ 989.973529] task:python3 state:D stack:25672 pid:3466 tgid:3466 ppid:3465 task_flags:0x400100 flags:0x00080802
[ 989.986730] Call Trace:
[ 989.990266]
[ 989.993416] __schedule+0xcc3/0x19c0
[ 989.998226] ? io_schedule_timeout+0x140/0x140
[ 990.004000] ? find_held_lock+0x2b/0x80
[ 990.009104] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.015280] schedule+0xd8/0x260
[ 990.019687] schedule_timeout+0x13f/0x290
[ 990.024987] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.031356] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 990.037725] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.043403] ? __free_object+0x2ad/0x490
[ 990.048604] msleep+0x1b/0x30
[ 990.052720] napi_set_threaded+0x3a5/0x440
[ 990.058113] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.063605] netif_set_threaded+0x257/0x400
[ 990.069097] threaded_store+0x1b8/0x220
[ 990.074190] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.079487] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.084782] ? sysfs_kf_write+0x65/0x160
[ 990.089981] ? sysfs_file_ops+0x140/0x140
[ 990.095277] kernfs_fop_write_iter+0x335/0x510
[ 990.101060] ? kernfs_ops+0xf0/0xf0
[ 990.105771] new_sync_write+0x333/0x750
[ 990.110870] ? __lock_acquire+0x508/0xc10
[ 990.116165] ? new_sync_read+0x740/0x740
[ 990.121366] ? lock_acquire.part.0+0xbc/0x260
[ 990.127052] ? ksys_write+0x116/0x250
[ 990.131960] vfs_write+0x657/0x9b0
[ 990.136573] ksys_write+0x116/0x250
[ 990.141287] ? __ia32_sys_read+0xc0/0xc0
[ 990.146483] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.152070] ? rcu_is_watching+0x15/0xd0
[ 990.157270] do_syscall_64+0xf3/0x650
[ 990.162164] ? irq_exit_rcu+0x1a/0x30
[ 990.167073] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.173529] RIP: 0033:0x7fd2d77ae64e
[ 990.178337] RSP: 002b:00007ffec9bb5b50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.187634] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd2d77ae64e
[ 990.196430] RDX: 0000000000000001 RSI: 00005611def5fbf0 RDI: 0000000000000007
[ 990.205238] RBP: 00007ffec9bb5b60 R08: 0000000000000000 R09: 0000000000000000
[ 990.214043] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd2d7627390
[ 990.222847] R13: 00005611def5fbf0 R14: 0000000000000007 R15: 00007fd2d75bd120
[ 990.231659]
[ 990.234915] \x0aShowing all locks held in the system:
[ 990.243456] 1 lock held by khungtaskd/186:
[ 990.248848] #0: ffffffff952fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.260318] 3 locks held by systemd-journal/802:
[ 990.266292] #0: ff1100180e9b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.276181] #1: ffffffff95502ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 990.288409] #2: ff1100018c9d2e90 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.299966] 4 locks held by python3/3466:
[ 990.305257] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.315147] #1: ff1100013f59ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.326109] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.337262] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.347366] 4 locks held by python3/5485:
[ 990.352663] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.362552] #1: ff110001c08f5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.373503] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.384659] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.394743]
[ 990.397207] =============================================\x0a
[ 1112.563155] INFO: task python3:5485 blocked for more than 245 seconds.
[ 1112.571301] Not tainted 7.1.0-rc6-kazs-gac309bb0374c #1
[ 1112.578552] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.588139] task:python3 state:D stack:25672 pid:5485 tgid:5485 ppid:5484 task_flags:0x400100 flags:0x00080000
[ 1112.601342] Call Trace:
[ 1112.604881]
[ 1112.608030] __schedule+0xcc3/0x19c0
[ 1112.612847] ? io_schedule_timeout+0x140/0x140
[ 1112.618630] ? find_held_lock+0x2b/0x80
[ 1112.623736] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.629621] schedule+0xd8/0x260
[ 1112.634037] schedule_preempt_disabled+0x18/0x30
[ 1112.640013] __mutex_lock+0x6af/0x2010
[ 1112.645016] ? threaded_store+0x132/0x220
[ 1112.650314] ? ww_mutex_lock+0x160/0x160
[ 1112.655513] ? selinux_inode_free_security+0x330/0x330
[ 1112.662082] ? cap_capable+0x1d6/0x3e0
[ 1112.667090] ? threaded_store+0x132/0x220
[ 1112.672385] threaded_store+0x132/0x220
[ 1112.677485] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.682782] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.688081] ? sysfs_kf_write+0x65/0x160
[ 1112.693272] ? sysfs_file_ops+0x140/0x140
[ 1112.698565] kernfs_fop_write_iter+0x335/0x510
[ 1112.704348] ? kernfs_ops+0xf0/0xf0
[ 1112.709059] new_sync_write+0x333/0x750
[ 1112.714150] ? __lock_acquire+0x508/0xc10
[ 1112.719446] ? new_sync_read+0x740/0x740
[ 1112.724649] ? lock_acquire.part.0+0xbc/0x260
[ 1112.730335] ? ksys_write+0x116/0x250
[ 1112.735245] vfs_write+0x657/0x9b0
[ 1112.739857] ksys_write+0x116/0x250
[ 1112.744566] ? __ia32_sys_read+0xc0/0xc0
[ 1112.749764] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.755351] ? rcu_is_watching+0x15/0xd0
[ 1112.760552] do_syscall_64+0xf3/0x650
[ 1112.765457] ? trace_hardirqs_off+0xd/0x30
[ 1112.770849] ? exc_page_fault+0xda/0xf0
[ 1112.775951] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.782418] RIP: 0033:0x7f0896da964e
[ 1112.787229] RSP: 002b:00007fffc91f63e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.796527] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0896da964e
[ 1112.805337] RDX: 0000000000000001 RSI: 0000555dfaf2ebf0 RDI: 0000000000000007
[ 1112.814142] RBP: 00007fffc91f63f0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.822946] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0896c22390
[ 1112.831753] R13: 0000555dfaf2ebf0 R14: 0000000000000007 R15: 00007f0896bb5120
[ 1112.840563]
[ 1112.843850] INFO: task python3:5485 is blocked on a mutex likely owned by task python3:3466.
[ 1112.854122] task:python3 state:D stack:25672 pid:3466 tgid:3466 ppid:3465 task_flags:0x400100 flags:0x00080802
[ 1112.867322] Call Trace:
[ 1112.870852]
[ 1112.874001] __schedule+0xcc3/0x19c0
[ 1112.878810] ? io_schedule_timeout+0x140/0x140
[ 1112.884591] ? find_held_lock+0x2b/0x80
[ 1112.889691] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.895870] schedule+0xd8/0x260
[ 1112.900285] schedule_timeout+0x13f/0x290
[ 1112.905579] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.911945] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1112.918312] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.924005] ? __free_object+0x2ad/0x490
[ 1112.929204] msleep+0x1b/0x30
[ 1112.933328] napi_set_threaded+0x3a5/0x440
[ 1112.938724] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.944209] netif_set_threaded+0x257/0x400
[ 1112.949700] threaded_store+0x1b8/0x220
[ 1112.954802] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.960097] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.965393] ? sysfs_kf_write+0x65/0x160
[ 1112.970590] ? sysfs_file_ops+0x140/0x140
[ 1112.975884] kernfs_fop_write_iter+0x335/0x510
[ 1112.981667] ? kernfs_ops+0xf0/0xf0
[ 1112.986375] new_sync_write+0x333/0x750
[ 1112.991476] ? __lock_acquire+0x508/0xc10
[ 1112.996769] ? new_sync_read+0x740/0x740
[ 1113.001967] ? lock_acquire.part.0+0xbc/0x260
[ 1113.007651] ? ksys_write+0x116/0x250
[ 1113.012561] vfs_write+0x657/0x9b0
[ 1113.017176] ksys_write+0x116/0x250
[ 1113.021887] ? __ia32_sys_read+0xc0/0xc0
[ 1113.027088] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.032667] ? rcu_is_watching+0x15/0xd0
[ 1113.037864] do_syscall_64+0xf3/0x650
[ 1113.042770] ? irq_exit_rcu+0x1a/0x30
[ 1113.047666] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.054131] RIP: 0033:0x7fd2d77ae64e
[ 1113.058938] RSP: 002b:00007ffec9bb5b50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.068233] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd2d77ae64e
[ 1113.077040] RDX: 0000000000000001 RSI: 00005611def5fbf0 RDI: 0000000000000007
[ 1113.085845] RBP: 00007ffec9bb5b60 R08: 0000000000000000 R09: 0000000000000000
[ 1113.094653] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd2d7627390
[ 1113.103458] R13: 00005611def5fbf0 R14: 0000000000000007 R15: 00007fd2d75bd120
[ 1113.112270]
[ 1113.115530] \x0aShowing all locks held in the system:
[ 1113.124069] 1 lock held by khungtaskd/186:
[ 1113.129458] #0: ffffffff952fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.140927] 3 locks held by systemd-journal/802:
[ 1113.146905] #0: ff1100180e0b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.156790] #1: ffffffff95502ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: link_path_walk+0x9a7/0x1830
[ 1113.169409] #2: ff1100018c9d2e90 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1113.180967] 4 locks held by python3/3466:
[ 1113.186260] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.196146] #1: ff1100013f59ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.207106] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.218260] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.228357] 4 locks held by python3/5485:
[ 1113.233654] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.243541] #1: ff110001c08f5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.254499] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.265654] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.275742]
[ 1113.278208] =============================================\x0a
[ 1235.444462] INFO: task python3:5485 blocked for more than 368 seconds.
[ 1235.452610] Not tainted 7.1.0-rc6-kazs-gac309bb0374c #1
[ 1235.459850] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.469428] task:python3 state:D stack:25672 pid:5485 tgid:5485 ppid:5484 task_flags:0x400100 flags:0x00080002
[ 1235.482632] Call Trace:
[ 1235.486171]
[ 1235.489319] __schedule+0xcc3/0x19c0
[ 1235.494134] ? io_schedule_timeout+0x140/0x140
[ 1235.499919] ? find_held_lock+0x2b/0x80
[ 1235.505021] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.510906] schedule+0xd8/0x260
[ 1235.515323] schedule_preempt_disabled+0x18/0x30
[ 1235.521304] __mutex_lock+0x6af/0x2010
[ 1235.526310] ? threaded_store+0x132/0x220
[ 1235.531608] ? ww_mutex_lock+0x160/0x160
[ 1235.536804] ? selinux_inode_free_security+0x330/0x330
[ 1235.543374] ? cap_capable+0x1d6/0x3e0
[ 1235.548383] ? threaded_store+0x132/0x220
[ 1235.553677] threaded_store+0x132/0x220
[ 1235.558779] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.564074] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.569374] ? sysfs_kf_write+0x65/0x160
[ 1235.574576] ? sysfs_file_ops+0x140/0x140
[ 1235.579870] kernfs_fop_write_iter+0x335/0x510
[ 1235.585652] ? kernfs_ops+0xf0/0xf0
[ 1235.590364] new_sync_write+0x333/0x750
[ 1235.595465] ? __lock_acquire+0x508/0xc10
[ 1235.600761] ? new_sync_read+0x740/0x740
[ 1235.605964] ? lock_acquire.part.0+0xbc/0x260
[ 1235.611651] ? ksys_write+0x116/0x250
[ 1235.616559] vfs_write+0x657/0x9b0
[ 1235.621172] ksys_write+0x116/0x250
[ 1235.625884] ? __ia32_sys_read+0xc0/0xc0
[ 1235.631072] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.636658] ? rcu_is_watching+0x15/0xd0
[ 1235.641858] do_syscall_64+0xf3/0x650
[ 1235.646763] ? trace_hardirqs_off+0xd/0x30
[ 1235.652155] ? exc_page_fault+0xda/0xf0
[ 1235.657256] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.663714] RIP: 0033:0x7f0896da964e
[ 1235.668520] RSP: 002b:00007fffc91f63e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.677816] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0896da964e
[ 1235.686622] RDX: 0000000000000001 RSI: 0000555dfaf2ebf0 RDI: 0000000000000007
[ 1235.695430] RBP: 00007fffc91f63f0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.704238] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0896c22390
[ 1235.713048] R13: 0000555dfaf2ebf0 R14: 0000000000000007 R15: 00007f0896bb5120
[ 1235.721861]
[ 1235.725136] INFO: task python3:5485 is blocked on a mutex likely owned by task python3:3466.
[ 1235.735407] task:python3 state:D stack:25672 pid:3466 tgid:3466 ppid:3465 task_flags:0x400100 flags:0x00080802
[ 1235.748606] Call Trace:
[ 1235.752136]
[ 1235.755283] __schedule+0xcc3/0x19c0
[ 1235.760093] ? io_schedule_timeout+0x140/0x140
[ 1235.765866] ? find_held_lock+0x2b/0x80
[ 1235.770967] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.777143] schedule+0xd8/0x260
[ 1235.781559] schedule_timeout+0x13f/0x290
[ 1235.786853] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.793220] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1235.799587] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.805277] ? __free_object+0x2ad/0x490
[ 1235.810478] msleep+0x1b/0x30
[ 1235.814602] napi_set_threaded+0x3a5/0x440
[ 1235.819994] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.825489] netif_set_threaded+0x257/0x400
[ 1235.830982] threaded_store+0x1b8/0x220
[ 1235.836085] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.841380] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.846673] ? sysfs_kf_write+0x65/0x160
[ 1235.851872] ? sysfs_file_ops+0x140/0x140
[ 1235.857165] kernfs_fop_write_iter+0x335/0x510
[ 1235.862950] ? kernfs_ops+0xf0/0xf0
[ 1235.867658] new_sync_write+0x333/0x750
[ 1235.872760] ? __lock_acquire+0x508/0xc10
[ 1235.878053] ? new_sync_read+0x740/0x740
[ 1235.883252] ? lock_acquire.part.0+0xbc/0x260
[ 1235.888936] ? ksys_write+0x116/0x250
[ 1235.893847] vfs_write+0x657/0x9b0
[ 1235.898463] ksys_write+0x116/0x250
[ 1235.903166] ? __ia32_sys_read+0xc0/0xc0
[ 1235.908366] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.913951] ? rcu_is_watching+0x15/0xd0
[ 1235.919151] do_syscall_64+0xf3/0x650
[ 1235.924054] ? irq_exit_rcu+0x1a/0x30
[ 1235.928960] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.935426] RIP: 0033:0x7fd2d77ae64e
[ 1235.940233] RSP: 002b:00007ffec9bb5b50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.949529] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd2d77ae64e
[ 1235.958337] RDX: 0000000000000001 RSI: 00005611def5fbf0 RDI: 0000000000000007
[ 1235.967144] RBP: 00007ffec9bb5b60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.975953] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd2d7627390
[ 1235.984760] R13: 00005611def5fbf0 R14: 0000000000000007 R15: 00007fd2d75bd120
[ 1235.993572]
[ 1235.996833] \x0aShowing all locks held in the system:
[ 1236.005370] 1 lock held by khungtaskd/186:
[ 1236.010761] #0: ffffffff952fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.022230] 2 locks held by systemd-journal/802:
[ 1236.028207] #0: ff1100180e7b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.038095] #1: ffffffff95502ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: lockref_get_not_dead+0xe/0x60
[ 1236.050911] 4 locks held by python3/3466:
[ 1236.056204] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.066090] #1: ff1100013f59ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.077050] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.088208] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.098300] 4 locks held by python3/5485:
[ 1236.103595] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.113485] #1: ff110001c08f5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.124443] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.135597] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.145688]
[ 1236.148143] =============================================\x0a
[ 1358.325774] INFO: task python3:5485 blocked for more than 491 seconds.
[ 1358.333939] Not tainted 7.1.0-rc6-kazs-gac309bb0374c #1
[ 1358.341190] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.350766] task:python3 state:D stack:25672 pid:5485 tgid:5485 ppid:5484 task_flags:0x400100 flags:0x00080002
[ 1358.363968] Call Trace:
[ 1358.367508]
[ 1358.370660] __schedule+0xcc3/0x19c0
[ 1358.375473] ? io_schedule_timeout+0x140/0x140
[ 1358.381259] ? find_held_lock+0x2b/0x80
[ 1358.386366] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.392249] schedule+0xd8/0x260
[ 1358.396664] schedule_preempt_disabled+0x18/0x30
[ 1358.402640] __mutex_lock+0x6af/0x2010
[ 1358.407642] ? threaded_store+0x132/0x220
[ 1358.412940] ? ww_mutex_lock+0x160/0x160
[ 1358.418139] ? selinux_inode_free_security+0x330/0x330
[ 1358.424707] ? cap_capable+0x1d6/0x3e0
[ 1358.429713] ? threaded_store+0x132/0x220
[ 1358.435010] threaded_store+0x132/0x220
[ 1358.440109] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.445403] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.450698] ? sysfs_kf_write+0x65/0x160
[ 1358.455898] ? sysfs_file_ops+0x140/0x140
[ 1358.461182] kernfs_fop_write_iter+0x335/0x510
[ 1358.466963] ? kernfs_ops+0xf0/0xf0
[ 1358.471674] new_sync_write+0x333/0x750
[ 1358.476769] ? __lock_acquire+0x508/0xc10
[ 1358.482064] ? new_sync_read+0x740/0x740
[ 1358.487263] ? lock_acquire.part.0+0xbc/0x260
[ 1358.492951] ? ksys_write+0x116/0x250
[ 1358.497851] vfs_write+0x657/0x9b0
[ 1358.502465] ksys_write+0x116/0x250
[ 1358.507174] ? __ia32_sys_read+0xc0/0xc0
[ 1358.512371] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.517957] ? rcu_is_watching+0x15/0xd0
[ 1358.523158] do_syscall_64+0xf3/0x650
[ 1358.528054] ? trace_hardirqs_off+0xd/0x30
[ 1358.533446] ? exc_page_fault+0xda/0xf0
[ 1358.538548] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.545014] RIP: 0033:0x7f0896da964e
[ 1358.549820] RSP: 002b:00007fffc91f63e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.559117] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0896da964e
[ 1358.567923] RDX: 0000000000000001 RSI: 0000555dfaf2ebf0 RDI: 0000000000000007
[ 1358.576729] RBP: 00007fffc91f63f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.585536] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0896c22390
[ 1358.594332] R13: 0000555dfaf2ebf0 R14: 0000000000000007 R15: 00007f0896bb5120
[ 1358.603146]
[ 1358.606458] INFO: task python3:5485 is blocked on a mutex likely owned by task python3:3466.
[ 1358.616729] task:python3 state:D stack:25672 pid:3466 tgid:3466 ppid:3465 task_flags:0x400100 flags:0x00080802
[ 1358.629932] Call Trace:
[ 1358.633470]
[ 1358.636622] __schedule+0xcc3/0x19c0
[ 1358.641432] ? io_schedule_timeout+0x140/0x140
[ 1358.647207] ? find_held_lock+0x2b/0x80
[ 1358.652307] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.658485] schedule+0xd8/0x260
[ 1358.662900] schedule_timeout+0x13f/0x290
[ 1358.668194] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.674564] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1358.680933] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.686626] ? __free_object+0x2ad/0x490
[ 1358.691826] msleep+0x1b/0x30
[ 1358.695952] napi_set_threaded+0x3a5/0x440
[ 1358.701346] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.706839] netif_set_threaded+0x257/0x400
[ 1358.712331] threaded_store+0x1b8/0x220
[ 1358.717423] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.722717] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.728014] ? sysfs_kf_write+0x65/0x160
[ 1358.733211] ? sysfs_file_ops+0x140/0x140
[ 1358.738505] kernfs_fop_write_iter+0x335/0x510
[ 1358.744289] ? kernfs_ops+0xf0/0xf0
[ 1358.748996] new_sync_write+0x333/0x750
[ 1358.754097] ? __lock_acquire+0x508/0xc10
[ 1358.759394] ? new_sync_read+0x740/0x740
[ 1358.764592] ? lock_acquire.part.0+0xbc/0x260
[ 1358.770276] ? ksys_write+0x116/0x250
[ 1358.775187] vfs_write+0x657/0x9b0
[ 1358.779801] ksys_write+0x116/0x250
[ 1358.784503] ? __ia32_sys_read+0xc0/0xc0
[ 1358.789701] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.795291] ? rcu_is_watching+0x15/0xd0
[ 1358.800491] do_syscall_64+0xf3/0x650
[ 1358.805396] ? irq_exit_rcu+0x1a/0x30
[ 1358.810302] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.816768] RIP: 0033:0x7fd2d77ae64e
[ 1358.821575] RSP: 002b:00007ffec9bb5b50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.830869] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd2d77ae64e
[ 1358.839680] RDX: 0000000000000001 RSI: 00005611def5fbf0 RDI: 0000000000000007
[ 1358.848486] RBP: 00007ffec9bb5b60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.857293] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd2d7627390
[ 1358.866098] R13: 00005611def5fbf0 R14: 0000000000000007 R15: 00007fd2d75bd120
[ 1358.874910]
[ 1358.878176] \x0aShowing all locks held in the system:
[ 1358.886715] 1 lock held by khungtaskd/186:
[ 1358.892105] #0: ffffffff952fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.903587] 4 locks held by python3/3466:
[ 1358.908881] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.918768] #1: ff1100013f59ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.929728] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.940882] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.950979] 4 locks held by python3/5485:
[ 1358.956272] #0: ff1100012f2ec3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.966160] #1: ff110001c08f5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.977118] #2: ff11000123310b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.988274] #3: ff110001232c1db8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.998365]
[ 1359.000831] =============================================\x0a