[ 762.500470] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 762.503163] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 762.655357] kselftest: Running tests in drivers/net
[ 846.360538] kworker/u130:4 (527) used greatest stack depth: 21456 bytes left
[ 989.721685] INFO: task python3:5402 blocked for more than 122 seconds.
[ 989.729896] Not tainted 7.1.0-rc7-ezdu-g4c3e3c1ac538 #1
[ 989.737675] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.747264] task:python3 state:D stack:24976 pid:5402 tgid:5402 ppid:5401 task_flags:0x400100 flags:0x00080000
[ 989.760471] Call Trace:
[ 989.764011]
[ 989.767158] __schedule+0xcc3/0x19c0
[ 989.771976] ? io_schedule_timeout+0x140/0x140
[ 989.777757] ? find_held_lock+0x2b/0x80
[ 989.782858] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.788742] schedule+0xd8/0x260
[ 989.793158] schedule_preempt_disabled+0x18/0x30
[ 989.799137] __mutex_lock+0x6af/0x2010
[ 989.804139] ? threaded_store+0x132/0x220
[ 989.809439] ? ww_mutex_lock+0x160/0x160
[ 989.814636] ? selinux_inode_free_security+0x330/0x330
[ 989.821204] ? cap_capable+0x1d6/0x3e0
[ 989.826214] ? threaded_store+0x132/0x220
[ 989.831514] threaded_store+0x132/0x220
[ 989.836614] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.841913] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.847211] ? sysfs_kf_write+0x65/0x160
[ 989.852411] ? sysfs_file_ops+0x140/0x140
[ 989.857697] kernfs_fop_write_iter+0x335/0x510
[ 989.863480] ? kernfs_ops+0xf0/0xf0
[ 989.868191] new_sync_write+0x333/0x750
[ 989.873282] ? __lock_acquire+0x508/0xc10
[ 989.878577] ? new_sync_read+0x740/0x740
[ 989.883774] ? lock_acquire.part.0+0xbc/0x260
[ 989.889461] ? ksys_write+0x116/0x250
[ 989.894369] vfs_write+0x657/0x9b0
[ 989.898976] ksys_write+0x116/0x250
[ 989.903685] ? __ia32_sys_read+0xc0/0xc0
[ 989.908882] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.914469] ? rcu_is_watching+0x15/0xd0
[ 989.919671] do_syscall_64+0xf3/0x650
[ 989.924576] ? trace_hardirqs_off+0xd/0x30
[ 989.929970] ? exc_page_fault+0xda/0xf0
[ 989.935072] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.941531] RIP: 0033:0x7fc55631064e
[ 989.946349] RSP: 002b:00007ffddbb51250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.955647] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc55631064e
[ 989.964453] RDX: 0000000000000001 RSI: 00005617491acbf0 RDI: 0000000000000007
[ 989.973258] RBP: 00007ffddbb51260 R08: 0000000000000000 R09: 0000000000000000
[ 989.982067] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc556189390
[ 989.990874] R13: 00005617491acbf0 R14: 0000000000000007 R15: 00007fc55611d120
[ 989.999687]
[ 990.002991] INFO: task python3:5402 is blocked on a mutex likely owned by task python3:3401.
[ 990.013262] task:python3 state:D stack:25504 pid:3401 tgid:3401 ppid:3400 task_flags:0x400100 flags:0x00080802
[ 990.026465] Call Trace:
[ 990.030004]
[ 990.033151] __schedule+0xcc3/0x19c0
[ 990.037962] ? io_schedule_timeout+0x140/0x140
[ 990.043743] ? find_held_lock+0x2b/0x80
[ 990.048842] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.055022] schedule+0xd8/0x260
[ 990.059440] schedule_timeout+0x13f/0x290
[ 990.064735] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.071101] ? trace_contention_end+0xb3/0x1a0
[ 990.076883] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.082570] ? ww_mutex_lock+0x160/0x160
[ 990.087768] msleep+0x1b/0x30
[ 990.091889] napi_set_threaded+0x3a5/0x440
[ 990.097283] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.102776] netif_set_threaded+0x257/0x400
[ 990.108270] threaded_store+0x1b8/0x220
[ 990.113370] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.118667] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.123963] ? sysfs_kf_write+0x65/0x160
[ 990.129160] ? sysfs_file_ops+0x140/0x140
[ 990.134456] kernfs_fop_write_iter+0x335/0x510
[ 990.140240] ? kernfs_ops+0xf0/0xf0
[ 990.144952] new_sync_write+0x333/0x750
[ 990.150046] ? __lock_acquire+0x508/0xc10
[ 990.155342] ? new_sync_read+0x740/0x740
[ 990.160543] ? lock_acquire.part.0+0xbc/0x260
[ 990.166230] ? ksys_write+0x116/0x250
[ 990.171139] vfs_write+0x657/0x9b0
[ 990.175750] ksys_write+0x116/0x250
[ 990.180459] ? __ia32_sys_read+0xc0/0xc0
[ 990.185657] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.191244] ? rcu_is_watching+0x15/0xd0
[ 990.196443] do_syscall_64+0xf3/0x650
[ 990.201346] ? trace_hardirqs_off+0xd/0x30
[ 990.206740] ? exc_page_fault+0xda/0xf0
[ 990.211841] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.218305] RIP: 0033:0x7f978e4df64e
[ 990.223111] RSP: 002b:00007ffdae54ceb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.232407] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f978e4df64e
[ 990.241213] RDX: 0000000000000001 RSI: 00005558a4ef2bf0 RDI: 0000000000000007
[ 990.250022] RBP: 00007ffdae54cec0 R08: 0000000000000000 R09: 0000000000000000
[ 990.258827] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f978e358390
[ 990.267634] R13: 00005558a4ef2bf0 R14: 0000000000000007 R15: 00007f978e2ed120
[ 990.276444]
[ 990.279703] \x0aShowing all locks held in the system:
[ 990.288242] 1 lock held by khungtaskd/186:
[ 990.293636] #0: ffffffff94cfdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.305118] 4 locks held by python3/3401:
[ 990.310412] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.320303] #1: ff1100013f7cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.331266] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.342422] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.352525] 4 locks held by python3/5402:
[ 990.357818] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.367711] #1: ff110001802c4a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.378953] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.390108] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.400195]
[ 990.402662] =============================================\x0a
[ 1112.601663] INFO: task python3:5402 blocked for more than 245 seconds.
[ 1112.609810] Not tainted 7.1.0-rc7-ezdu-g4c3e3c1ac538 #1
[ 1112.617061] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.626648] task:python3 state:D stack:24976 pid:5402 tgid:5402 ppid:5401 task_flags:0x400100 flags:0x00080000
[ 1112.639854] Call Trace:
[ 1112.643390]
[ 1112.646538] __schedule+0xcc3/0x19c0
[ 1112.651350] ? io_schedule_timeout+0x140/0x140
[ 1112.657136] ? find_held_lock+0x2b/0x80
[ 1112.662238] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.668123] schedule+0xd8/0x260
[ 1112.672539] schedule_preempt_disabled+0x18/0x30
[ 1112.678515] __mutex_lock+0x6af/0x2010
[ 1112.683518] ? threaded_store+0x132/0x220
[ 1112.688817] ? ww_mutex_lock+0x160/0x160
[ 1112.694015] ? selinux_inode_free_security+0x330/0x330
[ 1112.700576] ? cap_capable+0x1d6/0x3e0
[ 1112.705585] ? threaded_store+0x132/0x220
[ 1112.710879] threaded_store+0x132/0x220
[ 1112.715978] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.721275] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.726577] ? sysfs_kf_write+0x65/0x160
[ 1112.731779] ? sysfs_file_ops+0x140/0x140
[ 1112.737075] kernfs_fop_write_iter+0x335/0x510
[ 1112.742858] ? kernfs_ops+0xf0/0xf0
[ 1112.747569] new_sync_write+0x333/0x750
[ 1112.752671] ? __lock_acquire+0x508/0xc10
[ 1112.757967] ? new_sync_read+0x740/0x740
[ 1112.763170] ? lock_acquire.part.0+0xbc/0x260
[ 1112.768856] ? ksys_write+0x116/0x250
[ 1112.773765] vfs_write+0x657/0x9b0
[ 1112.778377] ksys_write+0x116/0x250
[ 1112.783085] ? __ia32_sys_read+0xc0/0xc0
[ 1112.788281] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.793868] ? rcu_is_watching+0x15/0xd0
[ 1112.799069] do_syscall_64+0xf3/0x650
[ 1112.803965] ? trace_hardirqs_off+0xd/0x30
[ 1112.809358] ? exc_page_fault+0xda/0xf0
[ 1112.814461] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.820926] RIP: 0033:0x7fc55631064e
[ 1112.825734] RSP: 002b:00007ffddbb51250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.835032] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc55631064e
[ 1112.843838] RDX: 0000000000000001 RSI: 00005617491acbf0 RDI: 0000000000000007
[ 1112.852645] RBP: 00007ffddbb51260 R08: 0000000000000000 R09: 0000000000000000
[ 1112.861450] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc556189390
[ 1112.870257] R13: 00005617491acbf0 R14: 0000000000000007 R15: 00007fc55611d120
[ 1112.879062]
[ 1112.882342] INFO: task python3:5402 is blocked on a mutex likely owned by task python3:3401.
[ 1112.892613] task:python3 state:D stack:25504 pid:3401 tgid:3401 ppid:3400 task_flags:0x400100 flags:0x00080802
[ 1112.905813] Call Trace:
[ 1112.909349]
[ 1112.912501] __schedule+0xcc3/0x19c0
[ 1112.917310] ? io_schedule_timeout+0x140/0x140
[ 1112.923091] ? find_held_lock+0x2b/0x80
[ 1112.928192] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.934367] schedule+0xd8/0x260
[ 1112.938785] schedule_timeout+0x13f/0x290
[ 1112.944079] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.950446] ? trace_contention_end+0xb3/0x1a0
[ 1112.956230] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.961919] ? ww_mutex_lock+0x160/0x160
[ 1112.967116] msleep+0x1b/0x30
[ 1112.971238] napi_set_threaded+0x3a5/0x440
[ 1112.976633] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.982128] netif_set_threaded+0x257/0x400
[ 1112.987618] threaded_store+0x1b8/0x220
[ 1112.992718] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.998012] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.003308] ? sysfs_kf_write+0x65/0x160
[ 1113.008506] ? sysfs_file_ops+0x140/0x140
[ 1113.013800] kernfs_fop_write_iter+0x335/0x510
[ 1113.019586] ? kernfs_ops+0xf0/0xf0
[ 1113.024285] new_sync_write+0x333/0x750
[ 1113.029385] ? __lock_acquire+0x508/0xc10
[ 1113.034683] ? new_sync_read+0x740/0x740
[ 1113.039882] ? lock_acquire.part.0+0xbc/0x260
[ 1113.045566] ? ksys_write+0x116/0x250
[ 1113.050472] vfs_write+0x657/0x9b0
[ 1113.055086] ksys_write+0x116/0x250
[ 1113.059797] ? __ia32_sys_read+0xc0/0xc0
[ 1113.064993] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.070582] ? rcu_is_watching+0x15/0xd0
[ 1113.075779] do_syscall_64+0xf3/0x650
[ 1113.080686] ? trace_hardirqs_off+0xd/0x30
[ 1113.086079] ? exc_page_fault+0xda/0xf0
[ 1113.091179] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.097646] RIP: 0033:0x7f978e4df64e
[ 1113.102453] RSP: 002b:00007ffdae54ceb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.111748] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f978e4df64e
[ 1113.120555] RDX: 0000000000000001 RSI: 00005558a4ef2bf0 RDI: 0000000000000007
[ 1113.129362] RBP: 00007ffdae54cec0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.138162] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f978e358390
[ 1113.146969] R13: 00005558a4ef2bf0 R14: 0000000000000007 R15: 00007f978e2ed120
[ 1113.155781]
[ 1113.159044] \x0aShowing all locks held in the system:
[ 1113.167582] 1 lock held by khungtaskd/186:
[ 1113.172973] #0: ffffffff94cfdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.184455] 4 locks held by python3/3401:
[ 1113.189751] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.199640] #1: ff1100013f7cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.210600] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.221755] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.231853] 4 locks held by python3/5402:
[ 1113.237147] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.247035] #1: ff110001802c4a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.257995] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.269154] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.279245]
[ 1113.281701] =============================================\x0a
[ 1235.483654] INFO: task python3:5402 blocked for more than 368 seconds.
[ 1235.491800] Not tainted 7.1.0-rc7-ezdu-g4c3e3c1ac538 #1
[ 1235.499042] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.508630] task:python3 state:D stack:24976 pid:5402 tgid:5402 ppid:5401 task_flags:0x400100 flags:0x00080002
[ 1235.521834] Call Trace:
[ 1235.525373]
[ 1235.528521] __schedule+0xcc3/0x19c0
[ 1235.533335] ? io_schedule_timeout+0x140/0x140
[ 1235.539111] ? find_held_lock+0x2b/0x80
[ 1235.544213] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.550098] schedule+0xd8/0x260
[ 1235.554514] schedule_preempt_disabled+0x18/0x30
[ 1235.560493] __mutex_lock+0x6af/0x2010
[ 1235.565497] ? threaded_store+0x132/0x220
[ 1235.570794] ? ww_mutex_lock+0x160/0x160
[ 1235.575990] ? selinux_inode_free_security+0x330/0x330
[ 1235.582560] ? cap_capable+0x1d6/0x3e0
[ 1235.587565] ? threaded_store+0x132/0x220
[ 1235.592859] threaded_store+0x132/0x220
[ 1235.597960] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.603253] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.608554] ? sysfs_kf_write+0x65/0x160
[ 1235.613754] ? sysfs_file_ops+0x140/0x140
[ 1235.619048] kernfs_fop_write_iter+0x335/0x510
[ 1235.624831] ? kernfs_ops+0xf0/0xf0
[ 1235.629543] new_sync_write+0x333/0x750
[ 1235.634644] ? __lock_acquire+0x508/0xc10
[ 1235.639941] ? new_sync_read+0x740/0x740
[ 1235.645143] ? lock_acquire.part.0+0xbc/0x260
[ 1235.650830] ? ksys_write+0x116/0x250
[ 1235.655739] vfs_write+0x657/0x9b0
[ 1235.660351] ksys_write+0x116/0x250
[ 1235.665063] ? __ia32_sys_read+0xc0/0xc0
[ 1235.670250] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.675837] ? rcu_is_watching+0x15/0xd0
[ 1235.681038] do_syscall_64+0xf3/0x650
[ 1235.685935] ? trace_hardirqs_off+0xd/0x30
[ 1235.691328] ? exc_page_fault+0xda/0xf0
[ 1235.696431] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.702897] RIP: 0033:0x7fc55631064e
[ 1235.707704] RSP: 002b:00007ffddbb51250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.716999] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc55631064e
[ 1235.725806] RDX: 0000000000000001 RSI: 00005617491acbf0 RDI: 0000000000000007
[ 1235.734612] RBP: 00007ffddbb51260 R08: 0000000000000000 R09: 0000000000000000
[ 1235.743419] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc556189390
[ 1235.752225] R13: 00005617491acbf0 R14: 0000000000000007 R15: 00007fc55611d120
[ 1235.761037]
[ 1235.764319] INFO: task python3:5402 is blocked on a mutex likely owned by task python3:3401.
[ 1235.774591] task:python3 state:D stack:25504 pid:3401 tgid:3401 ppid:3400 task_flags:0x400100 flags:0x00080802
[ 1235.787792] Call Trace:
[ 1235.791331]
[ 1235.794478] __schedule+0xcc3/0x19c0
[ 1235.799288] ? io_schedule_timeout+0x140/0x140
[ 1235.805064] ? find_held_lock+0x2b/0x80
[ 1235.810165] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.816341] schedule+0xd8/0x260
[ 1235.820747] schedule_timeout+0x13f/0x290
[ 1235.826041] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.832410] ? trace_contention_end+0xb3/0x1a0
[ 1235.838194] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.843884] ? ww_mutex_lock+0x160/0x160
[ 1235.849082] msleep+0x1b/0x30
[ 1235.853205] napi_set_threaded+0x3a5/0x440
[ 1235.858602] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.864097] netif_set_threaded+0x257/0x400
[ 1235.869589] threaded_store+0x1b8/0x220
[ 1235.874682] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.879978] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.885272] ? sysfs_kf_write+0x65/0x160
[ 1235.890469] ? sysfs_file_ops+0x140/0x140
[ 1235.895765] kernfs_fop_write_iter+0x335/0x510
[ 1235.901550] ? kernfs_ops+0xf0/0xf0
[ 1235.906250] new_sync_write+0x333/0x750
[ 1235.911353] ? __lock_acquire+0x508/0xc10
[ 1235.916649] ? new_sync_read+0x740/0x740
[ 1235.921849] ? lock_acquire.part.0+0xbc/0x260
[ 1235.927526] ? ksys_write+0x116/0x250
[ 1235.932433] vfs_write+0x657/0x9b0
[ 1235.937047] ksys_write+0x116/0x250
[ 1235.941754] ? __ia32_sys_read+0xc0/0xc0
[ 1235.946954] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.952544] ? rcu_is_watching+0x15/0xd0
[ 1235.957733] do_syscall_64+0xf3/0x650
[ 1235.962636] ? trace_hardirqs_off+0xd/0x30
[ 1235.968031] ? exc_page_fault+0xda/0xf0
[ 1235.973132] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.979598] RIP: 0033:0x7f978e4df64e
[ 1235.984408] RSP: 002b:00007ffdae54ceb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.993703] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f978e4df64e
[ 1236.002507] RDX: 0000000000000001 RSI: 00005558a4ef2bf0 RDI: 0000000000000007
[ 1236.011312] RBP: 00007ffdae54cec0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.020121] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f978e358390
[ 1236.028929] R13: 00005558a4ef2bf0 R14: 0000000000000007 R15: 00007f978e2ed120
[ 1236.037739]
[ 1236.041002] \x0aShowing all locks held in the system:
[ 1236.049541] 1 lock held by khungtaskd/186:
[ 1236.054934] #0: ffffffff94cfdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.066417] 4 locks held by python3/3401:
[ 1236.071712] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.081602] #1: ff1100013f7cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.092562] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.103718] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.113815] 4 locks held by python3/5402:
[ 1236.119109] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.128997] #1: ff110001802c4a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.139958] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.151106] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.161187]
[ 1236.163649] =============================================\x0a
[ 1358.364631] INFO: task python3:5402 blocked for more than 491 seconds.
[ 1358.372780] Not tainted 7.1.0-rc7-ezdu-g4c3e3c1ac538 #1
[ 1358.380028] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.389614] task:python3 state:D stack:24976 pid:5402 tgid:5402 ppid:5401 task_flags:0x400100 flags:0x00080002
[ 1358.402821] Call Trace:
[ 1358.406360]
[ 1358.409508] __schedule+0xcc3/0x19c0
[ 1358.414323] ? io_schedule_timeout+0x140/0x140
[ 1358.420099] ? find_held_lock+0x2b/0x80
[ 1358.425204] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.431089] schedule+0xd8/0x260
[ 1358.435505] schedule_preempt_disabled+0x18/0x30
[ 1358.441482] __mutex_lock+0x6af/0x2010
[ 1358.446485] ? threaded_store+0x132/0x220
[ 1358.451783] ? ww_mutex_lock+0x160/0x160
[ 1358.456982] ? selinux_inode_free_security+0x330/0x330
[ 1358.463550] ? cap_capable+0x1d6/0x3e0
[ 1358.468556] ? threaded_store+0x132/0x220
[ 1358.473844] threaded_store+0x132/0x220
[ 1358.478945] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.484239] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.489536] ? sysfs_kf_write+0x65/0x160
[ 1358.494734] ? sysfs_file_ops+0x140/0x140
[ 1358.500027] kernfs_fop_write_iter+0x335/0x510
[ 1358.505810] ? kernfs_ops+0xf0/0xf0
[ 1358.510520] new_sync_write+0x333/0x750
[ 1358.515614] ? __lock_acquire+0x508/0xc10
[ 1358.520911] ? new_sync_read+0x740/0x740
[ 1358.526111] ? lock_acquire.part.0+0xbc/0x260
[ 1358.531798] ? ksys_write+0x116/0x250
[ 1358.536707] vfs_write+0x657/0x9b0
[ 1358.541321] ksys_write+0x116/0x250
[ 1358.546029] ? __ia32_sys_read+0xc0/0xc0
[ 1358.551226] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.556814] ? rcu_is_watching+0x15/0xd0
[ 1358.562016] do_syscall_64+0xf3/0x650
[ 1358.566923] ? trace_hardirqs_off+0xd/0x30
[ 1358.572310] ? exc_page_fault+0xda/0xf0
[ 1358.577412] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.583868] RIP: 0033:0x7fc55631064e
[ 1358.588676] RSP: 002b:00007ffddbb51250 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.597971] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc55631064e
[ 1358.606778] RDX: 0000000000000001 RSI: 00005617491acbf0 RDI: 0000000000000007
[ 1358.615584] RBP: 00007ffddbb51260 R08: 0000000000000000 R09: 0000000000000000
[ 1358.624389] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc556189390
[ 1358.633198] R13: 00005617491acbf0 R14: 0000000000000007 R15: 00007fc55611d120
[ 1358.642013]
[ 1358.645314] INFO: task python3:5402 is blocked on a mutex likely owned by task python3:3401.
[ 1358.655576] task:python3 state:D stack:25504 pid:3401 tgid:3401 ppid:3400 task_flags:0x400100 flags:0x00080802
[ 1358.668778] Call Trace:
[ 1358.672313]
[ 1358.675460] __schedule+0xcc3/0x19c0
[ 1358.680269] ? io_schedule_timeout+0x140/0x140
[ 1358.686054] ? find_held_lock+0x2b/0x80
[ 1358.691154] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.697329] schedule+0xd8/0x260
[ 1358.701748] schedule_timeout+0x13f/0x290
[ 1358.707043] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.713409] ? trace_contention_end+0xb3/0x1a0
[ 1358.719193] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.724881] ? ww_mutex_lock+0x160/0x160
[ 1358.730078] msleep+0x1b/0x30
[ 1358.734201] napi_set_threaded+0x3a5/0x440
[ 1358.739595] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.745090] netif_set_threaded+0x257/0x400
[ 1358.750582] threaded_store+0x1b8/0x220
[ 1358.755683] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.760979] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.766276] ? sysfs_kf_write+0x65/0x160
[ 1358.771477] ? sysfs_file_ops+0x140/0x140
[ 1358.776772] kernfs_fop_write_iter+0x335/0x510
[ 1358.782556] ? kernfs_ops+0xf0/0xf0
[ 1358.787268] new_sync_write+0x333/0x750
[ 1358.792369] ? __lock_acquire+0x508/0xc10
[ 1358.797665] ? new_sync_read+0x740/0x740
[ 1358.802863] ? lock_acquire.part.0+0xbc/0x260
[ 1358.808548] ? ksys_write+0x116/0x250
[ 1358.813457] vfs_write+0x657/0x9b0
[ 1358.818071] ksys_write+0x116/0x250
[ 1358.822781] ? __ia32_sys_read+0xc0/0xc0
[ 1358.827981] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.833566] ? rcu_is_watching+0x15/0xd0
[ 1358.838767] do_syscall_64+0xf3/0x650
[ 1358.843673] ? trace_hardirqs_off+0xd/0x30
[ 1358.849066] ? exc_page_fault+0xda/0xf0
[ 1358.854165] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.860631] RIP: 0033:0x7f978e4df64e
[ 1358.865438] RSP: 002b:00007ffdae54ceb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.874734] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f978e4df64e
[ 1358.883540] RDX: 0000000000000001 RSI: 00005558a4ef2bf0 RDI: 0000000000000007
[ 1358.892349] RBP: 00007ffdae54cec0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.901155] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f978e358390
[ 1358.909962] R13: 00005558a4ef2bf0 R14: 0000000000000007 R15: 00007f978e2ed120
[ 1358.918766]
[ 1358.922035] \x0aShowing all locks held in the system:
[ 1358.930573] 1 lock held by khungtaskd/186:
[ 1358.935967] #0: ffffffff94cfdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.947437] 2 locks held by systemd-journal/804:
[ 1358.953415] #0: ff1100180e7374e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.963300] #1: ffffffff94f02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1358.975540] 4 locks held by python3/3401:
[ 1358.980831] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.990718] #1: ff1100013f7cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.001677] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.012835] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.022928] 4 locks held by python3/5402:
[ 1359.028225] #0: ff11000130c693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.038111] #1: ff110001802c4a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.049073] #2: ff11000122c48b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.060220] #3: ff11000122b91e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.070312]
[ 1359.072775] =============================================\x0a