[ 769.614907] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 769.617611] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 769.769769] kselftest: Running tests in drivers/net
[ 989.677524] INFO: task python3:5488 blocked for more than 122 seconds.
[ 989.685752] Not tainted 7.1.0-rc7-gbwd-g5a4d7108effe #1
[ 989.693645] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.703234] task:python3 state:D stack:25672 pid:5488 tgid:5488 ppid:5487 task_flags:0x400100 flags:0x00080000
[ 989.716439] Call Trace:
[ 989.719976]
[ 989.723127] __schedule+0xcc3/0x19c0
[ 989.727944] ? io_schedule_timeout+0x140/0x140
[ 989.733725] ? find_held_lock+0x2b/0x80
[ 989.738827] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.744782] schedule+0xd8/0x260
[ 989.749202] schedule_preempt_disabled+0x18/0x30
[ 989.755174] __mutex_lock+0x6af/0x2010
[ 989.760178] ? threaded_store+0x132/0x220
[ 989.765466] ? ww_mutex_lock+0x160/0x160
[ 989.770663] ? selinux_inode_free_security+0x330/0x330
[ 989.777231] ? cap_capable+0x1d6/0x3e0
[ 989.782240] ? threaded_store+0x132/0x220
[ 989.787539] threaded_store+0x132/0x220
[ 989.792643] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.797936] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.803232] ? sysfs_kf_write+0x65/0x160
[ 989.808430] ? sysfs_file_ops+0x140/0x140
[ 989.813723] kernfs_fop_write_iter+0x335/0x510
[ 989.819505] ? kernfs_ops+0xf0/0xf0
[ 989.824216] new_sync_write+0x333/0x750
[ 989.829309] ? __lock_acquire+0x508/0xc10
[ 989.834680] ? new_sync_read+0x740/0x740
[ 989.839882] ? lock_acquire.part.0+0xbc/0x260
[ 989.845565] ? ksys_write+0x116/0x250
[ 989.850474] vfs_write+0x657/0x9b0
[ 989.855087] ksys_write+0x116/0x250
[ 989.859797] ? __ia32_sys_read+0xc0/0xc0
[ 989.864996] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.870582] ? rcu_is_watching+0x15/0xd0
[ 989.875786] do_syscall_64+0xf3/0x650
[ 989.880694] ? trace_hardirqs_off+0xd/0x30
[ 989.886090] ? exc_page_fault+0xda/0xf0
[ 989.891191] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.897656] RIP: 0033:0x7fd11ede164e
[ 989.902463] RSP: 002b:00007ffdc29cf1e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.911759] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd11ede164e
[ 989.920567] RDX: 0000000000000001 RSI: 0000562213ab7bf0 RDI: 0000000000000007
[ 989.929372] RBP: 00007ffdc29cf1f0 R08: 0000000000000000 R09: 0000000000000000
[ 989.938178] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd11ec5a390
[ 989.946988] R13: 0000562213ab7bf0 R14: 0000000000000007 R15: 00007fd11ebed120
[ 989.955808]
[ 989.959113] INFO: task python3:5488 is blocked on a mutex likely owned by task python3:3490.
[ 989.969387] task:python3 state:D stack:25568 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 989.982590] Call Trace:
[ 989.986132]
[ 989.989284] __schedule+0xcc3/0x19c0
[ 989.994096] ? io_schedule_timeout+0x140/0x140
[ 989.999879] ? find_held_lock+0x2b/0x80
[ 990.004984] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.011161] schedule+0xd8/0x260
[ 990.015579] schedule_timeout+0x13f/0x290
[ 990.020874] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.027244] ? trace_contention_end+0xb3/0x1a0
[ 990.033032] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.038724] ? ww_mutex_lock+0x160/0x160
[ 990.043925] msleep+0x1b/0x30
[ 990.048039] napi_set_threaded+0x3a5/0x440
[ 990.053435] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.058921] netif_set_threaded+0x257/0x400
[ 990.064431] threaded_store+0x1b8/0x220
[ 990.069527] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.074826] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.080124] ? sysfs_kf_write+0x65/0x160
[ 990.085316] ? sysfs_file_ops+0x140/0x140
[ 990.090614] kernfs_fop_write_iter+0x335/0x510
[ 990.096478] ? kernfs_ops+0xf0/0xf0
[ 990.101191] new_sync_write+0x333/0x750
[ 990.106296] ? __lock_acquire+0x508/0xc10
[ 990.111594] ? new_sync_read+0x740/0x740
[ 990.116788] ? lock_acquire.part.0+0xbc/0x260
[ 990.122475] ? ksys_write+0x116/0x250
[ 990.127378] vfs_write+0x657/0x9b0
[ 990.131995] ksys_write+0x116/0x250
[ 990.136709] ? __ia32_sys_read+0xc0/0xc0
[ 990.141911] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.147504] ? rcu_is_watching+0x15/0xd0
[ 990.152771] do_syscall_64+0xf3/0x650
[ 990.157677] ? irq_exit_rcu+0x1a/0x30
[ 990.162589] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.169057] RIP: 0033:0x7f28674fc64e
[ 990.173936] RSP: 002b:00007fffe4f70b90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.183235] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f28674fc64e
[ 990.192044] RDX: 0000000000000001 RSI: 00005628cccc3bf0 RDI: 0000000000000007
[ 990.200853] RBP: 00007fffe4f70ba0 R08: 0000000000000000 R09: 0000000000000000
[ 990.209664] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2867375390
[ 990.218474] R13: 00005628cccc3bf0 R14: 0000000000000007 R15: 00007f2867309120
[ 990.227290]
[ 990.230551] \x0aShowing all locks held in the system:
[ 990.239096] 1 lock held by khungtaskd/185:
[ 990.244495] #0: ffffffff9befdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.255983] 4 locks held by python3/3490:
[ 990.261278] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.271233] #1: ff1100014d25dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.282198] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.293422] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.303524] 4 locks held by python3/5488:
[ 990.308818] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.318707] #1: ff110001b1555c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.329659] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.340817] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.350905] 1 lock held by systemd/6157:
[ 990.356107]
[ 990.358576] =============================================\x0a
[ 1112.558644] INFO: task python3:5488 blocked for more than 245 seconds.
[ 1112.566794] Not tainted 7.1.0-rc7-gbwd-g5a4d7108effe #1
[ 1112.574042] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.583626] task:python3 state:D stack:25672 pid:5488 tgid:5488 ppid:5487 task_flags:0x400100 flags:0x00080000
[ 1112.596833] Call Trace:
[ 1112.600376]
[ 1112.603525] __schedule+0xcc3/0x19c0
[ 1112.608341] ? io_schedule_timeout+0x140/0x140
[ 1112.614125] ? find_held_lock+0x2b/0x80
[ 1112.619219] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.625105] schedule+0xd8/0x260
[ 1112.629525] schedule_preempt_disabled+0x18/0x30
[ 1112.635494] __mutex_lock+0x6af/0x2010
[ 1112.640500] ? threaded_store+0x132/0x220
[ 1112.645800] ? ww_mutex_lock+0x160/0x160
[ 1112.651001] ? selinux_inode_free_security+0x330/0x330
[ 1112.657572] ? cap_capable+0x1d6/0x3e0
[ 1112.662580] ? threaded_store+0x132/0x220
[ 1112.667875] threaded_store+0x132/0x220
[ 1112.672977] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.678268] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.683570] ? sysfs_kf_write+0x65/0x160
[ 1112.688771] ? sysfs_file_ops+0x140/0x140
[ 1112.694065] kernfs_fop_write_iter+0x335/0x510
[ 1112.699851] ? kernfs_ops+0xf0/0xf0
[ 1112.704563] new_sync_write+0x333/0x750
[ 1112.709666] ? __lock_acquire+0x508/0xc10
[ 1112.714963] ? new_sync_read+0x740/0x740
[ 1112.720154] ? lock_acquire.part.0+0xbc/0x260
[ 1112.725838] ? ksys_write+0x116/0x250
[ 1112.730749] vfs_write+0x657/0x9b0
[ 1112.735364] ksys_write+0x116/0x250
[ 1112.740065] ? __ia32_sys_read+0xc0/0xc0
[ 1112.745264] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.750852] ? rcu_is_watching+0x15/0xd0
[ 1112.756053] do_syscall_64+0xf3/0x650
[ 1112.760958] ? trace_hardirqs_off+0xd/0x30
[ 1112.766352] ? exc_page_fault+0xda/0xf0
[ 1112.771456] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.777925] RIP: 0033:0x7fd11ede164e
[ 1112.782733] RSP: 002b:00007ffdc29cf1e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.792035] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd11ede164e
[ 1112.800843] RDX: 0000000000000001 RSI: 0000562213ab7bf0 RDI: 0000000000000007
[ 1112.809650] RBP: 00007ffdc29cf1f0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.818448] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd11ec5a390
[ 1112.827259] R13: 0000562213ab7bf0 R14: 0000000000000007 R15: 00007fd11ebed120
[ 1112.836071]
[ 1112.839343] INFO: task python3:5488 is blocked on a mutex likely owned by task python3:3490.
[ 1112.849616] task:python3 state:D stack:25568 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1112.862820] Call Trace:
[ 1112.866356]
[ 1112.869506] __schedule+0xcc3/0x19c0
[ 1112.874317] ? io_schedule_timeout+0x140/0x140
[ 1112.880102] ? find_held_lock+0x2b/0x80
[ 1112.885204] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.891385] schedule+0xd8/0x260
[ 1112.895801] schedule_timeout+0x13f/0x290
[ 1112.901099] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.907466] ? trace_contention_end+0xb3/0x1a0
[ 1112.913254] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.918943] ? ww_mutex_lock+0x160/0x160
[ 1112.924142] msleep+0x1b/0x30
[ 1112.928269] napi_set_threaded+0x3a5/0x440
[ 1112.933666] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.939152] netif_set_threaded+0x257/0x400
[ 1112.944658] threaded_store+0x1b8/0x220
[ 1112.949760] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.955057] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.960345] ? sysfs_kf_write+0x65/0x160
[ 1112.965547] ? sysfs_file_ops+0x140/0x140
[ 1112.970845] kernfs_fop_write_iter+0x335/0x510
[ 1112.976630] ? kernfs_ops+0xf0/0xf0
[ 1112.981334] new_sync_write+0x333/0x750
[ 1112.986438] ? __lock_acquire+0x508/0xc10
[ 1112.991727] ? new_sync_read+0x740/0x740
[ 1112.996927] ? lock_acquire.part.0+0xbc/0x260
[ 1113.002615] ? ksys_write+0x116/0x250
[ 1113.007527] vfs_write+0x657/0x9b0
[ 1113.012142] ksys_write+0x116/0x250
[ 1113.016845] ? __ia32_sys_read+0xc0/0xc0
[ 1113.022047] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.027636] ? rcu_is_watching+0x15/0xd0
[ 1113.032838] do_syscall_64+0xf3/0x650
[ 1113.037747] ? irq_exit_rcu+0x1a/0x30
[ 1113.042654] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.049122] RIP: 0033:0x7f28674fc64e
[ 1113.053932] RSP: 002b:00007fffe4f70b90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.063228] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f28674fc64e
[ 1113.072035] RDX: 0000000000000001 RSI: 00005628cccc3bf0 RDI: 0000000000000007
[ 1113.080843] RBP: 00007fffe4f70ba0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.089653] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2867375390
[ 1113.098461] R13: 00005628cccc3bf0 R14: 0000000000000007 R15: 00007f2867309120
[ 1113.107264]
[ 1113.110527] \x0aShowing all locks held in the system:
[ 1113.119066] 1 lock held by khungtaskd/185:
[ 1113.124460] #0: ffffffff9befdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.135932] 2 locks held by systemd-journal/805:
[ 1113.141911] #0: ff1100180e4374e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.151798] #1: ffffffff9c102ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.164626] 4 locks held by python3/3490:
[ 1113.169923] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.179810] #1: ff1100014d25dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.190774] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.201932] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.212026] 4 locks held by python3/5488:
[ 1113.217324] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.227214] #1: ff110001b1555c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.238178] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.249334] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.259426]
[ 1113.261894] =============================================\x0a
[ 1235.439769] INFO: task python3:5488 blocked for more than 368 seconds.
[ 1235.447918] Not tainted 7.1.0-rc7-gbwd-g5a4d7108effe #1
[ 1235.455169] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.464759] task:python3 state:D stack:25672 pid:5488 tgid:5488 ppid:5487 task_flags:0x400100 flags:0x00080002
[ 1235.477966] Call Trace:
[ 1235.481508]
[ 1235.484661] __schedule+0xcc3/0x19c0
[ 1235.489481] ? io_schedule_timeout+0x140/0x140
[ 1235.495269] ? find_held_lock+0x2b/0x80
[ 1235.500376] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.506261] schedule+0xd8/0x260
[ 1235.510680] schedule_preempt_disabled+0x18/0x30
[ 1235.516658] __mutex_lock+0x6af/0x2010
[ 1235.521664] ? threaded_store+0x132/0x220
[ 1235.526963] ? ww_mutex_lock+0x160/0x160
[ 1235.532154] ? selinux_inode_free_security+0x330/0x330
[ 1235.538726] ? cap_capable+0x1d6/0x3e0
[ 1235.543737] ? threaded_store+0x132/0x220
[ 1235.549032] threaded_store+0x132/0x220
[ 1235.554133] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.559432] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.564733] ? sysfs_kf_write+0x65/0x160
[ 1235.569934] ? sysfs_file_ops+0x140/0x140
[ 1235.575232] kernfs_fop_write_iter+0x335/0x510
[ 1235.581016] ? kernfs_ops+0xf0/0xf0
[ 1235.585728] new_sync_write+0x333/0x750
[ 1235.590834] ? __lock_acquire+0x508/0xc10
[ 1235.596131] ? new_sync_read+0x740/0x740
[ 1235.601331] ? lock_acquire.part.0+0xbc/0x260
[ 1235.607019] ? ksys_write+0x116/0x250
[ 1235.611928] vfs_write+0x657/0x9b0
[ 1235.616545] ksys_write+0x116/0x250
[ 1235.621259] ? __ia32_sys_read+0xc0/0xc0
[ 1235.626456] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.632046] ? rcu_is_watching+0x15/0xd0
[ 1235.637248] do_syscall_64+0xf3/0x650
[ 1235.642157] ? trace_hardirqs_off+0xd/0x30
[ 1235.647554] ? exc_page_fault+0xda/0xf0
[ 1235.652657] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.659124] RIP: 0033:0x7fd11ede164e
[ 1235.663935] RSP: 002b:00007ffdc29cf1e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.673233] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd11ede164e
[ 1235.682040] RDX: 0000000000000001 RSI: 0000562213ab7bf0 RDI: 0000000000000007
[ 1235.690847] RBP: 00007ffdc29cf1f0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.699654] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd11ec5a390
[ 1235.708462] R13: 0000562213ab7bf0 R14: 0000000000000007 R15: 00007fd11ebed120
[ 1235.717277]
[ 1235.720553] INFO: task python3:5488 is blocked on a mutex likely owned by task python3:3490.
[ 1235.730825] task:python3 state:D stack:25568 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1235.744029] Call Trace:
[ 1235.747567]
[ 1235.750720] __schedule+0xcc3/0x19c0
[ 1235.755532] ? io_schedule_timeout+0x140/0x140
[ 1235.761316] ? find_held_lock+0x2b/0x80
[ 1235.766420] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.772601] schedule+0xd8/0x260
[ 1235.777026] schedule_timeout+0x13f/0x290
[ 1235.782320] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.788691] ? trace_contention_end+0xb3/0x1a0
[ 1235.794478] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.800170] ? ww_mutex_lock+0x160/0x160
[ 1235.805372] msleep+0x1b/0x30
[ 1235.809497] napi_set_threaded+0x3a5/0x440
[ 1235.814895] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.820392] netif_set_threaded+0x257/0x400
[ 1235.825886] threaded_store+0x1b8/0x220
[ 1235.830990] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.836287] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.841577] ? sysfs_kf_write+0x65/0x160
[ 1235.846779] ? sysfs_file_ops+0x140/0x140
[ 1235.852077] kernfs_fop_write_iter+0x335/0x510
[ 1235.857861] ? kernfs_ops+0xf0/0xf0
[ 1235.862571] new_sync_write+0x333/0x750
[ 1235.867674] ? __lock_acquire+0x508/0xc10
[ 1235.872961] ? new_sync_read+0x740/0x740
[ 1235.878163] ? lock_acquire.part.0+0xbc/0x260
[ 1235.883849] ? ksys_write+0x116/0x250
[ 1235.888759] vfs_write+0x657/0x9b0
[ 1235.893376] ksys_write+0x116/0x250
[ 1235.898088] ? __ia32_sys_read+0xc0/0xc0
[ 1235.903285] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.908874] ? rcu_is_watching+0x15/0xd0
[ 1235.914074] do_syscall_64+0xf3/0x650
[ 1235.918975] ? irq_exit_rcu+0x1a/0x30
[ 1235.923881] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.930346] RIP: 0033:0x7f28674fc64e
[ 1235.935155] RSP: 002b:00007fffe4f70b90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.944444] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f28674fc64e
[ 1235.953250] RDX: 0000000000000001 RSI: 00005628cccc3bf0 RDI: 0000000000000007
[ 1235.962057] RBP: 00007fffe4f70ba0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.970865] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2867375390
[ 1235.979674] R13: 00005628cccc3bf0 R14: 0000000000000007 R15: 00007f2867309120
[ 1235.988490]
[ 1235.991757] \x0aShowing all locks held in the system:
[ 1236.000295] 1 lock held by khungtaskd/185:
[ 1236.005690] #0: ffffffff9befdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.017163] 4 locks held by python3/3490:
[ 1236.022460] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.032350] #1: ff1100014d25dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.043313] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.054469] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.064564] 4 locks held by python3/5488:
[ 1236.069862] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.079752] #1: ff110001b1555c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.090715] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.101873] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.111968]
[ 1236.114435] =============================================\x0a
[ 1358.320901] INFO: task python3:5488 blocked for more than 491 seconds.
[ 1358.329582] Not tainted 7.1.0-rc7-gbwd-g5a4d7108effe #1
[ 1358.336842] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.346432] task:python3 state:D stack:25672 pid:5488 tgid:5488 ppid:5487 task_flags:0x400100 flags:0x00080002
[ 1358.359646] Call Trace:
[ 1358.363276]
[ 1358.366427] __schedule+0xcc3/0x19c0
[ 1358.371243] ? io_schedule_timeout+0x140/0x140
[ 1358.377028] ? find_held_lock+0x2b/0x80
[ 1358.382129] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.388012] schedule+0xd8/0x260
[ 1358.392427] schedule_preempt_disabled+0x18/0x30
[ 1358.398407] __mutex_lock+0x6af/0x2010
[ 1358.403404] ? threaded_store+0x132/0x220
[ 1358.408700] ? ww_mutex_lock+0x160/0x160
[ 1358.413898] ? selinux_inode_free_security+0x330/0x330
[ 1358.420458] ? cap_capable+0x1d6/0x3e0
[ 1358.425466] ? threaded_store+0x132/0x220
[ 1358.430762] threaded_store+0x132/0x220
[ 1358.435860] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.441154] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.446450] ? sysfs_kf_write+0x65/0x160
[ 1358.451650] ? sysfs_file_ops+0x140/0x140
[ 1358.456946] kernfs_fop_write_iter+0x335/0x510
[ 1358.462728] ? kernfs_ops+0xf0/0xf0
[ 1358.467439] new_sync_write+0x333/0x750
[ 1358.472543] ? __lock_acquire+0x508/0xc10
[ 1358.477837] ? new_sync_read+0x740/0x740
[ 1358.483037] ? lock_acquire.part.0+0xbc/0x260
[ 1358.488725] ? ksys_write+0x116/0x250
[ 1358.493634] vfs_write+0x657/0x9b0
[ 1358.498249] ksys_write+0x116/0x250
[ 1358.502952] ? __ia32_sys_read+0xc0/0xc0
[ 1358.508148] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.513741] ? rcu_is_watching+0x15/0xd0
[ 1358.518941] do_syscall_64+0xf3/0x650
[ 1358.523838] ? trace_hardirqs_off+0xd/0x30
[ 1358.529231] ? exc_page_fault+0xda/0xf0
[ 1358.534329] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.540794] RIP: 0033:0x7fd11ede164e
[ 1358.545605] RSP: 002b:00007ffdc29cf1e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.554902] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd11ede164e
[ 1358.563702] RDX: 0000000000000001 RSI: 0000562213ab7bf0 RDI: 0000000000000007
[ 1358.572506] RBP: 00007ffdc29cf1f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.581310] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd11ec5a390
[ 1358.590114] R13: 0000562213ab7bf0 R14: 0000000000000007 R15: 00007fd11ebed120
[ 1358.598926]
[ 1358.602228] INFO: task python3:5488 is blocked on a mutex likely owned by task python3:3490.
[ 1358.612498] task:python3 state:D stack:25568 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1358.625698] Call Trace:
[ 1358.629227]
[ 1358.632374] __schedule+0xcc3/0x19c0
[ 1358.637186] ? io_schedule_timeout+0x140/0x140
[ 1358.642967] ? find_held_lock+0x2b/0x80
[ 1358.648066] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.654245] schedule+0xd8/0x260
[ 1358.658664] schedule_timeout+0x13f/0x290
[ 1358.663960] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.670326] ? trace_contention_end+0xb3/0x1a0
[ 1358.676108] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.681796] ? ww_mutex_lock+0x160/0x160
[ 1358.686992] msleep+0x1b/0x30
[ 1358.691115] napi_set_threaded+0x3a5/0x440
[ 1358.696509] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.702002] netif_set_threaded+0x257/0x400
[ 1358.707493] threaded_store+0x1b8/0x220
[ 1358.712593] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.717886] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.723183] ? sysfs_kf_write+0x65/0x160
[ 1358.728380] ? sysfs_file_ops+0x140/0x140
[ 1358.733672] kernfs_fop_write_iter+0x335/0x510
[ 1358.739455] ? kernfs_ops+0xf0/0xf0
[ 1358.744167] new_sync_write+0x333/0x750
[ 1358.749266] ? __lock_acquire+0x508/0xc10
[ 1358.754564] ? new_sync_read+0x740/0x740
[ 1358.759766] ? lock_acquire.part.0+0xbc/0x260
[ 1358.765449] ? ksys_write+0x116/0x250
[ 1358.770359] vfs_write+0x657/0x9b0
[ 1358.774971] ksys_write+0x116/0x250
[ 1358.779681] ? __ia32_sys_read+0xc0/0xc0
[ 1358.784879] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.790467] ? rcu_is_watching+0x15/0xd0
[ 1358.795667] do_syscall_64+0xf3/0x650
[ 1358.800563] ? irq_exit_rcu+0x1a/0x30
[ 1358.805472] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.811937] RIP: 0033:0x7f28674fc64e
[ 1358.816745] RSP: 002b:00007fffe4f70b90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.826039] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f28674fc64e
[ 1358.834847] RDX: 0000000000000001 RSI: 00005628cccc3bf0 RDI: 0000000000000007
[ 1358.843653] RBP: 00007fffe4f70ba0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.852460] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2867375390
[ 1358.861266] R13: 00005628cccc3bf0 R14: 0000000000000007 R15: 00007f2867309120
[ 1358.870079]
[ 1358.873348] \x0aShowing all locks held in the system:
[ 1358.881885] 1 lock held by khungtaskd/185:
[ 1358.887279] #0: ffffffff9befdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.898756] 2 locks held by systemd-journal/805:
[ 1358.904732] #0: ff1100180e7b74e0 (&rq->__lock){-.-.}-{2:2}, at: schedule+0x10f/0x260
[ 1358.914333] #1: ffffffff9c102ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.927159] 4 locks held by python3/3490:
[ 1358.932452] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.942338] #1: ff1100014d25dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.953301] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.964455] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.974549] 4 locks held by python3/5488:
[ 1358.979844] #0: ff1100013068c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.989732] #1: ff110001b1555c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.000698] #2: ff11000123acab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.011847] #3: ff11000123a81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.021939]
[ 1359.024405] =============================================\x0a