[ 769.706544] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 769.709265] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 769.862215] kselftest: Running tests in drivers/net
[ 989.685063] INFO: task python3:5476 blocked for more than 122 seconds.
[ 989.693285] Not tainted 7.1.0-rc7-vyqx-g1456fb84a342 #1
[ 989.701129] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.710716] task:python3 state:D stack:25672 pid:5476 tgid:5476 ppid:5475 task_flags:0x400100 flags:0x00080000
[ 989.723921] Call Trace:
[ 989.727460]
[ 989.730610] __schedule+0xcc3/0x19c0
[ 989.735426] ? io_schedule_timeout+0x140/0x140
[ 989.741210] ? find_held_lock+0x2b/0x80
[ 989.746315] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.752198] schedule+0xd8/0x260
[ 989.756617] schedule_preempt_disabled+0x18/0x30
[ 989.762596] __mutex_lock+0x6af/0x2010
[ 989.767602] ? threaded_store+0x132/0x220
[ 989.772905] ? ww_mutex_lock+0x160/0x160
[ 989.778103] ? selinux_inode_free_security+0x330/0x330
[ 989.784670] ? cap_capable+0x1d6/0x3e0
[ 989.789677] ? threaded_store+0x132/0x220
[ 989.794971] threaded_store+0x132/0x220
[ 989.800072] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.805369] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.810668] ? sysfs_kf_write+0x65/0x160
[ 989.815865] ? sysfs_file_ops+0x140/0x140
[ 989.821161] kernfs_fop_write_iter+0x335/0x510
[ 989.826946] ? kernfs_ops+0xf0/0xf0
[ 989.831650] new_sync_write+0x333/0x750
[ 989.836751] ? __lock_acquire+0x508/0xc10
[ 989.842047] ? new_sync_read+0x740/0x740
[ 989.847247] ? lock_acquire.part.0+0xbc/0x260
[ 989.852932] ? ksys_write+0x116/0x250
[ 989.857842] vfs_write+0x657/0x9b0
[ 989.862456] ksys_write+0x116/0x250
[ 989.867167] ? __ia32_sys_read+0xc0/0xc0
[ 989.872362] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.877953] ? rcu_is_watching+0x15/0xd0
[ 989.883152] do_syscall_64+0xf3/0x650
[ 989.888058] ? trace_hardirqs_off+0xd/0x30
[ 989.893452] ? exc_page_fault+0xda/0xf0
[ 989.898553] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.905021] RIP: 0033:0x7f5c83cc964e
[ 989.909829] RSP: 002b:00007ffd457f59c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.919126] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c83cc964e
[ 989.927934] RDX: 0000000000000001 RSI: 000055e350012bf0 RDI: 0000000000000007
[ 989.936733] RBP: 00007ffd457f59d0 R08: 0000000000000000 R09: 0000000000000000
[ 989.945541] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c83b42390
[ 989.954349] R13: 000055e350012bf0 R14: 0000000000000007 R15: 00007f5c83ad5120
[ 989.963158]
[ 989.966474] INFO: task python3:5476 is blocked on a mutex likely owned by task python3:3490.
[ 989.976743] task:python3 state:D stack:25672 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 989.989945] Call Trace:
[ 989.993484]
[ 989.996631] __schedule+0xcc3/0x19c0
[ 990.001441] ? io_schedule_timeout+0x140/0x140
[ 990.007215] ? find_held_lock+0x2b/0x80
[ 990.012316] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.018492] schedule+0xd8/0x260
[ 990.022911] schedule_timeout+0x13f/0x290
[ 990.028205] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.034574] ? trace_contention_end+0xb3/0x1a0
[ 990.040359] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.046050] ? ww_mutex_lock+0x160/0x160
[ 990.051249] msleep+0x1b/0x30
[ 990.055371] napi_set_threaded+0x3a5/0x440
[ 990.060766] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.066261] netif_set_threaded+0x257/0x400
[ 990.071752] threaded_store+0x1b8/0x220
[ 990.076855] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.082153] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.087438] ? sysfs_kf_write+0x65/0x160
[ 990.092636] ? sysfs_file_ops+0x140/0x140
[ 990.097930] kernfs_fop_write_iter+0x335/0x510
[ 990.103713] ? kernfs_ops+0xf0/0xf0
[ 990.108425] new_sync_write+0x333/0x750
[ 990.113526] ? __lock_acquire+0x508/0xc10
[ 990.118821] ? new_sync_read+0x740/0x740
[ 990.124019] ? lock_acquire.part.0+0xbc/0x260
[ 990.129705] ? ksys_write+0x116/0x250
[ 990.134612] vfs_write+0x657/0x9b0
[ 990.139226] ksys_write+0x116/0x250
[ 990.143937] ? __ia32_sys_read+0xc0/0xc0
[ 990.149136] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.154726] ? rcu_is_watching+0x15/0xd0
[ 990.159915] do_syscall_64+0xf3/0x650
[ 990.164819] ? trace_hardirqs_off+0xd/0x30
[ 990.170213] ? exc_page_fault+0xda/0xf0
[ 990.175315] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.181778] RIP: 0033:0x7f25c7c4f64e
[ 990.186587] RSP: 002b:00007ffd66ce0300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.195882] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25c7c4f64e
[ 990.204689] RDX: 0000000000000001 RSI: 000055bb8bf63bf0 RDI: 0000000000000007
[ 990.213498] RBP: 00007ffd66ce0310 R08: 0000000000000000 R09: 0000000000000000
[ 990.222305] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25c7ac8390
[ 990.231109] R13: 000055bb8bf63bf0 R14: 0000000000000007 R15: 00007f25c7a5d120
[ 990.239924]
[ 990.243183] \x0aShowing all locks held in the system:
[ 990.251721] 1 lock held by khungtaskd/185:
[ 990.257111] #0: ffffffffa32fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.268585] 2 locks held by systemd-journal/805:
[ 990.274563] #0: ff1100180dfb74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.284449] #1: ffffffffa3502ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: lockref_get_not_dead+0xe/0x60
[ 990.297274] 4 locks held by python3/3490:
[ 990.302568] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.312454] #1: ff1100013f0a6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.323415] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.334565] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.344666] 4 locks held by python3/5476:
[ 990.349960] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.359846] #1: ff110001a67bc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.370806] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.381963] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.392039]
[ 990.394503] =============================================\x0a
[ 1112.565147] INFO: task python3:5476 blocked for more than 245 seconds.
[ 1112.573300] Not tainted 7.1.0-rc7-vyqx-g1456fb84a342 #1
[ 1112.580550] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.590139] task:python3 state:D stack:25672 pid:5476 tgid:5476 ppid:5475 task_flags:0x400100 flags:0x00080000
[ 1112.603336] Call Trace:
[ 1112.606876]
[ 1112.610027] __schedule+0xcc3/0x19c0
[ 1112.614846] ? io_schedule_timeout+0x140/0x140
[ 1112.620634] ? find_held_lock+0x2b/0x80
[ 1112.625738] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.631627] schedule+0xd8/0x260
[ 1112.636045] schedule_preempt_disabled+0x18/0x30
[ 1112.642027] __mutex_lock+0x6af/0x2010
[ 1112.647035] ? threaded_store+0x132/0x220
[ 1112.652337] ? ww_mutex_lock+0x160/0x160
[ 1112.657536] ? selinux_inode_free_security+0x330/0x330
[ 1112.664106] ? cap_capable+0x1d6/0x3e0
[ 1112.669116] ? threaded_store+0x132/0x220
[ 1112.674412] threaded_store+0x132/0x220
[ 1112.679519] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.684818] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.690184] ? sysfs_kf_write+0x65/0x160
[ 1112.695383] ? sysfs_file_ops+0x140/0x140
[ 1112.700680] kernfs_fop_write_iter+0x335/0x510
[ 1112.706466] ? kernfs_ops+0xf0/0xf0
[ 1112.711176] new_sync_write+0x333/0x750
[ 1112.716271] ? __lock_acquire+0x508/0xc10
[ 1112.721570] ? new_sync_read+0x740/0x740
[ 1112.726772] ? lock_acquire.part.0+0xbc/0x260
[ 1112.732458] ? ksys_write+0x116/0x250
[ 1112.737369] vfs_write+0x657/0x9b0
[ 1112.741990] ksys_write+0x116/0x250
[ 1112.746703] ? __ia32_sys_read+0xc0/0xc0
[ 1112.751906] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.757496] ? rcu_is_watching+0x15/0xd0
[ 1112.762701] do_syscall_64+0xf3/0x650
[ 1112.767605] ? trace_hardirqs_off+0xd/0x30
[ 1112.773001] ? exc_page_fault+0xda/0xf0
[ 1112.778106] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.784574] RIP: 0033:0x7f5c83cc964e
[ 1112.789383] RSP: 002b:00007ffd457f59c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.798682] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c83cc964e
[ 1112.807490] RDX: 0000000000000001 RSI: 000055e350012bf0 RDI: 0000000000000007
[ 1112.816289] RBP: 00007ffd457f59d0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.825090] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c83b42390
[ 1112.833899] R13: 000055e350012bf0 R14: 0000000000000007 R15: 00007f5c83ad5120
[ 1112.842712]
[ 1112.846046] INFO: task python3:5476 is blocked on a mutex likely owned by task python3:3490.
[ 1112.856318] task:python3 state:D stack:25672 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1112.869522] Call Trace:
[ 1112.873062]
[ 1112.876214] __schedule+0xcc3/0x19c0
[ 1112.881028] ? io_schedule_timeout+0x140/0x140
[ 1112.886812] ? find_held_lock+0x2b/0x80
[ 1112.891917] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.898096] schedule+0xd8/0x260
[ 1112.902515] schedule_timeout+0x13f/0x290
[ 1112.907811] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.914181] ? trace_contention_end+0xb3/0x1a0
[ 1112.919969] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.925658] ? ww_mutex_lock+0x160/0x160
[ 1112.930859] msleep+0x1b/0x30
[ 1112.934988] napi_set_threaded+0x3a5/0x440
[ 1112.940384] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.945878] netif_set_threaded+0x257/0x400
[ 1112.951373] threaded_store+0x1b8/0x220
[ 1112.956475] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.961772] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.967068] ? sysfs_kf_write+0x65/0x160
[ 1112.972266] ? sysfs_file_ops+0x140/0x140
[ 1112.977564] kernfs_fop_write_iter+0x335/0x510
[ 1112.983348] ? kernfs_ops+0xf0/0xf0
[ 1112.988062] new_sync_write+0x333/0x750
[ 1112.993167] ? __lock_acquire+0x508/0xc10
[ 1112.998464] ? new_sync_read+0x740/0x740
[ 1113.003664] ? lock_acquire.part.0+0xbc/0x260
[ 1113.009349] ? ksys_write+0x116/0x250
[ 1113.014258] vfs_write+0x657/0x9b0
[ 1113.018876] ksys_write+0x116/0x250
[ 1113.023589] ? __ia32_sys_read+0xc0/0xc0
[ 1113.028787] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.034377] ? rcu_is_watching+0x15/0xd0
[ 1113.039579] do_syscall_64+0xf3/0x650
[ 1113.044487] ? trace_hardirqs_off+0xd/0x30
[ 1113.049880] ? exc_page_fault+0xda/0xf0
[ 1113.054986] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.061452] RIP: 0033:0x7f25c7c4f64e
[ 1113.066261] RSP: 002b:00007ffd66ce0300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.075560] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25c7c4f64e
[ 1113.084366] RDX: 0000000000000001 RSI: 000055bb8bf63bf0 RDI: 0000000000000007
[ 1113.093173] RBP: 00007ffd66ce0310 R08: 0000000000000000 R09: 0000000000000000
[ 1113.101984] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25c7ac8390
[ 1113.110793] R13: 000055bb8bf63bf0 R14: 0000000000000007 R15: 00007f25c7a5d120
[ 1113.119608]
[ 1113.122871] \x0aShowing all locks held in the system:
[ 1113.131413] 1 lock held by khungtaskd/185:
[ 1113.136808] #0: ffffffffa32fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.148292] 4 locks held by python3/3490:
[ 1113.153590] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.163478] #1: ff1100013f0a6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.174441] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.185596] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.195696] 4 locks held by python3/5476:
[ 1113.200993] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.210882] #1: ff110001a67bc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.221843] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.233004] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.243095]
[ 1113.245563] =============================================\x0a
[ 1235.446212] INFO: task python3:5476 blocked for more than 368 seconds.
[ 1235.454363] Not tainted 7.1.0-rc7-vyqx-g1456fb84a342 #1
[ 1235.461613] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.471195] task:python3 state:D stack:25672 pid:5476 tgid:5476 ppid:5475 task_flags:0x400100 flags:0x00080002
[ 1235.484402] Call Trace:
[ 1235.487942]
[ 1235.491094] __schedule+0xcc3/0x19c0
[ 1235.495911] ? io_schedule_timeout+0x140/0x140
[ 1235.501695] ? find_held_lock+0x2b/0x80
[ 1235.506800] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.512684] schedule+0xd8/0x260
[ 1235.517103] schedule_preempt_disabled+0x18/0x30
[ 1235.523080] __mutex_lock+0x6af/0x2010
[ 1235.528086] ? threaded_store+0x132/0x220
[ 1235.533383] ? ww_mutex_lock+0x160/0x160
[ 1235.538583] ? selinux_inode_free_security+0x330/0x330
[ 1235.545154] ? cap_capable+0x1d6/0x3e0
[ 1235.550163] ? threaded_store+0x132/0x220
[ 1235.555461] threaded_store+0x132/0x220
[ 1235.560555] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.565844] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.571145] ? sysfs_kf_write+0x65/0x160
[ 1235.576344] ? sysfs_file_ops+0x140/0x140
[ 1235.581640] kernfs_fop_write_iter+0x335/0x510
[ 1235.587422] ? kernfs_ops+0xf0/0xf0
[ 1235.592134] new_sync_write+0x333/0x750
[ 1235.597238] ? __lock_acquire+0x508/0xc10
[ 1235.602534] ? new_sync_read+0x740/0x740
[ 1235.607735] ? lock_acquire.part.0+0xbc/0x260
[ 1235.613420] ? ksys_write+0x116/0x250
[ 1235.618328] vfs_write+0x657/0x9b0
[ 1235.622932] ksys_write+0x116/0x250
[ 1235.627643] ? __ia32_sys_read+0xc0/0xc0
[ 1235.632841] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.638430] ? rcu_is_watching+0x15/0xd0
[ 1235.643630] do_syscall_64+0xf3/0x650
[ 1235.648534] ? trace_hardirqs_off+0xd/0x30
[ 1235.653927] ? exc_page_fault+0xda/0xf0
[ 1235.659029] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.665495] RIP: 0033:0x7f5c83cc964e
[ 1235.670305] RSP: 002b:00007ffd457f59c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.679601] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c83cc964e
[ 1235.688406] RDX: 0000000000000001 RSI: 000055e350012bf0 RDI: 0000000000000007
[ 1235.697212] RBP: 00007ffd457f59d0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.706018] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c83b42390
[ 1235.714822] R13: 000055e350012bf0 R14: 0000000000000007 R15: 00007f5c83ad5120
[ 1235.723634]
[ 1235.726946] INFO: task python3:5476 is blocked on a mutex likely owned by task python3:3490.
[ 1235.737216] task:python3 state:D stack:25672 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1235.750415] Call Trace:
[ 1235.753951]
[ 1235.757100] __schedule+0xcc3/0x19c0
[ 1235.761912] ? io_schedule_timeout+0x140/0x140
[ 1235.767696] ? find_held_lock+0x2b/0x80
[ 1235.772797] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.778966] schedule+0xd8/0x260
[ 1235.783384] schedule_timeout+0x13f/0x290
[ 1235.788679] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.795048] ? trace_contention_end+0xb3/0x1a0
[ 1235.800837] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.806525] ? ww_mutex_lock+0x160/0x160
[ 1235.811716] msleep+0x1b/0x30
[ 1235.815841] napi_set_threaded+0x3a5/0x440
[ 1235.821235] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.826728] netif_set_threaded+0x257/0x400
[ 1235.832221] threaded_store+0x1b8/0x220
[ 1235.837322] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.842619] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.847915] ? sysfs_kf_write+0x65/0x160
[ 1235.853114] ? sysfs_file_ops+0x140/0x140
[ 1235.858411] kernfs_fop_write_iter+0x335/0x510
[ 1235.864195] ? kernfs_ops+0xf0/0xf0
[ 1235.868906] new_sync_write+0x333/0x750
[ 1235.874008] ? __lock_acquire+0x508/0xc10
[ 1235.879304] ? new_sync_read+0x740/0x740
[ 1235.884504] ? lock_acquire.part.0+0xbc/0x260
[ 1235.890183] ? ksys_write+0x116/0x250
[ 1235.895093] vfs_write+0x657/0x9b0
[ 1235.899708] ksys_write+0x116/0x250
[ 1235.904419] ? __ia32_sys_read+0xc0/0xc0
[ 1235.909615] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.915201] ? rcu_is_watching+0x15/0xd0
[ 1235.920399] do_syscall_64+0xf3/0x650
[ 1235.925303] ? trace_hardirqs_off+0xd/0x30
[ 1235.930695] ? exc_page_fault+0xda/0xf0
[ 1235.935798] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.942253] RIP: 0033:0x7f25c7c4f64e
[ 1235.947060] RSP: 002b:00007ffd66ce0300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.956364] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25c7c4f64e
[ 1235.965173] RDX: 0000000000000001 RSI: 000055bb8bf63bf0 RDI: 0000000000000007
[ 1235.973981] RBP: 00007ffd66ce0310 R08: 0000000000000000 R09: 0000000000000000
[ 1235.982776] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25c7ac8390
[ 1235.991581] R13: 000055bb8bf63bf0 R14: 0000000000000007 R15: 00007f25c7a5d120
[ 1236.000392]
[ 1236.003657] \x0aShowing all locks held in the system:
[ 1236.012242] 2 locks held by systemd/1:
[ 1236.017274] 1 lock held by khungtaskd/185:
[ 1236.022664] #0: ffffffffa32fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.034158] 4 locks held by python3/3490:
[ 1236.039453] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.049340] #1: ff1100013f0a6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.060300] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.071454] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.081555] 4 locks held by python3/5476:
[ 1236.086850] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.096736] #1: ff110001a67bc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.107699] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.118856] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.128945]
[ 1236.131433] =============================================\x0a
[ 1358.328303] INFO: task python3:5476 blocked for more than 491 seconds.
[ 1358.336454] Not tainted 7.1.0-rc7-vyqx-g1456fb84a342 #1
[ 1358.343704] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.353297] task:python3 state:D stack:25672 pid:5476 tgid:5476 ppid:5475 task_flags:0x400100 flags:0x00080002
[ 1358.366502] Call Trace:
[ 1358.370042]
[ 1358.373193] __schedule+0xcc3/0x19c0
[ 1358.378012] ? io_schedule_timeout+0x140/0x140
[ 1358.383799] ? find_held_lock+0x2b/0x80
[ 1358.388901] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.394777] schedule+0xd8/0x260
[ 1358.399198] schedule_preempt_disabled+0x18/0x30
[ 1358.405177] __mutex_lock+0x6af/0x2010
[ 1358.410182] ? threaded_store+0x132/0x220
[ 1358.415481] ? ww_mutex_lock+0x160/0x160
[ 1358.420672] ? selinux_inode_free_security+0x330/0x330
[ 1358.427243] ? cap_capable+0x1d6/0x3e0
[ 1358.432254] ? threaded_store+0x132/0x220
[ 1358.437552] threaded_store+0x132/0x220
[ 1358.442654] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.447953] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.453254] ? sysfs_kf_write+0x65/0x160
[ 1358.458458] ? sysfs_file_ops+0x140/0x140
[ 1358.463754] kernfs_fop_write_iter+0x335/0x510
[ 1358.469542] ? kernfs_ops+0xf0/0xf0
[ 1358.474252] new_sync_write+0x333/0x750
[ 1358.479350] ? __lock_acquire+0x508/0xc10
[ 1358.484649] ? new_sync_read+0x740/0x740
[ 1358.489851] ? lock_acquire.part.0+0xbc/0x260
[ 1358.495538] ? ksys_write+0x116/0x250
[ 1358.500447] vfs_write+0x657/0x9b0
[ 1358.505063] ksys_write+0x116/0x250
[ 1358.509774] ? __ia32_sys_read+0xc0/0xc0
[ 1358.514975] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.520566] ? rcu_is_watching+0x15/0xd0
[ 1358.525771] do_syscall_64+0xf3/0x650
[ 1358.530679] ? trace_hardirqs_off+0xd/0x30
[ 1358.536076] ? exc_page_fault+0xda/0xf0
[ 1358.541181] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.547648] RIP: 0033:0x7f5c83cc964e
[ 1358.552450] RSP: 002b:00007ffd457f59c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.561750] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c83cc964e
[ 1358.570556] RDX: 0000000000000001 RSI: 000055e350012bf0 RDI: 0000000000000007
[ 1358.579366] RBP: 00007ffd457f59d0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.588173] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c83b42390
[ 1358.596972] R13: 000055e350012bf0 R14: 0000000000000007 R15: 00007f5c83ad5120
[ 1358.605777]
[ 1358.609052] INFO: task python3:5476 is blocked on a mutex likely owned by task python3:3490.
[ 1358.619325] task:python3 state:D stack:25672 pid:3490 tgid:3490 ppid:3489 task_flags:0x400100 flags:0x00080802
[ 1358.632527] Call Trace:
[ 1358.636067]
[ 1358.639217] __schedule+0xcc3/0x19c0
[ 1358.644027] ? io_schedule_timeout+0x140/0x140
[ 1358.649804] ? find_held_lock+0x2b/0x80
[ 1358.654900] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.661077] schedule+0xd8/0x260
[ 1358.665498] schedule_timeout+0x13f/0x290
[ 1358.670797] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.677166] ? trace_contention_end+0xb3/0x1a0
[ 1358.682950] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.688643] ? ww_mutex_lock+0x160/0x160
[ 1358.693843] msleep+0x1b/0x30
[ 1358.697959] napi_set_threaded+0x3a5/0x440
[ 1358.703355] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.708850] netif_set_threaded+0x257/0x400
[ 1358.714345] threaded_store+0x1b8/0x220
[ 1358.719447] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.724746] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.730042] ? sysfs_kf_write+0x65/0x160
[ 1358.735242] ? sysfs_file_ops+0x140/0x140
[ 1358.740539] kernfs_fop_write_iter+0x335/0x510
[ 1358.746326] ? kernfs_ops+0xf0/0xf0
[ 1358.751037] new_sync_write+0x333/0x750
[ 1358.756149] ? __lock_acquire+0x508/0xc10
[ 1358.761442] ? new_sync_read+0x740/0x740
[ 1358.766644] ? lock_acquire.part.0+0xbc/0x260
[ 1358.772332] ? ksys_write+0x116/0x250
[ 1358.777244] vfs_write+0x657/0x9b0
[ 1358.781859] ksys_write+0x116/0x250
[ 1358.786571] ? __ia32_sys_read+0xc0/0xc0
[ 1358.791768] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.797356] ? rcu_is_watching+0x15/0xd0
[ 1358.802555] do_syscall_64+0xf3/0x650
[ 1358.807462] ? trace_hardirqs_off+0xd/0x30
[ 1358.812850] ? exc_page_fault+0xda/0xf0
[ 1358.817951] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.824417] RIP: 0033:0x7f25c7c4f64e
[ 1358.829226] RSP: 002b:00007ffd66ce0300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.838526] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25c7c4f64e
[ 1358.847332] RDX: 0000000000000001 RSI: 000055bb8bf63bf0 RDI: 0000000000000007
[ 1358.856140] RBP: 00007ffd66ce0310 R08: 0000000000000000 R09: 0000000000000000
[ 1358.864948] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25c7ac8390
[ 1358.873758] R13: 000055bb8bf63bf0 R14: 0000000000000007 R15: 00007f25c7a5d120
[ 1358.882569]
[ 1358.885838] \x0aShowing all locks held in the system:
[ 1358.894378] 1 lock held by khungtaskd/185:
[ 1358.899771] #0: ffffffffa32fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.911244] 2 locks held by systemd-journal/805:
[ 1358.917225] #0: ff1100180e4b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.927115] #1: ffffffffa3502ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.939941] 4 locks held by python3/3490:
[ 1358.945236] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.955125] #1: ff1100013f0a6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.966088] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.977245] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.987331] 4 locks held by python3/5476:
[ 1358.992629] #0: ff110001307c93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.002517] #1: ff110001a67bc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.013472] #2: ff11000122e50fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.024630] #3: ff1100011cd81e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.034722]
[ 1359.037191] =============================================\x0a