[ 761.109959] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 761.112610] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 761.243169] kselftest: Running tests in drivers/net
[ 989.679508] INFO: task python3:5406 blocked for more than 122 seconds.
[ 989.687700] Not tainted 7.1.0-rc7-hrcb-gf18dca8f111f #1
[ 989.695275] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.704868] task:python3 state:D stack:25672 pid:5406 tgid:5406 ppid:5404 task_flags:0x400100 flags:0x00080000
[ 989.718072] Call Trace:
[ 989.721609]
[ 989.724756] __schedule+0xcc3/0x19c0
[ 989.729571] ? io_schedule_timeout+0x140/0x140
[ 989.735352] ? find_held_lock+0x2b/0x80
[ 989.740458] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.746349] schedule+0xd8/0x260
[ 989.750755] schedule_preempt_disabled+0x18/0x30
[ 989.756731] __mutex_lock+0x6af/0x2010
[ 989.761733] ? threaded_store+0x132/0x220
[ 989.767029] ? ww_mutex_lock+0x160/0x160
[ 989.772229] ? selinux_inode_free_security+0x330/0x330
[ 989.778806] ? cap_capable+0x1d6/0x3e0
[ 989.783826] ? threaded_store+0x132/0x220
[ 989.789125] threaded_store+0x132/0x220
[ 989.794228] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.799522] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.804820] ? sysfs_kf_write+0x65/0x160
[ 989.810020] ? sysfs_file_ops+0x140/0x140
[ 989.815316] kernfs_fop_write_iter+0x335/0x510
[ 989.821098] ? kernfs_ops+0xf0/0xf0
[ 989.825810] new_sync_write+0x333/0x750
[ 989.830913] ? __lock_acquire+0x508/0xc10
[ 989.836206] ? new_sync_read+0x740/0x740
[ 989.841407] ? lock_acquire.part.0+0xbc/0x260
[ 989.847094] ? ksys_write+0x116/0x250
[ 989.851993] vfs_write+0x657/0x9b0
[ 989.856599] ksys_write+0x116/0x250
[ 989.861311] ? __ia32_sys_read+0xc0/0xc0
[ 989.866510] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.872098] ? rcu_is_watching+0x15/0xd0
[ 989.877300] do_syscall_64+0xf3/0x650
[ 989.882205] ? trace_hardirqs_off+0xd/0x30
[ 989.887600] ? exc_page_fault+0xda/0xf0
[ 989.892702] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.899160] RIP: 0033:0x7f62478e564e
[ 989.903970] RSP: 002b:00007ffd19bf67c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.913266] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f62478e564e
[ 989.922075] RDX: 0000000000000001 RSI: 000055a819000bf0 RDI: 0000000000000007
[ 989.930880] RBP: 00007ffd19bf67d0 R08: 0000000000000000 R09: 0000000000000000
[ 989.939688] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f624775e390
[ 989.948483] R13: 000055a819000bf0 R14: 0000000000000007 R15: 00007f62476f1120
[ 989.957303]
[ 989.960618] INFO: task python3:5406 is blocked on a mutex likely owned by task python3:3414.
[ 989.970890] task:python3 state:D stack:25672 pid:3414 tgid:3414 ppid:3413 task_flags:0x400100 flags:0x00080802
[ 989.984093] Call Trace:
[ 989.987631]
[ 989.990778] __schedule+0xcc3/0x19c0
[ 989.995590] ? io_schedule_timeout+0x140/0x140
[ 990.001375] ? find_held_lock+0x2b/0x80
[ 990.006472] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.012650] schedule+0xd8/0x260
[ 990.017068] schedule_timeout+0x13f/0x290
[ 990.022365] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.028734] ? trace_contention_end+0xb3/0x1a0
[ 990.034507] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.040196] ? ww_mutex_lock+0x160/0x160
[ 990.045397] msleep+0x1b/0x30
[ 990.049520] napi_set_threaded+0x3a5/0x440
[ 990.054913] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.060407] netif_set_threaded+0x257/0x400
[ 990.065900] threaded_store+0x1b8/0x220
[ 990.071004] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.076299] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.081595] ? sysfs_kf_write+0x65/0x160
[ 990.086795] ? sysfs_file_ops+0x140/0x140
[ 990.092083] kernfs_fop_write_iter+0x335/0x510
[ 990.097866] ? kernfs_ops+0xf0/0xf0
[ 990.102578] new_sync_write+0x333/0x750
[ 990.107672] ? __lock_acquire+0x508/0xc10
[ 990.112958] ? new_sync_read+0x740/0x740
[ 990.118160] ? lock_acquire.part.0+0xbc/0x260
[ 990.123846] ? ksys_write+0x116/0x250
[ 990.128754] vfs_write+0x657/0x9b0
[ 990.133368] ksys_write+0x116/0x250
[ 990.138080] ? __ia32_sys_read+0xc0/0xc0
[ 990.143275] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.148861] ? rcu_is_watching+0x15/0xd0
[ 990.154062] do_syscall_64+0xf3/0x650
[ 990.158955] ? trace_hardirqs_off+0xd/0x30
[ 990.164353] ? exc_page_fault+0xda/0xf0
[ 990.169452] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.175917] RIP: 0033:0x7f4d4025864e
[ 990.180725] RSP: 002b:00007ffc2580d370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.190021] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d4025864e
[ 990.198828] RDX: 0000000000000001 RSI: 000055cfd7c66bf0 RDI: 0000000000000007
[ 990.207634] RBP: 00007ffc2580d380 R08: 0000000000000000 R09: 0000000000000000
[ 990.216441] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d400d1390
[ 990.225250] R13: 000055cfd7c66bf0 R14: 0000000000000007 R15: 00007f4d40065120
[ 990.234061]
[ 990.237319] \x0aShowing all locks held in the system:
[ 990.245855] 1 lock held by khungtaskd/185:
[ 990.251247] #0: ffffffff9f8fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.262729] 4 locks held by python3/3414:
[ 990.268021] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.277911] #1: ff110001404d2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.288872] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.300027] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.310131] 4 locks held by python3/5406:
[ 990.315423] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.325325] #1: ff1100018c436280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.336287] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.347443] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.357527]
[ 990.359993] =============================================\x0a
[ 1112.560613] INFO: task python3:5406 blocked for more than 245 seconds.
[ 1112.568760] Not tainted 7.1.0-rc7-hrcb-gf18dca8f111f #1
[ 1112.576001] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.585592] task:python3 state:D stack:25672 pid:5406 tgid:5406 ppid:5404 task_flags:0x400100 flags:0x00080000
[ 1112.598799] Call Trace:
[ 1112.602337]
[ 1112.605487] __schedule+0xcc3/0x19c0
[ 1112.610303] ? io_schedule_timeout+0x140/0x140
[ 1112.616089] ? find_held_lock+0x2b/0x80
[ 1112.621196] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.627082] schedule+0xd8/0x260
[ 1112.631503] schedule_preempt_disabled+0x18/0x30
[ 1112.637485] __mutex_lock+0x6af/0x2010
[ 1112.642489] ? threaded_store+0x132/0x220
[ 1112.647779] ? ww_mutex_lock+0x160/0x160
[ 1112.652979] ? selinux_inode_free_security+0x330/0x330
[ 1112.659550] ? cap_capable+0x1d6/0x3e0
[ 1112.664561] ? threaded_store+0x132/0x220
[ 1112.669858] threaded_store+0x132/0x220
[ 1112.674952] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.680252] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.685552] ? sysfs_kf_write+0x65/0x160
[ 1112.690755] ? sysfs_file_ops+0x140/0x140
[ 1112.696051] kernfs_fop_write_iter+0x335/0x510
[ 1112.701838] ? kernfs_ops+0xf0/0xf0
[ 1112.706549] new_sync_write+0x333/0x750
[ 1112.711646] ? __lock_acquire+0x508/0xc10
[ 1112.716942] ? new_sync_read+0x740/0x740
[ 1112.722144] ? lock_acquire.part.0+0xbc/0x260
[ 1112.727830] ? ksys_write+0x116/0x250
[ 1112.732742] vfs_write+0x657/0x9b0
[ 1112.737358] ksys_write+0x116/0x250
[ 1112.742069] ? __ia32_sys_read+0xc0/0xc0
[ 1112.747268] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.752858] ? rcu_is_watching+0x15/0xd0
[ 1112.758060] do_syscall_64+0xf3/0x650
[ 1112.762969] ? trace_hardirqs_off+0xd/0x30
[ 1112.768366] ? exc_page_fault+0xda/0xf0
[ 1112.773472] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.779942] RIP: 0033:0x7f62478e564e
[ 1112.784754] RSP: 002b:00007ffd19bf67c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.794052] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f62478e564e
[ 1112.802860] RDX: 0000000000000001 RSI: 000055a819000bf0 RDI: 0000000000000007
[ 1112.811666] RBP: 00007ffd19bf67d0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.820474] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f624775e390
[ 1112.829275] R13: 000055a819000bf0 R14: 0000000000000007 R15: 00007f62476f1120
[ 1112.838091]
[ 1112.841381] INFO: task python3:5406 is blocked on a mutex likely owned by task python3:3414.
[ 1112.851656] task:python3 state:D stack:25672 pid:3414 tgid:3414 ppid:3413 task_flags:0x400100 flags:0x00080802
[ 1112.864860] Call Trace:
[ 1112.868398]
[ 1112.871548] __schedule+0xcc3/0x19c0
[ 1112.876360] ? io_schedule_timeout+0x140/0x140
[ 1112.882144] ? find_held_lock+0x2b/0x80
[ 1112.887250] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.893427] schedule+0xd8/0x260
[ 1112.897846] schedule_timeout+0x13f/0x290
[ 1112.903142] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.909511] ? trace_contention_end+0xb3/0x1a0
[ 1112.915290] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.920980] ? ww_mutex_lock+0x160/0x160
[ 1112.926180] msleep+0x1b/0x30
[ 1112.930306] napi_set_threaded+0x3a5/0x440
[ 1112.935702] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.941198] netif_set_threaded+0x257/0x400
[ 1112.946692] threaded_store+0x1b8/0x220
[ 1112.951796] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.957093] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.962382] ? sysfs_kf_write+0x65/0x160
[ 1112.967583] ? sysfs_file_ops+0x140/0x140
[ 1112.972880] kernfs_fop_write_iter+0x335/0x510
[ 1112.978666] ? kernfs_ops+0xf0/0xf0
[ 1112.983380] new_sync_write+0x333/0x750
[ 1112.988484] ? __lock_acquire+0x508/0xc10
[ 1112.993780] ? new_sync_read+0x740/0x740
[ 1112.998982] ? lock_acquire.part.0+0xbc/0x260
[ 1113.004670] ? ksys_write+0x116/0x250
[ 1113.009579] vfs_write+0x657/0x9b0
[ 1113.014192] ksys_write+0x116/0x250
[ 1113.018904] ? __ia32_sys_read+0xc0/0xc0
[ 1113.024101] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.029693] ? rcu_is_watching+0x15/0xd0
[ 1113.034892] do_syscall_64+0xf3/0x650
[ 1113.039798] ? trace_hardirqs_off+0xd/0x30
[ 1113.045194] ? exc_page_fault+0xda/0xf0
[ 1113.050287] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.056753] RIP: 0033:0x7f4d4025864e
[ 1113.061562] RSP: 002b:00007ffc2580d370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.070861] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d4025864e
[ 1113.079668] RDX: 0000000000000001 RSI: 000055cfd7c66bf0 RDI: 0000000000000007
[ 1113.088478] RBP: 00007ffc2580d380 R08: 0000000000000000 R09: 0000000000000000
[ 1113.097289] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d400d1390
[ 1113.106098] R13: 000055cfd7c66bf0 R14: 0000000000000007 R15: 00007f4d40065120
[ 1113.114914]
[ 1113.118176] \x0aShowing all locks held in the system:
[ 1113.126716] 1 lock held by khungtaskd/185:
[ 1113.132111] #0: ffffffff9f8fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.143585] 4 locks held by python3/3414:
[ 1113.148881] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.158770] #1: ff110001404d2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.169730] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.180889] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.190987] 4 locks held by python3/5406:
[ 1113.196283] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.206173] #1: ff1100018c436280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.217137] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.228298] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.238390]
[ 1113.240858] =============================================\x0a
[ 1235.441728] INFO: task python3:5406 blocked for more than 368 seconds.
[ 1235.449879] Not tainted 7.1.0-rc7-hrcb-gf18dca8f111f #1
[ 1235.457130] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.466718] task:python3 state:D stack:25672 pid:5406 tgid:5406 ppid:5404 task_flags:0x400100 flags:0x00080002
[ 1235.479927] Call Trace:
[ 1235.483467]
[ 1235.486617] __schedule+0xcc3/0x19c0
[ 1235.491433] ? io_schedule_timeout+0x140/0x140
[ 1235.497219] ? find_held_lock+0x2b/0x80
[ 1235.502324] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.508213] schedule+0xd8/0x260
[ 1235.512632] schedule_preempt_disabled+0x18/0x30
[ 1235.518613] __mutex_lock+0x6af/0x2010
[ 1235.523621] ? threaded_store+0x132/0x220
[ 1235.528923] ? ww_mutex_lock+0x160/0x160
[ 1235.534121] ? selinux_inode_free_security+0x330/0x330
[ 1235.540690] ? cap_capable+0x1d6/0x3e0
[ 1235.545699] ? threaded_store+0x132/0x220
[ 1235.550995] threaded_store+0x132/0x220
[ 1235.556096] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.561392] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.566692] ? sysfs_kf_write+0x65/0x160
[ 1235.571896] ? sysfs_file_ops+0x140/0x140
[ 1235.577192] kernfs_fop_write_iter+0x335/0x510
[ 1235.582978] ? kernfs_ops+0xf0/0xf0
[ 1235.587690] new_sync_write+0x333/0x750
[ 1235.592796] ? __lock_acquire+0x508/0xc10
[ 1235.598094] ? new_sync_read+0x740/0x740
[ 1235.603286] ? lock_acquire.part.0+0xbc/0x260
[ 1235.608971] ? ksys_write+0x116/0x250
[ 1235.613884] vfs_write+0x657/0x9b0
[ 1235.618498] ksys_write+0x116/0x250
[ 1235.623210] ? __ia32_sys_read+0xc0/0xc0
[ 1235.628411] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.634001] ? rcu_is_watching+0x15/0xd0
[ 1235.639207] do_syscall_64+0xf3/0x650
[ 1235.644114] ? trace_hardirqs_off+0xd/0x30
[ 1235.649509] ? exc_page_fault+0xda/0xf0
[ 1235.654613] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.661082] RIP: 0033:0x7f62478e564e
[ 1235.665891] RSP: 002b:00007ffd19bf67c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.675189] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f62478e564e
[ 1235.684000] RDX: 0000000000000001 RSI: 000055a819000bf0 RDI: 0000000000000007
[ 1235.692810] RBP: 00007ffd19bf67d0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.701620] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f624775e390
[ 1235.710427] R13: 000055a819000bf0 R14: 0000000000000007 R15: 00007f62476f1120
[ 1235.719240]
[ 1235.722512] INFO: task python3:5406 is blocked on a mutex likely owned by task python3:3414.
[ 1235.732784] task:python3 state:D stack:25672 pid:3414 tgid:3414 ppid:3413 task_flags:0x400100 flags:0x00080802
[ 1235.745987] Call Trace:
[ 1235.749524]
[ 1235.752677] __schedule+0xcc3/0x19c0
[ 1235.757489] ? io_schedule_timeout+0x140/0x140
[ 1235.763273] ? find_held_lock+0x2b/0x80
[ 1235.768377] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.774558] schedule+0xd8/0x260
[ 1235.779617] schedule_timeout+0x13f/0x290
[ 1235.784917] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.791286] ? trace_contention_end+0xb3/0x1a0
[ 1235.797071] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.802761] ? ww_mutex_lock+0x160/0x160
[ 1235.807961] msleep+0x1b/0x30
[ 1235.812088] napi_set_threaded+0x3a5/0x440
[ 1235.817483] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.822980] netif_set_threaded+0x257/0x400
[ 1235.828474] threaded_store+0x1b8/0x220
[ 1235.833578] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.838874] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.844172] ? sysfs_kf_write+0x65/0x160
[ 1235.849361] ? sysfs_file_ops+0x140/0x140
[ 1235.854657] kernfs_fop_write_iter+0x335/0x510
[ 1235.860443] ? kernfs_ops+0xf0/0xf0
[ 1235.865155] new_sync_write+0x333/0x750
[ 1235.870260] ? __lock_acquire+0x508/0xc10
[ 1235.875557] ? new_sync_read+0x740/0x740
[ 1235.880757] ? lock_acquire.part.0+0xbc/0x260
[ 1235.886446] ? ksys_write+0x116/0x250
[ 1235.891355] vfs_write+0x657/0x9b0
[ 1235.895969] ksys_write+0x116/0x250
[ 1235.900681] ? __ia32_sys_read+0xc0/0xc0
[ 1235.905872] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.911462] ? rcu_is_watching+0x15/0xd0
[ 1235.916664] do_syscall_64+0xf3/0x650
[ 1235.921574] ? trace_hardirqs_off+0xd/0x30
[ 1235.926968] ? exc_page_fault+0xda/0xf0
[ 1235.932069] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.938538] RIP: 0033:0x7f4d4025864e
[ 1235.943345] RSP: 002b:00007ffc2580d370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.952642] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d4025864e
[ 1235.961451] RDX: 0000000000000001 RSI: 000055cfd7c66bf0 RDI: 0000000000000007
[ 1235.970260] RBP: 00007ffc2580d380 R08: 0000000000000000 R09: 0000000000000000
[ 1235.979069] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d400d1390
[ 1235.987876] R13: 000055cfd7c66bf0 R14: 0000000000000007 R15: 00007f4d40065120
[ 1235.996691]
[ 1235.999959] \x0aShowing all locks held in the system:
[ 1236.008497] 1 lock held by khungtaskd/185:
[ 1236.013892] #0: ffffffff9f8fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.025367] 2 locks held by systemd-journal/802:
[ 1236.031340] #0: ff1100180e3b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.041231] #1: ffffffff9fb02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.054058] 4 locks held by python3/3414:
[ 1236.059354] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.069244] #1: ff110001404d2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.080207] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.091366] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.101462] 4 locks held by python3/5406:
[ 1236.106760] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.116648] #1: ff1100018c436280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.127610] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.138766] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.148860]
[ 1236.151326] =============================================\x0a
[ 1358.322836] INFO: task python3:5406 blocked for more than 491 seconds.
[ 1358.330987] Not tainted 7.1.0-rc7-hrcb-gf18dca8f111f #1
[ 1358.338238] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.347828] task:python3 state:D stack:25672 pid:5406 tgid:5406 ppid:5404 task_flags:0x400100 flags:0x00080002
[ 1358.361033] Call Trace:
[ 1358.364571]
[ 1358.367723] __schedule+0xcc3/0x19c0
[ 1358.372541] ? io_schedule_timeout+0x140/0x140
[ 1358.378328] ? find_held_lock+0x2b/0x80
[ 1358.383435] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.389319] schedule+0xd8/0x260
[ 1358.393741] schedule_preempt_disabled+0x18/0x30
[ 1358.399723] __mutex_lock+0x6af/0x2010
[ 1358.404730] ? threaded_store+0x132/0x220
[ 1358.410030] ? ww_mutex_lock+0x160/0x160
[ 1358.415229] ? selinux_inode_free_security+0x330/0x330
[ 1358.421800] ? cap_capable+0x1d6/0x3e0
[ 1358.426808] ? threaded_store+0x132/0x220
[ 1358.432104] threaded_store+0x132/0x220
[ 1358.437206] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.442503] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.447806] ? sysfs_kf_write+0x65/0x160
[ 1358.453009] ? sysfs_file_ops+0x140/0x140
[ 1358.458307] kernfs_fop_write_iter+0x335/0x510
[ 1358.464094] ? kernfs_ops+0xf0/0xf0
[ 1358.468808] new_sync_write+0x333/0x750
[ 1358.473913] ? __lock_acquire+0x508/0xc10
[ 1358.479212] ? new_sync_read+0x740/0x740
[ 1358.484415] ? lock_acquire.part.0+0xbc/0x260
[ 1358.490100] ? ksys_write+0x116/0x250
[ 1358.495013] vfs_write+0x657/0x9b0
[ 1358.499629] ksys_write+0x116/0x250
[ 1358.504339] ? __ia32_sys_read+0xc0/0xc0
[ 1358.509539] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.515119] ? rcu_is_watching+0x15/0xd0
[ 1358.520320] do_syscall_64+0xf3/0x650
[ 1358.525224] ? trace_hardirqs_off+0xd/0x30
[ 1358.530620] ? exc_page_fault+0xda/0xf0
[ 1358.535723] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.542193] RIP: 0033:0x7f62478e564e
[ 1358.547006] RSP: 002b:00007ffd19bf67c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.556304] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f62478e564e
[ 1358.565111] RDX: 0000000000000001 RSI: 000055a819000bf0 RDI: 0000000000000007
[ 1358.573921] RBP: 00007ffd19bf67d0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.582728] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f624775e390
[ 1358.591536] R13: 000055a819000bf0 R14: 0000000000000007 R15: 00007f62476f1120
[ 1358.600351]
[ 1358.603621] INFO: task python3:5406 is blocked on a mutex likely owned by task python3:3414.
[ 1358.613894] task:python3 state:D stack:25672 pid:3414 tgid:3414 ppid:3413 task_flags:0x400100 flags:0x00080802
[ 1358.627098] Call Trace:
[ 1358.630638]
[ 1358.633788] __schedule+0xcc3/0x19c0
[ 1358.638601] ? io_schedule_timeout+0x140/0x140
[ 1358.644385] ? find_held_lock+0x2b/0x80
[ 1358.649488] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.655668] schedule+0xd8/0x260
[ 1358.660092] schedule_timeout+0x13f/0x290
[ 1358.665392] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.671760] ? trace_contention_end+0xb3/0x1a0
[ 1358.677539] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.683229] ? ww_mutex_lock+0x160/0x160
[ 1358.688430] msleep+0x1b/0x30
[ 1358.692547] napi_set_threaded+0x3a5/0x440
[ 1358.697945] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.703439] netif_set_threaded+0x257/0x400
[ 1358.708933] threaded_store+0x1b8/0x220
[ 1358.714034] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.719332] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.724632] ? sysfs_kf_write+0x65/0x160
[ 1358.729832] ? sysfs_file_ops+0x140/0x140
[ 1358.735120] kernfs_fop_write_iter+0x335/0x510
[ 1358.740907] ? kernfs_ops+0xf0/0xf0
[ 1358.745622] new_sync_write+0x333/0x750
[ 1358.750724] ? __lock_acquire+0x508/0xc10
[ 1358.756020] ? new_sync_read+0x740/0x740
[ 1358.761222] ? lock_acquire.part.0+0xbc/0x260
[ 1358.766908] ? ksys_write+0x116/0x250
[ 1358.771817] vfs_write+0x657/0x9b0
[ 1358.776434] ksys_write+0x116/0x250
[ 1358.781147] ? __ia32_sys_read+0xc0/0xc0
[ 1358.786347] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.791936] ? rcu_is_watching+0x15/0xd0
[ 1358.797139] do_syscall_64+0xf3/0x650
[ 1358.802043] ? trace_hardirqs_off+0xd/0x30
[ 1358.807438] ? exc_page_fault+0xda/0xf0
[ 1358.812540] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.819008] RIP: 0033:0x7f4d4025864e
[ 1358.823817] RSP: 002b:00007ffc2580d370 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.833107] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4d4025864e
[ 1358.841916] RDX: 0000000000000001 RSI: 000055cfd7c66bf0 RDI: 0000000000000007
[ 1358.850726] RBP: 00007ffc2580d380 R08: 0000000000000000 R09: 0000000000000000
[ 1358.859533] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4d400d1390
[ 1358.868331] R13: 000055cfd7c66bf0 R14: 0000000000000007 R15: 00007f4d40065120
[ 1358.877146]
[ 1358.880413] \x0aShowing all locks held in the system:
[ 1358.888952] 1 lock held by khungtaskd/185:
[ 1358.894347] #0: ffffffff9f8fdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.905813] 3 locks held by systemd-journal/802:
[ 1358.911784] #0: ff1100180e5b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.921672] #1: ffffffff9fb02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: nd_jump_root+0x353/0x550
[ 1358.934007] #2: ff1100019da3b0a0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.945567] 4 locks held by python3/3414:
[ 1358.950863] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.960749] #1: ff110001404d2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.971712] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.982870] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.992967] 4 locks held by python3/5406:
[ 1358.998265] #0: ff1100011f4ac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.008152] #1: ff1100018c436280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.019115] #2: ff11000123a78fd0 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.030273] #3: ff11000123a59e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.040364]
[ 1359.042831] =============================================\x0a