[ 760.776782] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.779304] nipa-hw-worker: [5/40] Retrying drivers/net:napi_threaded.py
[ 760.915200] kselftest: Running tests in drivers/net
[ 989.745065] INFO: task python3:5240 blocked for more than 122 seconds.
[ 989.753293] Not tainted 7.0.0-rc5-fyew-ge4d154f59c3a #1
[ 989.760542] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.770134] task:python3 state:D stack:25312 pid:5240 tgid:5240 ppid:5239 task_flags:0x400100 flags:0x00080000
[ 989.783339] Call Trace:
[ 989.786879]
[ 989.790032] __schedule+0xad9/0x1490
[ 989.794849] ? io_schedule_timeout+0x130/0x130
[ 989.800635] ? find_held_lock+0x2b/0x80
[ 989.805742] ? __lock_release.isra.0+0x59/0x170
[ 989.811629] schedule+0xd4/0x260
[ 989.816049] schedule_preempt_disabled+0x18/0x30
[ 989.822019] __mutex_lock+0xd76/0x1f20
[ 989.827027] ? threaded_store+0x132/0x220
[ 989.832329] ? ww_mutex_lock+0x160/0x160
[ 989.837526] ? selinux_inode_free_security+0x310/0x310
[ 989.844097] ? cap_capable+0x1ed/0x3f0
[ 989.849110] ? sysfs_file_ops+0x140/0x140
[ 989.854406] ? threaded_store+0x132/0x220
[ 989.859706] threaded_store+0x132/0x220
[ 989.864806] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.870301] ? sysfs_file_ops+0x140/0x140
[ 989.875596] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.880898] ? sysfs_kf_write+0x65/0x160
[ 989.886099] kernfs_fop_write_iter+0x335/0x510
[ 989.891883] ? kernfs_ops+0xf0/0xf0
[ 989.896596] new_sync_write+0x308/0x6f0
[ 989.901702] ? new_sync_read+0x6f0/0x6f0
[ 989.906903] ? lock_acquire.part.0+0xbc/0x260
[ 989.912589] ? ksys_write+0xff/0x200
[ 989.917403] vfs_write+0x62a/0x980
[ 989.922020] ksys_write+0xff/0x200
[ 989.926637] ? __ia32_sys_read+0xc0/0xc0
[ 989.931836] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.937427] ? rcu_is_watching+0x15/0xd0
[ 989.942630] do_syscall_64+0xf3/0x5e0
[ 989.947537] ? exc_page_fault+0x9e/0xb0
[ 989.952638] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.959107] RIP: 0033:0x7fda223c5c5e
[ 989.963916] RSP: 002b:00007ffc16a2b070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.973212] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fda223c5c5e
[ 989.982020] RDX: 0000000000000001 RSI: 000055aa019a6760 RDI: 0000000000000007
[ 989.990828] RBP: 00007ffc16a2b080 R08: 0000000000000000 R09: 0000000000000000
[ 989.999629] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fda22260e80
[ 990.008440] R13: 000055aa019a6760 R14: 0000000000000007 R15: 00007fda22ac6b98
[ 990.017253]
[ 990.020525] INFO: task python3:5240 is blocked on a mutex likely owned by task python3:3258.
[ 990.030803] task:python3 state:D stack:25312 pid:3258 tgid:3258 ppid:3257 task_flags:0x400100 flags:0x00080802
[ 990.044004] Call Trace:
[ 990.047542]
[ 990.050692] __schedule+0xad9/0x1490
[ 990.055506] ? io_schedule_timeout+0x130/0x130
[ 990.061288] ? find_held_lock+0x2b/0x80
[ 990.066392] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.072575] schedule+0xd4/0x260
[ 990.076996] schedule_timeout+0x103/0x260
[ 990.082293] ? rcu_is_watching+0x15/0xd0
[ 990.087492] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.093856] ? hrtimers_cpu_dying+0x250/0x250
[ 990.099547] ? ww_mutex_lock+0x160/0x160
[ 990.104749] msleep+0x1b/0x30
[ 990.108877] napi_set_threaded+0x376/0x410
[ 990.114273] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.119768] netif_set_threaded+0x254/0x400
[ 990.125260] ? sysfs_file_ops+0x140/0x140
[ 990.130548] threaded_store+0x1bb/0x220
[ 990.135650] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.141142] ? sysfs_file_ops+0x140/0x140
[ 990.146428] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.151726] ? sysfs_kf_write+0x65/0x160
[ 990.156925] kernfs_fop_write_iter+0x335/0x510
[ 990.162710] ? kernfs_ops+0xf0/0xf0
[ 990.167421] new_sync_write+0x308/0x6f0
[ 990.172525] ? new_sync_read+0x6f0/0x6f0
[ 990.177728] ? lock_acquire.part.0+0xbc/0x260
[ 990.183417] ? ksys_write+0xff/0x200
[ 990.188231] vfs_write+0x62a/0x980
[ 990.192847] ksys_write+0xff/0x200
[ 990.197462] ? __ia32_sys_read+0xc0/0xc0
[ 990.202661] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.208250] ? rcu_is_watching+0x15/0xd0
[ 990.213452] do_syscall_64+0xf3/0x5e0
[ 990.218357] ? exc_page_fault+0x9e/0xb0
[ 990.223457] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.229924] RIP: 0033:0x7f4cfc500c5e
[ 990.234731] RSP: 002b:00007ffca8d4e4d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.244028] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cfc500c5e
[ 990.252836] RDX: 0000000000000001 RSI: 000055b937342760 RDI: 0000000000000007
[ 990.261634] RBP: 00007ffca8d4e4e0 R08: 0000000000000000 R09: 0000000000000000
[ 990.270442] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cfc39be80
[ 990.279249] R13: 000055b937342760 R14: 0000000000000007 R15: 00007f4cfc32a480
[ 990.288063]
[ 990.291323] \x0aShowing all locks held in the system:
[ 990.299859] 1 lock held by khungtaskd/185:
[ 990.305253] #0: ffffffff9f6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.316738] 4 locks held by python3/3258:
[ 990.322036] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.331820] #1: ff1100013e682c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.342783] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.353940] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.364032] 4 locks held by python3/5240:
[ 990.369330] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.379122] #1: ff110001ab581488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.390084] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.401245] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.411336]
[ 990.413801] =============================================\x0a
[ 1112.627162] INFO: task python3:5240 blocked for more than 245 seconds.
[ 1112.635314] Not tainted 7.0.0-rc5-fyew-ge4d154f59c3a #1
[ 1112.642563] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.652152] task:python3 state:D stack:25312 pid:5240 tgid:5240 ppid:5239 task_flags:0x400100 flags:0x00080000
[ 1112.665349] Call Trace:
[ 1112.668891]
[ 1112.672042] __schedule+0xad9/0x1490
[ 1112.676860] ? io_schedule_timeout+0x130/0x130
[ 1112.682647] ? find_held_lock+0x2b/0x80
[ 1112.687750] ? __lock_release.isra.0+0x59/0x170
[ 1112.693638] schedule+0xd4/0x260
[ 1112.698057] schedule_preempt_disabled+0x18/0x30
[ 1112.704040] __mutex_lock+0xd76/0x1f20
[ 1112.709047] ? threaded_store+0x132/0x220
[ 1112.714346] ? ww_mutex_lock+0x160/0x160
[ 1112.719543] ? selinux_inode_free_security+0x310/0x310
[ 1112.726181] ? cap_capable+0x1ed/0x3f0
[ 1112.731188] ? sysfs_file_ops+0x140/0x140
[ 1112.736487] ? threaded_store+0x132/0x220
[ 1112.741777] threaded_store+0x132/0x220
[ 1112.746881] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.752372] ? sysfs_file_ops+0x140/0x140
[ 1112.757668] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.762969] ? sysfs_kf_write+0x65/0x160
[ 1112.768169] kernfs_fop_write_iter+0x335/0x510
[ 1112.773944] ? kernfs_ops+0xf0/0xf0
[ 1112.778655] new_sync_write+0x308/0x6f0
[ 1112.783760] ? new_sync_read+0x6f0/0x6f0
[ 1112.788949] ? lock_acquire.part.0+0xbc/0x260
[ 1112.794633] ? ksys_write+0xff/0x200
[ 1112.799447] vfs_write+0x62a/0x980
[ 1112.804061] ksys_write+0xff/0x200
[ 1112.808741] ? __ia32_sys_read+0xc0/0xc0
[ 1112.813937] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.819594] ? rcu_is_watching+0x15/0xd0
[ 1112.824796] do_syscall_64+0xf3/0x5e0
[ 1112.829700] ? exc_page_fault+0x9e/0xb0
[ 1112.834800] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.841355] RIP: 0033:0x7fda223c5c5e
[ 1112.846164] RSP: 002b:00007ffc16a2b070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.855463] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fda223c5c5e
[ 1112.864268] RDX: 0000000000000001 RSI: 000055aa019a6760 RDI: 0000000000000007
[ 1112.873074] RBP: 00007ffc16a2b080 R08: 0000000000000000 R09: 0000000000000000
[ 1112.881880] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fda22260e80
[ 1112.890687] R13: 000055aa019a6760 R14: 0000000000000007 R15: 00007fda22ac6b98
[ 1112.899499]
[ 1112.902779] INFO: task python3:5240 is blocked on a mutex likely owned by task python3:3258.
[ 1112.913050] task:python3 state:D stack:25312 pid:3258 tgid:3258 ppid:3257 task_flags:0x400100 flags:0x00080802
[ 1112.926251] Call Trace:
[ 1112.929791]
[ 1112.932939] __schedule+0xad9/0x1490
[ 1112.937749] ? io_schedule_timeout+0x130/0x130
[ 1112.943534] ? find_held_lock+0x2b/0x80
[ 1112.948637] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.954816] schedule+0xd4/0x260
[ 1112.959233] schedule_timeout+0x103/0x260
[ 1112.964530] ? rcu_is_watching+0x15/0xd0
[ 1112.969728] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.976097] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.981788] ? ww_mutex_lock+0x160/0x160
[ 1112.986989] msleep+0x1b/0x30
[ 1112.991106] napi_set_threaded+0x376/0x410
[ 1112.996502] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.001997] netif_set_threaded+0x254/0x400
[ 1113.007490] ? sysfs_file_ops+0x140/0x140
[ 1113.012786] threaded_store+0x1bb/0x220
[ 1113.017893] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.023384] ? sysfs_file_ops+0x140/0x140
[ 1113.028682] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.033974] ? sysfs_kf_write+0x65/0x160
[ 1113.039174] kernfs_fop_write_iter+0x335/0x510
[ 1113.044961] ? kernfs_ops+0xf0/0xf0
[ 1113.049676] new_sync_write+0x308/0x6f0
[ 1113.054779] ? new_sync_read+0x6f0/0x6f0
[ 1113.059980] ? lock_acquire.part.0+0xbc/0x260
[ 1113.065665] ? ksys_write+0xff/0x200
[ 1113.070480] vfs_write+0x62a/0x980
[ 1113.075166] ksys_write+0xff/0x200
[ 1113.079780] ? __ia32_sys_read+0xc0/0xc0
[ 1113.084979] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.090560] ? rcu_is_watching+0x15/0xd0
[ 1113.095760] do_syscall_64+0xf3/0x5e0
[ 1113.100666] ? exc_page_fault+0x9e/0xb0
[ 1113.105769] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.112236] RIP: 0033:0x7f4cfc500c5e
[ 1113.117045] RSP: 002b:00007ffca8d4e4d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.126342] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cfc500c5e
[ 1113.135150] RDX: 0000000000000001 RSI: 000055b937342760 RDI: 0000000000000007
[ 1113.143952] RBP: 00007ffca8d4e4e0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.152762] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cfc39be80
[ 1113.161572] R13: 000055b937342760 R14: 0000000000000007 R15: 00007f4cfc32a480
[ 1113.170387]
[ 1113.173654] \x0aShowing all locks held in the system:
[ 1113.182184] 1 lock held by khungtaskd/185:
[ 1113.187579] #0: ffffffff9f6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.199052] 3 locks held by systemd-journal/806:
[ 1113.205031] #0: ff1100180e5372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1113.214919] #1: ffffffff9f8c91e0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.227739] #2: ff110001a45cabd0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1113.239198] 4 locks held by python3/3258:
[ 1113.244495] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.254286] #1: ff1100013e682c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.265242] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.276401] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.286498] 4 locks held by python3/5240:
[ 1113.291795] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.301587] #1: ff110001ab581488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.312674] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.323832] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.333926] 2 locks held by systemd/6321:
[ 1113.339230]
[ 1113.341698] =============================================\x0a
[ 1235.508363] INFO: task python3:5240 blocked for more than 368 seconds.
[ 1235.516512] Not tainted 7.0.0-rc5-fyew-ge4d154f59c3a #1
[ 1235.523763] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.533351] task:python3 state:D stack:25312 pid:5240 tgid:5240 ppid:5239 task_flags:0x400100 flags:0x00080002
[ 1235.546562] Call Trace:
[ 1235.550096]
[ 1235.553242] __schedule+0xad9/0x1490
[ 1235.558049] ? io_schedule_timeout+0x130/0x130
[ 1235.563835] ? find_held_lock+0x2b/0x80
[ 1235.568943] ? __lock_release.isra.0+0x59/0x170
[ 1235.574828] schedule+0xd4/0x260
[ 1235.579246] schedule_preempt_disabled+0x18/0x30
[ 1235.585224] __mutex_lock+0xd76/0x1f20
[ 1235.590230] ? threaded_store+0x132/0x220
[ 1235.595529] ? ww_mutex_lock+0x160/0x160
[ 1235.600721] ? selinux_inode_free_security+0x310/0x310
[ 1235.607293] ? cap_capable+0x1ed/0x3f0
[ 1235.612304] ? sysfs_file_ops+0x140/0x140
[ 1235.617607] ? threaded_store+0x132/0x220
[ 1235.622903] threaded_store+0x132/0x220
[ 1235.628006] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.633498] ? sysfs_file_ops+0x140/0x140
[ 1235.638798] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.644094] ? sysfs_kf_write+0x65/0x160
[ 1235.649296] kernfs_fop_write_iter+0x335/0x510
[ 1235.655084] ? kernfs_ops+0xf0/0xf0
[ 1235.659798] new_sync_write+0x308/0x6f0
[ 1235.664903] ? new_sync_read+0x6f0/0x6f0
[ 1235.670104] ? lock_acquire.part.0+0xbc/0x260
[ 1235.675792] ? ksys_write+0xff/0x200
[ 1235.680604] vfs_write+0x62a/0x980
[ 1235.685219] ksys_write+0xff/0x200
[ 1235.689833] ? __ia32_sys_read+0xc0/0xc0
[ 1235.695031] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.700623] ? rcu_is_watching+0x15/0xd0
[ 1235.705825] do_syscall_64+0xf3/0x5e0
[ 1235.710734] ? exc_page_fault+0x9e/0xb0
[ 1235.715838] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.722308] RIP: 0033:0x7fda223c5c5e
[ 1235.727119] RSP: 002b:00007ffc16a2b070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.736417] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fda223c5c5e
[ 1235.745227] RDX: 0000000000000001 RSI: 000055aa019a6760 RDI: 0000000000000007
[ 1235.754037] RBP: 00007ffc16a2b080 R08: 0000000000000000 R09: 0000000000000000
[ 1235.762845] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fda22260e80
[ 1235.771654] R13: 000055aa019a6760 R14: 0000000000000007 R15: 00007fda22ac6b98
[ 1235.780470]
[ 1235.783733] INFO: task python3:5240 is blocked on a mutex likely owned by task python3:3258.
[ 1235.794007] task:python3 state:D stack:25312 pid:3258 tgid:3258 ppid:3257 task_flags:0x400100 flags:0x00080802
[ 1235.807212] Call Trace:
[ 1235.810751]
[ 1235.813903] __schedule+0xad9/0x1490
[ 1235.818706] ? io_schedule_timeout+0x130/0x130
[ 1235.824491] ? find_held_lock+0x2b/0x80
[ 1235.829592] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.835771] schedule+0xd4/0x260
[ 1235.840190] schedule_timeout+0x103/0x260
[ 1235.845492] ? rcu_is_watching+0x15/0xd0
[ 1235.850693] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.857064] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.862757] ? ww_mutex_lock+0x160/0x160
[ 1235.867958] msleep+0x1b/0x30
[ 1235.872083] napi_set_threaded+0x376/0x410
[ 1235.877481] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.882973] netif_set_threaded+0x254/0x400
[ 1235.888468] ? sysfs_file_ops+0x140/0x140
[ 1235.893764] threaded_store+0x1bb/0x220
[ 1235.898869] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.904362] ? sysfs_file_ops+0x140/0x140
[ 1235.909659] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.914954] ? sysfs_kf_write+0x65/0x160
[ 1235.920155] kernfs_fop_write_iter+0x335/0x510
[ 1235.925932] ? kernfs_ops+0xf0/0xf0
[ 1235.930636] new_sync_write+0x308/0x6f0
[ 1235.935728] ? new_sync_read+0x6f0/0x6f0
[ 1235.940930] ? lock_acquire.part.0+0xbc/0x260
[ 1235.946616] ? ksys_write+0xff/0x200
[ 1235.951430] vfs_write+0x62a/0x980
[ 1235.956045] ksys_write+0xff/0x200
[ 1235.960662] ? __ia32_sys_read+0xc0/0xc0
[ 1235.965863] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.971456] ? rcu_is_watching+0x15/0xd0
[ 1235.976654] do_syscall_64+0xf3/0x5e0
[ 1235.981559] ? exc_page_fault+0x9e/0xb0
[ 1235.986661] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.993130] RIP: 0033:0x7f4cfc500c5e
[ 1235.997937] RSP: 002b:00007ffca8d4e4d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.007232] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cfc500c5e
[ 1236.016042] RDX: 0000000000000001 RSI: 000055b937342760 RDI: 0000000000000007
[ 1236.024851] RBP: 00007ffca8d4e4e0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.033660] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cfc39be80
[ 1236.042468] R13: 000055b937342760 R14: 0000000000000007 R15: 00007f4cfc32a480
[ 1236.051283]
[ 1236.054553] \x0aShowing all locks held in the system:
[ 1236.063093] 1 lock held by khungtaskd/185:
[ 1236.068488] #0: ffffffff9f6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.079951] 2 locks held by systemd-journal/806:
[ 1236.085929] #0: ff1100180e5b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1236.095815] #1: ffffffff9f8c91e0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.108644] 4 locks held by python3/3258:
[ 1236.113938] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.123732] #1: ff1100013e682c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.134696] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.145852] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.155946] 4 locks held by python3/5240:
[ 1236.161243] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.171035] #1: ff110001ab581488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.181998] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.193155] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.203247]
[ 1236.205712] =============================================\x0a
[ 1358.389630] INFO: task python3:5240 blocked for more than 491 seconds.
[ 1358.397777] Not tainted 7.0.0-rc5-fyew-ge4d154f59c3a #1
[ 1358.405032] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.414625] task:python3 state:D stack:25312 pid:5240 tgid:5240 ppid:5239 task_flags:0x400100 flags:0x00080002
[ 1358.427839] Call Trace:
[ 1358.431382]
[ 1358.434530] __schedule+0xad9/0x1490
[ 1358.439352] ? io_schedule_timeout+0x130/0x130
[ 1358.445144] ? find_held_lock+0x2b/0x80
[ 1358.450253] ? __lock_release.isra.0+0x59/0x170
[ 1358.456146] schedule+0xd4/0x260
[ 1358.460569] schedule_preempt_disabled+0x18/0x30
[ 1358.466554] __mutex_lock+0xd76/0x1f20
[ 1358.471565] ? threaded_store+0x132/0x220
[ 1358.476873] ? ww_mutex_lock+0x160/0x160
[ 1358.482075] ? selinux_inode_free_security+0x310/0x310
[ 1358.488656] ? cap_capable+0x1ed/0x3f0
[ 1358.493664] ? sysfs_file_ops+0x140/0x140
[ 1358.498967] ? threaded_store+0x132/0x220
[ 1358.504268] threaded_store+0x132/0x220
[ 1358.509377] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.514877] ? sysfs_file_ops+0x140/0x140
[ 1358.520180] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.525480] ? sysfs_kf_write+0x65/0x160
[ 1358.530685] kernfs_fop_write_iter+0x335/0x510
[ 1358.536476] ? kernfs_ops+0xf0/0xf0
[ 1358.541192] new_sync_write+0x308/0x6f0
[ 1358.546299] ? new_sync_read+0x6f0/0x6f0
[ 1358.551504] ? lock_acquire.part.0+0xbc/0x260
[ 1358.557196] ? ksys_write+0xff/0x200
[ 1358.562017] vfs_write+0x62a/0x980
[ 1358.566636] ksys_write+0xff/0x200
[ 1358.571254] ? __ia32_sys_read+0xc0/0xc0
[ 1358.576454] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.582047] ? rcu_is_watching+0x15/0xd0
[ 1358.587255] do_syscall_64+0xf3/0x5e0
[ 1358.592167] ? exc_page_fault+0x9e/0xb0
[ 1358.597274] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.603747] RIP: 0033:0x7fda223c5c5e
[ 1358.608561] RSP: 002b:00007ffc16a2b070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.617864] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fda223c5c5e
[ 1358.626681] RDX: 0000000000000001 RSI: 000055aa019a6760 RDI: 0000000000000007
[ 1358.635492] RBP: 00007ffc16a2b080 R08: 0000000000000000 R09: 0000000000000000
[ 1358.644308] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fda22260e80
[ 1358.653119] R13: 000055aa019a6760 R14: 0000000000000007 R15: 00007fda22ac6b98
[ 1358.661945]
[ 1358.665235] INFO: task python3:5240 is blocked on a mutex likely owned by task python3:3258.
[ 1358.675516] task:python3 state:D stack:25312 pid:3258 tgid:3258 ppid:3257 task_flags:0x400100 flags:0x00080802
[ 1358.688715] Call Trace:
[ 1358.692256]
[ 1358.695408] __schedule+0xad9/0x1490
[ 1358.700226] ? io_schedule_timeout+0x130/0x130
[ 1358.706012] ? find_held_lock+0x2b/0x80
[ 1358.711122] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.717307] schedule+0xd4/0x260
[ 1358.721731] schedule_timeout+0x103/0x260
[ 1358.727034] ? rcu_is_watching+0x15/0xd0
[ 1358.732238] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.738610] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.744308] ? ww_mutex_lock+0x160/0x160
[ 1358.749513] msleep+0x1b/0x30
[ 1358.753641] napi_set_threaded+0x376/0x410
[ 1358.759040] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.764544] netif_set_threaded+0x254/0x400
[ 1358.770044] ? sysfs_file_ops+0x140/0x140
[ 1358.775343] threaded_store+0x1bb/0x220
[ 1358.780451] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.785949] ? sysfs_file_ops+0x140/0x140
[ 1358.791250] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.796550] ? sysfs_kf_write+0x65/0x160
[ 1358.801752] kernfs_fop_write_iter+0x335/0x510
[ 1358.807544] ? kernfs_ops+0xf0/0xf0
[ 1358.812259] new_sync_write+0x308/0x6f0
[ 1358.817356] ? new_sync_read+0x6f0/0x6f0
[ 1358.822563] ? lock_acquire.part.0+0xbc/0x260
[ 1358.828255] ? ksys_write+0xff/0x200
[ 1358.833072] vfs_write+0x62a/0x980
[ 1358.837693] ksys_write+0xff/0x200
[ 1358.842311] ? __ia32_sys_read+0xc0/0xc0
[ 1358.847516] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.853112] ? rcu_is_watching+0x15/0xd0
[ 1358.858320] do_syscall_64+0xf3/0x5e0
[ 1358.863231] ? exc_page_fault+0x9e/0xb0
[ 1358.868336] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.874809] RIP: 0033:0x7f4cfc500c5e
[ 1358.879621] RSP: 002b:00007ffca8d4e4d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.888922] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cfc500c5e
[ 1358.897736] RDX: 0000000000000001 RSI: 000055b937342760 RDI: 0000000000000007
[ 1358.906548] RBP: 00007ffca8d4e4e0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.915362] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cfc39be80
[ 1358.924173] R13: 000055b937342760 R14: 0000000000000007 R15: 00007f4cfc32a480
[ 1358.932997]
[ 1358.936262] \x0aShowing all locks held in the system:
[ 1358.944811] 1 lock held by khungtaskd/185:
[ 1358.950201] #0: ffffffff9f6ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.961685] 2 locks held by systemd-journal/806:
[ 1358.967665] #0: ff1100180e3b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1358.977563] #1: ffffffff9f8c91e0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1358.989813] 4 locks held by python3/3258:
[ 1358.995114] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.004914] #1: ff1100013e682c88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.015884] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.027051] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.037155] 4 locks held by python3/5240:
[ 1359.042458] #0: ff1100012eea13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.052266] #1: ff110001ab581488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.063237] #2: ff1100012184d0f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.074403] #3: ff110001218c1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.084504]
[ 1359.086971] =============================================\x0a