[ 762.216354] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 762.218910] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py
[ 762.383225] kselftest: Running tests in drivers/net
[ 989.749613] INFO: task python3:5058 blocked for more than 122 seconds.
[ 989.757847] Not tainted 7.0.0-rc4-npew-ge47e86122399 #1
[ 989.765098] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.774688] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080000
[ 989.787894] Call Trace:
[ 989.791437]
[ 989.794591] __schedule+0xad9/0x1490
[ 989.799407] ? io_schedule_timeout+0x130/0x130
[ 989.805193] ? find_held_lock+0x2b/0x80
[ 989.810297] ? __lock_release.isra.0+0x59/0x170
[ 989.816176] schedule+0xd4/0x260
[ 989.820595] schedule_preempt_disabled+0x18/0x30
[ 989.826575] __mutex_lock+0xd76/0x1f20
[ 989.831582] ? threaded_store+0x132/0x220
[ 989.836885] ? ww_mutex_lock+0x160/0x160
[ 989.842083] ? selinux_inode_free_security+0x310/0x310
[ 989.848655] ? cap_capable+0x1ed/0x3f0
[ 989.853663] ? sysfs_file_ops+0x140/0x140
[ 989.858963] ? threaded_store+0x132/0x220
[ 989.864251] threaded_store+0x132/0x220
[ 989.869343] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.874837] ? sysfs_file_ops+0x140/0x140
[ 989.880134] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.885432] ? sysfs_kf_write+0x65/0x160
[ 989.890638] kernfs_fop_write_iter+0x335/0x510
[ 989.896422] ? kernfs_ops+0xf0/0xf0
[ 989.901136] new_sync_write+0x308/0x6f0
[ 989.906241] ? new_sync_read+0x6f0/0x6f0
[ 989.911445] ? lock_acquire.part.0+0xbc/0x260
[ 989.917131] ? ksys_write+0xff/0x200
[ 989.921944] vfs_write+0x62a/0x980
[ 989.926561] ksys_write+0xff/0x200
[ 989.931177] ? __ia32_sys_read+0xc0/0xc0
[ 989.936375] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.941965] ? rcu_is_watching+0x15/0xd0
[ 989.947169] do_syscall_64+0xf3/0x5e0
[ 989.952076] ? exc_page_fault+0x9e/0xb0
[ 989.957177] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.963645] RIP: 0033:0x7f833d9ffc5e
[ 989.968454] RSP: 002b:00007ffe539bae30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.977751] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f833d9ffc5e
[ 989.986551] RDX: 0000000000000001 RSI: 0000560e10cd9110 RDI: 0000000000000007
[ 989.995359] RBP: 00007ffe539bae40 R08: 0000000000000000 R09: 0000000000000000
[ 990.004165] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f833d89ae80
[ 990.012973] R13: 0000560e10cd9110 R14: 0000000000000007 R15: 00007f833e100b98
[ 990.021778]
[ 990.025059] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3109.
[ 990.035339] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 990.048540] Call Trace:
[ 990.052081]
[ 990.055232] __schedule+0xad9/0x1490
[ 990.060042] ? io_schedule_timeout+0x130/0x130
[ 990.065816] ? find_held_lock+0x2b/0x80
[ 990.070919] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.077102] schedule+0xd4/0x260
[ 990.081519] schedule_timeout+0x103/0x260
[ 990.086815] ? rcu_is_watching+0x15/0xd0
[ 990.092013] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.098382] ? hrtimers_cpu_dying+0x250/0x250
[ 990.104073] ? ww_mutex_lock+0x160/0x160
[ 990.109271] msleep+0x1b/0x30
[ 990.113396] napi_set_threaded+0x376/0x410
[ 990.118792] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.124279] netif_set_threaded+0x254/0x400
[ 990.129771] ? sysfs_file_ops+0x140/0x140
[ 990.135069] threaded_store+0x1bb/0x220
[ 990.140162] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.145655] ? sysfs_file_ops+0x140/0x140
[ 990.150951] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.156249] ? sysfs_kf_write+0x65/0x160
[ 990.161450] kernfs_fop_write_iter+0x335/0x510
[ 990.167235] ? kernfs_ops+0xf0/0xf0
[ 990.171937] new_sync_write+0x308/0x6f0
[ 990.177041] ? new_sync_read+0x6f0/0x6f0
[ 990.182242] ? lock_acquire.part.0+0xbc/0x260
[ 990.187931] ? ksys_write+0xff/0x200
[ 990.192742] vfs_write+0x62a/0x980
[ 990.197355] ksys_write+0xff/0x200
[ 990.201970] ? __ia32_sys_read+0xc0/0xc0
[ 990.207170] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.212762] ? rcu_is_watching+0x15/0xd0
[ 990.217963] do_syscall_64+0xf3/0x5e0
[ 990.222871] ? exc_page_fault+0x9e/0xb0
[ 990.227963] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.234430] RIP: 0033:0x7f38c8b7ec5e
[ 990.239238] RSP: 002b:00007ffc68d9c400 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.248534] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f38c8b7ec5e
[ 990.257332] RDX: 0000000000000001 RSI: 000055f9cd419110 RDI: 0000000000000007
[ 990.266141] RBP: 00007ffc68d9c410 R08: 0000000000000000 R09: 0000000000000000
[ 990.274941] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f38c8a19e80
[ 990.283749] R13: 000055f9cd419110 R14: 0000000000000007 R15: 00007f38c89aa480
[ 990.292562]
[ 990.295823] \x0aShowing all locks held in the system:
[ 990.304360] 1 lock held by khungtaskd/184:
[ 990.309756] #0: ffffffffb76ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.321219] 2 locks held by systemd-journal/805:
[ 990.327197] #0: ff1100180e4b7220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 990.337083] #1: ffffffffb78c8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.349910] 4 locks held by python3/3109:
[ 990.355204] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.364994] #1: ff1100013d041488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.375955] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.387114] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.397210] 4 locks held by python3/5058:
[ 990.402509] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.412291] #1: ff110001a046e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.423254] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.434412] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.444501]
[ 990.446966] =============================================\x0a
[ 1112.632006] INFO: task python3:5058 blocked for more than 245 seconds.
[ 1112.640151] Not tainted 7.0.0-rc4-npew-ge47e86122399 #1
[ 1112.647403] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.656993] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080000
[ 1112.670196] Call Trace:
[ 1112.673736]
[ 1112.676887] __schedule+0xad9/0x1490
[ 1112.681700] ? io_schedule_timeout+0x130/0x130
[ 1112.687485] ? find_held_lock+0x2b/0x80
[ 1112.692593] ? __lock_release.isra.0+0x59/0x170
[ 1112.698476] schedule+0xd4/0x260
[ 1112.702892] schedule_preempt_disabled+0x18/0x30
[ 1112.708867] __mutex_lock+0xd76/0x1f20
[ 1112.713870] ? threaded_store+0x132/0x220
[ 1112.719159] ? ww_mutex_lock+0x160/0x160
[ 1112.724358] ? selinux_inode_free_security+0x310/0x310
[ 1112.730927] ? cap_capable+0x1ed/0x3f0
[ 1112.735935] ? sysfs_file_ops+0x140/0x140
[ 1112.741234] ? threaded_store+0x132/0x220
[ 1112.746528] threaded_store+0x132/0x220
[ 1112.751632] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.757124] ? sysfs_file_ops+0x140/0x140
[ 1112.762409] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.767704] ? sysfs_kf_write+0x65/0x160
[ 1112.772904] kernfs_fop_write_iter+0x335/0x510
[ 1112.778687] ? kernfs_ops+0xf0/0xf0
[ 1112.783396] new_sync_write+0x308/0x6f0
[ 1112.788499] ? new_sync_read+0x6f0/0x6f0
[ 1112.793697] ? lock_acquire.part.0+0xbc/0x260
[ 1112.799382] ? ksys_write+0xff/0x200
[ 1112.804194] vfs_write+0x62a/0x980
[ 1112.808808] ksys_write+0xff/0x200
[ 1112.813422] ? __ia32_sys_read+0xc0/0xc0
[ 1112.818619] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.824207] ? rcu_is_watching+0x15/0xd0
[ 1112.829407] do_syscall_64+0xf3/0x5e0
[ 1112.834312] ? exc_page_fault+0x9e/0xb0
[ 1112.839414] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.845881] RIP: 0033:0x7f833d9ffc5e
[ 1112.850683] RSP: 002b:00007ffe539bae30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.859981] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f833d9ffc5e
[ 1112.868788] RDX: 0000000000000001 RSI: 0000560e10cd9110 RDI: 0000000000000007
[ 1112.877596] RBP: 00007ffe539bae40 R08: 0000000000000000 R09: 0000000000000000
[ 1112.886394] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f833d89ae80
[ 1112.895195] R13: 0000560e10cd9110 R14: 0000000000000007 R15: 00007f833e100b98
[ 1112.904007]
[ 1112.907290] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3109.
[ 1112.917563] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1112.930765] Call Trace:
[ 1112.934303]
[ 1112.937450] __schedule+0xad9/0x1490
[ 1112.942258] ? io_schedule_timeout+0x130/0x130
[ 1112.948038] ? find_held_lock+0x2b/0x80
[ 1112.953139] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.959319] schedule+0xd4/0x260
[ 1112.963735] schedule_timeout+0x103/0x260
[ 1112.969031] ? rcu_is_watching+0x15/0xd0
[ 1112.974228] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.980600] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.986287] ? ww_mutex_lock+0x160/0x160
[ 1112.991484] msleep+0x1b/0x30
[ 1112.995610] napi_set_threaded+0x376/0x410
[ 1113.001004] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.006499] netif_set_threaded+0x254/0x400
[ 1113.011990] ? sysfs_file_ops+0x140/0x140
[ 1113.017285] threaded_store+0x1bb/0x220
[ 1113.022389] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.027881] ? sysfs_file_ops+0x140/0x140
[ 1113.033174] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.038470] ? sysfs_kf_write+0x65/0x160
[ 1113.043672] kernfs_fop_write_iter+0x335/0x510
[ 1113.049457] ? kernfs_ops+0xf0/0xf0
[ 1113.054167] new_sync_write+0x308/0x6f0
[ 1113.059269] ? new_sync_read+0x6f0/0x6f0
[ 1113.064467] ? lock_acquire.part.0+0xbc/0x260
[ 1113.070150] ? ksys_write+0xff/0x200
[ 1113.074963] vfs_write+0x62a/0x980
[ 1113.079578] ksys_write+0xff/0x200
[ 1113.084192] ? __ia32_sys_read+0xc0/0xc0
[ 1113.089390] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.094978] ? rcu_is_watching+0x15/0xd0
[ 1113.100179] do_syscall_64+0xf3/0x5e0
[ 1113.105085] ? exc_page_fault+0x9e/0xb0
[ 1113.110184] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.116650] RIP: 0033:0x7f38c8b7ec5e
[ 1113.121458] RSP: 002b:00007ffc68d9c400 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.130755] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f38c8b7ec5e
[ 1113.139560] RDX: 0000000000000001 RSI: 000055f9cd419110 RDI: 0000000000000007
[ 1113.148365] RBP: 00007ffc68d9c410 R08: 0000000000000000 R09: 0000000000000000
[ 1113.157171] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f38c8a19e80
[ 1113.165977] R13: 000055f9cd419110 R14: 0000000000000007 R15: 00007f38c89aa480
[ 1113.174788]
[ 1113.178048] \x0aShowing all locks held in the system:
[ 1113.186583] 1 lock held by khungtaskd/184:
[ 1113.191975] #0: ffffffffb76ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.203456] 4 locks held by python3/3109:
[ 1113.208749] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.218539] #1: ff1100013d041488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.229501] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.240657] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.250755] 4 locks held by python3/5058:
[ 1113.256049] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.265836] #1: ff110001a046e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.276800] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.287955] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.298045]
[ 1113.300510] =============================================\x0a
[ 1235.513402] INFO: task python3:5058 blocked for more than 368 seconds.
[ 1235.521547] Not tainted 7.0.0-rc4-npew-ge47e86122399 #1
[ 1235.528797] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.538384] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080002
[ 1235.551588] Call Trace:
[ 1235.555128]
[ 1235.558276] __schedule+0xad9/0x1490
[ 1235.563090] ? io_schedule_timeout+0x130/0x130
[ 1235.568875] ? find_held_lock+0x2b/0x80
[ 1235.573977] ? __lock_release.isra.0+0x59/0x170
[ 1235.579862] schedule+0xd4/0x260
[ 1235.584278] schedule_preempt_disabled+0x18/0x30
[ 1235.590254] __mutex_lock+0xd76/0x1f20
[ 1235.595259] ? threaded_store+0x132/0x220
[ 1235.600557] ? ww_mutex_lock+0x160/0x160
[ 1235.605757] ? selinux_inode_free_security+0x310/0x310
[ 1235.612325] ? cap_capable+0x1ed/0x3f0
[ 1235.617337] ? sysfs_file_ops+0x140/0x140
[ 1235.622634] ? threaded_store+0x132/0x220
[ 1235.627930] threaded_store+0x132/0x220
[ 1235.633031] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.638521] ? sysfs_file_ops+0x140/0x140
[ 1235.643816] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.649112] ? sysfs_kf_write+0x65/0x160
[ 1235.654312] kernfs_fop_write_iter+0x335/0x510
[ 1235.660086] ? kernfs_ops+0xf0/0xf0
[ 1235.664795] new_sync_write+0x308/0x6f0
[ 1235.669898] ? new_sync_read+0x6f0/0x6f0
[ 1235.675095] ? lock_acquire.part.0+0xbc/0x260
[ 1235.680781] ? ksys_write+0xff/0x200
[ 1235.685592] vfs_write+0x62a/0x980
[ 1235.690207] ksys_write+0xff/0x200
[ 1235.694821] ? __ia32_sys_read+0xc0/0xc0
[ 1235.700017] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.705605] ? rcu_is_watching+0x15/0xd0
[ 1235.710806] do_syscall_64+0xf3/0x5e0
[ 1235.715711] ? exc_page_fault+0x9e/0xb0
[ 1235.720814] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.727280] RIP: 0033:0x7f833d9ffc5e
[ 1235.732087] RSP: 002b:00007ffe539bae30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.741385] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f833d9ffc5e
[ 1235.750192] RDX: 0000000000000001 RSI: 0000560e10cd9110 RDI: 0000000000000007
[ 1235.758996] RBP: 00007ffe539bae40 R08: 0000000000000000 R09: 0000000000000000
[ 1235.767801] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f833d89ae80
[ 1235.776607] R13: 0000560e10cd9110 R14: 0000000000000007 R15: 00007f833e100b98
[ 1235.785419]
[ 1235.788706] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3109.
[ 1235.798981] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1235.812180] Call Trace:
[ 1235.815718]
[ 1235.818865] __schedule+0xad9/0x1490
[ 1235.823673] ? io_schedule_timeout+0x130/0x130
[ 1235.829454] ? find_held_lock+0x2b/0x80
[ 1235.834555] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.840736] schedule+0xd4/0x260
[ 1235.845151] schedule_timeout+0x103/0x260
[ 1235.850447] ? rcu_is_watching+0x15/0xd0
[ 1235.855644] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.862011] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.867699] ? ww_mutex_lock+0x160/0x160
[ 1235.872899] msleep+0x1b/0x30
[ 1235.877026] napi_set_threaded+0x376/0x410
[ 1235.882419] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.887913] netif_set_threaded+0x254/0x400
[ 1235.893408] ? sysfs_file_ops+0x140/0x140
[ 1235.898703] threaded_store+0x1bb/0x220
[ 1235.903803] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.909295] ? sysfs_file_ops+0x140/0x140
[ 1235.914589] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.919886] ? sysfs_kf_write+0x65/0x160
[ 1235.925084] kernfs_fop_write_iter+0x335/0x510
[ 1235.930869] ? kernfs_ops+0xf0/0xf0
[ 1235.935570] new_sync_write+0x308/0x6f0
[ 1235.940672] ? new_sync_read+0x6f0/0x6f0
[ 1235.945870] ? lock_acquire.part.0+0xbc/0x260
[ 1235.951557] ? ksys_write+0xff/0x200
[ 1235.956368] vfs_write+0x62a/0x980
[ 1235.960983] ksys_write+0xff/0x200
[ 1235.965588] ? __ia32_sys_read+0xc0/0xc0
[ 1235.970787] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.976365] ? rcu_is_watching+0x15/0xd0
[ 1235.981565] do_syscall_64+0xf3/0x5e0
[ 1235.986471] ? exc_page_fault+0x9e/0xb0
[ 1235.991570] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.998038] RIP: 0033:0x7f38c8b7ec5e
[ 1236.002834] RSP: 002b:00007ffc68d9c400 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.012128] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f38c8b7ec5e
[ 1236.020934] RDX: 0000000000000001 RSI: 000055f9cd419110 RDI: 0000000000000007
[ 1236.029743] RBP: 00007ffc68d9c410 R08: 0000000000000000 R09: 0000000000000000
[ 1236.038551] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f38c8a19e80
[ 1236.047357] R13: 000055f9cd419110 R14: 0000000000000007 R15: 00007f38c89aa480
[ 1236.056170]
[ 1236.059436] \x0aShowing all locks held in the system:
[ 1236.067969] 1 lock held by khungtaskd/184:
[ 1236.073363] #0: ffffffffb76ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.084828] 3 locks held by kworker/u129:11/306:
[ 1236.090828] 4 locks held by python3/3109:
[ 1236.096123] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.105915] #1: ff1100013d041488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.116876] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.128024] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.138117] 4 locks held by python3/5058:
[ 1236.143412] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.153199] #1: ff110001a046e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.164159] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.175317] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.185407]
[ 1236.187873] =============================================\x0a
[ 1268.281747] kworker/u130:3 (535) used greatest stack depth: 21192 bytes left
[ 1358.394799] INFO: task python3:5058 blocked for more than 491 seconds.
[ 1358.402946] Not tainted 7.0.0-rc4-npew-ge47e86122399 #1
[ 1358.410186] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.419776] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080002
[ 1358.432980] Call Trace:
[ 1358.436521]
[ 1358.439669] __schedule+0xad9/0x1490
[ 1358.444486] ? io_schedule_timeout+0x130/0x130
[ 1358.450272] ? find_held_lock+0x2b/0x80
[ 1358.455374] ? __lock_release.isra.0+0x59/0x170
[ 1358.461261] schedule+0xd4/0x260
[ 1358.465678] schedule_preempt_disabled+0x18/0x30
[ 1358.471655] __mutex_lock+0xd76/0x1f20
[ 1358.476659] ? threaded_store+0x132/0x220
[ 1358.481959] ? ww_mutex_lock+0x160/0x160
[ 1358.487157] ? selinux_inode_free_security+0x310/0x310
[ 1358.493727] ? cap_capable+0x1ed/0x3f0
[ 1358.498731] ? sysfs_file_ops+0x140/0x140
[ 1358.504031] ? threaded_store+0x132/0x220
[ 1358.509318] threaded_store+0x132/0x220
[ 1358.514423] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.519917] ? sysfs_file_ops+0x140/0x140
[ 1358.525211] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.530506] ? sysfs_kf_write+0x65/0x160
[ 1358.535706] kernfs_fop_write_iter+0x335/0x510
[ 1358.541479] ? kernfs_ops+0xf0/0xf0
[ 1358.546188] new_sync_write+0x308/0x6f0
[ 1358.551291] ? new_sync_read+0x6f0/0x6f0
[ 1358.556489] ? lock_acquire.part.0+0xbc/0x260
[ 1358.562176] ? ksys_write+0xff/0x200
[ 1358.566978] vfs_write+0x62a/0x980
[ 1358.571594] ksys_write+0xff/0x200
[ 1358.576198] ? __ia32_sys_read+0xc0/0xc0
[ 1358.581395] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.586983] ? rcu_is_watching+0x15/0xd0
[ 1358.592184] do_syscall_64+0xf3/0x5e0
[ 1358.597081] ? exc_page_fault+0x9e/0xb0
[ 1358.602180] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.608648] RIP: 0033:0x7f833d9ffc5e
[ 1358.613456] RSP: 002b:00007ffe539bae30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.622752] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f833d9ffc5e
[ 1358.631559] RDX: 0000000000000001 RSI: 0000560e10cd9110 RDI: 0000000000000007
[ 1358.640364] RBP: 00007ffe539bae40 R08: 0000000000000000 R09: 0000000000000000
[ 1358.649169] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f833d89ae80
[ 1358.657975] R13: 0000560e10cd9110 R14: 0000000000000007 R15: 00007f833e100b98
[ 1358.666787]
[ 1358.670052] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3109.
[ 1358.680324] task:python3 state:D stack:25312 pid:3109 tgid:3109 ppid:3108 task_flags:0x400100 flags:0x00080802
[ 1358.693525] Call Trace:
[ 1358.697064]
[ 1358.700212] __schedule+0xad9/0x1490
[ 1358.705021] ? io_schedule_timeout+0x130/0x130
[ 1358.710803] ? find_held_lock+0x2b/0x80
[ 1358.715905] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.722085] schedule+0xd4/0x260
[ 1358.726501] schedule_timeout+0x103/0x260
[ 1358.731798] ? rcu_is_watching+0x15/0xd0
[ 1358.736996] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.743365] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.749054] ? ww_mutex_lock+0x160/0x160
[ 1358.754251] msleep+0x1b/0x30
[ 1358.758374] napi_set_threaded+0x376/0x410
[ 1358.763769] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.769259] netif_set_threaded+0x254/0x400
[ 1358.774751] ? sysfs_file_ops+0x140/0x140
[ 1358.780048] threaded_store+0x1bb/0x220
[ 1358.785149] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.790644] ? sysfs_file_ops+0x140/0x140
[ 1358.795938] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.801235] ? sysfs_kf_write+0x65/0x160
[ 1358.806425] kernfs_fop_write_iter+0x335/0x510
[ 1358.812207] ? kernfs_ops+0xf0/0xf0
[ 1358.816919] new_sync_write+0x308/0x6f0
[ 1358.822022] ? new_sync_read+0x6f0/0x6f0
[ 1358.827220] ? lock_acquire.part.0+0xbc/0x260
[ 1358.832904] ? ksys_write+0xff/0x200
[ 1358.837713] vfs_write+0x62a/0x980
[ 1358.842327] ksys_write+0xff/0x200
[ 1358.846939] ? __ia32_sys_read+0xc0/0xc0
[ 1358.852473] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.858059] ? rcu_is_watching+0x15/0xd0
[ 1358.863259] do_syscall_64+0xf3/0x5e0
[ 1358.868162] ? exc_page_fault+0x9e/0xb0
[ 1358.873331] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.879798] RIP: 0033:0x7f38c8b7ec5e
[ 1358.884605] RSP: 002b:00007ffc68d9c400 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.893970] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f38c8b7ec5e
[ 1358.902777] RDX: 0000000000000001 RSI: 000055f9cd419110 RDI: 0000000000000007
[ 1358.911585] RBP: 00007ffc68d9c410 R08: 0000000000000000 R09: 0000000000000000
[ 1358.920391] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f38c8a19e80
[ 1358.929197] R13: 000055f9cd419110 R14: 0000000000000007 R15: 00007f38c89aa480
[ 1358.938009]
[ 1358.941280] \x0aShowing all locks held in the system:
[ 1358.949799] 2 locks held by systemd/1:
[ 1358.954800] #0: ff1100012dfa93f8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.964592] #1: ff110001e3e63288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.975578] 1 lock held by khungtaskd/184:
[ 1358.980971] #0: ffffffffb76ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.992460] 4 locks held by python3/3109:
[ 1358.997752] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.007540] #1: ff1100013d041488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.018501] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.029655] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.039759] 4 locks held by python3/5058:
[ 1359.045056] #0: ff1100012dec13f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.054850] #1: ff110001a046e888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.065809] #2: ff110001207230f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.076964] #3: ff110001206f1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.087054]
[ 1359.089519] =============================================\x0a