[ 759.062225] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 759.064786] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py
[ 759.225361] kselftest: Running tests in drivers/net
[ 989.746026] INFO: task python3:4966 blocked for more than 122 seconds.
[ 989.754254] Not tainted 7.0.0-rc4-gfpd-gb5a55d9e4f05 #1
[ 989.761503] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.771083] task:python3 state:D stack:25312 pid:4966 tgid:4966 ppid:4965 task_flags:0x400100 flags:0x00080000
[ 989.784287] Call Trace:
[ 989.787824]
[ 989.790975] __schedule+0xad9/0x1490
[ 989.795792] ? io_schedule_timeout+0x130/0x130
[ 989.801574] ? find_held_lock+0x2b/0x80
[ 989.806676] ? __lock_release.isra.0+0x59/0x170
[ 989.812563] schedule+0xd4/0x260
[ 989.816987] schedule_preempt_disabled+0x18/0x30
[ 989.822967] __mutex_lock+0xd76/0x1f20
[ 989.827973] ? threaded_store+0x132/0x220
[ 989.833274] ? ww_mutex_lock+0x160/0x160
[ 989.838473] ? selinux_inode_free_security+0x310/0x310
[ 989.845045] ? cap_capable+0x1ed/0x3f0
[ 989.850049] ? sysfs_file_ops+0x140/0x140
[ 989.855349] ? threaded_store+0x132/0x220
[ 989.860644] threaded_store+0x132/0x220
[ 989.865746] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.871240] ? sysfs_file_ops+0x140/0x140
[ 989.876535] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.881832] ? sysfs_kf_write+0x65/0x160
[ 989.887030] kernfs_fop_write_iter+0x335/0x510
[ 989.892813] ? kernfs_ops+0xf0/0xf0
[ 989.897522] new_sync_write+0x308/0x6f0
[ 989.902625] ? new_sync_read+0x6f0/0x6f0
[ 989.907822] ? lock_acquire.part.0+0xbc/0x260
[ 989.913509] ? ksys_write+0xff/0x200
[ 989.918320] vfs_write+0x62a/0x980
[ 989.922934] ksys_write+0xff/0x200
[ 989.927545] ? __ia32_sys_read+0xc0/0xc0
[ 989.932742] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.938330] ? rcu_is_watching+0x15/0xd0
[ 989.943533] do_syscall_64+0xf3/0x5e0
[ 989.948439] ? exc_page_fault+0x9e/0xb0
[ 989.953542] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.960009] RIP: 0033:0x7f36b7f1dc5e
[ 989.964808] RSP: 002b:00007ffe0a76a6e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.974105] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f36b7f1dc5e
[ 989.982913] RDX: 0000000000000001 RSI: 0000563093b37110 RDI: 0000000000000007
[ 989.991721] RBP: 00007ffe0a76a6f0 R08: 0000000000000000 R09: 0000000000000000
[ 990.000518] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f36b7db8e80
[ 990.009324] R13: 0000563093b37110 R14: 0000000000000007 R15: 00007f36b861eb98
[ 990.018137]
[ 990.021431] INFO: task python3:4966 is blocked on a mutex likely owned by task python3:3029.
[ 990.031719] task:python3 state:D stack:25312 pid:3029 tgid:3029 ppid:3028 task_flags:0x400100 flags:0x00080802
[ 990.044926] Call Trace:
[ 990.048464]
[ 990.051616] __schedule+0xad9/0x1490
[ 990.056425] ? io_schedule_timeout+0x130/0x130
[ 990.062207] ? find_held_lock+0x2b/0x80
[ 990.067309] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.073481] schedule+0xd4/0x260
[ 990.077896] schedule_timeout+0x103/0x260
[ 990.083190] ? rcu_is_watching+0x15/0xd0
[ 990.088388] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.094756] ? hrtimers_cpu_dying+0x250/0x250
[ 990.100445] ? ww_mutex_lock+0x160/0x160
[ 990.105632] msleep+0x1b/0x30
[ 990.109756] napi_set_threaded+0x376/0x410
[ 990.115150] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.120644] netif_set_threaded+0x254/0x400
[ 990.126134] ? sysfs_file_ops+0x140/0x140
[ 990.131431] threaded_store+0x1bb/0x220
[ 990.136532] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.142025] ? sysfs_file_ops+0x140/0x140
[ 990.147318] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.152615] ? sysfs_kf_write+0x65/0x160
[ 990.157813] kernfs_fop_write_iter+0x335/0x510
[ 990.163600] ? kernfs_ops+0xf0/0xf0
[ 990.168309] new_sync_write+0x308/0x6f0
[ 990.173412] ? new_sync_read+0x6f0/0x6f0
[ 990.178600] ? lock_acquire.part.0+0xbc/0x260
[ 990.184284] ? ksys_write+0xff/0x200
[ 990.189096] vfs_write+0x62a/0x980
[ 990.193708] ksys_write+0xff/0x200
[ 990.198322] ? __ia32_sys_read+0xc0/0xc0
[ 990.203522] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.209100] ? rcu_is_watching+0x15/0xd0
[ 990.214297] do_syscall_64+0xf3/0x5e0
[ 990.219204] ? irq_exit_rcu+0x39/0xf0
[ 990.224109] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.230576] RIP: 0033:0x7f049535dc5e
[ 990.235374] RSP: 002b:00007ffc341236c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.244671] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f049535dc5e
[ 990.253478] RDX: 0000000000000001 RSI: 00005626f3d68110 RDI: 0000000000000007
[ 990.262284] RBP: 00007ffc341236d0 R08: 0000000000000000 R09: 0000000000000000
[ 990.271093] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f04951f8e80
[ 990.279900] R13: 00005626f3d68110 R14: 0000000000000007 R15: 00007f0495186480
[ 990.288720]
[ 990.291981] \x0aShowing all locks held in the system:
[ 990.300521] 1 lock held by khungtaskd/184:
[ 990.305916] #0: ffffffffaecce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.317405] 4 locks held by python3/3029:
[ 990.322700] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.332491] #1: ff1100013c5d6288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.343446] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.354602] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.364699] 4 locks held by python3/4966:
[ 990.369993] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.379783] #1: ff1100017aad2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.390745] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.401905] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.411993]
[ 990.414462] =============================================\x0a
[ 1092.146396] kworker/u129:11 (306) used greatest stack depth: 21192 bytes left
[ 1112.626224] INFO: task python3:4966 blocked for more than 245 seconds.
[ 1112.634375] Not tainted 7.0.0-rc4-gfpd-gb5a55d9e4f05 #1
[ 1112.641629] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.651223] task:python3 state:D stack:25312 pid:4966 tgid:4966 ppid:4965 task_flags:0x400100 flags:0x00080000
[ 1112.664435] Call Trace:
[ 1112.667980]
[ 1112.671253] __schedule+0xad9/0x1490
[ 1112.676079] ? io_schedule_timeout+0x130/0x130
[ 1112.681867] ? find_held_lock+0x2b/0x80
[ 1112.686976] ? __lock_release.isra.0+0x59/0x170
[ 1112.692867] schedule+0xd4/0x260
[ 1112.697292] schedule_preempt_disabled+0x18/0x30
[ 1112.703277] __mutex_lock+0xd76/0x1f20
[ 1112.708290] ? threaded_store+0x132/0x220
[ 1112.713595] ? ww_mutex_lock+0x160/0x160
[ 1112.718797] ? selinux_inode_free_security+0x310/0x310
[ 1112.725373] ? cap_capable+0x1ed/0x3f0
[ 1112.730390] ? sysfs_file_ops+0x140/0x140
[ 1112.735693] ? threaded_store+0x132/0x220
[ 1112.740991] threaded_store+0x132/0x220
[ 1112.746095] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.751590] ? sysfs_file_ops+0x140/0x140
[ 1112.756893] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.762313] ? sysfs_kf_write+0x65/0x160
[ 1112.767520] kernfs_fop_write_iter+0x335/0x510
[ 1112.773308] ? kernfs_ops+0xf0/0xf0
[ 1112.778025] new_sync_write+0x308/0x6f0
[ 1112.783133] ? new_sync_read+0x6f0/0x6f0
[ 1112.788339] ? lock_acquire.part.0+0xbc/0x260
[ 1112.794027] ? ksys_write+0xff/0x200
[ 1112.798847] vfs_write+0x62a/0x980
[ 1112.803464] ksys_write+0xff/0x200
[ 1112.808083] ? __ia32_sys_read+0xc0/0xc0
[ 1112.813286] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.818882] ? rcu_is_watching+0x15/0xd0
[ 1112.824087] do_syscall_64+0xf3/0x5e0
[ 1112.829000] ? exc_page_fault+0x9e/0xb0
[ 1112.834107] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.840764] RIP: 0033:0x7f36b7f1dc5e
[ 1112.845578] RSP: 002b:00007ffe0a76a6e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.854883] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f36b7f1dc5e
[ 1112.863697] RDX: 0000000000000001 RSI: 0000563093b37110 RDI: 0000000000000007
[ 1112.872507] RBP: 00007ffe0a76a6f0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.881320] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f36b7db8e80
[ 1112.890132] R13: 0000563093b37110 R14: 0000000000000007 R15: 00007f36b861eb98
[ 1112.898954]
[ 1112.902300] INFO: task python3:4966 is blocked on a mutex likely owned by task python3:3029.
[ 1112.912582] task:python3 state:D stack:25312 pid:3029 tgid:3029 ppid:3028 task_flags:0x400100 flags:0x00080802
[ 1112.925790] Call Trace:
[ 1112.929653]
[ 1112.932806] __schedule+0xad9/0x1490
[ 1112.937624] ? io_schedule_timeout+0x130/0x130
[ 1112.943412] ? find_held_lock+0x2b/0x80
[ 1112.948522] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.954711] schedule+0xd4/0x260
[ 1112.959134] schedule_timeout+0x103/0x260
[ 1112.964436] ? rcu_is_watching+0x15/0xd0
[ 1112.969641] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.976018] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.981711] ? ww_mutex_lock+0x160/0x160
[ 1112.987032] msleep+0x1b/0x30
[ 1112.991152] napi_set_threaded+0x376/0x410
[ 1112.996552] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.002057] netif_set_threaded+0x254/0x400
[ 1113.007555] ? sysfs_file_ops+0x140/0x140
[ 1113.012856] threaded_store+0x1bb/0x220
[ 1113.017962] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.023573] ? sysfs_file_ops+0x140/0x140
[ 1113.028873] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.034175] ? sysfs_kf_write+0x65/0x160
[ 1113.039377] kernfs_fop_write_iter+0x335/0x510
[ 1113.045168] ? kernfs_ops+0xf0/0xf0
[ 1113.049886] new_sync_write+0x308/0x6f0
[ 1113.054995] ? new_sync_read+0x6f0/0x6f0
[ 1113.060198] ? lock_acquire.part.0+0xbc/0x260
[ 1113.065886] ? ksys_write+0xff/0x200
[ 1113.070702] vfs_write+0x62a/0x980
[ 1113.075320] ksys_write+0xff/0x200
[ 1113.079937] ? __ia32_sys_read+0xc0/0xc0
[ 1113.085131] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.090791] ? rcu_is_watching+0x15/0xd0
[ 1113.095995] do_syscall_64+0xf3/0x5e0
[ 1113.100904] ? irq_exit_rcu+0x39/0xf0
[ 1113.105816] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.112288] RIP: 0033:0x7f049535dc5e
[ 1113.117101] RSP: 002b:00007ffc341236c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.126401] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f049535dc5e
[ 1113.135213] RDX: 0000000000000001 RSI: 00005626f3d68110 RDI: 0000000000000007
[ 1113.144024] RBP: 00007ffc341236d0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.152842] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f04951f8e80
[ 1113.161651] R13: 00005626f3d68110 R14: 0000000000000007 R15: 00007f0495186480
[ 1113.170478]
[ 1113.173746] \x0aShowing all locks held in the system:
[ 1113.182312] 1 lock held by khungtaskd/184:
[ 1113.187701] #0: ffffffffaecce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.199209] 4 locks held by systemd-journal/803:
[ 1113.205185] #0: ff1100180e3b7220 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1113.215083] #1: ffffffffaeec8ca0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: link_path_walk+0x9d8/0x1560
[ 1113.227709] #2: ff110001a2f40860 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1113.239168] #3: ff1100019b30d1e8 (&xa->xa_lock#5){-.-.}-{3:3}, at: __folio_mark_dirty+0x91/0x270
[ 1113.249962] 4 locks held by python3/3029:
[ 1113.255265] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.265067] #1: ff1100013c5d6288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.276040] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.287210] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.297323] 4 locks held by python3/4966:
[ 1113.302619] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.312416] #1: ff1100017aad2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.323388] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.334554] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.344654]
[ 1113.347123] =============================================\x0a
[ 1235.507405] INFO: task python3:4966 blocked for more than 368 seconds.
[ 1235.515553] Not tainted 7.0.0-rc4-gfpd-gb5a55d9e4f05 #1
[ 1235.522802] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.532391] task:python3 state:D stack:25312 pid:4966 tgid:4966 ppid:4965 task_flags:0x400100 flags:0x00080002
[ 1235.545589] Call Trace:
[ 1235.549129]
[ 1235.552283] __schedule+0xad9/0x1490
[ 1235.557100] ? io_schedule_timeout+0x130/0x130
[ 1235.562886] ? find_held_lock+0x2b/0x80
[ 1235.567992] ? __lock_release.isra.0+0x59/0x170
[ 1235.573877] schedule+0xd4/0x260
[ 1235.578297] schedule_preempt_disabled+0x18/0x30
[ 1235.584278] __mutex_lock+0xd76/0x1f20
[ 1235.589283] ? threaded_store+0x132/0x220
[ 1235.594586] ? ww_mutex_lock+0x160/0x160
[ 1235.599784] ? selinux_inode_free_security+0x310/0x310
[ 1235.606354] ? cap_capable+0x1ed/0x3f0
[ 1235.611361] ? sysfs_file_ops+0x140/0x140
[ 1235.616660] ? threaded_store+0x132/0x220
[ 1235.621949] threaded_store+0x132/0x220
[ 1235.627042] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.632536] ? sysfs_file_ops+0x140/0x140
[ 1235.637835] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.643131] ? sysfs_kf_write+0x65/0x160
[ 1235.648331] kernfs_fop_write_iter+0x335/0x510
[ 1235.654109] ? kernfs_ops+0xf0/0xf0
[ 1235.658820] new_sync_write+0x308/0x6f0
[ 1235.663918] ? new_sync_read+0x6f0/0x6f0
[ 1235.669120] ? lock_acquire.part.0+0xbc/0x260
[ 1235.674806] ? ksys_write+0xff/0x200
[ 1235.679620] vfs_write+0x62a/0x980
[ 1235.684238] ksys_write+0xff/0x200
[ 1235.688852] ? __ia32_sys_read+0xc0/0xc0
[ 1235.694052] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.699643] ? rcu_is_watching+0x15/0xd0
[ 1235.704848] do_syscall_64+0xf3/0x5e0
[ 1235.709757] ? exc_page_fault+0x9e/0xb0
[ 1235.714863] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.721332] RIP: 0033:0x7f36b7f1dc5e
[ 1235.726143] RSP: 002b:00007ffe0a76a6e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.735442] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f36b7f1dc5e
[ 1235.744252] RDX: 0000000000000001 RSI: 0000563093b37110 RDI: 0000000000000007
[ 1235.753060] RBP: 00007ffe0a76a6f0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.761861] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f36b7db8e80
[ 1235.770671] R13: 0000563093b37110 R14: 0000000000000007 R15: 00007f36b861eb98
[ 1235.779487]
[ 1235.782754] INFO: task python3:4966 is blocked on a mutex likely owned by task python3:3029.
[ 1235.793025] task:python3 state:D stack:25312 pid:3029 tgid:3029 ppid:3028 task_flags:0x400100 flags:0x00080802
[ 1235.806226] Call Trace:
[ 1235.809769]
[ 1235.812917] __schedule+0xad9/0x1490
[ 1235.817728] ? io_schedule_timeout+0x130/0x130
[ 1235.823512] ? find_held_lock+0x2b/0x80
[ 1235.828617] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.834796] schedule+0xd4/0x260
[ 1235.839214] schedule_timeout+0x103/0x260
[ 1235.844512] ? rcu_is_watching+0x15/0xd0
[ 1235.849713] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.856083] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.861766] ? ww_mutex_lock+0x160/0x160
[ 1235.866966] msleep+0x1b/0x30
[ 1235.871093] napi_set_threaded+0x376/0x410
[ 1235.876490] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.881984] netif_set_threaded+0x254/0x400
[ 1235.887478] ? sysfs_file_ops+0x140/0x140
[ 1235.892777] threaded_store+0x1bb/0x220
[ 1235.897880] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.903366] ? sysfs_file_ops+0x140/0x140
[ 1235.908664] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.913964] ? sysfs_kf_write+0x65/0x160
[ 1235.919162] kernfs_fop_write_iter+0x335/0x510
[ 1235.924951] ? kernfs_ops+0xf0/0xf0
[ 1235.929664] new_sync_write+0x308/0x6f0
[ 1235.934759] ? new_sync_read+0x6f0/0x6f0
[ 1235.939960] ? lock_acquire.part.0+0xbc/0x260
[ 1235.945645] ? ksys_write+0xff/0x200
[ 1235.950460] vfs_write+0x62a/0x980
[ 1235.955077] ksys_write+0xff/0x200
[ 1235.959693] ? __ia32_sys_read+0xc0/0xc0
[ 1235.964894] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.970483] ? rcu_is_watching+0x15/0xd0
[ 1235.975686] do_syscall_64+0xf3/0x5e0
[ 1235.980594] ? irq_exit_rcu+0x39/0xf0
[ 1235.985501] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.991970] RIP: 0033:0x7f049535dc5e
[ 1235.996778] RSP: 002b:00007ffc341236c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.006073] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f049535dc5e
[ 1236.014883] RDX: 0000000000000001 RSI: 00005626f3d68110 RDI: 0000000000000007
[ 1236.023690] RBP: 00007ffc341236d0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.032499] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f04951f8e80
[ 1236.041308] R13: 00005626f3d68110 R14: 0000000000000007 R15: 00007f0495186480
[ 1236.050123]
[ 1236.053390] \x0aShowing all locks held in the system:
[ 1236.061929] 1 lock held by khungtaskd/184:
[ 1236.067323] #0: ffffffffaecce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.078808] 4 locks held by python3/3029:
[ 1236.084102] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.093896] #1: ff1100013c5d6288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.104860] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.116018] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.126114] 4 locks held by python3/4966:
[ 1236.131410] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.141202] #1: ff1100017aad2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.152165] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.163323] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.173418]
[ 1236.175886] =============================================\x0a
[ 1358.388582] INFO: task python3:4966 blocked for more than 491 seconds.
[ 1358.396735] Not tainted 7.0.0-rc4-gfpd-gb5a55d9e4f05 #1
[ 1358.403976] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.413553] task:python3 state:D stack:25312 pid:4966 tgid:4966 ppid:4965 task_flags:0x400100 flags:0x00080002
[ 1358.426759] Call Trace:
[ 1358.430295]
[ 1358.433443] __schedule+0xad9/0x1490
[ 1358.438261] ? io_schedule_timeout+0x130/0x130
[ 1358.444045] ? find_held_lock+0x2b/0x80
[ 1358.449150] ? __lock_release.isra.0+0x59/0x170
[ 1358.455025] schedule+0xd4/0x260
[ 1358.459435] schedule_preempt_disabled+0x18/0x30
[ 1358.465415] __mutex_lock+0xd76/0x1f20
[ 1358.470426] ? threaded_store+0x132/0x220
[ 1358.475726] ? ww_mutex_lock+0x160/0x160
[ 1358.480923] ? selinux_inode_free_security+0x310/0x310
[ 1358.487483] ? cap_capable+0x1ed/0x3f0
[ 1358.492490] ? sysfs_file_ops+0x140/0x140
[ 1358.497789] ? threaded_store+0x132/0x220
[ 1358.503081] threaded_store+0x132/0x220
[ 1358.508183] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.513673] ? sysfs_file_ops+0x140/0x140
[ 1358.518967] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.524262] ? sysfs_kf_write+0x65/0x160
[ 1358.529459] kernfs_fop_write_iter+0x335/0x510
[ 1358.535245] ? kernfs_ops+0xf0/0xf0
[ 1358.539955] new_sync_write+0x308/0x6f0
[ 1358.545058] ? new_sync_read+0x6f0/0x6f0
[ 1358.550259] ? lock_acquire.part.0+0xbc/0x260
[ 1358.555945] ? ksys_write+0xff/0x200
[ 1358.560756] vfs_write+0x62a/0x980
[ 1358.565371] ksys_write+0xff/0x200
[ 1358.569973] ? __ia32_sys_read+0xc0/0xc0
[ 1358.575169] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.580756] ? rcu_is_watching+0x15/0xd0
[ 1358.585959] do_syscall_64+0xf3/0x5e0
[ 1358.590864] ? exc_page_fault+0x9e/0xb0
[ 1358.595966] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.602431] RIP: 0033:0x7f36b7f1dc5e
[ 1358.607239] RSP: 002b:00007ffe0a76a6e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.616537] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f36b7f1dc5e
[ 1358.625343] RDX: 0000000000000001 RSI: 0000563093b37110 RDI: 0000000000000007
[ 1358.634148] RBP: 00007ffe0a76a6f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.642954] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f36b7db8e80
[ 1358.651761] R13: 0000563093b37110 R14: 0000000000000007 R15: 00007f36b861eb98
[ 1358.660567]
[ 1358.663832] INFO: task python3:4966 is blocked on a mutex likely owned by task python3:3029.
[ 1358.674103] task:python3 state:D stack:25312 pid:3029 tgid:3029 ppid:3028 task_flags:0x400100 flags:0x00080802
[ 1358.687305] Call Trace:
[ 1358.690841]
[ 1358.693990] __schedule+0xad9/0x1490
[ 1358.698799] ? io_schedule_timeout+0x130/0x130
[ 1358.704580] ? find_held_lock+0x2b/0x80
[ 1358.709681] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.715851] schedule+0xd4/0x260
[ 1358.720266] schedule_timeout+0x103/0x260
[ 1358.725563] ? rcu_is_watching+0x15/0xd0
[ 1358.730760] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.737127] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.742815] ? ww_mutex_lock+0x160/0x160
[ 1358.748012] msleep+0x1b/0x30
[ 1358.752138] napi_set_threaded+0x376/0x410
[ 1358.757533] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.763027] netif_set_threaded+0x254/0x400
[ 1358.768520] ? sysfs_file_ops+0x140/0x140
[ 1358.773817] threaded_store+0x1bb/0x220
[ 1358.778918] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.784409] ? sysfs_file_ops+0x140/0x140
[ 1358.789702] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.794995] ? sysfs_kf_write+0x65/0x160
[ 1358.800193] kernfs_fop_write_iter+0x335/0x510
[ 1358.805976] ? kernfs_ops+0xf0/0xf0
[ 1358.810686] new_sync_write+0x308/0x6f0
[ 1358.815788] ? new_sync_read+0x6f0/0x6f0
[ 1358.820987] ? lock_acquire.part.0+0xbc/0x260
[ 1358.826671] ? ksys_write+0xff/0x200
[ 1358.831484] vfs_write+0x62a/0x980
[ 1358.836096] ksys_write+0xff/0x200
[ 1358.840711] ? __ia32_sys_read+0xc0/0xc0
[ 1358.845910] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.851489] ? rcu_is_watching+0x15/0xd0
[ 1358.856686] do_syscall_64+0xf3/0x5e0
[ 1358.861594] ? irq_exit_rcu+0x39/0xf0
[ 1358.866498] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.872965] RIP: 0033:0x7f049535dc5e
[ 1358.877771] RSP: 002b:00007ffc341236c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.887067] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f049535dc5e
[ 1358.895865] RDX: 0000000000000001 RSI: 00005626f3d68110 RDI: 0000000000000007
[ 1358.904674] RBP: 00007ffc341236d0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.913482] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f04951f8e80
[ 1358.922289] R13: 00005626f3d68110 R14: 0000000000000007 R15: 00007f0495186480
[ 1358.931100]
[ 1358.934367] \x0aShowing all locks held in the system:
[ 1358.942902] 1 lock held by khungtaskd/184:
[ 1358.948296] #0: ffffffffaecce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.959777] 4 locks held by python3/3029:
[ 1358.965072] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.974863] #1: ff1100013c5d6288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.985822] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.996979] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.007063] 4 locks held by python3/4966:
[ 1359.012358] #0: ff1100012e0d93f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.022146] #1: ff1100017aad2088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.033107] #2: ff11000120df10f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.044263] #3: ff11000120e39cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.054355]
[ 1359.056821] =============================================\x0a