[ 760.359271] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.361791] nipa-hw-worker: [4/39] Retrying drivers/net:napi_threaded.py
[ 760.525023] kselftest: Running tests in drivers/net
[ 989.757376] INFO: task python3:4994 blocked for more than 122 seconds.
[ 989.765598] Not tainted 7.0.0-rc4-jlmg-g193b4228ec54 #1
[ 989.772848] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.782436] task:python3 state:D stack:25312 pid:4994 tgid:4994 ppid:4993 task_flags:0x400100 flags:0x00080000
[ 989.795641] Call Trace:
[ 989.799179]
[ 989.802331] __schedule+0xad9/0x1490
[ 989.807147] ? io_schedule_timeout+0x130/0x130
[ 989.812931] ? find_held_lock+0x2b/0x80
[ 989.818036] ? __lock_release.isra.0+0x59/0x170
[ 989.823921] schedule+0xd4/0x260
[ 989.828340] schedule_preempt_disabled+0x18/0x30
[ 989.834315] __mutex_lock+0xd76/0x1f20
[ 989.839321] ? threaded_store+0x132/0x220
[ 989.844621] ? ww_mutex_lock+0x160/0x160
[ 989.849819] ? selinux_inode_free_security+0x310/0x310
[ 989.856386] ? cap_capable+0x1ed/0x3f0
[ 989.861392] ? sysfs_file_ops+0x140/0x140
[ 989.866691] ? threaded_store+0x132/0x220
[ 989.871989] threaded_store+0x132/0x220
[ 989.877081] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.882574] ? sysfs_file_ops+0x140/0x140
[ 989.887869] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.893163] ? sysfs_kf_write+0x65/0x160
[ 989.898362] kernfs_fop_write_iter+0x335/0x510
[ 989.904146] ? kernfs_ops+0xf0/0xf0
[ 989.908857] new_sync_write+0x308/0x6f0
[ 989.913962] ? new_sync_read+0x6f0/0x6f0
[ 989.919162] ? lock_acquire.part.0+0xbc/0x260
[ 989.924838] ? ksys_write+0xff/0x200
[ 989.929652] vfs_write+0x62a/0x980
[ 989.934266] ksys_write+0xff/0x200
[ 989.938878] ? __ia32_sys_read+0xc0/0xc0
[ 989.944073] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.949662] ? rcu_is_watching+0x15/0xd0
[ 989.954852] do_syscall_64+0xf3/0x5e0
[ 989.959759] ? exc_page_fault+0x9e/0xb0
[ 989.964864] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.971333] RIP: 0033:0x7f1d9e5b4c5e
[ 989.976144] RSP: 002b:00007ffd5cb02fe0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.985442] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1d9e5b4c5e
[ 989.994247] RDX: 0000000000000001 RSI: 00005559182f2110 RDI: 0000000000000007
[ 990.003052] RBP: 00007ffd5cb02ff0 R08: 0000000000000000 R09: 0000000000000000
[ 990.011860] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1d9e44fe80
[ 990.020667] R13: 00005559182f2110 R14: 0000000000000007 R15: 00007f1d9ecb5b98
[ 990.029481]
[ 990.032758] INFO: task python3:4994 is blocked on a mutex likely owned by task python3:3050.
[ 990.043035] task:python3 state:D stack:25312 pid:3050 tgid:3050 ppid:3049 task_flags:0x400100 flags:0x00080802
[ 990.056238] Call Trace:
[ 990.059775]
[ 990.062924] __schedule+0xad9/0x1490
[ 990.067733] ? io_schedule_timeout+0x130/0x130
[ 990.073517] ? find_held_lock+0x2b/0x80
[ 990.078621] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.084799] schedule+0xd4/0x260
[ 990.089215] schedule_timeout+0x103/0x260
[ 990.094511] ? rcu_is_watching+0x15/0xd0
[ 990.099711] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.106081] ? hrtimers_cpu_dying+0x250/0x250
[ 990.111772] ? ww_mutex_lock+0x160/0x160
[ 990.116970] msleep+0x1b/0x30
[ 990.121093] napi_set_threaded+0x376/0x410
[ 990.126490] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.131973] netif_set_threaded+0x254/0x400
[ 990.137457] ? sysfs_file_ops+0x140/0x140
[ 990.142743] threaded_store+0x1bb/0x220
[ 990.147845] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.153326] ? sysfs_file_ops+0x140/0x140
[ 990.158619] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.163913] ? sysfs_kf_write+0x65/0x160
[ 990.169112] kernfs_fop_write_iter+0x335/0x510
[ 990.174897] ? kernfs_ops+0xf0/0xf0
[ 990.179609] new_sync_write+0x308/0x6f0
[ 990.184710] ? new_sync_read+0x6f0/0x6f0
[ 990.189910] ? lock_acquire.part.0+0xbc/0x260
[ 990.195596] ? ksys_write+0xff/0x200
[ 990.200408] vfs_write+0x62a/0x980
[ 990.205022] ksys_write+0xff/0x200
[ 990.209633] ? __ia32_sys_read+0xc0/0xc0
[ 990.214831] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.220419] ? rcu_is_watching+0x15/0xd0
[ 990.225619] do_syscall_64+0xf3/0x5e0
[ 990.230523] ? exc_page_fault+0x9e/0xb0
[ 990.235622] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.242086] RIP: 0033:0x7f866ce1fc5e
[ 990.246894] RSP: 002b:00007fff0b36f100 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.256191] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f866ce1fc5e
[ 990.265000] RDX: 0000000000000001 RSI: 00005654800d7110 RDI: 0000000000000007
[ 990.273810] RBP: 00007fff0b36f110 R08: 0000000000000000 R09: 0000000000000000
[ 990.282617] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f866ccbae80
[ 990.291415] R13: 00005654800d7110 R14: 0000000000000007 R15: 00007f866cc4a480
[ 990.300226]
[ 990.303484] \x0aShowing all locks held in the system:
[ 990.312019] 1 lock held by khungtaskd/184:
[ 990.317411] #0: ffffffff928ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.328894] 4 locks held by python3/3050:
[ 990.334181] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.343970] #1: ff1100013f268e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.354931] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.366088] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.376174] 4 locks held by python3/4994:
[ 990.381467] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.391259] #1: ff110001bcc8a088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.402213] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.413371] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.423451]
[ 990.425915] =============================================\x0a
[ 1112.637698] INFO: task python3:4994 blocked for more than 245 seconds.
[ 1112.645843] Not tainted 7.0.0-rc4-jlmg-g193b4228ec54 #1
[ 1112.653096] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.662686] task:python3 state:D stack:25312 pid:4994 tgid:4994 ppid:4993 task_flags:0x400100 flags:0x00080000
[ 1112.675894] Call Trace:
[ 1112.679436]
[ 1112.682587] __schedule+0xad9/0x1490
[ 1112.687402] ? io_schedule_timeout+0x130/0x130
[ 1112.693186] ? find_held_lock+0x2b/0x80
[ 1112.698291] ? __lock_release.isra.0+0x59/0x170
[ 1112.704167] schedule+0xd4/0x260
[ 1112.708585] schedule_preempt_disabled+0x18/0x30
[ 1112.714564] __mutex_lock+0xd76/0x1f20
[ 1112.719570] ? threaded_store+0x132/0x220
[ 1112.724870] ? ww_mutex_lock+0x160/0x160
[ 1112.730068] ? selinux_inode_free_security+0x310/0x310
[ 1112.736631] ? cap_capable+0x1ed/0x3f0
[ 1112.741641] ? sysfs_file_ops+0x140/0x140
[ 1112.746938] ? threaded_store+0x132/0x220
[ 1112.752236] threaded_store+0x132/0x220
[ 1112.757333] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.762828] ? sysfs_file_ops+0x140/0x140
[ 1112.768123] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.773420] ? sysfs_kf_write+0x65/0x160
[ 1112.778618] kernfs_fop_write_iter+0x335/0x510
[ 1112.784404] ? kernfs_ops+0xf0/0xf0
[ 1112.789106] new_sync_write+0x308/0x6f0
[ 1112.794211] ? new_sync_read+0x6f0/0x6f0
[ 1112.799414] ? lock_acquire.part.0+0xbc/0x260
[ 1112.805102] ? ksys_write+0xff/0x200
[ 1112.809916] vfs_write+0x62a/0x980
[ 1112.814536] ksys_write+0xff/0x200
[ 1112.819152] ? __ia32_sys_read+0xc0/0xc0
[ 1112.824350] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.829940] ? rcu_is_watching+0x15/0xd0
[ 1112.835133] do_syscall_64+0xf3/0x5e0
[ 1112.840040] ? exc_page_fault+0x9e/0xb0
[ 1112.845145] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.851613] RIP: 0033:0x7f1d9e5b4c5e
[ 1112.856426] RSP: 002b:00007ffd5cb02fe0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.865727] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1d9e5b4c5e
[ 1112.874540] RDX: 0000000000000001 RSI: 00005559182f2110 RDI: 0000000000000007
[ 1112.883347] RBP: 00007ffd5cb02ff0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.892150] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1d9e44fe80
[ 1112.900956] R13: 00005559182f2110 R14: 0000000000000007 R15: 00007f1d9ecb5b98
[ 1112.909770]
[ 1112.913033] INFO: task python3:4994 is blocked on a mutex likely owned by task python3:3050.
[ 1112.923307] task:python3 state:D stack:25312 pid:3050 tgid:3050 ppid:3049 task_flags:0x400100 flags:0x00080802
[ 1112.936509] Call Trace:
[ 1112.940049]
[ 1112.943202] __schedule+0xad9/0x1490
[ 1112.948015] ? io_schedule_timeout+0x130/0x130
[ 1112.953798] ? find_held_lock+0x2b/0x80
[ 1112.958901] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.965080] schedule+0xd4/0x260
[ 1112.969500] schedule_timeout+0x103/0x260
[ 1112.974798] ? rcu_is_watching+0x15/0xd0
[ 1112.979997] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.986369] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.992063] ? ww_mutex_lock+0x160/0x160
[ 1112.997263] msleep+0x1b/0x30
[ 1113.001391] napi_set_threaded+0x376/0x410
[ 1113.006786] ? napi_resume_irqs+0x1a0/0x1a0
[ 1113.012282] netif_set_threaded+0x254/0x400
[ 1113.017779] ? sysfs_file_ops+0x140/0x140
[ 1113.023076] threaded_store+0x1bb/0x220
[ 1113.028171] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.033663] ? sysfs_file_ops+0x140/0x140
[ 1113.038961] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.044249] ? sysfs_kf_write+0x65/0x160
[ 1113.049451] kernfs_fop_write_iter+0x335/0x510
[ 1113.055239] ? kernfs_ops+0xf0/0xf0
[ 1113.059950] new_sync_write+0x308/0x6f0
[ 1113.065053] ? new_sync_read+0x6f0/0x6f0
[ 1113.070254] ? lock_acquire.part.0+0xbc/0x260
[ 1113.075941] ? ksys_write+0xff/0x200
[ 1113.080753] vfs_write+0x62a/0x980
[ 1113.085370] ksys_write+0xff/0x200
[ 1113.089983] ? __ia32_sys_read+0xc0/0xc0
[ 1113.095181] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.100769] ? rcu_is_watching+0x15/0xd0
[ 1113.105969] do_syscall_64+0xf3/0x5e0
[ 1113.110866] ? exc_page_fault+0x9e/0xb0
[ 1113.115971] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.122438] RIP: 0033:0x7f866ce1fc5e
[ 1113.127239] RSP: 002b:00007fff0b36f100 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.136528] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f866ce1fc5e
[ 1113.145338] RDX: 0000000000000001 RSI: 00005654800d7110 RDI: 0000000000000007
[ 1113.154149] RBP: 00007fff0b36f110 R08: 0000000000000000 R09: 0000000000000000
[ 1113.162955] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f866ccbae80
[ 1113.171761] R13: 00005654800d7110 R14: 0000000000000007 R15: 00007f866cc4a480
[ 1113.180578]
[ 1113.183843] \x0aShowing all locks held in the system:
[ 1113.192380] 1 lock held by khungtaskd/184:
[ 1113.197774] #0: ffffffff928ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.209258] 4 locks held by python3/3050:
[ 1113.214555] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.224346] #1: ff1100013f268e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.235311] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.246467] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.256561] 4 locks held by python3/4994:
[ 1113.261858] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.271650] #1: ff110001bcc8a088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.282612] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.293771] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.303862]
[ 1113.306330] =============================================\x0a
[ 1235.519041] INFO: task python3:4994 blocked for more than 368 seconds.
[ 1235.527190] Not tainted 7.0.0-rc4-jlmg-g193b4228ec54 #1
[ 1235.534440] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.544029] task:python3 state:D stack:25312 pid:4994 tgid:4994 ppid:4993 task_flags:0x400100 flags:0x00080002
[ 1235.557225] Call Trace:
[ 1235.560839]
[ 1235.563993] __schedule+0xad9/0x1490
[ 1235.568807] ? io_schedule_timeout+0x130/0x130
[ 1235.574584] ? find_held_lock+0x2b/0x80
[ 1235.579692] ? __lock_release.isra.0+0x59/0x170
[ 1235.585577] schedule+0xd4/0x260
[ 1235.589994] schedule_preempt_disabled+0x18/0x30
[ 1235.595971] __mutex_lock+0xd76/0x1f20
[ 1235.600976] ? threaded_store+0x132/0x220
[ 1235.606274] ? ww_mutex_lock+0x160/0x160
[ 1235.611473] ? selinux_inode_free_security+0x310/0x310
[ 1235.618041] ? cap_capable+0x1ed/0x3f0
[ 1235.623049] ? sysfs_file_ops+0x140/0x140
[ 1235.628350] ? threaded_store+0x132/0x220
[ 1235.633650] threaded_store+0x132/0x220
[ 1235.638752] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.644243] ? sysfs_file_ops+0x140/0x140
[ 1235.649541] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.654832] ? sysfs_kf_write+0x65/0x160
[ 1235.660033] kernfs_fop_write_iter+0x335/0x510
[ 1235.665819] ? kernfs_ops+0xf0/0xf0
[ 1235.670533] new_sync_write+0x308/0x6f0
[ 1235.675636] ? new_sync_read+0x6f0/0x6f0
[ 1235.680837] ? lock_acquire.part.0+0xbc/0x260
[ 1235.686523] ? ksys_write+0xff/0x200
[ 1235.691335] vfs_write+0x62a/0x980
[ 1235.695951] ksys_write+0xff/0x200
[ 1235.700566] ? __ia32_sys_read+0xc0/0xc0
[ 1235.705766] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.711357] ? rcu_is_watching+0x15/0xd0
[ 1235.716557] do_syscall_64+0xf3/0x5e0
[ 1235.721462] ? exc_page_fault+0x9e/0xb0
[ 1235.726565] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.733035] RIP: 0033:0x7f1d9e5b4c5e
[ 1235.737845] RSP: 002b:00007ffd5cb02fe0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.747144] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1d9e5b4c5e
[ 1235.755950] RDX: 0000000000000001 RSI: 00005559182f2110 RDI: 0000000000000007
[ 1235.764759] RBP: 00007ffd5cb02ff0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.773569] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1d9e44fe80
[ 1235.782378] R13: 00005559182f2110 R14: 0000000000000007 R15: 00007f1d9ecb5b98
[ 1235.791194]
[ 1235.794498] INFO: task python3:4994 is blocked on a mutex likely owned by task python3:3050.
[ 1235.804772] task:python3 state:D stack:25312 pid:3050 tgid:3050 ppid:3049 task_flags:0x400100 flags:0x00080802
[ 1235.817969] Call Trace:
[ 1235.821507]
[ 1235.824657] __schedule+0xad9/0x1490
[ 1235.829466] ? io_schedule_timeout+0x130/0x130
[ 1235.835249] ? find_held_lock+0x2b/0x80
[ 1235.840351] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.846533] schedule+0xd4/0x260
[ 1235.850951] schedule_timeout+0x103/0x260
[ 1235.856248] ? rcu_is_watching+0x15/0xd0
[ 1235.861448] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.867817] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.873508] ? ww_mutex_lock+0x160/0x160
[ 1235.878707] msleep+0x1b/0x30
[ 1235.882835] napi_set_threaded+0x376/0x410
[ 1235.888231] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.893719] netif_set_threaded+0x254/0x400
[ 1235.899212] ? sysfs_file_ops+0x140/0x140
[ 1235.904500] threaded_store+0x1bb/0x220
[ 1235.909602] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.915093] ? sysfs_file_ops+0x140/0x140
[ 1235.920392] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.925691] ? sysfs_kf_write+0x65/0x160
[ 1235.930890] kernfs_fop_write_iter+0x335/0x510
[ 1235.936675] ? kernfs_ops+0xf0/0xf0
[ 1235.941387] new_sync_write+0x308/0x6f0
[ 1235.946491] ? new_sync_read+0x6f0/0x6f0
[ 1235.951691] ? lock_acquire.part.0+0xbc/0x260
[ 1235.957376] ? ksys_write+0xff/0x200
[ 1235.962190] vfs_write+0x62a/0x980
[ 1235.966803] ksys_write+0xff/0x200
[ 1235.971418] ? __ia32_sys_read+0xc0/0xc0
[ 1235.976609] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.982201] ? rcu_is_watching+0x15/0xd0
[ 1235.987401] do_syscall_64+0xf3/0x5e0
[ 1235.992308] ? exc_page_fault+0x9e/0xb0
[ 1235.997413] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1236.003881] RIP: 0033:0x7f866ce1fc5e
[ 1236.008690] RSP: 002b:00007fff0b36f100 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1236.017984] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f866ce1fc5e
[ 1236.026794] RDX: 0000000000000001 RSI: 00005654800d7110 RDI: 0000000000000007
[ 1236.035601] RBP: 00007fff0b36f110 R08: 0000000000000000 R09: 0000000000000000
[ 1236.044410] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f866ccbae80
[ 1236.053217] R13: 00005654800d7110 R14: 0000000000000007 R15: 00007f866cc4a480
[ 1236.062031]
[ 1236.065298] \x0aShowing all locks held in the system:
[ 1236.073836] 1 lock held by khungtaskd/184:
[ 1236.079231] #0: ffffffff928ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.090713] 4 locks held by python3/3050:
[ 1236.096006] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.105797] #1: ff1100013f268e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.116751] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.127907] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.138000] 4 locks held by python3/4994:
[ 1236.143293] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.153082] #1: ff110001bcc8a088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.164042] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.175200] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.185284]
[ 1236.187750] =============================================\x0a
[ 1358.401369] INFO: task python3:4994 blocked for more than 491 seconds.
[ 1358.409515] Not tainted 7.0.0-rc4-jlmg-g193b4228ec54 #1
[ 1358.416762] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.426350] task:python3 state:D stack:25312 pid:4994 tgid:4994 ppid:4993 task_flags:0x400100 flags:0x00080002
[ 1358.439553] Call Trace:
[ 1358.443094]
[ 1358.446242] __schedule+0xad9/0x1490
[ 1358.451055] ? io_schedule_timeout+0x130/0x130
[ 1358.456836] ? find_held_lock+0x2b/0x80
[ 1358.461938] ? __lock_release.isra.0+0x59/0x170
[ 1358.467845] schedule+0xd4/0x260
[ 1358.472264] schedule_preempt_disabled+0x18/0x30
[ 1358.478240] __mutex_lock+0xd76/0x1f20
[ 1358.483243] ? threaded_store+0x132/0x220
[ 1358.488542] ? ww_mutex_lock+0x160/0x160
[ 1358.493740] ? selinux_inode_free_security+0x310/0x310
[ 1358.500310] ? cap_capable+0x1ed/0x3f0
[ 1358.505317] ? sysfs_file_ops+0x140/0x140
[ 1358.510613] ? threaded_store+0x132/0x220
[ 1358.515907] threaded_store+0x132/0x220
[ 1358.521010] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.526501] ? sysfs_file_ops+0x140/0x140
[ 1358.531795] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.537090] ? sysfs_kf_write+0x65/0x160
[ 1358.542291] kernfs_fop_write_iter+0x335/0x510
[ 1358.548073] ? kernfs_ops+0xf0/0xf0
[ 1358.552786] new_sync_write+0x308/0x6f0
[ 1358.557888] ? new_sync_read+0x6f0/0x6f0
[ 1358.563088] ? lock_acquire.part.0+0xbc/0x260
[ 1358.568775] ? ksys_write+0xff/0x200
[ 1358.573586] vfs_write+0x62a/0x980
[ 1358.578200] ksys_write+0xff/0x200
[ 1358.582814] ? __ia32_sys_read+0xc0/0xc0
[ 1358.588010] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.593597] ? rcu_is_watching+0x15/0xd0
[ 1358.598798] do_syscall_64+0xf3/0x5e0
[ 1358.603694] ? exc_page_fault+0x9e/0xb0
[ 1358.608794] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.615259] RIP: 0033:0x7f1d9e5b4c5e
[ 1358.620066] RSP: 002b:00007ffd5cb02fe0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.629365] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1d9e5b4c5e
[ 1358.638171] RDX: 0000000000000001 RSI: 00005559182f2110 RDI: 0000000000000007
[ 1358.646976] RBP: 00007ffd5cb02ff0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.655781] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1d9e44fe80
[ 1358.664589] R13: 00005559182f2110 R14: 0000000000000007 R15: 00007f1d9ecb5b98
[ 1358.673391]
[ 1358.676681] INFO: task python3:4994 is blocked on a mutex likely owned by task python3:3050.
[ 1358.686952] task:python3 state:D stack:25312 pid:3050 tgid:3050 ppid:3049 task_flags:0x400100 flags:0x00080802
[ 1358.700155] Call Trace:
[ 1358.703693]
[ 1358.706841] __schedule+0xad9/0x1490
[ 1358.711649] ? io_schedule_timeout+0x130/0x130
[ 1358.717430] ? find_held_lock+0x2b/0x80
[ 1358.722531] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.728708] schedule+0xd4/0x260
[ 1358.733126] schedule_timeout+0x103/0x260
[ 1358.738423] ? rcu_is_watching+0x15/0xd0
[ 1358.743619] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.749988] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.755676] ? ww_mutex_lock+0x160/0x160
[ 1358.760873] msleep+0x1b/0x30
[ 1358.764999] napi_set_threaded+0x376/0x410
[ 1358.770394] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.775889] netif_set_threaded+0x254/0x400
[ 1358.781379] ? sysfs_file_ops+0x140/0x140
[ 1358.786674] threaded_store+0x1bb/0x220
[ 1358.791773] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.797264] ? sysfs_file_ops+0x140/0x140
[ 1358.802558] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.807854] ? sysfs_kf_write+0x65/0x160
[ 1358.813052] kernfs_fop_write_iter+0x335/0x510
[ 1358.818833] ? kernfs_ops+0xf0/0xf0
[ 1358.823543] new_sync_write+0x308/0x6f0
[ 1358.828646] ? new_sync_read+0x6f0/0x6f0
[ 1358.833843] ? lock_acquire.part.0+0xbc/0x260
[ 1358.839530] ? ksys_write+0xff/0x200
[ 1358.844341] vfs_write+0x62a/0x980
[ 1358.848957] ksys_write+0xff/0x200
[ 1358.853561] ? __ia32_sys_read+0xc0/0xc0
[ 1358.858759] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.864348] ? rcu_is_watching+0x15/0xd0
[ 1358.869547] do_syscall_64+0xf3/0x5e0
[ 1358.874454] ? exc_page_fault+0x9e/0xb0
[ 1358.879553] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.886018] RIP: 0033:0x7f866ce1fc5e
[ 1358.890823] RSP: 002b:00007fff0b36f100 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.900119] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f866ce1fc5e
[ 1358.908925] RDX: 0000000000000001 RSI: 00005654800d7110 RDI: 0000000000000007
[ 1358.917731] RBP: 00007fff0b36f110 R08: 0000000000000000 R09: 0000000000000000
[ 1358.926539] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f866ccbae80
[ 1358.935346] R13: 00005654800d7110 R14: 0000000000000007 R15: 00007f866cc4a480
[ 1358.944158]
[ 1358.947427] \x0aShowing all locks held in the system:
[ 1358.955966] 1 lock held by khungtaskd/184:
[ 1358.961358] #0: ffffffff928ce020 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.972841] 4 locks held by python3/3050:
[ 1358.978133] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.987922] #1: ff1100013f268e88 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.998884] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.010031] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.020117] 2 locks held by kworker/25:0/3883:
[ 1359.025900] #0: ff110001000da748 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xd53/0x1410
[ 1359.037349] #1: ffa000002602fd20 (key_gc_work){+.+.}-{0:0}, at: process_one_work+0xdb5/0x1410
[ 1359.047824] 4 locks held by python3/4994:
[ 1359.053118] #0: ff110017db4d43f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.062909] #1: ff110001bcc8a088 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.073862] #2: ff110017daa250f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.085018] #3: ff110017daa99cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.095107]
[ 1359.097566] =============================================\x0a