====================================== | [ 758.391455] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 758.393897] nipa-hw-worker: [4/38] Retrying drivers/net:napi_threaded.py | [ 758.554136] kselftest: Running tests in drivers/net [ 989.750490] INFO: task python3:5013 blocked for more than 122 seconds. [ 989.758718] Not tainted 7.0.0-rc4-hqlo-g31240a36c3b0 #1 [ 989.765969] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.775561] task:python3 state:D stack:25312 pid:5013 tgid:5013 ppid:5012 task_flags:0x400100 flags:0x00080000 [ 989.788767] Call Trace: [ 989.792307] [ 989.795464] __schedule+0xad9/0x1490 [ 989.800281] ? io_schedule_timeout+0x130/0x130 [ 989.806066] ? find_held_lock+0x2b/0x80 [ 989.811172] ? __lock_release.isra.0+0x59/0x170 [ 989.817060] schedule+0xd4/0x260 [ 989.821478] schedule_preempt_disabled+0x18/0x30 [ 989.827458] __mutex_lock+0xd76/0x1f20 [ 989.832465] ? threaded_store+0x132/0x220 [ 989.837767] ? ww_mutex_lock+0x160/0x160 [ 989.842968] ? selinux_inode_free_security+0x310/0x310 [ 989.849541] ? cap_capable+0x1ed/0x3f0 [ 989.854548] ? sysfs_file_ops+0x140/0x140 [ 989.859846] ? threaded_store+0x132/0x220 [ 989.865144] threaded_store+0x132/0x220 [ 989.870243] ? tx_maxrate_store+0x4e0/0x4e0 [ 989.875738] ? sysfs_file_ops+0x140/0x140 [ 989.881035] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.886333] ? sysfs_kf_write+0x65/0x160 [ 989.891532] kernfs_fop_write_iter+0x335/0x510 [ 989.897319] ? kernfs_ops+0xf0/0xf0 [ 989.902031] new_sync_write+0x308/0x6f0 [ 989.907126] ? new_sync_read+0x6f0/0x6f0 [ 989.912320] ? lock_acquire.part.0+0xbc/0x260 [ 989.918009] ? ksys_write+0xff/0x200 [ 989.922824] vfs_write+0x62a/0x980 [ 989.927442] ksys_write+0xff/0x200 [ 989.932057] ? __ia32_sys_read+0xc0/0xc0 [ 989.937255] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.942846] ? rcu_is_watching+0x15/0xd0 [ 989.948049] do_syscall_64+0xf3/0x5e0 [ 989.952957] ? exc_page_fault+0x9e/0xb0 [ 989.958062] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.964530] RIP: 0033:0x7f8641dfac5e [ 989.969338] RSP: 002b:00007ffd912e0e60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.978636] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8641dfac5e [ 989.987444] RDX: 0000000000000001 RSI: 000055ef1901d110 RDI: 0000000000000007 [ 989.996244] RBP: 00007ffd912e0e70 R08: 0000000000000000 R09: 0000000000000000 [ 990.005054] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8641c95e80 [ 990.013862] R13: 000055ef1901d110 R14: 0000000000000007 R15: 00007f86424fbb98 | [ 990.413145] #1: ff1100013cf9b288 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510 | [ 990.424109] #2: ff110001211350f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.435267] #3: ff110001211a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.445356] | [ 990.447822] =============================================\x0a [ 1112.631686] INFO: task python3:5013 blocked for more than 245 seconds. [ 1112.632649] kworker/u129:1 (186) used greatest stack depth: 21688 bytes left [ 1112.639821] Not tainted 7.0.0-rc4-hqlo-g31240a36c3b0 #1 [ 1112.655795] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.665386] task:python3 state:D stack:25312 pid:5013 tgid:5013 ppid:5012 task_flags:0x400100 flags:0x00080000 [ 1112.678593] Call Trace: [ 1112.682134] [ 1112.685286] __schedule+0xad9/0x1490 [ 1112.690101] ? io_schedule_timeout+0x130/0x130 [ 1112.695887] ? find_held_lock+0x2b/0x80 [ 1112.700993] ? __lock_release.isra.0+0x59/0x170 [ 1112.706880] schedule+0xd4/0x260 [ 1112.711298] schedule_preempt_disabled+0x18/0x30 [ 1112.717277] __mutex_lock+0xd76/0x1f20 [ 1112.722283] ? threaded_store+0x132/0x220 [ 1112.727586] ? ww_mutex_lock+0x160/0x160 [ 1112.732787] ? selinux_inode_free_security+0x310/0x310 [ 1112.739362] ? cap_capable+0x1ed/0x3f0 [ 1112.744372] ? sysfs_file_ops+0x140/0x140 [ 1112.749674] ? threaded_store+0x132/0x220 [ 1112.754970] threaded_store+0x132/0x220 [ 1112.760075] ? tx_maxrate_store+0x4e0/0x4e0 [ 1112.765565] ? sysfs_file_ops+0x140/0x140 [ 1112.770861] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.776159] ? sysfs_kf_write+0x65/0x160 [ 1112.781358] kernfs_fop_write_iter+0x335/0x510 [ 1112.787146] ? kernfs_ops+0xf0/0xf0 [ 1112.791858] new_sync_write+0x308/0x6f0 [ 1112.796954] ? new_sync_read+0x6f0/0x6f0 [ 1112.802153] ? lock_acquire.part.0+0xbc/0x260 [ 1112.807842] ? ksys_write+0xff/0x200 [ 1112.812656] vfs_write+0x62a/0x980 [ 1112.817274] ksys_write+0xff/0x200 [ 1112.821890] ? __ia32_sys_read+0xc0/0xc0 [ 1112.827089] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.832681] ? rcu_is_watching+0x15/0xd0 [ 1112.837884] do_syscall_64+0xf3/0x5e0 [ 1112.842791] ? exc_page_fault+0x9e/0xb0 [ 1112.847895] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.854363] RIP: 0033:0x7f8641dfac5e [ 1112.859184] RSP: 002b:00007ffd912e0e60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.868503] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8641dfac5e [ 1112.877319] RDX: 0000000000000001 RSI: 000055ef1901d110 RDI: 0000000000000007 [ 1112.886130] RBP: 00007ffd912e0e70 R08: 0000000000000000 R09: 0000000000000000 [ 1112.895037] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8641c95e80 [ 1112.903844] R13: 000055ef1901d110 R14: 0000000000000007 R15: 00007f86424fbb98 | [ 1113.332976] #2: ffffffff99b36e48 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xd2/0x3b0 | [ 1113.343657] #3: ffffffff99968e90 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e7/0x640 | [ 1113.355301] #4: ffffffff99b36b50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f3/0x640 | [ 1113.367730] | [ 1113.370196] =============================================\x0a [ 1235.513874] INFO: task python3:5013 blocked for more than 368 seconds. [ 1235.522018] Not tainted 7.0.0-rc4-hqlo-g31240a36c3b0 #1 [ 1235.529268] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.538855] task:python3 state:D stack:25312 pid:5013 tgid:5013 ppid:5012 task_flags:0x400100 flags:0x00080002 [ 1235.552059] Call Trace: [ 1235.555599] [ 1235.558748] __schedule+0xad9/0x1490 [ 1235.563565] ? io_schedule_timeout+0x130/0x130 [ 1235.569350] ? find_held_lock+0x2b/0x80 [ 1235.574452] ? __lock_release.isra.0+0x59/0x170 [ 1235.580336] schedule+0xd4/0x260 [ 1235.584753] schedule_preempt_disabled+0x18/0x30 [ 1235.590731] __mutex_lock+0xd76/0x1f20 [ 1235.595735] ? threaded_store+0x132/0x220 [ 1235.601033] ? ww_mutex_lock+0x160/0x160 [ 1235.606232] ? selinux_inode_free_security+0x310/0x310 [ 1235.612802] ? cap_capable+0x1ed/0x3f0 [ 1235.617806] ? sysfs_file_ops+0x140/0x140 [ 1235.623105] ? threaded_store+0x132/0x220 [ 1235.628400] threaded_store+0x132/0x220 [ 1235.633499] ? tx_maxrate_store+0x4e0/0x4e0 [ 1235.638993] ? sysfs_file_ops+0x140/0x140 [ 1235.644289] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.649584] ? sysfs_kf_write+0x65/0x160 [ 1235.654782] kernfs_fop_write_iter+0x335/0x510 [ 1235.660564] ? kernfs_ops+0xf0/0xf0 [ 1235.665272] new_sync_write+0x308/0x6f0 [ 1235.670375] ? new_sync_read+0x6f0/0x6f0 [ 1235.675576] ? lock_acquire.part.0+0xbc/0x260 [ 1235.681262] ? ksys_write+0xff/0x200 [ 1235.686073] vfs_write+0x62a/0x980 [ 1235.690688] ksys_write+0xff/0x200 [ 1235.695292] ? __ia32_sys_read+0xc0/0xc0 [ 1235.700490] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.706077] ? rcu_is_watching+0x15/0xd0 [ 1235.711278] do_syscall_64+0xf3/0x5e0 [ 1235.716183] ? exc_page_fault+0x9e/0xb0 [ 1235.721284] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.727750] RIP: 0033:0x7f8641dfac5e [ 1235.732562] RSP: 002b:00007ffd912e0e60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.741857] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f8641dfac5e [ 1235.750663] RDX: 0000000000000001 RSI: 000055ef1901d110 RDI: 0000000000000007 [ 1235.759469] RBP: 00007ffd912e0e70 R08: 0000000000000000 R09: 0000000000000000 [ 1235.768274] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f8641c95e80 [ 1235.777080] R13: 000055ef1901d110 R14: 0000000000000007 R15: 00007f86424fbb98 | [ 1236.158501] #2: ff110001211350f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.169656] #3: ff110001211a1cb8 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.179749] | [ 1236.182221] =============================================\x0a | [ 1247.801976] kworker/u130:8 (3131) used greatest stack depth: 21192 bytes left [ 1358.395062] INFO: task python3:5013 blocked for more than 491 seconds. [ 1358.403214] Not tainted 7.0.0-rc4-hqlo-g31240a36c3b0 #1 [ 1358.410464] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.420054] task:python3 state:D stack:25312 pid:5013 tgid:5013 ppid:5012 task_flags:0x400100 flags:0x00080002 [ 1358.433259] Call Trace: [ 1358.436802] [ 1358.439955] __schedule+0xad9/0x1490 [ 1358.444770] ? io_schedule_timeout+0x130/0x130 [ 1358.450558] ? find_held_lock+0x2b/0x80 [ 1358.455662] ? __lock_release.isra.0+0x59/0x170 [ 1358.461547] schedule+0xd4/0x260 [ 1358.465966] schedule_preempt_disabled+0x18/0x30 [ 1358.471945] __mutex_lock+0xd76/0x1f20 [ 1358.476951] ? threaded_store+0x132/0x220 [ 1358.482250] ? ww_mutex_lock+0x160/0x160 [ 1358.487451] ? selinux_inode_free_security+0x310/0x310 [ 1358.494025] ? cap_capable+0x1ed/0x3f0 [ 1358.499034] ? sysfs_file_ops+0x140/0x140 [ 1358.504336] ? threaded_store+0x132/0x220 [ 1358.509631] threaded_store+0x132/0x220 [ 1358.514318] nipa-hw-worker: drivers/net:napi_threaded.py: timed out [ 1358.514731] ? tx_maxrate_store+0x4e0/0x4e0 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store