====================================== | [ 772.417388] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 772.421804] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 772.573090] kselftest: Running tests in drivers/net [ 989.714900] INFO: task python3:5453 blocked for more than 122 seconds. [ 989.723086] Not tainted 7.1.0-rc6-tgcp-gc3e973d955ca #1 [ 989.730587] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.740180] task:python3 state:D stack:25672 pid:5453 tgid:5453 ppid:5452 task_flags:0x400100 flags:0x00080000 [ 989.753387] Call Trace: [ 989.756927] [ 989.760080] __schedule+0xcc3/0x19c0 [ 989.764897] ? io_schedule_timeout+0x140/0x140 [ 989.770682] ? find_held_lock+0x2b/0x80 [ 989.775790] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.781675] schedule+0xd8/0x260 [ 989.786092] schedule_preempt_disabled+0x18/0x30 [ 989.792071] __mutex_lock+0x6af/0x2010 [ 989.797076] ? threaded_store+0x132/0x220 [ 989.802376] ? ww_mutex_lock+0x160/0x160 [ 989.807578] ? selinux_inode_free_security+0x330/0x330 [ 989.814150] ? cap_capable+0x1d6/0x3e0 [ 989.819162] ? threaded_store+0x132/0x220 [ 989.824457] threaded_store+0x132/0x220 [ 989.829559] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.834854] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.840157] ? sysfs_kf_write+0x65/0x160 [ 989.845358] ? sysfs_file_ops+0x140/0x140 [ 989.850656] kernfs_fop_write_iter+0x335/0x510 [ 989.856442] ? kernfs_ops+0xf0/0xf0 [ 989.861147] new_sync_write+0x333/0x750 [ 989.866251] ? __lock_acquire+0x508/0xc10 [ 989.871548] ? new_sync_read+0x740/0x740 [ 989.876745] ? lock_acquire.part.0+0xbc/0x260 [ 989.882430] ? ksys_write+0x116/0x250 [ 989.887342] vfs_write+0x657/0x9b0 [ 989.891960] ksys_write+0x116/0x250 [ 989.896672] ? __ia32_sys_read+0xc0/0xc0 [ 989.901871] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.907459] ? rcu_is_watching+0x15/0xd0 [ 989.912653] do_syscall_64+0xf3/0x650 [ 989.917561] ? trace_hardirqs_off+0xd/0x30 [ 989.922956] ? exc_page_fault+0xda/0xf0 [ 989.928056] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.934525] RIP: 0033:0x7f371775864e [ 989.939335] RSP: 002b:00007ffea6a259e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.948627] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f371775864e [ 989.957435] RDX: 0000000000000001 RSI: 000055956fe00bf0 RDI: 0000000000000007 [ 989.966243] RBP: 00007ffea6a259f0 R08: 0000000000000000 R09: 0000000000000000 [ 989.975052] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37175d1390 [ 989.983861] R13: 000055956fe00bf0 R14: 0000000000000007 R15: 00007f3717565120 | [ 990.360821] #1: ff110001a5766280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.371783] #2: ff1100012438ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.382940] #3: ff11000124409d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.393021] | [ 990.395487] =============================================\x0a [ 1112.594991] INFO: task python3:5453 blocked for more than 245 seconds. [ 1112.603142] Not tainted 7.1.0-rc6-tgcp-gc3e973d955ca #1 [ 1112.610394] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.619981] task:python3 state:D stack:25672 pid:5453 tgid:5453 ppid:5452 task_flags:0x400100 flags:0x00080000 [ 1112.633186] Call Trace: [ 1112.636726] [ 1112.639875] __schedule+0xcc3/0x19c0 [ 1112.644690] ? io_schedule_timeout+0x140/0x140 [ 1112.650476] ? find_held_lock+0x2b/0x80 [ 1112.655578] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.661464] schedule+0xd8/0x260 [ 1112.665881] schedule_preempt_disabled+0x18/0x30 [ 1112.671858] __mutex_lock+0x6af/0x2010 [ 1112.676861] ? threaded_store+0x132/0x220 [ 1112.682161] ? ww_mutex_lock+0x160/0x160 [ 1112.687351] ? selinux_inode_free_security+0x330/0x330 [ 1112.693923] ? cap_capable+0x1d6/0x3e0 [ 1112.698932] ? threaded_store+0x132/0x220 [ 1112.704226] threaded_store+0x132/0x220 [ 1112.709328] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.714697] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.719992] ? sysfs_kf_write+0x65/0x160 [ 1112.725193] ? sysfs_file_ops+0x140/0x140 [ 1112.730489] kernfs_fop_write_iter+0x335/0x510 [ 1112.736272] ? kernfs_ops+0xf0/0xf0 [ 1112.740985] new_sync_write+0x333/0x750 [ 1112.746085] ? __lock_acquire+0x508/0xc10 [ 1112.751379] ? new_sync_read+0x740/0x740 [ 1112.756581] ? lock_acquire.part.0+0xbc/0x260 [ 1112.762266] ? ksys_write+0x116/0x250 [ 1112.767174] vfs_write+0x657/0x9b0 [ 1112.771789] ksys_write+0x116/0x250 [ 1112.776501] ? __ia32_sys_read+0xc0/0xc0 [ 1112.781700] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.787289] ? rcu_is_watching+0x15/0xd0 [ 1112.792482] do_syscall_64+0xf3/0x650 [ 1112.797389] ? trace_hardirqs_off+0xd/0x30 [ 1112.802774] ? exc_page_fault+0xda/0xf0 [ 1112.807877] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.814342] RIP: 0033:0x7f371775864e [ 1112.819153] RSP: 002b:00007ffea6a259e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.828450] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f371775864e [ 1112.837250] RDX: 0000000000000001 RSI: 000055956fe00bf0 RDI: 0000000000000007 [ 1112.846047] RBP: 00007ffea6a259f0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.854852] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37175d1390 [ 1112.863661] R13: 000055956fe00bf0 R14: 0000000000000007 R15: 00007f3717565120 | [ 1113.299004] #2: ffffffffa9769c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x640 | [ 1113.310666] #3: ffffffffa95687b0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a3/0x5c0 | [ 1113.322220] #4: ffffffffa9769990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2af/0x5c0 | [ 1113.334552] | [ 1113.337187] =============================================\x0a [ 1235.477112] INFO: task python3:5453 blocked for more than 368 seconds. [ 1235.485263] Not tainted 7.1.0-rc6-tgcp-gc3e973d955ca #1 [ 1235.492514] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.502104] task:python3 state:D stack:25672 pid:5453 tgid:5453 ppid:5452 task_flags:0x400100 flags:0x00080002 [ 1235.515310] Call Trace: [ 1235.518851] [ 1235.522006] __schedule+0xcc3/0x19c0 [ 1235.526827] ? io_schedule_timeout+0x140/0x140 [ 1235.532613] ? find_held_lock+0x2b/0x80 [ 1235.537717] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.543602] schedule+0xd8/0x260 [ 1235.548019] schedule_preempt_disabled+0x18/0x30 [ 1235.553998] __mutex_lock+0x6af/0x2010 [ 1235.559005] ? threaded_store+0x132/0x220 [ 1235.564309] ? ww_mutex_lock+0x160/0x160 [ 1235.569509] ? selinux_inode_free_security+0x330/0x330 [ 1235.576080] ? cap_capable+0x1d6/0x3e0 [ 1235.581088] ? threaded_store+0x132/0x220 [ 1235.586387] threaded_store+0x132/0x220 [ 1235.591491] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.596791] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.602091] ? sysfs_kf_write+0x65/0x160 [ 1235.607294] ? sysfs_file_ops+0x140/0x140 [ 1235.612592] kernfs_fop_write_iter+0x335/0x510 [ 1235.618375] ? kernfs_ops+0xf0/0xf0 [ 1235.623086] new_sync_write+0x333/0x750 [ 1235.628192] ? __lock_acquire+0x508/0xc10 [ 1235.633489] ? new_sync_read+0x740/0x740 [ 1235.638692] ? lock_acquire.part.0+0xbc/0x260 [ 1235.644377] ? ksys_write+0x116/0x250 [ 1235.649287] vfs_write+0x657/0x9b0 [ 1235.653901] ksys_write+0x116/0x250 [ 1235.658615] ? __ia32_sys_read+0xc0/0xc0 [ 1235.663812] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.669403] ? rcu_is_watching+0x15/0xd0 [ 1235.674604] do_syscall_64+0xf3/0x650 [ 1235.679513] ? trace_hardirqs_off+0xd/0x30 [ 1235.684910] ? exc_page_fault+0xda/0xf0 [ 1235.690014] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.696484] RIP: 0033:0x7f371775864e [ 1235.701296] RSP: 002b:00007ffea6a259e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.710596] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f371775864e [ 1235.719404] RDX: 0000000000000001 RSI: 000055956fe00bf0 RDI: 0000000000000007 [ 1235.728201] RBP: 00007ffea6a259f0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.737011] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37175d1390 [ 1235.745820] R13: 000055956fe00bf0 R14: 0000000000000007 R15: 00007f3717565120 | [ 1236.151384] #1: ff110001a5766280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.162339] #2: ff1100012438ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.173497] #3: ff11000124409d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.183591] | [ 1236.186058] =============================================\x0a [ 1358.358253] INFO: task python3:5453 blocked for more than 491 seconds. [ 1358.366404] Not tainted 7.1.0-rc6-tgcp-gc3e973d955ca #1 [ 1358.373654] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.383242] task:python3 state:D stack:25672 pid:5453 tgid:5453 ppid:5452 task_flags:0x400100 flags:0x00080002 [ 1358.396446] Call Trace: [ 1358.399985] [ 1358.403137] __schedule+0xcc3/0x19c0 [ 1358.407952] ? io_schedule_timeout+0x140/0x140 [ 1358.413728] ? find_held_lock+0x2b/0x80 [ 1358.418834] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.424719] schedule+0xd8/0x260 [ 1358.429135] schedule_preempt_disabled+0x18/0x30 [ 1358.435113] __mutex_lock+0x6af/0x2010 [ 1358.440115] ? threaded_store+0x132/0x220 [ 1358.445413] ? ww_mutex_lock+0x160/0x160 [ 1358.450613] ? selinux_inode_free_security+0x330/0x330 [ 1358.457183] ? cap_capable+0x1d6/0x3e0 [ 1358.462188] ? threaded_store+0x132/0x220 [ 1358.467486] threaded_store+0x132/0x220 [ 1358.472578] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.477879] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.483176] ? sysfs_kf_write+0x65/0x160 [ 1358.488374] ? sysfs_file_ops+0x140/0x140 [ 1358.493667] kernfs_fop_write_iter+0x335/0x510 [ 1358.499449] ? kernfs_ops+0xf0/0xf0 [ 1358.504161] new_sync_write+0x333/0x750 [ 1358.509266] ? __lock_acquire+0x508/0xc10 [ 1358.514561] ? new_sync_read+0x740/0x740 [ 1358.519764] ? lock_acquire.part.0+0xbc/0x260 [ 1358.525451] ? ksys_write+0x116/0x250 [ 1358.530351] vfs_write+0x657/0x9b0 [ 1358.534965] ksys_write+0x116/0x250 [ 1358.539678] ? __ia32_sys_read+0xc0/0xc0 [ 1358.544876] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.550466] ? rcu_is_watching+0x15/0xd0 [ 1358.555667] do_syscall_64+0xf3/0x650 [ 1358.560572] ? trace_hardirqs_off+0xd/0x30 [ 1358.565964] ? exc_page_fault+0xda/0xf0 [ 1358.571065] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.577523] RIP: 0033:0x7f371775864e [ 1358.582321] RSP: 002b:00007ffea6a259e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.591615] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f371775864e [ 1358.600423] RDX: 0000000000000001 RSI: 000055956fe00bf0 RDI: 0000000000000007 [ 1358.609230] RBP: 00007ffea6a259f0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.618037] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37175d1390 [ 1358.626842] R13: 000055956fe00bf0 R14: 0000000000000007 R15: 00007f3717565120 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store