====================================== | [ 777.431650] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 777.434010] nipa-hw-worker: [4/39] Retrying drivers/net:napi_threaded.py | [ 777.586217] kselftest: Running tests in drivers/net | [ 850.410176] kworker/u130:4 (529) used greatest stack depth: 21192 bytes left [ 989.675694] INFO: task python3:5555 blocked for more than 122 seconds. [ 989.683910] Not tainted 7.0.0-rc6-fowg-gae9854baecae #1 [ 989.691159] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.700746] task:python3 state:D stack:25336 pid:5555 tgid:5555 ppid:5554 task_flags:0x400100 flags:0x00080000 [ 989.713952] Call Trace: [ 989.717490] [ 989.720642] __schedule+0xae3/0x14d0 [ 989.725458] ? io_schedule_timeout+0x140/0x140 [ 989.731242] ? find_held_lock+0x2b/0x80 [ 989.736347] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.742230] schedule+0xd4/0x260 [ 989.746645] schedule_preempt_disabled+0x18/0x30 [ 989.752624] __mutex_lock+0x6b2/0x1ee0 [ 989.757630] ? rcu_is_watching+0x15/0xd0 [ 989.762827] ? threaded_store+0x132/0x220 [ 989.768123] ? ww_mutex_lock+0x160/0x160 [ 989.773321] ? selinux_inode_free_security+0x330/0x330 [ 989.779888] ? cap_capable+0x1ed/0x3f0 [ 989.784895] ? threaded_store+0x132/0x220 [ 989.790191] threaded_store+0x132/0x220 [ 989.795296] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.800594] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.805890] ? sysfs_kf_write+0x65/0x160 [ 989.811088] ? sysfs_file_ops+0x140/0x140 [ 989.816382] kernfs_fop_write_iter+0x335/0x510 [ 989.822164] ? kernfs_ops+0xf0/0xf0 [ 989.826873] new_sync_write+0x333/0x750 [ 989.831977] ? __lock_acquire+0x508/0xc10 [ 989.837271] ? new_sync_read+0x740/0x740 [ 989.842470] ? lock_acquire.part.0+0xbc/0x260 [ 989.848155] ? ksys_write+0x116/0x250 [ 989.853063] vfs_write+0x657/0x9b0 [ 989.857670] ksys_write+0x116/0x250 [ 989.862378] ? __ia32_sys_read+0xc0/0xc0 [ 989.867574] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.873162] ? rcu_is_watching+0x15/0xd0 [ 989.878359] do_syscall_64+0xf3/0x5e0 [ 989.883262] ? irq_exit_rcu+0x39/0xf0 [ 989.888170] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.894626] RIP: 0033:0x7f9288a6122e [ 989.899436] RSP: 002b:00007ffd7e792df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.908733] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9288a6122e [ 989.917545] RDX: 0000000000000001 RSI: 00005645c66ae340 RDI: 0000000000000007 [ 989.926350] RBP: 00007ffd7e792e00 R08: 0000000000000000 R09: 0000000000000000 [ 989.935157] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92888d9390 [ 989.943972] R13: 00005645c66ae340 R14: 0000000000000007 R15: 0000000000000003 | [ 990.354888] #1: ff110001d2075688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.365839] #2: ff11000111c210f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.376994] #3: ff11000111c01d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.387083] | [ 990.389550] =============================================\x0a [ 1112.556991] INFO: task python3:5555 blocked for more than 245 seconds. [ 1112.565139] Not tainted 7.0.0-rc6-fowg-gae9854baecae #1 [ 1112.572396] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.581976] task:python3 state:D stack:25336 pid:5555 tgid:5555 ppid:5554 task_flags:0x400100 flags:0x00080000 [ 1112.595179] Call Trace: [ 1112.598719] [ 1112.601867] __schedule+0xae3/0x14d0 [ 1112.606680] ? io_schedule_timeout+0x140/0x140 [ 1112.612466] ? find_held_lock+0x2b/0x80 [ 1112.617572] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.623456] schedule+0xd4/0x260 [ 1112.627872] schedule_preempt_disabled+0x18/0x30 [ 1112.633849] __mutex_lock+0x6b2/0x1ee0 [ 1112.638854] ? rcu_is_watching+0x15/0xd0 [ 1112.644055] ? threaded_store+0x132/0x220 [ 1112.649356] ? ww_mutex_lock+0x160/0x160 [ 1112.654556] ? selinux_inode_free_security+0x330/0x330 [ 1112.661127] ? cap_capable+0x1ed/0x3f0 [ 1112.666132] ? threaded_store+0x132/0x220 [ 1112.671421] threaded_store+0x132/0x220 [ 1112.676517] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.681814] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.687102] ? sysfs_kf_write+0x65/0x160 [ 1112.692298] ? sysfs_file_ops+0x140/0x140 [ 1112.697594] kernfs_fop_write_iter+0x335/0x510 [ 1112.703379] ? kernfs_ops+0xf0/0xf0 [ 1112.708084] new_sync_write+0x333/0x750 [ 1112.713188] ? __lock_acquire+0x508/0xc10 [ 1112.718474] ? new_sync_read+0x740/0x740 [ 1112.723673] ? lock_acquire.part.0+0xbc/0x260 [ 1112.729351] ? ksys_write+0x116/0x250 [ 1112.734260] vfs_write+0x657/0x9b0 [ 1112.738873] ksys_write+0x116/0x250 [ 1112.743583] ? __ia32_sys_read+0xc0/0xc0 [ 1112.748780] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.754367] ? rcu_is_watching+0x15/0xd0 [ 1112.759566] do_syscall_64+0xf3/0x5e0 [ 1112.764474] ? irq_exit_rcu+0x39/0xf0 [ 1112.769382] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.775850] RIP: 0033:0x7f9288a6122e [ 1112.780658] RSP: 002b:00007ffd7e792df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.789955] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9288a6122e [ 1112.798753] RDX: 0000000000000001 RSI: 00005645c66ae340 RDI: 0000000000000007 [ 1112.807562] RBP: 00007ffd7e792e00 R08: 0000000000000000 R09: 0000000000000000 [ 1112.816370] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92888d9390 [ 1112.825260] R13: 00005645c66ae340 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.254981] #2: ffffffff97137108 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x560 | [ 1113.266626] #3: ffffffff96f68b50 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a3/0x5c0 | [ 1113.278175] #4: ffffffff97136e10 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2af/0x5c0 | [ 1113.290504] | [ 1113.292973] =============================================\x0a [ 1235.437284] INFO: task python3:5555 blocked for more than 368 seconds. [ 1235.445435] Not tainted 7.0.0-rc6-fowg-gae9854baecae #1 [ 1235.452686] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.462276] task:python3 state:D stack:25336 pid:5555 tgid:5555 ppid:5554 task_flags:0x400100 flags:0x00080002 [ 1235.475482] Call Trace: [ 1235.479023] [ 1235.482177] __schedule+0xae3/0x14d0 [ 1235.486994] ? io_schedule_timeout+0x140/0x140 [ 1235.492778] ? find_held_lock+0x2b/0x80 [ 1235.497883] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.503769] schedule+0xd4/0x260 [ 1235.508187] schedule_preempt_disabled+0x18/0x30 [ 1235.514165] __mutex_lock+0x6b2/0x1ee0 [ 1235.519171] ? rcu_is_watching+0x15/0xd0 [ 1235.524370] ? threaded_store+0x132/0x220 [ 1235.529660] ? ww_mutex_lock+0x160/0x160 [ 1235.534861] ? selinux_inode_free_security+0x330/0x330 [ 1235.541433] ? cap_capable+0x1ed/0x3f0 [ 1235.546444] ? threaded_store+0x132/0x220 [ 1235.551743] threaded_store+0x132/0x220 [ 1235.556848] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.562149] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.567448] ? sysfs_kf_write+0x65/0x160 [ 1235.572650] ? sysfs_file_ops+0x140/0x140 [ 1235.577947] kernfs_fop_write_iter+0x335/0x510 [ 1235.583731] ? kernfs_ops+0xf0/0xf0 [ 1235.588443] new_sync_write+0x333/0x750 [ 1235.593539] ? __lock_acquire+0x508/0xc10 [ 1235.598826] ? new_sync_read+0x740/0x740 [ 1235.604029] ? lock_acquire.part.0+0xbc/0x260 [ 1235.609716] ? ksys_write+0x116/0x250 [ 1235.614618] vfs_write+0x657/0x9b0 [ 1235.619236] ksys_write+0x116/0x250 [ 1235.623946] ? __ia32_sys_read+0xc0/0xc0 [ 1235.629143] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.634733] ? rcu_is_watching+0x15/0xd0 [ 1235.639931] do_syscall_64+0xf3/0x5e0 [ 1235.644838] ? irq_exit_rcu+0x39/0xf0 [ 1235.649748] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.656218] RIP: 0033:0x7f9288a6122e [ 1235.661030] RSP: 002b:00007ffd7e792df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.670329] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9288a6122e [ 1235.679137] RDX: 0000000000000001 RSI: 00005645c66ae340 RDI: 0000000000000007 [ 1235.687939] RBP: 00007ffd7e792e00 R08: 0000000000000000 R09: 0000000000000000 [ 1235.696749] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92888d9390 [ 1235.705556] R13: 00005645c66ae340 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.105517] #1: ff110001d2075688 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.116477] #2: ff11000111c210f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.127633] #3: ff11000111c01d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.137724] | [ 1236.140192] =============================================\x0a [ 1358.319569] INFO: task python3:5555 blocked for more than 491 seconds. [ 1358.328240] Not tainted 7.0.0-rc6-fowg-gae9854baecae #1 [ 1358.335493] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.345084] task:python3 state:D stack:25336 pid:5555 tgid:5555 ppid:5554 task_flags:0x400100 flags:0x00080002 [ 1358.358290] Call Trace: [ 1358.361834] [ 1358.364986] __schedule+0xae3/0x14d0 [ 1358.369803] ? io_schedule_timeout+0x140/0x140 [ 1358.375588] ? find_held_lock+0x2b/0x80 [ 1358.380694] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.386581] schedule+0xd4/0x260 [ 1358.391001] schedule_preempt_disabled+0x18/0x30 [ 1358.396980] __mutex_lock+0x6b2/0x1ee0 [ 1358.401986] ? rcu_is_watching+0x15/0xd0 [ 1358.407185] ? threaded_store+0x132/0x220 [ 1358.412477] ? ww_mutex_lock+0x160/0x160 [ 1358.417675] ? selinux_inode_free_security+0x330/0x330 [ 1358.424249] ? cap_capable+0x1ed/0x3f0 [ 1358.429259] ? threaded_store+0x132/0x220 [ 1358.434554] threaded_store+0x132/0x220 [ 1358.439658] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.444955] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.450255] ? sysfs_kf_write+0x65/0x160 [ 1358.455453] ? sysfs_file_ops+0x140/0x140 [ 1358.460748] kernfs_fop_write_iter+0x335/0x510 [ 1358.466536] ? kernfs_ops+0xf0/0xf0 [ 1358.471250] new_sync_write+0x333/0x750 [ 1358.476357] ? __lock_acquire+0x508/0xc10 [ 1358.481654] ? new_sync_read+0x740/0x740 [ 1358.486854] ? lock_acquire.part.0+0xbc/0x260 [ 1358.492544] ? ksys_write+0x116/0x250 [ 1358.497456] vfs_write+0x657/0x9b0 [ 1358.502070] ksys_write+0x116/0x250 [ 1358.506781] ? __ia32_sys_read+0xc0/0xc0 [ 1358.511979] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.517567] ? rcu_is_watching+0x15/0xd0 [ 1358.522770] do_syscall_64+0xf3/0x5e0 [ 1358.527678] ? irq_exit_rcu+0x39/0xf0 [ 1358.532585] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.539052] RIP: 0033:0x7f9288a6122e [ 1358.543861] RSP: 002b:00007ffd7e792df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.553161] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9288a6122e [ 1358.561970] RDX: 0000000000000001 RSI: 00005645c66ae340 RDI: 0000000000000007 [ 1358.570778] RBP: 00007ffd7e792e00 R08: 0000000000000000 R09: 0000000000000000 [ 1358.579575] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92888d9390 [ 1358.588382] R13: 00005645c66ae340 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store