====================================== | [ 761.933019] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 761.935473] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 762.063616] kselftest: Running tests in drivers/net [ 989.705584] INFO: task python3:5380 blocked for more than 122 seconds. [ 989.713779] Not tainted 7.1.0-rc6-obzi-g16b35835e365 #1 [ 989.721378] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.730970] task:python3 state:D stack:25672 pid:5380 tgid:5380 ppid:5379 task_flags:0x400100 flags:0x00080000 [ 989.744179] Call Trace: [ 989.747720] [ 989.750870] __schedule+0xcc3/0x19c0 [ 989.755687] ? io_schedule_timeout+0x140/0x140 [ 989.761470] ? find_held_lock+0x2b/0x80 [ 989.766566] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.772446] schedule+0xd8/0x260 [ 989.776865] schedule_preempt_disabled+0x18/0x30 [ 989.782843] __mutex_lock+0x6af/0x2010 [ 989.787848] ? threaded_store+0x132/0x220 [ 989.793148] ? ww_mutex_lock+0x160/0x160 [ 989.798347] ? selinux_inode_free_security+0x330/0x330 [ 989.804919] ? cap_capable+0x1d6/0x3e0 [ 989.809928] ? threaded_store+0x132/0x220 [ 989.815224] threaded_store+0x132/0x220 [ 989.820329] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.825628] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.830931] ? sysfs_kf_write+0x65/0x160 [ 989.836135] ? sysfs_file_ops+0x140/0x140 [ 989.841433] kernfs_fop_write_iter+0x335/0x510 [ 989.847218] ? kernfs_ops+0xf0/0xf0 [ 989.851921] new_sync_write+0x333/0x750 [ 989.857028] ? __lock_acquire+0x508/0xc10 [ 989.862324] ? new_sync_read+0x740/0x740 [ 989.867528] ? lock_acquire.part.0+0xbc/0x260 [ 989.873212] ? ksys_write+0x116/0x250 [ 989.878122] vfs_write+0x657/0x9b0 [ 989.882740] ksys_write+0x116/0x250 [ 989.887451] ? __ia32_sys_read+0xc0/0xc0 [ 989.892651] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.898239] ? rcu_is_watching+0x15/0xd0 [ 989.903441] do_syscall_64+0xf3/0x650 [ 989.908347] ? trace_hardirqs_off+0xd/0x30 [ 989.913741] ? exc_page_fault+0xda/0xf0 [ 989.918845] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.925312] RIP: 0033:0x7f90af58564e [ 989.930124] RSP: 002b:00007ffd7e1f7f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.939428] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f90af58564e [ 989.948235] RDX: 0000000000000001 RSI: 0000561d5526a420 RDI: 0000000000000007 [ 989.957037] RBP: 00007ffd7e1f7f60 R08: 0000000000000000 R09: 0000000000000000 [ 989.965847] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90af3fe390 [ 989.974655] R13: 0000561d5526a420 R14: 0000000000000007 R15: 00007f90af391120 | [ 990.345951] #1: ff11000187b23880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.356903] #2: ff110017d9a84b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.368060] #3: ff110017d9ad1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.378144] | [ 990.380611] =============================================\x0a [ 1112.586984] INFO: task python3:5380 blocked for more than 245 seconds. [ 1112.595134] Not tainted 7.1.0-rc6-obzi-g16b35835e365 #1 [ 1112.602581] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.612725] task:python3 state:D stack:25672 pid:5380 tgid:5380 ppid:5379 task_flags:0x400100 flags:0x00080000 [ 1112.625941] Call Trace: [ 1112.629483] [ 1112.632626] __schedule+0xcc3/0x19c0 [ 1112.637442] ? io_schedule_timeout+0x140/0x140 [ 1112.643227] ? find_held_lock+0x2b/0x80 [ 1112.648334] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.654221] schedule+0xd8/0x260 [ 1112.658642] schedule_preempt_disabled+0x18/0x30 [ 1112.664625] __mutex_lock+0x6af/0x2010 [ 1112.669631] ? threaded_store+0x132/0x220 [ 1112.674999] ? ww_mutex_lock+0x160/0x160 [ 1112.680200] ? selinux_inode_free_security+0x330/0x330 [ 1112.686773] ? cap_capable+0x1d6/0x3e0 [ 1112.691782] ? threaded_store+0x132/0x220 [ 1112.697080] threaded_store+0x132/0x220 [ 1112.702174] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.707464] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.712763] ? sysfs_kf_write+0x65/0x160 [ 1112.717963] ? sysfs_file_ops+0x140/0x140 [ 1112.723249] kernfs_fop_write_iter+0x335/0x510 [ 1112.729035] ? kernfs_ops+0xf0/0xf0 [ 1112.733747] new_sync_write+0x333/0x750 [ 1112.738853] ? __lock_acquire+0x508/0xc10 [ 1112.744149] ? new_sync_read+0x740/0x740 [ 1112.749351] ? lock_acquire.part.0+0xbc/0x260 [ 1112.755040] ? ksys_write+0x116/0x250 [ 1112.759952] vfs_write+0x657/0x9b0 [ 1112.764568] ksys_write+0x116/0x250 [ 1112.769284] ? __ia32_sys_read+0xc0/0xc0 [ 1112.774483] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.780071] ? rcu_is_watching+0x15/0xd0 [ 1112.785274] do_syscall_64+0xf3/0x650 [ 1112.790181] ? trace_hardirqs_off+0xd/0x30 [ 1112.795577] ? exc_page_fault+0xda/0xf0 [ 1112.800681] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.807148] RIP: 0033:0x7f90af58564e [ 1112.811957] RSP: 002b:00007ffd7e1f7f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.821259] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f90af58564e [ 1112.830067] RDX: 0000000000000001 RSI: 0000561d5526a420 RDI: 0000000000000007 [ 1112.838868] RBP: 00007ffd7e1f7f60 R08: 0000000000000000 R09: 0000000000000000 [ 1112.847676] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90af3fe390 [ 1112.856478] R13: 0000561d5526a420 R14: 0000000000000007 R15: 00007f90af391120 | [ 1113.326720] #2: ffffffffab769c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x640 | [ 1113.338364] #3: ffffffffab5687b0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a3/0x5c0 | [ 1113.349911] #4: ffffffffab769990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2af/0x5c0 | [ 1113.362251] | [ 1113.364727] =============================================\x0a [ 1235.468386] INFO: task python3:5380 blocked for more than 368 seconds. [ 1235.476534] Not tainted 7.1.0-rc6-obzi-g16b35835e365 #1 [ 1235.483784] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.493376] task:python3 state:D stack:25672 pid:5380 tgid:5380 ppid:5379 task_flags:0x400100 flags:0x00080002 [ 1235.506584] Call Trace: [ 1235.510125] [ 1235.513279] __schedule+0xcc3/0x19c0 [ 1235.518098] ? io_schedule_timeout+0x140/0x140 [ 1235.523885] ? find_held_lock+0x2b/0x80 [ 1235.528992] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.534881] schedule+0xd8/0x260 [ 1235.539302] schedule_preempt_disabled+0x18/0x30 [ 1235.545283] __mutex_lock+0x6af/0x2010 [ 1235.550291] ? threaded_store+0x132/0x220 [ 1235.555593] ? ww_mutex_lock+0x160/0x160 [ 1235.560792] ? selinux_inode_free_security+0x330/0x330 [ 1235.567362] ? cap_capable+0x1d6/0x3e0 [ 1235.572371] ? threaded_store+0x132/0x220 [ 1235.577669] threaded_store+0x132/0x220 [ 1235.582772] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.588071] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.593373] ? sysfs_kf_write+0x65/0x160 [ 1235.598575] ? sysfs_file_ops+0x140/0x140 [ 1235.603873] kernfs_fop_write_iter+0x335/0x510 [ 1235.609659] ? kernfs_ops+0xf0/0xf0 [ 1235.614373] new_sync_write+0x333/0x750 [ 1235.619478] ? __lock_acquire+0x508/0xc10 [ 1235.624776] ? new_sync_read+0x740/0x740 [ 1235.629979] ? lock_acquire.part.0+0xbc/0x260 [ 1235.635667] ? ksys_write+0x116/0x250 [ 1235.640579] vfs_write+0x657/0x9b0 [ 1235.645197] ksys_write+0x116/0x250 [ 1235.649910] ? __ia32_sys_read+0xc0/0xc0 [ 1235.655101] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.660691] ? rcu_is_watching+0x15/0xd0 [ 1235.665895] do_syscall_64+0xf3/0x650 [ 1235.670802] ? trace_hardirqs_off+0xd/0x30 [ 1235.676197] ? exc_page_fault+0xda/0xf0 [ 1235.681299] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.687758] RIP: 0033:0x7f90af58564e [ 1235.692569] RSP: 002b:00007ffd7e1f7f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.701868] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f90af58564e [ 1235.710677] RDX: 0000000000000001 RSI: 0000561d5526a420 RDI: 0000000000000007 [ 1235.719486] RBP: 00007ffd7e1f7f60 R08: 0000000000000000 R09: 0000000000000000 [ 1235.728295] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90af3fe390 [ 1235.737103] R13: 0000561d5526a420 R14: 0000000000000007 R15: 00007f90af391120 | [ 1236.148641] #1: ff11000187b23880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.159605] #2: ff110017d9a84b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.170765] #3: ff110017d9ad1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.180855] | [ 1236.183320] =============================================\x0a [ 1358.349804] INFO: task python3:5380 blocked for more than 491 seconds. [ 1358.357964] Not tainted 7.1.0-rc6-obzi-g16b35835e365 #1 [ 1358.365216] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.374807] task:python3 state:D stack:25672 pid:5380 tgid:5380 ppid:5379 task_flags:0x400100 flags:0x00080002 [ 1358.388015] Call Trace: [ 1358.391553] [ 1358.394702] __schedule+0xcc3/0x19c0 [ 1358.399518] ? io_schedule_timeout+0x140/0x140 [ 1358.405302] ? find_held_lock+0x2b/0x80 [ 1358.410406] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.416289] schedule+0xd8/0x260 [ 1358.420704] schedule_preempt_disabled+0x18/0x30 [ 1358.426681] __mutex_lock+0x6af/0x2010 [ 1358.431682] ? threaded_store+0x132/0x220 [ 1358.436981] ? ww_mutex_lock+0x160/0x160 [ 1358.442179] ? selinux_inode_free_security+0x330/0x330 [ 1358.448748] ? cap_capable+0x1d6/0x3e0 [ 1358.453754] ? threaded_store+0x132/0x220 [ 1358.459050] threaded_store+0x132/0x220 [ 1358.464150] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.469444] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.474744] ? sysfs_kf_write+0x65/0x160 [ 1358.479943] ? sysfs_file_ops+0x140/0x140 [ 1358.485239] kernfs_fop_write_iter+0x335/0x510 [ 1358.491020] ? kernfs_ops+0xf0/0xf0 [ 1358.495731] new_sync_write+0x333/0x750 [ 1358.500835] ? __lock_acquire+0x508/0xc10 [ 1358.506128] ? new_sync_read+0x740/0x740 [ 1358.511326] ? lock_acquire.part.0+0xbc/0x260 [ 1358.517012] ? ksys_write+0x116/0x250 [ 1358.521922] vfs_write+0x657/0x9b0 [ 1358.526535] ksys_write+0x116/0x250 [ 1358.531246] ? __ia32_sys_read+0xc0/0xc0 [ 1358.536445] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.542031] ? rcu_is_watching+0x15/0xd0 [ 1358.547233] do_syscall_64+0xf3/0x650 [ 1358.552136] ? trace_hardirqs_off+0xd/0x30 [ 1358.557531] ? exc_page_fault+0xda/0xf0 [ 1358.562632] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.569097] RIP: 0033:0x7f90af58564e [ 1358.573907] RSP: 002b:00007ffd7e1f7f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.583197] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f90af58564e [ 1358.592003] RDX: 0000000000000001 RSI: 0000561d5526a420 RDI: 0000000000000007 [ 1358.600807] RBP: 00007ffd7e1f7f60 R08: 0000000000000000 R09: 0000000000000000 [ 1358.609613] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90af3fe390 [ 1358.618418] R13: 0000561d5526a420 R14: 0000000000000007 R15: 00007f90af391120 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store