====================================== | [ 769.487346] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 769.515329] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 769.641873] kselftest: Running tests in drivers/net [ 989.708270] INFO: task python3:5593 blocked for more than 122 seconds. [ 989.716508] Not tainted 7.1.0-rc7-ffhv-ged76b27e5ef1 #1 [ 989.724431] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.734020] task:python3 state:D stack:25672 pid:5593 tgid:5593 ppid:5592 task_flags:0x400100 flags:0x00080000 [ 989.747225] Call Trace: [ 989.750765] [ 989.753915] __schedule+0xcc3/0x19c0 [ 989.758732] ? io_schedule_timeout+0x140/0x140 [ 989.764514] ? find_held_lock+0x2b/0x80 [ 989.769619] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.775503] schedule+0xd8/0x260 [ 989.779920] schedule_preempt_disabled+0x18/0x30 [ 989.785897] __mutex_lock+0x6af/0x2010 [ 989.790903] ? threaded_store+0x132/0x220 [ 989.796199] ? ww_mutex_lock+0x160/0x160 [ 989.801397] ? selinux_inode_free_security+0x330/0x330 [ 989.807957] ? cap_capable+0x1d6/0x3e0 [ 989.813046] ? threaded_store+0x132/0x220 [ 989.818344] threaded_store+0x132/0x220 [ 989.823436] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.828733] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.834030] ? sysfs_kf_write+0x65/0x160 [ 989.839229] ? sysfs_file_ops+0x140/0x140 [ 989.844526] kernfs_fop_write_iter+0x335/0x510 [ 989.850308] ? kernfs_ops+0xf0/0xf0 [ 989.855019] new_sync_write+0x333/0x750 [ 989.860114] ? __lock_acquire+0x508/0xc10 [ 989.865409] ? new_sync_read+0x740/0x740 [ 989.870610] ? lock_acquire.part.0+0xbc/0x260 [ 989.876295] ? ksys_write+0x116/0x250 [ 989.881203] vfs_write+0x657/0x9b0 [ 989.885818] ksys_write+0x116/0x250 [ 989.890520] ? __ia32_sys_read+0xc0/0xc0 [ 989.895717] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.901307] ? rcu_is_watching+0x15/0xd0 [ 989.906508] do_syscall_64+0xf3/0x650 [ 989.911417] ? irq_exit_rcu+0x1a/0x30 [ 989.916327] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.922795] RIP: 0033:0x7f3448d3a64e [ 989.927605] RSP: 002b:00007fff7278a270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.936903] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3448d3a64e [ 989.945712] RDX: 0000000000000001 RSI: 0000560ce561bbf0 RDI: 0000000000000007 [ 989.954522] RBP: 00007fff7278a280 R08: 0000000000000000 R09: 0000000000000000 [ 989.963327] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3448bb3390 [ 989.972134] R13: 0000560ce561bbf0 R14: 0000000000000007 R15: 00007f3448b49120 | [ 990.371687] #3: ff11000112581e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.381832] 1 lock held by systemd/6263: | [ 990.387091] | [ 990.389555] =============================================\x0a | [ 1092.110538] kworker/u129:9 (290) used greatest stack depth: 21936 bytes left [ 1112.590628] INFO: task python3:5593 blocked for more than 245 seconds. [ 1112.598777] Not tainted 7.1.0-rc7-ffhv-ged76b27e5ef1 #1 [ 1112.606028] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.615618] task:python3 state:D stack:25672 pid:5593 tgid:5593 ppid:5592 task_flags:0x400100 flags:0x00080000 [ 1112.628824] Call Trace: [ 1112.632367] [ 1112.635517] __schedule+0xcc3/0x19c0 [ 1112.640337] ? io_schedule_timeout+0x140/0x140 [ 1112.646122] ? find_held_lock+0x2b/0x80 [ 1112.651225] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.657111] schedule+0xd8/0x260 [ 1112.661530] schedule_preempt_disabled+0x18/0x30 [ 1112.667508] __mutex_lock+0x6af/0x2010 [ 1112.672513] ? threaded_store+0x132/0x220 [ 1112.677813] ? ww_mutex_lock+0x160/0x160 [ 1112.683014] ? selinux_inode_free_security+0x330/0x330 [ 1112.689585] ? cap_capable+0x1d6/0x3e0 [ 1112.694595] ? threaded_store+0x132/0x220 [ 1112.699890] threaded_store+0x132/0x220 [ 1112.704992] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.710289] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.715591] ? sysfs_kf_write+0x65/0x160 [ 1112.720792] ? sysfs_file_ops+0x140/0x140 [ 1112.726090] kernfs_fop_write_iter+0x335/0x510 [ 1112.731875] ? kernfs_ops+0xf0/0xf0 [ 1112.736577] new_sync_write+0x333/0x750 [ 1112.741674] ? __lock_acquire+0x508/0xc10 [ 1112.746971] ? new_sync_read+0x740/0x740 [ 1112.752166] ? lock_acquire.part.0+0xbc/0x260 [ 1112.757854] ? ksys_write+0x116/0x250 [ 1112.762755] vfs_write+0x657/0x9b0 [ 1112.767369] ksys_write+0x116/0x250 [ 1112.772078] ? __ia32_sys_read+0xc0/0xc0 [ 1112.777277] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.782865] ? rcu_is_watching+0x15/0xd0 [ 1112.788068] do_syscall_64+0xf3/0x650 [ 1112.792974] ? irq_exit_rcu+0x1a/0x30 [ 1112.797883] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.804350] RIP: 0033:0x7f3448d3a64e [ 1112.809152] RSP: 002b:00007fff7278a270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.818451] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3448d3a64e [ 1112.827263] RDX: 0000000000000001 RSI: 0000560ce561bbf0 RDI: 0000000000000007 [ 1112.836070] RBP: 00007fff7278a280 R08: 0000000000000000 R09: 0000000000000000 [ 1112.844881] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3448bb3390 [ 1112.853688] R13: 0000560ce561bbf0 R14: 0000000000000007 R15: 00007f3448b49120 | [ 1113.270762] #1: ff110001ae423280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.281725] #2: ff1100011ba3ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.292883] #3: ff11000112581e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.302974] | [ 1113.305439] =============================================\x0a [ 1235.471634] INFO: task python3:5593 blocked for more than 368 seconds. [ 1235.479783] Not tainted 7.1.0-rc7-ffhv-ged76b27e5ef1 #1 [ 1235.487034] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.496627] task:python3 state:D stack:25672 pid:5593 tgid:5593 ppid:5592 task_flags:0x400100 flags:0x00080002 [ 1235.509833] Call Trace: [ 1235.513373] [ 1235.516524] __schedule+0xcc3/0x19c0 [ 1235.521337] ? io_schedule_timeout+0x140/0x140 [ 1235.527123] ? find_held_lock+0x2b/0x80 [ 1235.532224] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.538111] schedule+0xd8/0x260 [ 1235.542529] schedule_preempt_disabled+0x18/0x30 [ 1235.548508] __mutex_lock+0x6af/0x2010 [ 1235.553504] ? threaded_store+0x132/0x220 [ 1235.558804] ? ww_mutex_lock+0x160/0x160 [ 1235.564005] ? selinux_inode_free_security+0x330/0x330 [ 1235.570578] ? cap_capable+0x1d6/0x3e0 [ 1235.575589] ? threaded_store+0x132/0x220 [ 1235.580885] threaded_store+0x132/0x220 [ 1235.585988] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.591292] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.596592] ? sysfs_kf_write+0x65/0x160 [ 1235.601791] ? sysfs_file_ops+0x140/0x140 [ 1235.607089] kernfs_fop_write_iter+0x335/0x510 [ 1235.612876] ? kernfs_ops+0xf0/0xf0 [ 1235.617588] new_sync_write+0x333/0x750 [ 1235.622694] ? __lock_acquire+0x508/0xc10 [ 1235.627991] ? new_sync_read+0x740/0x740 [ 1235.633186] ? lock_acquire.part.0+0xbc/0x260 [ 1235.638874] ? ksys_write+0x116/0x250 [ 1235.643784] vfs_write+0x657/0x9b0 [ 1235.648398] ksys_write+0x116/0x250 [ 1235.653108] ? __ia32_sys_read+0xc0/0xc0 [ 1235.658310] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.663897] ? rcu_is_watching+0x15/0xd0 [ 1235.669099] do_syscall_64+0xf3/0x650 [ 1235.674005] ? irq_exit_rcu+0x1a/0x30 [ 1235.678911] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.685378] RIP: 0033:0x7f3448d3a64e [ 1235.690188] RSP: 002b:00007fff7278a270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.699489] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3448d3a64e [ 1235.708296] RDX: 0000000000000001 RSI: 0000560ce561bbf0 RDI: 0000000000000007 [ 1235.717105] RBP: 00007fff7278a280 R08: 0000000000000000 R09: 0000000000000000 [ 1235.725914] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3448bb3390 [ 1235.734723] R13: 0000560ce561bbf0 R14: 0000000000000007 R15: 00007f3448b49120 | [ 1236.111699] #1: ff110001ae423280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.122661] #2: ff1100011ba3ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.133809] #3: ff11000112581e00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.143900] | [ 1236.146365] =============================================\x0a [ 1358.352795] INFO: task python3:5593 blocked for more than 491 seconds. [ 1358.360937] Not tainted 7.1.0-rc7-ffhv-ged76b27e5ef1 #1 [ 1358.368185] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.377774] task:python3 state:D stack:25672 pid:5593 tgid:5593 ppid:5592 task_flags:0x400100 flags:0x00080002 [ 1358.390981] Call Trace: [ 1358.394523] [ 1358.397673] __schedule+0xcc3/0x19c0 [ 1358.402489] ? io_schedule_timeout+0x140/0x140 [ 1358.408277] ? find_held_lock+0x2b/0x80 [ 1358.413383] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.419282] schedule+0xd8/0x260 [ 1358.423705] schedule_preempt_disabled+0x18/0x30 [ 1358.429684] __mutex_lock+0x6af/0x2010 [ 1358.434681] ? threaded_store+0x132/0x220 [ 1358.439970] ? ww_mutex_lock+0x160/0x160 [ 1358.445171] ? selinux_inode_free_security+0x330/0x330 [ 1358.451743] ? cap_capable+0x1d6/0x3e0 [ 1358.456753] ? threaded_store+0x132/0x220 [ 1358.462048] threaded_store+0x132/0x220 [ 1358.467150] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.472449] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.477748] ? sysfs_kf_write+0x65/0x160 [ 1358.482951] ? sysfs_file_ops+0x140/0x140 [ 1358.488245] kernfs_fop_write_iter+0x335/0x510 [ 1358.494028] ? kernfs_ops+0xf0/0xf0 [ 1358.498742] new_sync_write+0x333/0x750 [ 1358.503845] ? __lock_acquire+0x508/0xc10 [ 1358.509142] ? new_sync_read+0x740/0x740 [ 1358.514347] ? lock_acquire.part.0+0xbc/0x260 [ 1358.520034] ? ksys_write+0x116/0x250 [ 1358.524943] vfs_write+0x657/0x9b0 [ 1358.529556] ksys_write+0x116/0x250 [ 1358.534270] ? __ia32_sys_read+0xc0/0xc0 [ 1358.539467] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.545055] ? rcu_is_watching+0x15/0xd0 [ 1358.550257] do_syscall_64+0xf3/0x650 [ 1358.555166] ? irq_exit_rcu+0x1a/0x30 [ 1358.560072] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.566543] RIP: 0033:0x7f3448d3a64e [ 1358.571353] RSP: 002b:00007fff7278a270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.580648] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3448d3a64e [ 1358.589456] RDX: 0000000000000001 RSI: 0000560ce561bbf0 RDI: 0000000000000007 [ 1358.598253] RBP: 00007fff7278a280 R08: 0000000000000000 R09: 0000000000000000 [ 1358.607059] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3448bb3390 [ 1358.615866] R13: 0000560ce561bbf0 R14: 0000000000000007 R15: 00007f3448b49120 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store