====================================== | [ 788.528168] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 788.530624] nipa-hw-worker: [5/43] Retrying drivers/net:napi_threaded.py | [ 788.689238] kselftest: Running tests in drivers/net [ 989.718402] INFO: task python3:5889 blocked for more than 122 seconds. [ 989.726622] Not tainted 7.1.0-rc1-kfng-gabaddbf07c5d #1 [ 989.734344] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.743932] task:python3 state:D stack:25640 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080000 [ 989.757135] Call Trace: [ 989.760674] [ 989.763825] __schedule+0xcba/0x1940 [ 989.768640] ? io_schedule_timeout+0x140/0x140 [ 989.774426] ? find_held_lock+0x2b/0x80 [ 989.779528] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.785414] schedule+0xd4/0x260 [ 989.789831] schedule_preempt_disabled+0x18/0x30 [ 989.795807] __mutex_lock+0x6a3/0x2000 [ 989.800812] ? threaded_store+0x132/0x220 [ 989.806110] ? ww_mutex_lock+0x160/0x160 [ 989.811308] ? selinux_inode_free_security+0x330/0x330 [ 989.817869] ? cap_capable+0x1d6/0x3e0 [ 989.822874] ? threaded_store+0x132/0x220 [ 989.828169] threaded_store+0x132/0x220 [ 989.833269] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.838566] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.843865] ? sysfs_kf_write+0x65/0x160 [ 989.849064] ? sysfs_file_ops+0x140/0x140 [ 989.854360] kernfs_fop_write_iter+0x335/0x510 [ 989.860143] ? kernfs_ops+0xf0/0xf0 [ 989.864854] new_sync_write+0x333/0x750 [ 989.869955] ? __lock_acquire+0x508/0xc10 [ 989.875251] ? new_sync_read+0x740/0x740 [ 989.880450] ? lock_acquire.part.0+0xbc/0x260 [ 989.886137] ? ksys_write+0x116/0x250 [ 989.891047] vfs_write+0x657/0x9b0 [ 989.895660] ksys_write+0x116/0x250 [ 989.900369] ? __ia32_sys_read+0xc0/0xc0 [ 989.905569] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.911157] ? rcu_is_watching+0x15/0xd0 [ 989.916356] do_syscall_64+0xf3/0x650 [ 989.921264] ? irq_exit_rcu+0x1a/0x30 [ 989.926172] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.932637] RIP: 0033:0x7f832597b22e [ 989.937445] RSP: 002b:00007ffcb9313f80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.946740] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f832597b22e [ 989.955547] RDX: 0000000000000001 RSI: 0000559f91faba10 RDI: 0000000000000007 [ 989.964354] RBP: 00007ffcb9313f90 R08: 0000000000000000 R09: 0000000000000000 [ 989.973159] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83257f3390 [ 989.981966] R13: 0000559f91faba10 R14: 0000000000000007 R15: 0000000000000003 | [ 990.381889] #1: ff110001e60c9a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.392850] #2: ff11000121e8cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.403994] #3: ff11000121f01d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.414081] | [ 990.416544] =============================================\x0a [ 1112.600602] INFO: task python3:5889 blocked for more than 245 seconds. [ 1112.608749] Not tainted 7.1.0-rc1-kfng-gabaddbf07c5d #1 [ 1112.616000] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.625591] task:python3 state:D stack:25640 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080000 [ 1112.638798] Call Trace: [ 1112.642338] [ 1112.645490] __schedule+0xcba/0x1940 [ 1112.650307] ? io_schedule_timeout+0x140/0x140 [ 1112.656093] ? find_held_lock+0x2b/0x80 [ 1112.661199] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.667087] schedule+0xd4/0x260 [ 1112.671503] schedule_preempt_disabled+0x18/0x30 [ 1112.677482] __mutex_lock+0x6a3/0x2000 [ 1112.682484] ? threaded_store+0x132/0x220 [ 1112.687785] ? ww_mutex_lock+0x160/0x160 [ 1112.692985] ? selinux_inode_free_security+0x330/0x330 [ 1112.699552] ? cap_capable+0x1d6/0x3e0 [ 1112.704560] ? threaded_store+0x132/0x220 [ 1112.709858] threaded_store+0x132/0x220 [ 1112.714957] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.720257] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.725556] ? sysfs_kf_write+0x65/0x160 [ 1112.730757] ? sysfs_file_ops+0x140/0x140 [ 1112.736042] kernfs_fop_write_iter+0x335/0x510 [ 1112.741824] ? kernfs_ops+0xf0/0xf0 [ 1112.746533] new_sync_write+0x333/0x750 [ 1112.751636] ? __lock_acquire+0x508/0xc10 [ 1112.756930] ? new_sync_read+0x740/0x740 [ 1112.762132] ? lock_acquire.part.0+0xbc/0x260 [ 1112.767817] ? ksys_write+0x116/0x250 [ 1112.772725] vfs_write+0x657/0x9b0 [ 1112.777328] ksys_write+0x116/0x250 [ 1112.782039] ? __ia32_sys_read+0xc0/0xc0 [ 1112.787239] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.792828] ? rcu_is_watching+0x15/0xd0 [ 1112.798027] do_syscall_64+0xf3/0x650 [ 1112.802932] ? irq_exit_rcu+0x1a/0x30 [ 1112.807837] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.814302] RIP: 0033:0x7f832597b22e [ 1112.819112] RSP: 002b:00007ffcb9313f80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.828409] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f832597b22e [ 1112.837215] RDX: 0000000000000001 RSI: 0000559f91faba10 RDI: 0000000000000007 [ 1112.846024] RBP: 00007ffcb9313f90 R08: 0000000000000000 R09: 0000000000000000 [ 1112.854828] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83257f3390 [ 1112.863633] R13: 0000559f91faba10 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.234866] #1: ff110001e60c9a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.245825] #2: ff11000121e8cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.256981] #3: ff11000121f01d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.267070] | [ 1113.269536] =============================================\x0a [ 1235.481857] INFO: task python3:5889 blocked for more than 368 seconds. [ 1235.490005] Not tainted 7.1.0-rc1-kfng-gabaddbf07c5d #1 [ 1235.497248] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.506836] task:python3 state:D stack:25640 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080002 [ 1235.520043] Call Trace: [ 1235.523581] [ 1235.526731] __schedule+0xcba/0x1940 [ 1235.531547] ? io_schedule_timeout+0x140/0x140 [ 1235.537334] ? find_held_lock+0x2b/0x80 [ 1235.542438] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.548322] schedule+0xd4/0x260 [ 1235.552739] schedule_preempt_disabled+0x18/0x30 [ 1235.558719] __mutex_lock+0x6a3/0x2000 [ 1235.563721] ? threaded_store+0x132/0x220 [ 1235.569018] ? ww_mutex_lock+0x160/0x160 [ 1235.574216] ? selinux_inode_free_security+0x330/0x330 [ 1235.580785] ? cap_capable+0x1d6/0x3e0 [ 1235.585794] ? threaded_store+0x132/0x220 [ 1235.591092] threaded_store+0x132/0x220 [ 1235.596182] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.601479] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.606774] ? sysfs_kf_write+0x65/0x160 [ 1235.611976] ? sysfs_file_ops+0x140/0x140 [ 1235.617271] kernfs_fop_write_iter+0x335/0x510 [ 1235.623053] ? kernfs_ops+0xf0/0xf0 [ 1235.627764] new_sync_write+0x333/0x750 [ 1235.632858] ? __lock_acquire+0x508/0xc10 [ 1235.638153] ? new_sync_read+0x740/0x740 [ 1235.643355] ? lock_acquire.part.0+0xbc/0x260 [ 1235.649040] ? ksys_write+0x116/0x250 [ 1235.653950] vfs_write+0x657/0x9b0 [ 1235.658565] ksys_write+0x116/0x250 [ 1235.663277] ? __ia32_sys_read+0xc0/0xc0 [ 1235.668473] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.674062] ? rcu_is_watching+0x15/0xd0 [ 1235.679254] do_syscall_64+0xf3/0x650 [ 1235.684158] ? irq_exit_rcu+0x1a/0x30 [ 1235.689066] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.695526] RIP: 0033:0x7f832597b22e [ 1235.700337] RSP: 002b:00007ffcb9313f80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.709635] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f832597b22e [ 1235.718441] RDX: 0000000000000001 RSI: 0000559f91faba10 RDI: 0000000000000007 [ 1235.727245] RBP: 00007ffcb9313f90 R08: 0000000000000000 R09: 0000000000000000 [ 1235.736052] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83257f3390 [ 1235.744857] R13: 0000559f91faba10 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.126988] #2: ff11000121e8cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.138145] #3: ff11000121f01d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.148229] | [ 1236.150692] =============================================\x0a | [ 1268.249169] kworker/u130:2 (327) used greatest stack depth: 21456 bytes left [ 1358.362157] INFO: task python3:5889 blocked for more than 491 seconds. [ 1358.370305] Not tainted 7.1.0-rc1-kfng-gabaddbf07c5d #1 [ 1358.377553] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.387142] task:python3 state:D stack:25640 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080002 [ 1358.400343] Call Trace: [ 1358.403884] [ 1358.407034] __schedule+0xcba/0x1940 [ 1358.411854] ? io_schedule_timeout+0x140/0x140 [ 1358.417640] ? find_held_lock+0x2b/0x80 [ 1358.422744] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.428629] schedule+0xd4/0x260 [ 1358.433051] schedule_preempt_disabled+0x18/0x30 [ 1358.439028] __mutex_lock+0x6a3/0x2000 [ 1358.444033] ? threaded_store+0x132/0x220 [ 1358.449333] ? ww_mutex_lock+0x160/0x160 [ 1358.454524] ? selinux_inode_free_security+0x330/0x330 [ 1358.461094] ? cap_capable+0x1d6/0x3e0 [ 1358.466102] ? threaded_store+0x132/0x220 [ 1358.471400] threaded_store+0x132/0x220 [ 1358.476492] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.481790] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.487089] ? sysfs_kf_write+0x65/0x160 [ 1358.492289] ? sysfs_file_ops+0x140/0x140 [ 1358.497586] kernfs_fop_write_iter+0x335/0x510 [ 1358.503372] ? kernfs_ops+0xf0/0xf0 [ 1358.508085] new_sync_write+0x333/0x750 [ 1358.513187] ? __lock_acquire+0x508/0xc10 [ 1358.518482] ? new_sync_read+0x740/0x740 [ 1358.523686] ? lock_acquire.part.0+0xbc/0x260 [ 1358.529374] ? ksys_write+0x116/0x250 [ 1358.534286] vfs_write+0x657/0x9b0 [ 1358.538903] ksys_write+0x116/0x250 [ 1358.543616] ? __ia32_sys_read+0xc0/0xc0 [ 1358.548808] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.554389] ? rcu_is_watching+0x15/0xd0 [ 1358.559594] do_syscall_64+0xf3/0x650 [ 1358.564502] ? irq_exit_rcu+0x1a/0x30 [ 1358.569401] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.575871] RIP: 0033:0x7f832597b22e [ 1358.580680] RSP: 002b:00007ffcb9313f80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.589979] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f832597b22e [ 1358.598790] RDX: 0000000000000001 RSI: 0000559f91faba10 RDI: 0000000000000007 [ 1358.607599] RBP: 00007ffcb9313f90 R08: 0000000000000000 R09: 0000000000000000 [ 1358.616409] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83257f3390 [ 1358.625220] R13: 0000559f91faba10 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store