====================================== | [ 781.416100] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 781.418431] nipa-hw-worker: [4/40] Retrying drivers/net:napi_threaded.py | [ 781.573929] kselftest: Running tests in drivers/net [ 989.674660] INFO: task python3:5591 blocked for more than 122 seconds. [ 989.682892] Not tainted 7.0.0-rc6-ekaz-g2729b1c38dea #1 [ 989.690142] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.699732] task:python3 state:D stack:25336 pid:5591 tgid:5591 ppid:5590 task_flags:0x400100 flags:0x00080000 [ 989.712942] Call Trace: [ 989.712945] [ 989.712948] __schedule+0xae3/0x14d0 [ 989.712960] ? io_schedule_timeout+0x140/0x140 [ 989.712963] ? find_held_lock+0x2b/0x80 [ 989.712970] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.741293] schedule+0xd4/0x260 [ 989.745710] schedule_preempt_disabled+0x18/0x30 [ 989.751689] __mutex_lock+0x6b2/0x1ee0 [ 989.756693] ? rcu_is_watching+0x15/0xd0 [ 989.761891] ? threaded_store+0x132/0x220 [ 989.767194] ? ww_mutex_lock+0x160/0x160 [ 989.772394] ? selinux_inode_free_security+0x330/0x330 [ 989.778964] ? cap_capable+0x1ed/0x3f0 [ 989.783977] ? threaded_store+0x132/0x220 [ 989.789277] threaded_store+0x132/0x220 [ 989.794381] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.799681] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.804978] ? sysfs_kf_write+0x65/0x160 [ 989.810179] ? sysfs_file_ops+0x140/0x140 [ 989.815476] kernfs_fop_write_iter+0x335/0x510 [ 989.821261] ? kernfs_ops+0xf0/0xf0 [ 989.825974] new_sync_write+0x333/0x750 [ 989.831079] ? __lock_acquire+0x508/0xc10 [ 989.836376] ? new_sync_read+0x740/0x740 [ 989.841569] ? lock_acquire.part.0+0xbc/0x260 [ 989.847256] ? ksys_write+0x116/0x250 [ 989.852156] vfs_write+0x657/0x9b0 [ 989.856769] ksys_write+0x116/0x250 [ 989.861479] ? __ia32_sys_read+0xc0/0xc0 [ 989.866681] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.872272] ? rcu_is_watching+0x15/0xd0 [ 989.877475] do_syscall_64+0xf3/0x5e0 [ 989.882381] ? trace_hardirqs_off+0xd/0x30 [ 989.887776] ? exc_page_fault+0xda/0xf0 [ 989.892878] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.899345] RIP: 0033:0x7f5c454f022e [ 989.904154] RSP: 002b:00007fffa57b7940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.913455] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c454f022e [ 989.922262] RDX: 0000000000000001 RSI: 000055a11ef63f40 RDI: 0000000000000007 [ 989.931070] RBP: 00007fffa57b7950 R08: 0000000000000000 R09: 0000000000000000 [ 989.939881] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c45368390 [ 989.948694] R13: 000055a11ef63f40 R14: 0000000000000007 R15: 0000000000000003 | [ 990.390036] #2: ffffffff9b937108 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0 | [ 990.400706] #3: ffffffff9b768b50 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0 | [ 990.412342] #4: ffffffff9b936e10 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0 | [ 990.424773] | [ 990.427239] =============================================\x0a [ 1112.554839] INFO: task python3:5591 blocked for more than 245 seconds. [ 1112.562987] Not tainted 7.0.0-rc6-ekaz-g2729b1c38dea #1 [ 1112.570240] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.579828] task:python3 state:D stack:25336 pid:5591 tgid:5591 ppid:5590 task_flags:0x400100 flags:0x00080000 [ 1112.593025] Call Trace: [ 1112.596563] [ 1112.599714] __schedule+0xae3/0x14d0 [ 1112.604530] ? io_schedule_timeout+0x140/0x140 [ 1112.610314] ? find_held_lock+0x2b/0x80 [ 1112.615420] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.621297] schedule+0xd4/0x260 [ 1112.625717] schedule_preempt_disabled+0x18/0x30 [ 1112.631696] __mutex_lock+0x6b2/0x1ee0 [ 1112.636703] ? rcu_is_watching+0x15/0xd0 [ 1112.641902] ? threaded_store+0x132/0x220 [ 1112.647204] ? ww_mutex_lock+0x160/0x160 [ 1112.652405] ? selinux_inode_free_security+0x330/0x330 [ 1112.658977] ? cap_capable+0x1ed/0x3f0 [ 1112.663991] ? threaded_store+0x132/0x220 [ 1112.669289] threaded_store+0x132/0x220 [ 1112.674391] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.679683] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.684981] ? sysfs_kf_write+0x65/0x160 [ 1112.690182] ? sysfs_file_ops+0x140/0x140 [ 1112.695476] kernfs_fop_write_iter+0x335/0x510 [ 1112.701263] ? kernfs_ops+0xf0/0xf0 [ 1112.705975] new_sync_write+0x333/0x750 [ 1112.711077] ? __lock_acquire+0x508/0xc10 [ 1112.716374] ? new_sync_read+0x740/0x740 [ 1112.721581] ? lock_acquire.part.0+0xbc/0x260 [ 1112.727267] ? ksys_write+0x116/0x250 [ 1112.732176] vfs_write+0x657/0x9b0 [ 1112.736792] ksys_write+0x116/0x250 [ 1112.741503] ? __ia32_sys_read+0xc0/0xc0 [ 1112.746702] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.752291] ? rcu_is_watching+0x15/0xd0 [ 1112.757492] do_syscall_64+0xf3/0x5e0 [ 1112.762398] ? trace_hardirqs_off+0xd/0x30 [ 1112.767791] ? exc_page_fault+0xda/0xf0 [ 1112.772890] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.779359] RIP: 0033:0x7f5c454f022e [ 1112.784167] RSP: 002b:00007fffa57b7940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.793464] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c454f022e [ 1112.802264] RDX: 0000000000000001 RSI: 000055a11ef63f40 RDI: 0000000000000007 [ 1112.811062] RBP: 00007fffa57b7950 R08: 0000000000000000 R09: 0000000000000000 [ 1112.819873] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c45368390 [ 1112.828682] R13: 000055a11ef63f40 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.205593] #1: ff110001dbd88888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.216554] #2: ff110001213790f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.227714] #3: ff110001213e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.237807] | [ 1113.240287] =============================================\x0a [ 1235.435844] INFO: task python3:5591 blocked for more than 368 seconds. [ 1235.443995] Not tainted 7.0.0-rc6-ekaz-g2729b1c38dea #1 [ 1235.451246] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.460837] task:python3 state:D stack:25336 pid:5591 tgid:5591 ppid:5590 task_flags:0x400100 flags:0x00080002 [ 1235.474041] Call Trace: [ 1235.477580] [ 1235.480732] __schedule+0xae3/0x14d0 [ 1235.485549] ? io_schedule_timeout+0x140/0x140 [ 1235.491334] ? find_held_lock+0x2b/0x80 [ 1235.496441] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.502325] schedule+0xd4/0x260 [ 1235.506747] schedule_preempt_disabled+0x18/0x30 [ 1235.512727] __mutex_lock+0x6b2/0x1ee0 [ 1235.517726] ? rcu_is_watching+0x15/0xd0 [ 1235.522926] ? threaded_store+0x132/0x220 [ 1235.528229] ? ww_mutex_lock+0x160/0x160 [ 1235.533427] ? selinux_inode_free_security+0x330/0x330 [ 1235.539992] ? cap_capable+0x1ed/0x3f0 [ 1235.545000] ? threaded_store+0x132/0x220 [ 1235.550301] threaded_store+0x132/0x220 [ 1235.555403] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.560701] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.566000] ? sysfs_kf_write+0x65/0x160 [ 1235.571199] ? sysfs_file_ops+0x140/0x140 [ 1235.576495] kernfs_fop_write_iter+0x335/0x510 [ 1235.582281] ? kernfs_ops+0xf0/0xf0 [ 1235.587058] new_sync_write+0x333/0x750 [ 1235.592164] ? __lock_acquire+0x508/0xc10 [ 1235.597460] ? new_sync_read+0x740/0x740 [ 1235.602734] ? lock_acquire.part.0+0xbc/0x260 [ 1235.608422] ? ksys_write+0x116/0x250 [ 1235.613335] vfs_write+0x657/0x9b0 [ 1235.617951] ksys_write+0x116/0x250 [ 1235.622666] ? __ia32_sys_read+0xc0/0xc0 [ 1235.627863] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.633455] ? rcu_is_watching+0x15/0xd0 [ 1235.638658] do_syscall_64+0xf3/0x5e0 [ 1235.643567] ? trace_hardirqs_off+0xd/0x30 [ 1235.648962] ? exc_page_fault+0xda/0xf0 [ 1235.654065] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.660534] RIP: 0033:0x7f5c454f022e [ 1235.665418] RSP: 002b:00007fffa57b7940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.674717] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c454f022e [ 1235.683528] RDX: 0000000000000001 RSI: 000055a11ef63f40 RDI: 0000000000000007 [ 1235.692338] RBP: 00007fffa57b7950 R08: 0000000000000000 R09: 0000000000000000 [ 1235.701147] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c45368390 [ 1235.709955] R13: 000055a11ef63f40 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.086919] #1: ff110001dbd88888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.097884] #2: ff110001213790f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.109041] #3: ff110001213e1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.119126] | [ 1236.121592] =============================================\x0a [ 1358.317946] INFO: task python3:5591 blocked for more than 491 seconds. [ 1358.326093] Not tainted 7.0.0-rc6-ekaz-g2729b1c38dea #1 [ 1358.333344] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.342935] task:python3 state:D stack:25336 pid:5591 tgid:5591 ppid:5590 task_flags:0x400100 flags:0x00080002 [ 1358.356142] Call Trace: [ 1358.359683] [ 1358.362834] __schedule+0xae3/0x14d0 [ 1358.367653] ? io_schedule_timeout+0x140/0x140 [ 1358.373439] ? find_held_lock+0x2b/0x80 [ 1358.378545] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.384428] schedule+0xd4/0x260 [ 1358.388848] schedule_preempt_disabled+0x18/0x30 [ 1358.394820] __mutex_lock+0x6b2/0x1ee0 [ 1358.399827] ? rcu_is_watching+0x15/0xd0 [ 1358.405028] ? threaded_store+0x132/0x220 [ 1358.410331] ? ww_mutex_lock+0x160/0x160 [ 1358.415530] ? selinux_inode_free_security+0x330/0x330 [ 1358.422103] ? cap_capable+0x1ed/0x3f0 [ 1358.427111] ? threaded_store+0x132/0x220 [ 1358.432407] threaded_store+0x132/0x220 [ 1358.437510] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.442811] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.448112] ? sysfs_kf_write+0x65/0x160 [ 1358.453313] ? sysfs_file_ops+0x140/0x140 [ 1358.458608] kernfs_fop_write_iter+0x335/0x510 [ 1358.464396] ? kernfs_ops+0xf0/0xf0 [ 1358.469106] new_sync_write+0x333/0x750 [ 1358.474209] ? __lock_acquire+0x508/0xc10 [ 1358.479505] ? new_sync_read+0x740/0x740 [ 1358.484705] ? lock_acquire.part.0+0xbc/0x260 [ 1358.490381] ? ksys_write+0x116/0x250 [ 1358.495294] vfs_write+0x657/0x9b0 [ 1358.499910] ksys_write+0x116/0x250 [ 1358.504623] ? __ia32_sys_read+0xc0/0xc0 [ 1358.509823] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.515406] ? rcu_is_watching+0x15/0xd0 [ 1358.520608] do_syscall_64+0xf3/0x5e0 [ 1358.525516] ? trace_hardirqs_off+0xd/0x30 [ 1358.530911] ? exc_page_fault+0xda/0xf0 [ 1358.536013] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.542482] RIP: 0033:0x7f5c454f022e [ 1358.547294] RSP: 002b:00007fffa57b7940 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.556593] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f5c454f022e [ 1358.565403] RDX: 0000000000000001 RSI: 000055a11ef63f40 RDI: 0000000000000007 [ 1358.574213] RBP: 00007fffa57b7950 R08: 0000000000000000 R09: 0000000000000000 [ 1358.583023] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f5c45368390 [ 1358.591831] R13: 000055a11ef63f40 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store