====================================== | [ 782.368043] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 782.370568] nipa-hw-worker: [5/43] Retrying drivers/net:napi_threaded.py | [ 782.526180] kselftest: Running tests in drivers/net [ 989.699620] INFO: task python3:5770 blocked for more than 122 seconds. [ 989.707853] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1 [ 989.715792] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.725384] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080000 [ 989.738591] Call Trace: [ 989.742132] [ 989.745285] __schedule+0xcba/0x1940 [ 989.750105] ? io_schedule_timeout+0x140/0x140 [ 989.755891] ? find_held_lock+0x2b/0x80 [ 989.760998] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.766883] schedule+0xd4/0x260 [ 989.771302] schedule_preempt_disabled+0x18/0x30 [ 989.777281] __mutex_lock+0x6a3/0x2000 [ 989.782288] ? threaded_store+0x132/0x220 [ 989.787589] ? ww_mutex_lock+0x160/0x160 [ 989.792787] ? selinux_inode_free_security+0x330/0x330 [ 989.799348] ? cap_capable+0x1d6/0x3e0 [ 989.804357] ? threaded_store+0x132/0x220 [ 989.809652] threaded_store+0x132/0x220 [ 989.814753] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.820054] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.825353] ? sysfs_kf_write+0x65/0x160 [ 989.830547] ? sysfs_file_ops+0x140/0x140 [ 989.835844] kernfs_fop_write_iter+0x335/0x510 [ 989.841622] ? kernfs_ops+0xf0/0xf0 [ 989.846332] new_sync_write+0x333/0x750 [ 989.851436] ? __lock_acquire+0x508/0xc10 [ 989.856736] ? new_sync_read+0x740/0x740 [ 989.861937] ? lock_acquire.part.0+0xbc/0x260 [ 989.867624] ? ksys_write+0x116/0x250 [ 989.872537] vfs_write+0x657/0x9b0 [ 989.877152] ksys_write+0x116/0x250 [ 989.881856] ? __ia32_sys_read+0xc0/0xc0 [ 989.887053] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.892644] ? rcu_is_watching+0x15/0xd0 [ 989.897844] do_syscall_64+0xf3/0x650 [ 989.902754] ? trace_hardirqs_off+0xd/0x30 [ 989.908151] ? exc_page_fault+0xda/0xf0 [ 989.913256] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.919723] RIP: 0033:0x7f66b1cc622e [ 989.924533] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.933821] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e [ 989.942628] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007 [ 989.951429] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000 [ 989.960239] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390 [ 989.969054] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003 | [ 990.372550] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.383511] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.394662] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.404750] | [ 990.407215] =============================================\x0a [ 1112.579716] INFO: task python3:5770 blocked for more than 245 seconds. [ 1112.587859] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1 [ 1112.595109] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.604699] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080000 [ 1112.617908] Call Trace: [ 1112.621450] [ 1112.624603] __schedule+0xcba/0x1940 [ 1112.629421] ? io_schedule_timeout+0x140/0x140 [ 1112.635207] ? find_held_lock+0x2b/0x80 [ 1112.640315] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.646202] schedule+0xd4/0x260 [ 1112.650624] schedule_preempt_disabled+0x18/0x30 [ 1112.656605] __mutex_lock+0x6a3/0x2000 [ 1112.661612] ? threaded_store+0x132/0x220 [ 1112.666913] ? ww_mutex_lock+0x160/0x160 [ 1112.672112] ? selinux_inode_free_security+0x330/0x330 [ 1112.678674] ? cap_capable+0x1d6/0x3e0 [ 1112.683685] ? threaded_store+0x132/0x220 [ 1112.688984] threaded_store+0x132/0x220 [ 1112.694088] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.699389] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.704690] ? sysfs_kf_write+0x65/0x160 [ 1112.709891] ? sysfs_file_ops+0x140/0x140 [ 1112.715189] kernfs_fop_write_iter+0x335/0x510 [ 1112.720974] ? kernfs_ops+0xf0/0xf0 [ 1112.725685] new_sync_write+0x333/0x750 [ 1112.730790] ? __lock_acquire+0x508/0xc10 [ 1112.736089] ? new_sync_read+0x740/0x740 [ 1112.741294] ? lock_acquire.part.0+0xbc/0x260 [ 1112.746980] ? ksys_write+0x116/0x250 [ 1112.751891] vfs_write+0x657/0x9b0 [ 1112.756506] ksys_write+0x116/0x250 [ 1112.761209] ? __ia32_sys_read+0xc0/0xc0 [ 1112.766409] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.771990] ? rcu_is_watching+0x15/0xd0 [ 1112.777183] do_syscall_64+0xf3/0x650 [ 1112.782091] ? trace_hardirqs_off+0xd/0x30 [ 1112.787488] ? exc_page_fault+0xda/0xf0 [ 1112.792592] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.799061] RIP: 0033:0x7f66b1cc622e [ 1112.803871] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.813173] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e [ 1112.821982] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007 [ 1112.830793] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.839601] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390 [ 1112.848410] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.247483] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.257572] 2 locks held by systemd/6823: | [ 1113.262869] | [ 1113.265339] =============================================\x0a | [ 1210.884555] kworker/u130:6 (850) used greatest stack depth: 21456 bytes left [ 1235.461831] INFO: task python3:5770 blocked for more than 368 seconds. [ 1235.469980] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1 [ 1235.477230] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.486823] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080002 [ 1235.500030] Call Trace: [ 1235.503570] [ 1235.506723] __schedule+0xcba/0x1940 [ 1235.511542] ? io_schedule_timeout+0x140/0x140 [ 1235.517328] ? find_held_lock+0x2b/0x80 [ 1235.522435] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.528320] schedule+0xd4/0x260 [ 1235.532741] schedule_preempt_disabled+0x18/0x30 [ 1235.538723] __mutex_lock+0x6a3/0x2000 [ 1235.543731] ? threaded_store+0x132/0x220 [ 1235.549033] ? ww_mutex_lock+0x160/0x160 [ 1235.554232] ? selinux_inode_free_security+0x330/0x330 [ 1235.560801] ? cap_capable+0x1d6/0x3e0 [ 1235.565811] ? threaded_store+0x132/0x220 [ 1235.571108] threaded_store+0x132/0x220 [ 1235.576212] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.581510] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.586813] ? sysfs_kf_write+0x65/0x160 [ 1235.592016] ? sysfs_file_ops+0x140/0x140 [ 1235.597313] kernfs_fop_write_iter+0x335/0x510 [ 1235.603090] ? kernfs_ops+0xf0/0xf0 [ 1235.607801] new_sync_write+0x333/0x750 [ 1235.612905] ? __lock_acquire+0x508/0xc10 [ 1235.618201] ? new_sync_read+0x740/0x740 [ 1235.623403] ? lock_acquire.part.0+0xbc/0x260 [ 1235.629089] ? ksys_write+0x116/0x250 [ 1235.633998] vfs_write+0x657/0x9b0 [ 1235.638615] ksys_write+0x116/0x250 [ 1235.643328] ? __ia32_sys_read+0xc0/0xc0 [ 1235.648529] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.654109] ? rcu_is_watching+0x15/0xd0 [ 1235.659304] do_syscall_64+0xf3/0x650 [ 1235.664214] ? trace_hardirqs_off+0xd/0x30 [ 1235.669610] ? exc_page_fault+0xda/0xf0 [ 1235.674704] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.681166] RIP: 0033:0x7f66b1cc622e [ 1235.685976] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.695266] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e [ 1235.704074] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007 [ 1235.712874] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.721684] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390 [ 1235.730494] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.107379] #1: ff110001cfb5b280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.118333] #2: ff1100011c394b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.129494] #3: ff11000124239d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.139587] | [ 1236.142054] =============================================\x0a [ 1358.342954] INFO: task python3:5770 blocked for more than 491 seconds. [ 1358.351121] Not tainted 7.1.0-rc1-qxsy-g426c17c0a72a #1 [ 1358.358392] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.368004] task:python3 state:D stack:25608 pid:5770 tgid:5770 ppid:5769 task_flags:0x400100 flags:0x00080002 [ 1358.381234] Call Trace: [ 1358.384777] [ 1358.388475] __schedule+0xcba/0x1940 [ 1358.393305] ? io_schedule_timeout+0x140/0x140 [ 1358.399091] ? find_held_lock+0x2b/0x80 [ 1358.404196] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.410080] schedule+0xd4/0x260 [ 1358.414500] schedule_preempt_disabled+0x18/0x30 [ 1358.420471] __mutex_lock+0x6a3/0x2000 [ 1358.425465] ? threaded_store+0x132/0x220 [ 1358.430764] ? ww_mutex_lock+0x160/0x160 [ 1358.435953] ? selinux_inode_free_security+0x330/0x330 [ 1358.442540] ? cap_capable+0x1d6/0x3e0 [ 1358.447585] ? threaded_store+0x132/0x220 [ 1358.452885] threaded_store+0x132/0x220 [ 1358.457990] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.463289] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.468589] ? sysfs_kf_write+0x65/0x160 [ 1358.473797] ? sysfs_file_ops+0x140/0x140 [ 1358.479100] kernfs_fop_write_iter+0x335/0x510 [ 1358.484890] ? kernfs_ops+0xf0/0xf0 [ 1358.489604] new_sync_write+0x333/0x750 [ 1358.494712] ? __lock_acquire+0x508/0xc10 [ 1358.500014] ? new_sync_read+0x740/0x740 [ 1358.505218] ? lock_acquire.part.0+0xbc/0x260 [ 1358.510908] ? ksys_write+0x116/0x250 [ 1358.515823] vfs_write+0x657/0x9b0 [ 1358.520443] ksys_write+0x116/0x250 [ 1358.525226] ? __ia32_sys_read+0xc0/0xc0 [ 1358.530430] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.536018] ? rcu_is_watching+0x15/0xd0 [ 1358.541213] do_syscall_64+0xf3/0x650 [ 1358.546124] ? trace_hardirqs_off+0xd/0x30 [ 1358.551520] ? exc_page_fault+0xda/0xf0 [ 1358.556622] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.563083] RIP: 0033:0x7f66b1cc622e [ 1358.567896] RSP: 002b:00007fff9e5044b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.577198] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f66b1cc622e [ 1358.586009] RDX: 0000000000000001 RSI: 0000563e2b715a10 RDI: 0000000000000007 [ 1358.594819] RBP: 00007fff9e5044c0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.603628] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f66b1b3e390 [ 1358.612436] R13: 0000563e2b715a10 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store