[ 1923.776258][ T12] ------------[ cut here ]------------ [ 1923.776613][ T12] conntrack cleanup blocked for 60s [ 1923.776616][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#2: kworker/u16:0/12 [ 1923.777088][ T12] Modules linked in: nf_flow_table(+) xt_conntrack drop_monitor nft_chain_nat xt_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables cls_bpf netdevsim psample cls_matchall act_gact cls_flower sch_ingress vxlan [ 1923.777743][ T12] CPU: 2 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 1923.778041][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1923.778269][ T12] Workqueue: netns cleanup_net [ 1923.778451][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack] [ 1923.778696][ T12] Code: 00 48 8b 54 24 18 48 8b 05 c3 28 e8 d9 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 ae d7 d8 e9 25 fd ff ff 48 8d 3d 56 76 da ff <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df [ 1923.779169][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010297 [ 1923.779383][ T12] RAX: 000000010018c51b RBX: ffa00000000c7af8 RCX: 0000000000000001 [ 1923.779607][ T12] RDX: 000000010018c51a RSI: 0000000000000004 RDI: ffffffffc0336030 [ 1923.779832][ T12] RBP: 0000000000000001 R08: ffffffffc058e7aa R09: ffe21c0003cfaf54 [ 1923.780059][ T12] R10: ffe21c0003cfaf55 R11: 0000000000000001 R12: dffffc0000000000 [ 1923.780312][ T12] R13: ff1100001e7d7aa0 R14: fffffbfff8068607 R15: ff1100001da59300 [ 1923.780536][ T12] FS: 0000000000000000(0000) GS:ff110000d090b000(0000) knlGS:0000000000000000 [ 1923.780788][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1923.780980][ T12] CR2: 00007ffe6d24fe10 CR3: 0000000016548006 CR4: 0000000000771ef0 [ 1923.781375][ T12] PKRU: 55555554 [ 1923.781512][ T12] Call Trace: [ 1923.781653][ T12] [ 1923.781765][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 1923.781956][ T12] ? kfree+0x119/0x580 [ 1923.782090][ T12] ? lock_acquire+0x10a/0x150 [ 1923.782272][ T12] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack] [ 1923.782466][ T12] ops_undo_list+0x2d7/0x8f0 [ 1923.782628][ T12] ? netns_install+0x280/0x280 [ 1923.782790][ T12] cleanup_net+0x3bc/0x890 [ 1923.782949][ T12] ? process_one_work+0xd16/0x1390 [ 1923.783111][ T12] ? net_passive_dec+0x190/0x190 [ 1923.783289][ T12] ? rcu_is_watching+0x15/0xd0 [ 1923.783447][ T12] ? process_one_work+0xd16/0x1390 [ 1923.783610][ T12] ? lock_acquire+0x10a/0x150 [ 1923.783770][ T12] ? rcu_is_watching+0x15/0xd0 [ 1923.783929][ T12] process_one_work+0xd57/0x1390 [ 1923.784089][ T12] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1923.784263][ T12] ? lock_acquire.part.0+0xbc/0x260 [ 1923.784423][ T12] ? assign_work+0x152/0x380 [ 1923.784581][ T12] worker_thread+0x4d6/0xd40 [ 1923.784741][ T12] ? process_one_work+0x1390/0x1390 [ 1923.784901][ T12] kthread+0x355/0x5b0 [ 1923.785033][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1923.785193][ T12] ? __lock_release.isra.0+0x59/0x170 [ 1923.785364][ T12] ? rcu_is_watching+0x15/0xd0 [ 1923.785521][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1923.785678][ T12] ret_from_fork+0x3fb/0x510 [ 1923.785836][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 1923.786025][ T12] ? __switch_to+0x602/0xd00 [ 1923.786190][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1923.786362][ T12] ret_from_fork_asm+0x11/0x20 [ 1923.786525][ T12] [ 1923.786657][ T12] irq event stamp: 32564439 [ 1923.786815][ T12] hardirqs last enabled at (32564449): [] __up_console_sem+0x5a/0x70 [ 1923.787056][ T12] hardirqs last disabled at (32564458): [] __up_console_sem+0x3f/0x70 [ 1923.787314][ T12] softirqs last enabled at (32563958): [] handle_softirqs+0x56f/0x840 [ 1923.787555][ T12] softirqs last disabled at (32563951): [] irq_exit_rcu+0xa2/0xf0 [ 1923.787793][ T12] ---[ end trace 0000000000000000 ]--- [ 2090.406264][ T44] INFO: task modprobe:30670 blocked for more than 122 seconds. [ 2090.406558][ T44] Tainted: G W 6.18.0-virtme #1 [ 2090.406704][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2090.406899][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2090.407171][ T44] Call Trace: [ 2090.407280][ T44] [ 2090.407346][ T44] __schedule+0xae2/0x1720 [ 2090.407465][ T44] ? io_schedule_timeout+0x130/0x130 [ 2090.407577][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.407686][ T44] schedule+0xd4/0x260 [ 2090.407770][ T44] schedule_preempt_disabled+0x18/0x30 [ 2090.407911][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2090.408027][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2090.408137][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.408251][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2090.408359][ T44] ? register_pernet_subsys+0x19/0x40 [ 2090.408466][ T44] ? lock_acquire+0x10a/0x150 [ 2090.408580][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2090.408745][ T44] down_write+0x1c6/0x1f0 [ 2090.408825][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2090.408976][ T44] register_pernet_subsys+0x19/0x40 [ 2090.409091][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2090.409237][ T44] do_one_initcall+0xa3/0x2e0 [ 2090.409346][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2090.409481][ T44] ? kasan_unpoison+0x44/0x70 [ 2090.409589][ T44] do_init_module+0x27b/0x820 [ 2090.409696][ T44] ? free_module+0x450/0x450 [ 2090.409900][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2090.410015][ T44] init_module_from_file+0x15d/0x180 [ 2090.410121][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2090.410237][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.410346][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2090.410447][ T44] idempotent_init_module+0x226/0x760 [ 2090.410551][ T44] ? init_module_from_file+0x180/0x180 [ 2090.410657][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.410765][ T44] ? cap_capable+0x181/0x3f0 [ 2090.410867][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2090.410972][ T44] do_syscall_64+0xbd/0xfc0 [ 2090.411075][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2090.411203][ T44] RIP: 0033:0x7f86c04f934d [ 2090.411316][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2090.411472][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2090.411624][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2090.411775][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2090.411931][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2090.412082][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2090.412248][ T44] [ 2090.412331][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2090.412494][ T44] [ 2090.412494][ T44] Showing all locks held in the system: [ 2090.412636][ T44] 4 locks held by kworker/u16:0/12: [ 2090.412735][ T44] 1 lock held by khungtaskd/44: [ 2090.412827][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2090.413026][ T44] 2 locks held by kworker/u17:3/1799: [ 2090.413121][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2090.413405][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2090.413627][ T44] 1 lock held by modprobe/30670: [ 2090.413722][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2090.413915][ T44] [ 2090.413967][ T44] ============================================= [ 2090.413967][ T44] [ 2213.286283][ T44] INFO: task modprobe:30670 blocked for more than 245 seconds. [ 2213.286568][ T44] Tainted: G W 6.18.0-virtme #1 [ 2213.286727][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2213.286938][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2213.287239][ T44] Call Trace: [ 2213.287343][ T44] [ 2213.287411][ T44] __schedule+0xae2/0x1720 [ 2213.287547][ T44] ? io_schedule_timeout+0x130/0x130 [ 2213.287668][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.287783][ T44] schedule+0xd4/0x260 [ 2213.287869][ T44] schedule_preempt_disabled+0x18/0x30 [ 2213.287976][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2213.288090][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2213.288199][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.288312][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2213.288420][ T44] ? register_pernet_subsys+0x19/0x40 [ 2213.288539][ T44] ? lock_acquire+0x10a/0x150 [ 2213.288651][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2213.288813][ T44] down_write+0x1c6/0x1f0 [ 2213.288895][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2213.289034][ T44] register_pernet_subsys+0x19/0x40 [ 2213.289140][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2213.289294][ T44] do_one_initcall+0xa3/0x2e0 [ 2213.289424][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2213.289558][ T44] ? kasan_unpoison+0x44/0x70 [ 2213.289672][ T44] do_init_module+0x27b/0x820 [ 2213.289780][ T44] ? free_module+0x450/0x450 [ 2213.289883][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2213.289986][ T44] init_module_from_file+0x15d/0x180 [ 2213.290099][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2213.290211][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.290318][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2213.290423][ T44] idempotent_init_module+0x226/0x760 [ 2213.290527][ T44] ? init_module_from_file+0x180/0x180 [ 2213.290634][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.290734][ T44] ? cap_capable+0x181/0x3f0 [ 2213.290843][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2213.290945][ T44] do_syscall_64+0xbd/0xfc0 [ 2213.291048][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2213.291172][ T44] RIP: 0033:0x7f86c04f934d [ 2213.291291][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2213.291445][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2213.291604][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2213.291754][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2213.291904][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2213.292059][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2213.292216][ T44] [ 2213.292297][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2213.292461][ T44] [ 2213.292461][ T44] Showing all locks held in the system: [ 2213.292605][ T44] 4 locks held by kworker/u16:0/12: [ 2213.292706][ T44] 1 lock held by khungtaskd/44: [ 2213.292800][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2213.293000][ T44] 2 locks held by kworker/u17:3/1799: [ 2213.293093][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2213.293372][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2213.293591][ T44] 1 lock held by modprobe/30670: [ 2213.293695][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2213.293885][ T44] [ 2213.293933][ T44] ============================================= [ 2213.293933][ T44] [ 2336.166269][ T44] INFO: task modprobe:30670 blocked for more than 368 seconds. [ 2336.166520][ T44] Tainted: G W 6.18.0-virtme #1 [ 2336.166674][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2336.166873][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2336.167131][ T44] Call Trace: [ 2336.167229][ T44] [ 2336.167292][ T44] __schedule+0xae2/0x1720 [ 2336.167417][ T44] ? io_schedule_timeout+0x130/0x130 [ 2336.167540][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.167661][ T44] schedule+0xd4/0x260 [ 2336.167750][ T44] schedule_preempt_disabled+0x18/0x30 [ 2336.167865][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2336.167972][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2336.168081][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.168194][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2336.168313][ T44] ? register_pernet_subsys+0x19/0x40 [ 2336.168421][ T44] ? lock_acquire+0x10a/0x150 [ 2336.168529][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2336.168687][ T44] down_write+0x1c6/0x1f0 [ 2336.168768][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2336.168900][ T44] register_pernet_subsys+0x19/0x40 [ 2336.169005][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2336.169139][ T44] do_one_initcall+0xa3/0x2e0 [ 2336.169249][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2336.169384][ T44] ? kasan_unpoison+0x44/0x70 [ 2336.169491][ T44] do_init_module+0x27b/0x820 [ 2336.169595][ T44] ? free_module+0x450/0x450 [ 2336.169698][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2336.169811][ T44] init_module_from_file+0x15d/0x180 [ 2336.169910][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2336.170014][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.170112][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2336.170210][ T44] idempotent_init_module+0x226/0x760 [ 2336.170319][ T44] ? init_module_from_file+0x180/0x180 [ 2336.170423][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.170521][ T44] ? cap_capable+0x181/0x3f0 [ 2336.170621][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2336.170719][ T44] do_syscall_64+0xbd/0xfc0 [ 2336.170819][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2336.170941][ T44] RIP: 0033:0x7f86c04f934d [ 2336.171047][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2336.171203][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2336.171358][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2336.171506][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2336.171652][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2336.171803][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2336.171954][ T44] [ 2336.172028][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2336.172183][ T44] [ 2336.172183][ T44] Showing all locks held in the system: [ 2336.172330][ T44] 4 locks held by kworker/u16:0/12: [ 2336.172425][ T44] 1 lock held by khungtaskd/44: [ 2336.172524][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2336.172717][ T44] 2 locks held by kworker/u17:3/1799: [ 2336.172812][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2336.172997][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2336.173212][ T44] 1 lock held by modprobe/30670: [ 2336.173314][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2336.173503][ T44] [ 2336.173550][ T44] ============================================= [ 2336.173550][ T44] [ 2459.046255][ T44] INFO: task modprobe:30670 blocked for more than 491 seconds. [ 2459.046495][ T44] Tainted: G W 6.18.0-virtme #1 [ 2459.046643][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2459.046843][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2459.047110][ T44] Call Trace: [ 2459.047198][ T44] [ 2459.047271][ T44] __schedule+0xae2/0x1720 [ 2459.047389][ T44] ? io_schedule_timeout+0x130/0x130 [ 2459.047500][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.047617][ T44] schedule+0xd4/0x260 [ 2459.047709][ T44] schedule_preempt_disabled+0x18/0x30 [ 2459.047822][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2459.047932][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2459.048049][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.048160][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2459.048274][ T44] ? register_pernet_subsys+0x19/0x40 [ 2459.048379][ T44] ? lock_acquire+0x10a/0x150 [ 2459.048485][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2459.048642][ T44] down_write+0x1c6/0x1f0 [ 2459.048725][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2459.048861][ T44] register_pernet_subsys+0x19/0x40 [ 2459.048972][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2459.049109][ T44] do_one_initcall+0xa3/0x2e0 [ 2459.049225][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2459.049353][ T44] ? kasan_unpoison+0x44/0x70 [ 2459.049455][ T44] do_init_module+0x27b/0x820 [ 2459.049570][ T44] ? free_module+0x450/0x450 [ 2459.049674][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2459.049780][ T44] init_module_from_file+0x15d/0x180 [ 2459.049883][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2459.049989][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.050088][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2459.050189][ T44] idempotent_init_module+0x226/0x760 [ 2459.050300][ T44] ? init_module_from_file+0x180/0x180 [ 2459.050402][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.050501][ T44] ? cap_capable+0x181/0x3f0 [ 2459.050602][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2459.050701][ T44] do_syscall_64+0xbd/0xfc0 [ 2459.050801][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2459.050923][ T44] RIP: 0033:0x7f86c04f934d [ 2459.051030][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2459.051181][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2459.051332][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2459.051483][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2459.051635][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2459.051786][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2459.051939][ T44] [ 2459.052011][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2459.052167][ T44] [ 2459.052167][ T44] Showing all locks held in the system: [ 2459.052322][ T44] 4 locks held by kworker/u16:0/12: [ 2459.052419][ T44] 1 lock held by khungtaskd/44: [ 2459.052511][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2459.052704][ T44] 2 locks held by kworker/u17:3/1799: [ 2459.052798][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2459.052989][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2459.053205][ T44] 1 lock held by modprobe/30670: [ 2459.053313][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2459.053500][ T44] [ 2459.053548][ T44] ============================================= [ 2459.053548][ T44] [ 2581.926264][ T44] INFO: task modprobe:30670 blocked for more than 614 seconds. [ 2581.926501][ T44] Tainted: G W 6.18.0-virtme #1 [ 2581.926648][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2581.926848][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2581.927123][ T44] Call Trace: [ 2581.927216][ T44] [ 2581.927294][ T44] __schedule+0xae2/0x1720 [ 2581.927409][ T44] ? io_schedule_timeout+0x130/0x130 [ 2581.927521][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.927630][ T44] schedule+0xd4/0x260 [ 2581.927714][ T44] schedule_preempt_disabled+0x18/0x30 [ 2581.927826][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2581.927941][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2581.928056][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.928173][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2581.928287][ T44] ? register_pernet_subsys+0x19/0x40 [ 2581.928399][ T44] ? lock_acquire+0x10a/0x150 [ 2581.928505][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2581.928667][ T44] down_write+0x1c6/0x1f0 [ 2581.928747][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2581.928877][ T44] register_pernet_subsys+0x19/0x40 [ 2581.928979][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2581.929120][ T44] do_one_initcall+0xa3/0x2e0 [ 2581.929229][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2581.929370][ T44] ? kasan_unpoison+0x44/0x70 [ 2581.929471][ T44] do_init_module+0x27b/0x820 [ 2581.929575][ T44] ? free_module+0x450/0x450 [ 2581.929675][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2581.929790][ T44] init_module_from_file+0x15d/0x180 [ 2581.929894][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2581.930004][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.930117][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2581.930225][ T44] idempotent_init_module+0x226/0x760 [ 2581.930328][ T44] ? init_module_from_file+0x180/0x180 [ 2581.930436][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.930534][ T44] ? cap_capable+0x181/0x3f0 [ 2581.930634][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2581.930733][ T44] do_syscall_64+0xbd/0xfc0 [ 2581.930839][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2581.930960][ T44] RIP: 0033:0x7f86c04f934d [ 2581.931067][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2581.931215][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2581.931369][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2581.931517][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2581.931662][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2581.931809][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2581.931961][ T44] [ 2581.932037][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2581.932196][ T44] [ 2581.932196][ T44] Showing all locks held in the system: [ 2581.932339][ T44] 4 locks held by kworker/u16:0/12: [ 2581.932433][ T44] 1 lock held by khungtaskd/44: [ 2581.932525][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2581.932720][ T44] 2 locks held by kworker/u17:3/1799: [ 2581.932814][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2581.933005][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2581.933218][ T44] 1 lock held by modprobe/30670: [ 2581.933314][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2581.933505][ T44] [ 2581.933551][ T44] ============================================= [ 2581.933551][ T44] [ 2704.806258][ T44] INFO: task modprobe:30670 blocked for more than 737 seconds. [ 2704.806488][ T44] Tainted: G W 6.18.0-virtme #1 [ 2704.806632][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2704.806839][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2704.807114][ T44] Call Trace: [ 2704.807207][ T44] [ 2704.807284][ T44] __schedule+0xae2/0x1720 [ 2704.807411][ T44] ? io_schedule_timeout+0x130/0x130 [ 2704.807535][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.807646][ T44] schedule+0xd4/0x260 [ 2704.807730][ T44] schedule_preempt_disabled+0x18/0x30 [ 2704.807841][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2704.807951][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2704.808064][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.808171][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2704.808282][ T44] ? register_pernet_subsys+0x19/0x40 [ 2704.808389][ T44] ? lock_acquire+0x10a/0x150 [ 2704.808501][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2704.808662][ T44] down_write+0x1c6/0x1f0 [ 2704.808747][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2704.808881][ T44] register_pernet_subsys+0x19/0x40 [ 2704.808990][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2704.809119][ T44] do_one_initcall+0xa3/0x2e0 [ 2704.809229][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2704.809364][ T44] ? kasan_unpoison+0x44/0x70 [ 2704.809472][ T44] do_init_module+0x27b/0x820 [ 2704.809576][ T44] ? free_module+0x450/0x450 [ 2704.809676][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2704.809779][ T44] init_module_from_file+0x15d/0x180 [ 2704.809880][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2704.809998][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.810100][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2704.810203][ T44] idempotent_init_module+0x226/0x760 [ 2704.810311][ T44] ? init_module_from_file+0x180/0x180 [ 2704.810414][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.810517][ T44] ? cap_capable+0x181/0x3f0 [ 2704.810616][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2704.810718][ T44] do_syscall_64+0xbd/0xfc0 [ 2704.810816][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2704.810940][ T44] RIP: 0033:0x7f86c04f934d [ 2704.811044][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2704.811193][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2704.811352][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2704.811499][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2704.811645][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2704.811795][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2704.811951][ T44] [ 2704.812026][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2704.812183][ T44] [ 2704.812183][ T44] Showing all locks held in the system: [ 2704.812324][ T44] 4 locks held by kworker/u16:0/12: [ 2704.812419][ T44] 1 lock held by khungtaskd/44: [ 2704.812510][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2704.812721][ T44] 2 locks held by kworker/u17:3/1799: [ 2704.812813][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2704.813008][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2704.813229][ T44] 1 lock held by modprobe/30670: [ 2704.813324][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2704.813511][ T44] [ 2704.813557][ T44] ============================================= [ 2704.813557][ T44] [ 2827.686256][ T44] INFO: task modprobe:30670 blocked for more than 860 seconds. [ 2827.686485][ T44] Tainted: G W 6.18.0-virtme #1 [ 2827.686634][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2827.686834][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2827.687098][ T44] Call Trace: [ 2827.687186][ T44] [ 2827.687259][ T44] __schedule+0xae2/0x1720 [ 2827.687384][ T44] ? io_schedule_timeout+0x130/0x130 [ 2827.687506][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.687625][ T44] schedule+0xd4/0x260 [ 2827.687713][ T44] schedule_preempt_disabled+0x18/0x30 [ 2827.687826][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2827.687935][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2827.688044][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.688153][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2827.688270][ T44] ? register_pernet_subsys+0x19/0x40 [ 2827.688379][ T44] ? lock_acquire+0x10a/0x150 [ 2827.688490][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2827.688651][ T44] down_write+0x1c6/0x1f0 [ 2827.688732][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2827.688860][ T44] register_pernet_subsys+0x19/0x40 [ 2827.688970][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2827.689111][ T44] do_one_initcall+0xa3/0x2e0 [ 2827.689224][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2827.689361][ T44] ? kasan_unpoison+0x44/0x70 [ 2827.689467][ T44] do_init_module+0x27b/0x820 [ 2827.689575][ T44] ? free_module+0x450/0x450 [ 2827.689688][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2827.689798][ T44] init_module_from_file+0x15d/0x180 [ 2827.689899][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2827.690007][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.690106][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2827.690207][ T44] idempotent_init_module+0x226/0x760 [ 2827.690312][ T44] ? init_module_from_file+0x180/0x180 [ 2827.690413][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.690515][ T44] ? cap_capable+0x181/0x3f0 [ 2827.690614][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2827.690712][ T44] do_syscall_64+0xbd/0xfc0 [ 2827.690812][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2827.690936][ T44] RIP: 0033:0x7f86c04f934d [ 2827.691040][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2827.691195][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2827.691347][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2827.691492][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2827.691639][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2827.691785][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2827.691944][ T44] [ 2827.692017][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2827.692171][ T44] [ 2827.692171][ T44] Showing all locks held in the system: [ 2827.692313][ T44] 4 locks held by kworker/u16:0/12: [ 2827.692410][ T44] 1 lock held by khungtaskd/44: [ 2827.692506][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2827.692696][ T44] 2 locks held by kworker/u17:3/1799: [ 2827.692797][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2827.692989][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2827.693203][ T44] 1 lock held by modprobe/30670: [ 2827.693298][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2827.693489][ T44] [ 2827.693536][ T44] ============================================= [ 2827.693536][ T44] [ 2950.566255][ T44] INFO: task modprobe:30670 blocked for more than 983 seconds. [ 2950.566490][ T44] Tainted: G W 6.18.0-virtme #1 [ 2950.566633][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2950.566828][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 2950.567094][ T44] Call Trace: [ 2950.567185][ T44] [ 2950.567253][ T44] __schedule+0xae2/0x1720 [ 2950.567372][ T44] ? io_schedule_timeout+0x130/0x130 [ 2950.567493][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.567608][ T44] schedule+0xd4/0x260 [ 2950.567694][ T44] schedule_preempt_disabled+0x18/0x30 [ 2950.567806][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2950.567926][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2950.568040][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.568149][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2950.568259][ T44] ? register_pernet_subsys+0x19/0x40 [ 2950.568364][ T44] ? lock_acquire+0x10a/0x150 [ 2950.568474][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 2950.568641][ T44] down_write+0x1c6/0x1f0 [ 2950.568724][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2950.568865][ T44] register_pernet_subsys+0x19/0x40 [ 2950.568975][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 2950.569109][ T44] do_one_initcall+0xa3/0x2e0 [ 2950.569213][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2950.569347][ T44] ? kasan_unpoison+0x44/0x70 [ 2950.569462][ T44] do_init_module+0x27b/0x820 [ 2950.569570][ T44] ? free_module+0x450/0x450 [ 2950.569675][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2950.569777][ T44] init_module_from_file+0x15d/0x180 [ 2950.569879][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2950.569989][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.570089][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2950.570189][ T44] idempotent_init_module+0x226/0x760 [ 2950.570295][ T44] ? init_module_from_file+0x180/0x180 [ 2950.570397][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.570493][ T44] ? cap_capable+0x181/0x3f0 [ 2950.570590][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2950.570687][ T44] do_syscall_64+0xbd/0xfc0 [ 2950.570784][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2950.570905][ T44] RIP: 0033:0x7f86c04f934d [ 2950.571017][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2950.571162][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 2950.571312][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 2950.571455][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 2950.571597][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 2950.571745][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 2950.571893][ T44] [ 2950.571968][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 2950.572120][ T44] [ 2950.572120][ T44] Showing all locks held in the system: [ 2950.572264][ T44] 4 locks held by kworker/u16:0/12: [ 2950.572356][ T44] 1 lock held by khungtaskd/44: [ 2950.572446][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2950.572632][ T44] 2 locks held by kworker/u17:3/1799: [ 2950.572727][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2950.572920][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2950.573126][ T44] 1 lock held by modprobe/30670: [ 2950.573216][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2950.573407][ T44] [ 2950.573454][ T44] ============================================= [ 2950.573454][ T44] [ 3073.446259][ T44] INFO: task modprobe:30670 blocked for more than 1105 seconds. [ 3073.446480][ T44] Tainted: G W 6.18.0-virtme #1 [ 3073.446622][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3073.446814][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 3073.447084][ T44] Call Trace: [ 3073.447174][ T44] [ 3073.447240][ T44] __schedule+0xae2/0x1720 [ 3073.447352][ T44] ? io_schedule_timeout+0x130/0x130 [ 3073.447459][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.447565][ T44] schedule+0xd4/0x260 [ 3073.447644][ T44] schedule_preempt_disabled+0x18/0x30 [ 3073.447747][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3073.447861][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3073.447970][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.448075][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3073.448179][ T44] ? register_pernet_subsys+0x19/0x40 [ 3073.448290][ T44] ? lock_acquire+0x10a/0x150 [ 3073.448389][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 3073.448542][ T44] down_write+0x1c6/0x1f0 [ 3073.448615][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3073.448749][ T44] register_pernet_subsys+0x19/0x40 [ 3073.448853][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 3073.448988][ T44] do_one_initcall+0xa3/0x2e0 [ 3073.449098][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3073.449234][ T44] ? kasan_unpoison+0x44/0x70 [ 3073.449339][ T44] do_init_module+0x27b/0x820 [ 3073.449437][ T44] ? free_module+0x450/0x450 [ 3073.449534][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3073.449632][ T44] init_module_from_file+0x15d/0x180 [ 3073.449733][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3073.449835][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.449932][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3073.450034][ T44] idempotent_init_module+0x226/0x760 [ 3073.450131][ T44] ? init_module_from_file+0x180/0x180 [ 3073.450234][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.450332][ T44] ? cap_capable+0x181/0x3f0 [ 3073.450429][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3073.450526][ T44] do_syscall_64+0xbd/0xfc0 [ 3073.450624][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3073.450745][ T44] RIP: 0033:0x7f86c04f934d [ 3073.450847][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3073.450994][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 3073.451140][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 3073.451289][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 3073.451445][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 3073.451590][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 3073.451739][ T44] [ 3073.451811][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 3073.451969][ T44] [ 3073.451969][ T44] Showing all locks held in the system: [ 3073.452104][ T44] 5 locks held by kworker/u16:0/12: [ 3073.452199][ T44] 1 lock held by khungtaskd/44: [ 3073.452293][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3073.452478][ T44] 2 locks held by kworker/u17:3/1799: [ 3073.452568][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3073.452758][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3073.452966][ T44] 1 lock held by modprobe/30670: [ 3073.453058][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3073.453249][ T44] [ 3073.453295][ T44] ============================================= [ 3073.453295][ T44] [ 3196.326255][ T44] INFO: task modprobe:30670 blocked for more than 1228 seconds. [ 3196.326459][ T44] Tainted: G W 6.18.0-virtme #1 [ 3196.326585][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3196.326752][ T44] task:modprobe state:D stack:25136 pid:30670 tgid:30670 ppid:1799 task_flags:0x400100 flags:0x00080000 [ 3196.326990][ T44] Call Trace: [ 3196.327076][ T44] [ 3196.327132][ T44] __schedule+0xae2/0x1720 [ 3196.327261][ T44] ? io_schedule_timeout+0x130/0x130 [ 3196.327372][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.327480][ T44] schedule+0xd4/0x260 [ 3196.327561][ T44] schedule_preempt_disabled+0x18/0x30 [ 3196.327666][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3196.327768][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3196.327874][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.327974][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3196.328079][ T44] ? register_pernet_subsys+0x19/0x40 [ 3196.328182][ T44] ? lock_acquire+0x10a/0x150 [ 3196.328298][ T44] ? nf_flow_table_module_exit+0x520/0x520 [nf_flow_table] [ 3196.328453][ T44] down_write+0x1c6/0x1f0 [ 3196.328527][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3196.328648][ T44] register_pernet_subsys+0x19/0x40 [ 3196.328747][ T44] nf_flow_table_module_init+0x16/0x1000 [nf_flow_table] [ 3196.328867][ T44] do_one_initcall+0xa3/0x2e0 [ 3196.328967][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3196.329092][ T44] ? kasan_unpoison+0x44/0x70 [ 3196.329190][ T44] do_init_module+0x27b/0x820 [ 3196.329295][ T44] ? free_module+0x450/0x450 [ 3196.329393][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3196.329491][ T44] init_module_from_file+0x15d/0x180 [ 3196.329588][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3196.329695][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.329792][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3196.329888][ T44] idempotent_init_module+0x226/0x760 [ 3196.329988][ T44] ? init_module_from_file+0x180/0x180 [ 3196.330090][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.330191][ T44] ? cap_capable+0x181/0x3f0 [ 3196.330295][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3196.330394][ T44] do_syscall_64+0xbd/0xfc0 [ 3196.330491][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3196.330612][ T44] RIP: 0033:0x7f86c04f934d [ 3196.330715][ T44] RSP: 002b:00007ffe8747c378 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3196.330860][ T44] RAX: ffffffffffffffda RBX: 000055ea1ce8bce0 RCX: 00007f86c04f934d [ 3196.331009][ T44] RDX: 0000000000000000 RSI: 000055e9e5f0ef2e RDI: 0000000000000000 [ 3196.331157][ T44] RBP: 00007ffe8747c410 R08: 0000000000000000 R09: 0000000000000000 [ 3196.331307][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055e9e5f0ef2e [ 3196.331451][ T44] R13: 0000000000040000 R14: 000055ea1ce8bc90 R15: 000055ea1ce8b570 [ 3196.331602][ T44] [ 3196.331680][ T44] INFO: task modprobe:30670 is blocked on an rw-semaphore, but the owner is not found. [ 3196.331833][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 3196.331990][ T44] [ 3196.331990][ T44] Showing all locks held in the system: [ 3196.332127][ T44] 5 locks held by kworker/u16:0/12: [ 3196.332227][ T44] 1 lock held by khungtaskd/44: [ 3196.332320][ T44] #0: ffffffff9a784c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3196.332508][ T44] 2 locks held by kworker/u17:3/1799: [ 3196.332599][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3196.332784][ T44] #1: ffa00000043b7cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3196.332992][ T44] 1 lock held by modprobe/30670: [ 3196.333084][ T44] #0: ffffffff9ae79190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3196.333275][ T44] [ 3196.333320][ T44] ============================================= [ 3196.333320][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr