[ 1981.779660][T28136] GACT probability NOT on [ 2013.642461][ T12] ------------[ cut here ]------------ [ 2013.642868][ T12] conntrack cleanup blocked for 60s [ 2013.642871][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#2: kworker/u16:0/12 [ 2013.643367][ T12] Modules linked in: act_gact(+) xt_conntrack act_mirred cls_u32 sch_ingress ifb xfrm_user openvswitch psample nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nsh geneve vxlan act_csum act_pedit cls_flower sch_prio xt_HL nft_compat nf_tables amt [last unloaded: ila] [ 2013.644172][ T12] CPU: 2 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 2013.644484][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 2013.644740][ T12] Workqueue: netns cleanup_net [ 2013.644948][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack] [ 2013.645223][ T12] Code: 00 48 8b 54 24 18 48 8b 05 c3 f8 47 e4 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 7e 37 e3 e9 25 fd ff ff 48 8d 3d 56 b6 d6 ff <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df [ 2013.645767][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010297 [ 2013.646039][ T12] RAX: 00000001001a241f RBX: ffa00000000c7af8 RCX: 0000000000000001 [ 2013.646298][ T12] RDX: 00000001001a241e RSI: 0000000000000004 RDI: ffffffffc02fd030 [ 2013.646576][ T12] RBP: 0000000000000001 R08: ffffffffc05917aa R09: ffe21c000174a8dc [ 2013.646837][ T12] R10: ffe21c000174a8dd R11: 0000000000000001 R12: dffffc0000000000 [ 2013.647102][ T12] R13: ff1100000ba546e0 R14: fffffbfff8061407 R15: ff11000019bb8d00 [ 2013.647360][ T12] FS: 0000000000000000(0000) GS:ff110000c630b000(0000) knlGS:0000000000000000 [ 2013.647673][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2013.647900][ T12] CR2: 00007fbebae31a48 CR3: 000000005dd48006 CR4: 0000000000771ef0 [ 2013.648596][ T12] PKRU: 55555554 [ 2013.648762][ T12] Call Trace: [ 2013.648927][ T12] [ 2013.649061][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 2013.649292][ T12] ? kfree+0x119/0x580 [ 2013.649471][ T12] ? lock_acquire+0x10a/0x150 [ 2013.649673][ T12] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack] [ 2013.649900][ T12] ops_undo_list+0x2d7/0x8f0 [ 2013.650104][ T12] ? netns_install+0x280/0x280 [ 2013.650300][ T12] cleanup_net+0x3bc/0x890 [ 2013.650516][ T12] ? process_one_work+0xd16/0x1390 [ 2013.650713][ T12] ? net_passive_dec+0x190/0x190 [ 2013.650906][ T12] ? rcu_is_watching+0x15/0xd0 [ 2013.651099][ T12] ? process_one_work+0xd16/0x1390 [ 2013.651289][ T12] ? lock_acquire+0x10a/0x150 [ 2013.651499][ T12] ? rcu_is_watching+0x15/0xd0 [ 2013.651707][ T12] process_one_work+0xd57/0x1390 [ 2013.651902][ T12] ? pwq_dec_nr_in_flight+0x700/0x700 [ 2013.652093][ T12] ? lock_acquire.part.0+0xbc/0x260 [ 2013.652288][ T12] ? assign_work+0x152/0x380 [ 2013.652496][ T12] worker_thread+0x4d6/0xd40 [ 2013.652702][ T12] ? process_one_work+0x1390/0x1390 [ 2013.652893][ T12] kthread+0x355/0x5b0 [ 2013.653063][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 2013.653256][ T12] ? __lock_release.isra.0+0x59/0x170 [ 2013.653466][ T12] ? rcu_is_watching+0x15/0xd0 [ 2013.653666][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 2013.653859][ T12] ret_from_fork+0x3fb/0x510 [ 2013.654054][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 2013.654280][ T12] ? __switch_to+0x602/0xd00 [ 2013.654487][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 2013.654696][ T12] ret_from_fork_asm+0x11/0x20 [ 2013.654897][ T12] [ 2013.655058][ T12] irq event stamp: 27032801 [ 2013.655251][ T12] hardirqs last enabled at (27032811): [] __up_console_sem+0x5a/0x70 [ 2013.655559][ T12] hardirqs last disabled at (27032822): [] __up_console_sem+0x3f/0x70 [ 2013.655849][ T12] softirqs last enabled at (27032306): [] handle_softirqs+0x56f/0x840 [ 2013.656144][ T12] softirqs last disabled at (27032299): [] irq_exit_rcu+0xa2/0xf0 [ 2013.656446][ T12] ---[ end trace 0000000000000000 ]--- [ 2213.292491][ T44] INFO: task modprobe:28136 blocked for more than 122 seconds. [ 2213.292922][ T44] Tainted: G W 6.18.0-virtme #1 [ 2213.293161][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2213.293407][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2213.293760][ T44] Call Trace: [ 2213.293867][ T44] [ 2213.293929][ T44] __schedule+0xae2/0x1720 [ 2213.294075][ T44] ? io_schedule_timeout+0x130/0x130 [ 2213.294218][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.294358][ T44] schedule+0xd4/0x260 [ 2213.294472][ T44] schedule_preempt_disabled+0x18/0x30 [ 2213.294611][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2213.294752][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2213.294882][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.295018][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2213.295167][ T44] ? register_pernet_subsys+0x19/0x40 [ 2213.295299][ T44] ? lock_acquire+0x10a/0x150 [ 2213.295435][ T44] down_write+0x1c6/0x1f0 [ 2213.295545][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2213.295707][ T44] register_pernet_subsys+0x19/0x40 [ 2213.295843][ T44] tcf_register_action+0xa3/0x5c0 [ 2213.295981][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2213.296123][ T44] do_one_initcall+0xa3/0x2e0 [ 2213.296274][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2213.296444][ T44] ? kasan_unpoison+0x44/0x70 [ 2213.296572][ T44] do_init_module+0x27b/0x820 [ 2213.296709][ T44] ? free_module+0x450/0x450 [ 2213.296843][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2213.296982][ T44] init_module_from_file+0x15d/0x180 [ 2213.297517][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2213.297659][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.297792][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2213.297927][ T44] idempotent_init_module+0x226/0x760 [ 2213.298064][ T44] ? init_module_from_file+0x180/0x180 [ 2213.298203][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.298341][ T44] ? cap_capable+0x181/0x3f0 [ 2213.298469][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2213.298605][ T44] do_syscall_64+0xbd/0xfc0 [ 2213.298742][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2213.298915][ T44] RIP: 0033:0x7fac678ad34d [ 2213.299047][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2213.299241][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2213.299448][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2213.299642][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2213.299827][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2213.300012][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2213.300208][ T44] [ 2213.300315][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2213.300542][ T44] [ 2213.300542][ T44] Showing all locks held in the system: [ 2213.300750][ T44] 3 locks held by kworker/u16:0/12: [ 2213.300872][ T44] 1 lock held by khungtaskd/44: [ 2213.301003][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2213.301270][ T44] 2 locks held by kworker/u17:1/1026: [ 2213.301398][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2213.301746][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2213.302049][ T44] 1 lock held by modprobe/28136: [ 2213.302175][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2213.302440][ T44] [ 2213.302507][ T44] ============================================= [ 2213.302507][ T44] [ 2336.172485][ T44] INFO: task modprobe:28136 blocked for more than 245 seconds. [ 2336.172794][ T44] Tainted: G W 6.18.0-virtme #1 [ 2336.172967][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2336.173199][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2336.173525][ T44] Call Trace: [ 2336.173637][ T44] [ 2336.173712][ T44] __schedule+0xae2/0x1720 [ 2336.173859][ T44] ? io_schedule_timeout+0x130/0x130 [ 2336.174002][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.174130][ T44] schedule+0xd4/0x260 [ 2336.174237][ T44] schedule_preempt_disabled+0x18/0x30 [ 2336.174361][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2336.174505][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2336.174639][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.174783][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2336.174919][ T44] ? register_pernet_subsys+0x19/0x40 [ 2336.175053][ T44] ? lock_acquire+0x10a/0x150 [ 2336.175192][ T44] down_write+0x1c6/0x1f0 [ 2336.175287][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2336.175458][ T44] register_pernet_subsys+0x19/0x40 [ 2336.175590][ T44] tcf_register_action+0xa3/0x5c0 [ 2336.175721][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2336.175861][ T44] do_one_initcall+0xa3/0x2e0 [ 2336.175998][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2336.176174][ T44] ? kasan_unpoison+0x44/0x70 [ 2336.176314][ T44] do_init_module+0x27b/0x820 [ 2336.176443][ T44] ? free_module+0x450/0x450 [ 2336.176578][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2336.176720][ T44] init_module_from_file+0x15d/0x180 [ 2336.176855][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2336.176995][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.177132][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2336.177255][ T44] idempotent_init_module+0x226/0x760 [ 2336.177391][ T44] ? init_module_from_file+0x180/0x180 [ 2336.177563][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.177695][ T44] ? cap_capable+0x181/0x3f0 [ 2336.177832][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2336.177950][ T44] do_syscall_64+0xbd/0xfc0 [ 2336.178085][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2336.178254][ T44] RIP: 0033:0x7fac678ad34d [ 2336.178383][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2336.178595][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2336.178784][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2336.178968][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2336.179151][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2336.179339][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2336.179535][ T44] [ 2336.179638][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2336.179862][ T44] [ 2336.179862][ T44] Showing all locks held in the system: [ 2336.180058][ T44] 4 locks held by kworker/u16:0/12: [ 2336.180200][ T44] 1 lock held by khungtaskd/44: [ 2336.180334][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2336.180680][ T44] 2 locks held by kworker/u17:1/1026: [ 2336.180810][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2336.181067][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2336.181370][ T44] 1 lock held by modprobe/28136: [ 2336.181502][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2336.181764][ T44] [ 2336.181832][ T44] ============================================= [ 2336.181832][ T44] [ 2459.051484][ T44] INFO: task modprobe:28136 blocked for more than 368 seconds. [ 2459.051792][ T44] Tainted: G W 6.18.0-virtme #1 [ 2459.051968][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2459.052213][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2459.052551][ T44] Call Trace: [ 2459.052661][ T44] [ 2459.052742][ T44] __schedule+0xae2/0x1720 [ 2459.052882][ T44] ? io_schedule_timeout+0x130/0x130 [ 2459.053022][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.053159][ T44] schedule+0xd4/0x260 [ 2459.053257][ T44] schedule_preempt_disabled+0x18/0x30 [ 2459.053391][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2459.053536][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2459.053678][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.053813][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2459.053953][ T44] ? register_pernet_subsys+0x19/0x40 [ 2459.054090][ T44] ? lock_acquire+0x10a/0x150 [ 2459.054227][ T44] down_write+0x1c6/0x1f0 [ 2459.054321][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2459.054490][ T44] register_pernet_subsys+0x19/0x40 [ 2459.054627][ T44] tcf_register_action+0xa3/0x5c0 [ 2459.054767][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2459.054903][ T44] do_one_initcall+0xa3/0x2e0 [ 2459.055053][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2459.055215][ T44] ? kasan_unpoison+0x44/0x70 [ 2459.055339][ T44] do_init_module+0x27b/0x820 [ 2459.055480][ T44] ? free_module+0x450/0x450 [ 2459.055616][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2459.055736][ T44] init_module_from_file+0x15d/0x180 [ 2459.055871][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2459.055996][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.056128][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2459.056261][ T44] idempotent_init_module+0x226/0x760 [ 2459.056417][ T44] ? init_module_from_file+0x180/0x180 [ 2459.056569][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.056687][ T44] ? cap_capable+0x181/0x3f0 [ 2459.056822][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2459.056943][ T44] do_syscall_64+0xbd/0xfc0 [ 2459.057079][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2459.057249][ T44] RIP: 0033:0x7fac678ad34d [ 2459.057378][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2459.057583][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2459.057767][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2459.057955][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2459.058138][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2459.058324][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2459.058518][ T44] [ 2459.058612][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2459.058838][ T44] [ 2459.058838][ T44] Showing all locks held in the system: [ 2459.059035][ T44] 4 locks held by kworker/u16:0/12: [ 2459.059177][ T44] 1 lock held by khungtaskd/44: [ 2459.059305][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2459.059663][ T44] 2 locks held by kworker/u17:1/1026: [ 2459.059789][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2459.060061][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2459.060363][ T44] 1 lock held by modprobe/28136: [ 2459.060484][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2459.060743][ T44] [ 2459.060808][ T44] ============================================= [ 2459.060808][ T44] [ 2581.932484][ T44] INFO: task modprobe:28136 blocked for more than 491 seconds. [ 2581.932793][ T44] Tainted: G W 6.18.0-virtme #1 [ 2581.932968][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2581.933205][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2581.933562][ T44] Call Trace: [ 2581.933671][ T44] [ 2581.933732][ T44] __schedule+0xae2/0x1720 [ 2581.933876][ T44] ? io_schedule_timeout+0x130/0x130 [ 2581.934012][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.934153][ T44] schedule+0xd4/0x260 [ 2581.934263][ T44] schedule_preempt_disabled+0x18/0x30 [ 2581.934397][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2581.934547][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2581.934675][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.934809][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2581.934945][ T44] ? register_pernet_subsys+0x19/0x40 [ 2581.935075][ T44] ? lock_acquire+0x10a/0x150 [ 2581.935218][ T44] down_write+0x1c6/0x1f0 [ 2581.935315][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2581.935501][ T44] register_pernet_subsys+0x19/0x40 [ 2581.935636][ T44] tcf_register_action+0xa3/0x5c0 [ 2581.935774][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2581.935897][ T44] do_one_initcall+0xa3/0x2e0 [ 2581.936035][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2581.936212][ T44] ? kasan_unpoison+0x44/0x70 [ 2581.936352][ T44] do_init_module+0x27b/0x820 [ 2581.936504][ T44] ? free_module+0x450/0x450 [ 2581.936627][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2581.936764][ T44] init_module_from_file+0x15d/0x180 [ 2581.936901][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2581.937042][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.937179][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2581.937300][ T44] idempotent_init_module+0x226/0x760 [ 2581.937451][ T44] ? init_module_from_file+0x180/0x180 [ 2581.937587][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.937721][ T44] ? cap_capable+0x181/0x3f0 [ 2581.937849][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2581.937980][ T44] do_syscall_64+0xbd/0xfc0 [ 2581.938102][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2581.938267][ T44] RIP: 0033:0x7fac678ad34d [ 2581.938424][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2581.938620][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2581.938802][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2581.938983][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2581.939177][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2581.939372][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2581.939571][ T44] [ 2581.939666][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2581.939894][ T44] [ 2581.939894][ T44] Showing all locks held in the system: [ 2581.940094][ T44] 4 locks held by kworker/u16:0/12: [ 2581.940233][ T44] 1 lock held by khungtaskd/44: [ 2581.940359][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2581.940713][ T44] 2 locks held by kworker/u17:1/1026: [ 2581.940842][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2581.941108][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2581.941406][ T44] 1 lock held by modprobe/28136: [ 2581.941535][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2581.941791][ T44] [ 2581.941855][ T44] ============================================= [ 2581.941855][ T44] [ 2704.812481][ T44] INFO: task modprobe:28136 blocked for more than 614 seconds. [ 2704.812766][ T44] Tainted: G W 6.18.0-virtme #1 [ 2704.812938][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2704.813175][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2704.813560][ T44] Call Trace: [ 2704.813675][ T44] [ 2704.813752][ T44] __schedule+0xae2/0x1720 [ 2704.813895][ T44] ? io_schedule_timeout+0x130/0x130 [ 2704.814031][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.814172][ T44] schedule+0xd4/0x260 [ 2704.814281][ T44] schedule_preempt_disabled+0x18/0x30 [ 2704.814423][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2704.814556][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2704.814691][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.814830][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2704.814955][ T44] ? register_pernet_subsys+0x19/0x40 [ 2704.815094][ T44] ? lock_acquire+0x10a/0x150 [ 2704.815243][ T44] down_write+0x1c6/0x1f0 [ 2704.815357][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2704.815532][ T44] register_pernet_subsys+0x19/0x40 [ 2704.815652][ T44] tcf_register_action+0xa3/0x5c0 [ 2704.815790][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2704.815922][ T44] do_one_initcall+0xa3/0x2e0 [ 2704.816058][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2704.816224][ T44] ? kasan_unpoison+0x44/0x70 [ 2704.816371][ T44] do_init_module+0x27b/0x820 [ 2704.816519][ T44] ? free_module+0x450/0x450 [ 2704.816641][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2704.816784][ T44] init_module_from_file+0x15d/0x180 [ 2704.816921][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2704.817060][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.817193][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2704.817348][ T44] idempotent_init_module+0x226/0x760 [ 2704.817479][ T44] ? init_module_from_file+0x180/0x180 [ 2704.817612][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.817746][ T44] ? cap_capable+0x181/0x3f0 [ 2704.817881][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2704.818017][ T44] do_syscall_64+0xbd/0xfc0 [ 2704.818151][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2704.818319][ T44] RIP: 0033:0x7fac678ad34d [ 2704.818467][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2704.818666][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2704.818850][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2704.819033][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2704.819223][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2704.819425][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2704.819621][ T44] [ 2704.819714][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2704.819938][ T44] [ 2704.819938][ T44] Showing all locks held in the system: [ 2704.820121][ T44] 4 locks held by kworker/u16:0/12: [ 2704.820258][ T44] 1 lock held by khungtaskd/44: [ 2704.820382][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2704.820735][ T44] 2 locks held by kworker/u17:1/1026: [ 2704.820863][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2704.821130][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2704.821437][ T44] 1 lock held by modprobe/28136: [ 2704.821564][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2704.821824][ T44] [ 2704.821893][ T44] ============================================= [ 2704.821893][ T44] [ 2827.692483][ T44] INFO: task modprobe:28136 blocked for more than 737 seconds. [ 2827.692769][ T44] Tainted: G W 6.18.0-virtme #1 [ 2827.692934][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2827.693150][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2827.693506][ T44] Call Trace: [ 2827.693621][ T44] [ 2827.693704][ T44] __schedule+0xae2/0x1720 [ 2827.693854][ T44] ? io_schedule_timeout+0x130/0x130 [ 2827.693984][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.694122][ T44] schedule+0xd4/0x260 [ 2827.694229][ T44] schedule_preempt_disabled+0x18/0x30 [ 2827.694359][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2827.694506][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2827.694646][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.694783][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2827.694919][ T44] ? register_pernet_subsys+0x19/0x40 [ 2827.695054][ T44] ? lock_acquire+0x10a/0x150 [ 2827.695202][ T44] down_write+0x1c6/0x1f0 [ 2827.695307][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2827.695462][ T44] register_pernet_subsys+0x19/0x40 [ 2827.695599][ T44] tcf_register_action+0xa3/0x5c0 [ 2827.695733][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2827.695868][ T44] do_one_initcall+0xa3/0x2e0 [ 2827.695999][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2827.696181][ T44] ? kasan_unpoison+0x44/0x70 [ 2827.696308][ T44] do_init_module+0x27b/0x820 [ 2827.696450][ T44] ? free_module+0x450/0x450 [ 2827.696582][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2827.696724][ T44] init_module_from_file+0x15d/0x180 [ 2827.696858][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2827.696982][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.697133][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2827.697267][ T44] idempotent_init_module+0x226/0x760 [ 2827.697387][ T44] ? init_module_from_file+0x180/0x180 [ 2827.697537][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.697671][ T44] ? cap_capable+0x181/0x3f0 [ 2827.697792][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2827.697926][ T44] do_syscall_64+0xbd/0xfc0 [ 2827.698064][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2827.698211][ T44] RIP: 0033:0x7fac678ad34d [ 2827.698353][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2827.698561][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2827.698744][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2827.698931][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2827.699115][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2827.699304][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2827.699499][ T44] [ 2827.699608][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2827.699839][ T44] [ 2827.699839][ T44] Showing all locks held in the system: [ 2827.700031][ T44] 4 locks held by kworker/u16:0/12: [ 2827.700165][ T44] 1 lock held by khungtaskd/44: [ 2827.700292][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2827.700653][ T44] 2 locks held by kworker/u17:1/1026: [ 2827.700787][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2827.701043][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2827.701341][ T44] 1 lock held by modprobe/28136: [ 2827.701467][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2827.701738][ T44] [ 2827.701804][ T44] ============================================= [ 2827.701804][ T44] [ 2950.572489][ T44] INFO: task modprobe:28136 blocked for more than 860 seconds. [ 2950.572781][ T44] Tainted: G W 6.18.0-virtme #1 [ 2950.572954][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2950.573212][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 2950.573557][ T44] Call Trace: [ 2950.573668][ T44] [ 2950.573742][ T44] __schedule+0xae2/0x1720 [ 2950.573877][ T44] ? io_schedule_timeout+0x130/0x130 [ 2950.574018][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.574157][ T44] schedule+0xd4/0x260 [ 2950.574260][ T44] schedule_preempt_disabled+0x18/0x30 [ 2950.574399][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2950.574539][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2950.574676][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.574814][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2950.574951][ T44] ? register_pernet_subsys+0x19/0x40 [ 2950.575089][ T44] ? lock_acquire+0x10a/0x150 [ 2950.575231][ T44] down_write+0x1c6/0x1f0 [ 2950.575329][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2950.575514][ T44] register_pernet_subsys+0x19/0x40 [ 2950.575638][ T44] tcf_register_action+0xa3/0x5c0 [ 2950.575776][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 2950.575911][ T44] do_one_initcall+0xa3/0x2e0 [ 2950.576031][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2950.576208][ T44] ? kasan_unpoison+0x44/0x70 [ 2950.576332][ T44] do_init_module+0x27b/0x820 [ 2950.576485][ T44] ? free_module+0x450/0x450 [ 2950.576617][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2950.576752][ T44] init_module_from_file+0x15d/0x180 [ 2950.576873][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2950.577033][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.577166][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2950.577301][ T44] idempotent_init_module+0x226/0x760 [ 2950.577423][ T44] ? init_module_from_file+0x180/0x180 [ 2950.577576][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.577694][ T44] ? cap_capable+0x181/0x3f0 [ 2950.577831][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2950.577967][ T44] do_syscall_64+0xbd/0xfc0 [ 2950.578103][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2950.578259][ T44] RIP: 0033:0x7fac678ad34d [ 2950.578409][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2950.578607][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 2950.578800][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 2950.579001][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 2950.579197][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 2950.579398][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 2950.579594][ T44] [ 2950.579688][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 2950.579914][ T44] [ 2950.579914][ T44] Showing all locks held in the system: [ 2950.580100][ T44] 4 locks held by kworker/u16:0/12: [ 2950.580236][ T44] 1 lock held by khungtaskd/44: [ 2950.580364][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2950.580737][ T44] 2 locks held by kworker/u17:1/1026: [ 2950.580868][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2950.581126][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2950.581418][ T44] 1 lock held by modprobe/28136: [ 2950.581551][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2950.581820][ T44] [ 2950.581890][ T44] ============================================= [ 2950.581890][ T44] [ 3073.452488][ T44] INFO: task modprobe:28136 blocked for more than 983 seconds. [ 3073.452786][ T44] Tainted: G W 6.18.0-virtme #1 [ 3073.452956][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3073.453195][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 3073.453533][ T44] Call Trace: [ 3073.453638][ T44] [ 3073.453712][ T44] __schedule+0xae2/0x1720 [ 3073.453857][ T44] ? io_schedule_timeout+0x130/0x130 [ 3073.453992][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.454132][ T44] schedule+0xd4/0x260 [ 3073.454225][ T44] schedule_preempt_disabled+0x18/0x30 [ 3073.454352][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3073.454497][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3073.454633][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.454753][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3073.454888][ T44] ? register_pernet_subsys+0x19/0x40 [ 3073.455014][ T44] ? lock_acquire+0x10a/0x150 [ 3073.455149][ T44] down_write+0x1c6/0x1f0 [ 3073.455253][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3073.455405][ T44] register_pernet_subsys+0x19/0x40 [ 3073.455543][ T44] tcf_register_action+0xa3/0x5c0 [ 3073.455676][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 3073.455810][ T44] do_one_initcall+0xa3/0x2e0 [ 3073.455933][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3073.456094][ T44] ? kasan_unpoison+0x44/0x70 [ 3073.456228][ T44] do_init_module+0x27b/0x820 [ 3073.456369][ T44] ? free_module+0x450/0x450 [ 3073.456505][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3073.456642][ T44] init_module_from_file+0x15d/0x180 [ 3073.456765][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3073.456895][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.457026][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3073.457145][ T44] idempotent_init_module+0x226/0x760 [ 3073.457278][ T44] ? init_module_from_file+0x180/0x180 [ 3073.457414][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.457550][ T44] ? cap_capable+0x181/0x3f0 [ 3073.457696][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3073.457831][ T44] do_syscall_64+0xbd/0xfc0 [ 3073.457972][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3073.458144][ T44] RIP: 0033:0x7fac678ad34d [ 3073.458272][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3073.458467][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 3073.458666][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 3073.458850][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 3073.459033][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 3073.459215][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 3073.459415][ T44] [ 3073.459526][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 3073.459747][ T44] [ 3073.459747][ T44] Showing all locks held in the system: [ 3073.459933][ T44] 4 locks held by kworker/u16:0/12: [ 3073.460068][ T44] 1 lock held by khungtaskd/44: [ 3073.460198][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3073.460572][ T44] 2 locks held by kworker/u17:1/1026: [ 3073.460688][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3073.460945][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3073.461243][ T44] 1 lock held by modprobe/28136: [ 3073.461378][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3073.461651][ T44] [ 3073.461721][ T44] ============================================= [ 3073.461721][ T44] [ 3196.332460][ T44] INFO: task modprobe:28136 blocked for more than 1105 seconds. [ 3196.332705][ T44] Tainted: G W 6.18.0-virtme #1 [ 3196.332873][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3196.333108][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 3196.333408][ T44] Call Trace: [ 3196.333545][ T44] [ 3196.333622][ T44] __schedule+0xae2/0x1720 [ 3196.333768][ T44] ? io_schedule_timeout+0x130/0x130 [ 3196.333896][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.334031][ T44] schedule+0xd4/0x260 [ 3196.334124][ T44] schedule_preempt_disabled+0x18/0x30 [ 3196.334246][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3196.334381][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3196.334524][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.334653][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3196.334788][ T44] ? register_pernet_subsys+0x19/0x40 [ 3196.334908][ T44] ? lock_acquire+0x10a/0x150 [ 3196.335026][ T44] down_write+0x1c6/0x1f0 [ 3196.335131][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3196.335298][ T44] register_pernet_subsys+0x19/0x40 [ 3196.335422][ T44] tcf_register_action+0xa3/0x5c0 [ 3196.335559][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 3196.335685][ T44] do_one_initcall+0xa3/0x2e0 [ 3196.335804][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3196.335987][ T44] ? kasan_unpoison+0x44/0x70 [ 3196.336112][ T44] do_init_module+0x27b/0x820 [ 3196.336251][ T44] ? free_module+0x450/0x450 [ 3196.336370][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3196.336513][ T44] init_module_from_file+0x15d/0x180 [ 3196.336652][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3196.336779][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.336898][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3196.337032][ T44] idempotent_init_module+0x226/0x760 [ 3196.337151][ T44] ? init_module_from_file+0x180/0x180 [ 3196.337294][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.337423][ T44] ? cap_capable+0x181/0x3f0 [ 3196.337572][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3196.337691][ T44] do_syscall_64+0xbd/0xfc0 [ 3196.337826][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3196.337981][ T44] RIP: 0033:0x7fac678ad34d [ 3196.338110][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3196.338298][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 3196.338503][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 3196.338688][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 3196.338871][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 3196.339054][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 3196.339249][ T44] [ 3196.339345][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 3196.339568][ T44] [ 3196.339568][ T44] Showing all locks held in the system: [ 3196.339762][ T44] 4 locks held by kworker/u16:0/12: [ 3196.339895][ T44] 1 lock held by khungtaskd/44: [ 3196.340022][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3196.340293][ T44] 2 locks held by kworker/u17:1/1026: [ 3196.340422][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3196.340793][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3196.341098][ T44] 1 lock held by modprobe/28136: [ 3196.341229][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3196.341498][ T44] [ 3196.341564][ T44] ============================================= [ 3196.341564][ T44] [ 3319.211453][ T44] INFO: task modprobe:28136 blocked for more than 1228 seconds. [ 3319.211690][ T44] Tainted: G W 6.18.0-virtme #1 [ 3319.211868][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3319.212080][ T44] task:modprobe state:D stack:25136 pid:28136 tgid:28136 ppid:1026 task_flags:0x400100 flags:0x00080000 [ 3319.212369][ T44] Call Trace: [ 3319.212492][ T44] [ 3319.212565][ T44] __schedule+0xae2/0x1720 [ 3319.212714][ T44] ? io_schedule_timeout+0x130/0x130 [ 3319.212857][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3319.212992][ T44] schedule+0xd4/0x260 [ 3319.213085][ T44] schedule_preempt_disabled+0x18/0x30 [ 3319.213208][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3319.213346][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3319.213472][ T44] ? rcu_is_watching+0x15/0xd0 [ 3319.213607][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3319.213724][ T44] ? register_pernet_subsys+0x19/0x40 [ 3319.213857][ T44] ? lock_acquire+0x10a/0x150 [ 3319.213976][ T44] down_write+0x1c6/0x1f0 [ 3319.214081][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3319.214244][ T44] register_pernet_subsys+0x19/0x40 [ 3319.214365][ T44] tcf_register_action+0xa3/0x5c0 [ 3319.214508][ T44] ? nsh_cleanup_module+0x420/0x420 [nsh] [ 3319.214630][ T44] do_one_initcall+0xa3/0x2e0 [ 3319.214764][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3319.214920][ T44] ? kasan_unpoison+0x44/0x70 [ 3319.215041][ T44] do_init_module+0x27b/0x820 [ 3319.215164][ T44] ? free_module+0x450/0x450 [ 3319.215296][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3319.215440][ T44] init_module_from_file+0x15d/0x180 [ 3319.215575][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3319.215698][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3319.215828][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3319.215962][ T44] idempotent_init_module+0x226/0x760 [ 3319.216081][ T44] ? init_module_from_file+0x180/0x180 [ 3319.216229][ T44] ? rcu_is_watching+0x15/0xd0 [ 3319.216360][ T44] ? cap_capable+0x181/0x3f0 [ 3319.216492][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3319.216624][ T44] do_syscall_64+0xbd/0xfc0 [ 3319.216745][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3319.216902][ T44] RIP: 0033:0x7fac678ad34d [ 3319.217042][ T44] RSP: 002b:00007ffe758ce358 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3319.217236][ T44] RAX: ffffffffffffffda RBX: 00005573fef15b10 RCX: 00007fac678ad34d [ 3319.217438][ T44] RDX: 0000000000000000 RSI: 00005573d75e8f2e RDI: 0000000000000000 [ 3319.217624][ T44] RBP: 00007ffe758ce3f0 R08: 0000000000000000 R09: 0000000000000000 [ 3319.217808][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005573d75e8f2e [ 3319.217992][ T44] R13: 0000000000040000 R14: 00005573fef15c60 R15: 00005573fef15570 [ 3319.218183][ T44] [ 3319.218281][ T44] INFO: task modprobe:28136 is blocked on an rw-semaphore, but the owner is not found. [ 3319.218501][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 3319.218729][ T44] [ 3319.218729][ T44] Showing all locks held in the system: [ 3319.218922][ T44] 3 locks held by kworker/u16:0/12: [ 3319.219051][ T44] 1 lock held by khungtaskd/44: [ 3319.219187][ T44] #0: ffffffffa4d84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3319.219541][ T44] 2 locks held by kworker/u17:1/1026: [ 3319.219672][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3319.219964][ T44] #1: ffa0000002427cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3319.220255][ T44] 1 lock held by modprobe/28136: [ 3319.220382][ T44] #0: ffffffffa5479190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3319.220648][ T44] [ 3319.220712][ T44] ============================================= [ 3319.220712][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr