[ 2145.129833][ T68] ------------[ cut here ]------------ [ 2145.130166][ T68] conntrack cleanup blocked for 60s [ 2145.130168][ T68] WARNING: net/netfilter/nf_conntrack_core.c:2511 at nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack], CPU#3: kworker/u16:1/68 [ 2145.130658][ T68] Modules linked in: nf_nat(+) cls_flower sch_ingress xt_conntrack nf_conntrack nf_defrag_ipv4 nf_defrag_ipv6 bonding psample xfrm_user macsec vxlan ip6_gre ip_gre gre cls_u32 sch_htb ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables [last unloaded: netdevsim] [ 2145.131382][ T68] CPU: 3 UID: 0 PID: 68 Comm: kworker/u16:1 Not tainted 6.19.0-rc1-virtme #1 PREEMPT(full) [ 2145.131651][ T68] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 2145.131821][ T68] Workqueue: netns cleanup_net [ 2145.131959][ T68] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack] [ 2145.132160][ T68] Code: 00 48 8b 54 24 18 48 8b 05 b3 38 c6 c6 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 0e bb c5 e9 25 fd ff ff 48 8d 3d 46 e6 09 00 <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df [ 2145.132612][ T68] RSP: 0018:ffa0000000497980 EFLAGS: 00010297 [ 2145.132796][ T68] RAX: 00000001001c25ab RBX: ffa0000000497af8 RCX: 0000000000000001 [ 2145.132993][ T68] RDX: 00000001001c25aa RSI: 0000000000000004 RDI: ffffffffc064c030 [ 2145.133178][ T68] RBP: 0000000000000001 R08: ffffffffc05ad7ba R09: ffe21c0000c33c4c [ 2145.133367][ T68] R10: ffe21c0000c33c4d R11: 0000000000000001 R12: dffffc0000000000 [ 2145.133553][ T68] R13: ff1100000619e260 R14: fffffbfff80cb207 R15: ff110000110b1c00 [ 2145.133740][ T68] FS: 0000000000000000(0000) GS:ff110000e3b73000(0000) knlGS:0000000000000000 [ 2145.133958][ T68] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2145.134249][ T68] CR2: 00007fafb0d72a48 CR3: 000000002b748003 CR4: 0000000000771ef0 [ 2145.134438][ T68] PKRU: 55555554 [ 2145.134534][ T68] Call Trace: [ 2145.134627][ T68] [ 2145.134697][ T68] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 2145.134857][ T68] ? kfree+0x119/0x580 [ 2145.134951][ T68] ? lock_acquire+0x10a/0x150 [ 2145.135075][ T68] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack] [ 2145.135229][ T68] ops_undo_list+0x2d7/0x8f0 [ 2145.135351][ T68] ? netns_install+0x280/0x280 [ 2145.135481][ T68] cleanup_net+0x3bc/0x890 [ 2145.135600][ T68] ? process_one_work+0xd16/0x1390 [ 2145.135727][ T68] ? net_passive_dec+0x190/0x190 [ 2145.135851][ T68] ? rcu_is_watching+0x15/0xd0 [ 2145.135971][ T68] ? process_one_work+0xd16/0x1390 [ 2145.136090][ T68] ? lock_acquire+0x10a/0x150 [ 2145.136212][ T68] ? rcu_is_watching+0x15/0xd0 [ 2145.136334][ T68] process_one_work+0xd57/0x1390 [ 2145.136459][ T68] ? pwq_dec_nr_in_flight+0x700/0x700 [ 2145.136580][ T68] ? lock_acquire.part.0+0xbc/0x260 [ 2145.136706][ T68] ? assign_work+0x152/0x380 [ 2145.136831][ T68] worker_thread+0x4d6/0xd40 [ 2145.136958][ T68] ? process_one_work+0x1390/0x1390 [ 2145.137079][ T68] kthread+0x355/0x5b0 [ 2145.137172][ T68] ? kthread_is_per_cpu+0xe0/0xe0 [ 2145.137292][ T68] ? __lock_release.isra.0+0x59/0x170 [ 2145.137418][ T68] ? rcu_is_watching+0x15/0xd0 [ 2145.137540][ T68] ? kthread_is_per_cpu+0xe0/0xe0 [ 2145.137664][ T68] ret_from_fork+0x3fb/0x510 [ 2145.137785][ T68] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 2145.137940][ T68] ? __switch_to+0x53c/0xd00 [ 2145.138062][ T68] ? kthread_is_per_cpu+0xe0/0xe0 [ 2145.138182][ T68] ret_from_fork_asm+0x11/0x20 [ 2145.138315][ T68] [ 2145.138408][ T68] irq event stamp: 10469453 [ 2145.138531][ T68] hardirqs last enabled at (10469461): [] __up_console_sem+0x5a/0x70 [ 2145.138749][ T68] hardirqs last disabled at (10469468): [] __up_console_sem+0x3f/0x70 [ 2145.138964][ T68] softirqs last enabled at (10469066): [] handle_softirqs+0x56f/0x840 [ 2145.139177][ T68] softirqs last disabled at (10469061): [] irq_exit_rcu+0xa2/0xf0 [ 2145.139389][ T68] ---[ end trace 0000000000000000 ]--- [ 2336.191928][ T44] INFO: task modprobe:3789 blocked for more than 122 seconds. [ 2336.192296][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2336.192493][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2336.192705][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2336.192990][ T44] Call Trace: [ 2336.193088][ T44] [ 2336.193155][ T44] __schedule+0xae2/0x1720 [ 2336.193295][ T44] ? io_schedule_timeout+0x130/0x130 [ 2336.193428][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.193564][ T44] schedule+0xd4/0x260 [ 2336.193660][ T44] schedule_preempt_disabled+0x18/0x30 [ 2336.193782][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2336.193908][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2336.194044][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.194163][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2336.194286][ T44] ? register_pernet_subsys+0x19/0x40 [ 2336.194410][ T44] ? lock_acquire+0x10a/0x150 [ 2336.194532][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2336.194659][ T44] down_write+0x1c6/0x1f0 [ 2336.194743][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2336.194884][ T44] ? static_obj+0x5d/0x90 [ 2336.194969][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2336.195081][ T44] register_pernet_subsys+0x19/0x40 [ 2336.195191][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2336.195306][ T44] do_one_initcall+0xa3/0x2e0 [ 2336.195417][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2336.195561][ T44] ? kasan_unpoison+0x44/0x70 [ 2336.195778][ T44] do_init_module+0x27b/0x820 [ 2336.195900][ T44] ? free_module+0x450/0x450 [ 2336.196011][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2336.196123][ T44] init_module_from_file+0x15d/0x180 [ 2336.196233][ T44] ? __do_sys_init_module+0x200/0x200 [ 2336.196349][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.196463][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2336.196575][ T44] idempotent_init_module+0x226/0x760 [ 2336.196686][ T44] ? init_module_from_file+0x180/0x180 [ 2336.196799][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.196915][ T44] ? cap_capable+0x181/0x3f0 [ 2336.197026][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2336.197135][ T44] do_syscall_64+0xbd/0xfc0 [ 2336.197245][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2336.197381][ T44] RIP: 0033:0x7f45f51e234d [ 2336.197501][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2336.197669][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2336.197839][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2336.198004][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2336.198171][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2336.198336][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2336.198511][ T44] [ 2336.198595][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2336.198771][ T44] [ 2336.198771][ T44] Showing all locks held in the system: [ 2336.198943][ T44] 1 lock held by khungtaskd/44: [ 2336.199050][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2336.199266][ T44] 4 locks held by kworker/u16:1/68: [ 2336.199372][ T44] 2 locks held by kworker/u19:3/21685: [ 2336.199479][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2336.199694][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2336.199935][ T44] 1 lock held by modprobe/3789: [ 2336.200038][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2336.200244][ T44] [ 2336.200301][ T44] ============================================= [ 2336.200301][ T44] [ 2459.070835][ T44] INFO: task modprobe:3789 blocked for more than 245 seconds. [ 2459.071111][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2459.071312][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2459.071547][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2459.071879][ T44] Call Trace: [ 2459.071971][ T44] [ 2459.072036][ T44] __schedule+0xae2/0x1720 [ 2459.072161][ T44] ? io_schedule_timeout+0x130/0x130 [ 2459.072283][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.072409][ T44] schedule+0xd4/0x260 [ 2459.072500][ T44] schedule_preempt_disabled+0x18/0x30 [ 2459.072623][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2459.072746][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2459.072877][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.072991][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2459.073104][ T44] ? register_pernet_subsys+0x19/0x40 [ 2459.073217][ T44] ? lock_acquire+0x10a/0x150 [ 2459.073332][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2459.073455][ T44] down_write+0x1c6/0x1f0 [ 2459.073541][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2459.073682][ T44] ? static_obj+0x5d/0x90 [ 2459.073767][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2459.073887][ T44] register_pernet_subsys+0x19/0x40 [ 2459.073997][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2459.074113][ T44] do_one_initcall+0xa3/0x2e0 [ 2459.074223][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2459.074361][ T44] ? kasan_unpoison+0x44/0x70 [ 2459.074475][ T44] do_init_module+0x27b/0x820 [ 2459.074587][ T44] ? free_module+0x450/0x450 [ 2459.074696][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2459.074818][ T44] init_module_from_file+0x15d/0x180 [ 2459.074933][ T44] ? __do_sys_init_module+0x200/0x200 [ 2459.075053][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.075163][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2459.075273][ T44] idempotent_init_module+0x226/0x760 [ 2459.075384][ T44] ? init_module_from_file+0x180/0x180 [ 2459.075496][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.075605][ T44] ? cap_capable+0x181/0x3f0 [ 2459.075716][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2459.075835][ T44] do_syscall_64+0xbd/0xfc0 [ 2459.075945][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2459.076080][ T44] RIP: 0033:0x7f45f51e234d [ 2459.076194][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2459.076359][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2459.076527][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2459.076690][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2459.076859][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2459.077021][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2459.077194][ T44] [ 2459.077275][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2459.077447][ T44] [ 2459.077447][ T44] Showing all locks held in the system: [ 2459.077608][ T44] 1 lock held by khungtaskd/44: [ 2459.077712][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2459.077931][ T44] 3 locks held by kworker/u16:1/68: [ 2459.078036][ T44] 2 locks held by kworker/u19:3/21685: [ 2459.078139][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2459.078352][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2459.078588][ T44] 1 lock held by modprobe/3789: [ 2459.078693][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2459.078908][ T44] [ 2459.078961][ T44] ============================================= [ 2459.078961][ T44] [ 2581.950834][ T44] INFO: task modprobe:3789 blocked for more than 368 seconds. [ 2581.951107][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2581.951326][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2581.951553][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2581.951888][ T44] Call Trace: [ 2581.951991][ T44] [ 2581.952058][ T44] __schedule+0xae2/0x1720 [ 2581.952181][ T44] ? io_schedule_timeout+0x130/0x130 [ 2581.952300][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.952417][ T44] schedule+0xd4/0x260 [ 2581.952505][ T44] schedule_preempt_disabled+0x18/0x30 [ 2581.952624][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2581.952741][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2581.952866][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.952981][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2581.953100][ T44] ? register_pernet_subsys+0x19/0x40 [ 2581.953214][ T44] ? lock_acquire+0x10a/0x150 [ 2581.953325][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2581.953438][ T44] down_write+0x1c6/0x1f0 [ 2581.953523][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2581.953660][ T44] ? static_obj+0x5d/0x90 [ 2581.953743][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2581.953862][ T44] register_pernet_subsys+0x19/0x40 [ 2581.953974][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2581.954087][ T44] do_one_initcall+0xa3/0x2e0 [ 2581.954198][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2581.954335][ T44] ? kasan_unpoison+0x44/0x70 [ 2581.954448][ T44] do_init_module+0x27b/0x820 [ 2581.954566][ T44] ? free_module+0x450/0x450 [ 2581.954675][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2581.954787][ T44] init_module_from_file+0x15d/0x180 [ 2581.954902][ T44] ? __do_sys_init_module+0x200/0x200 [ 2581.955017][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.955128][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2581.955238][ T44] idempotent_init_module+0x226/0x760 [ 2581.955352][ T44] ? init_module_from_file+0x180/0x180 [ 2581.955465][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.955573][ T44] ? cap_capable+0x181/0x3f0 [ 2581.955683][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2581.955793][ T44] do_syscall_64+0xbd/0xfc0 [ 2581.955907][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2581.956041][ T44] RIP: 0033:0x7f45f51e234d [ 2581.956160][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2581.956323][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2581.956486][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2581.956648][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2581.956816][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2581.956985][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2581.957157][ T44] [ 2581.957237][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2581.957411][ T44] [ 2581.957411][ T44] Showing all locks held in the system: [ 2581.957571][ T44] 1 lock held by khungtaskd/44: [ 2581.957676][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2581.957895][ T44] 4 locks held by kworker/u16:1/68: [ 2581.957998][ T44] 2 locks held by kworker/u19:3/21685: [ 2581.958101][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2581.958316][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2581.958550][ T44] 1 lock held by modprobe/3789: [ 2581.958653][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2581.958865][ T44] [ 2581.958918][ T44] ============================================= [ 2581.958918][ T44] [ 2704.831834][ T44] INFO: task modprobe:3789 blocked for more than 491 seconds. [ 2704.832094][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2704.832296][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2704.832527][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2704.832841][ T44] Call Trace: [ 2704.832940][ T44] [ 2704.833011][ T44] __schedule+0xae2/0x1720 [ 2704.833152][ T44] ? io_schedule_timeout+0x130/0x130 [ 2704.833294][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.833414][ T44] schedule+0xd4/0x260 [ 2704.833505][ T44] schedule_preempt_disabled+0x18/0x30 [ 2704.833619][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2704.833737][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2704.833860][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.833975][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2704.834096][ T44] ? register_pernet_subsys+0x19/0x40 [ 2704.834210][ T44] ? lock_acquire+0x10a/0x150 [ 2704.834325][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2704.834440][ T44] down_write+0x1c6/0x1f0 [ 2704.834527][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2704.834665][ T44] ? static_obj+0x5d/0x90 [ 2704.834747][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2704.834864][ T44] register_pernet_subsys+0x19/0x40 [ 2704.834976][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2704.835089][ T44] do_one_initcall+0xa3/0x2e0 [ 2704.835204][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2704.835344][ T44] ? kasan_unpoison+0x44/0x70 [ 2704.835459][ T44] do_init_module+0x27b/0x820 [ 2704.835570][ T44] ? free_module+0x450/0x450 [ 2704.835680][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2704.835790][ T44] init_module_from_file+0x15d/0x180 [ 2704.835904][ T44] ? __do_sys_init_module+0x200/0x200 [ 2704.836024][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.836135][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2704.836245][ T44] idempotent_init_module+0x226/0x760 [ 2704.836356][ T44] ? init_module_from_file+0x180/0x180 [ 2704.836473][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.836589][ T44] ? cap_capable+0x181/0x3f0 [ 2704.836700][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2704.836820][ T44] do_syscall_64+0xbd/0xfc0 [ 2704.836930][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2704.837065][ T44] RIP: 0033:0x7f45f51e234d [ 2704.837179][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2704.837344][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2704.837515][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2704.837693][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2704.837862][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2704.838026][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2704.838196][ T44] [ 2704.838280][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2704.838457][ T44] [ 2704.838457][ T44] Showing all locks held in the system: [ 2704.838613][ T44] 1 lock held by khungtaskd/44: [ 2704.838716][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2704.838932][ T44] 4 locks held by kworker/u16:1/68: [ 2704.839040][ T44] 2 locks held by kworker/u19:3/21685: [ 2704.839147][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2704.839357][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2704.839596][ T44] 1 lock held by modprobe/3789: [ 2704.839698][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2704.839913][ T44] [ 2704.839966][ T44] ============================================= [ 2704.839966][ T44] [ 2827.711834][ T44] INFO: task modprobe:3789 blocked for more than 614 seconds. [ 2827.712115][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2827.712314][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2827.712542][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2827.712855][ T44] Call Trace: [ 2827.712965][ T44] [ 2827.713033][ T44] __schedule+0xae2/0x1720 [ 2827.713170][ T44] ? io_schedule_timeout+0x130/0x130 [ 2827.713300][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.713432][ T44] schedule+0xd4/0x260 [ 2827.713528][ T44] schedule_preempt_disabled+0x18/0x30 [ 2827.713645][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2827.713765][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2827.713887][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.714004][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2827.714118][ T44] ? register_pernet_subsys+0x19/0x40 [ 2827.714235][ T44] ? lock_acquire+0x10a/0x150 [ 2827.714349][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2827.714470][ T44] down_write+0x1c6/0x1f0 [ 2827.714561][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2827.714697][ T44] ? static_obj+0x5d/0x90 [ 2827.714780][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2827.714898][ T44] register_pernet_subsys+0x19/0x40 [ 2827.715012][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2827.715124][ T44] do_one_initcall+0xa3/0x2e0 [ 2827.715233][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2827.715372][ T44] ? kasan_unpoison+0x44/0x70 [ 2827.715485][ T44] do_init_module+0x27b/0x820 [ 2827.715596][ T44] ? free_module+0x450/0x450 [ 2827.715708][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2827.715823][ T44] init_module_from_file+0x15d/0x180 [ 2827.715932][ T44] ? __do_sys_init_module+0x200/0x200 [ 2827.716051][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.716167][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2827.716276][ T44] idempotent_init_module+0x226/0x760 [ 2827.716385][ T44] ? init_module_from_file+0x180/0x180 [ 2827.716504][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.716611][ T44] ? cap_capable+0x181/0x3f0 [ 2827.716722][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2827.716838][ T44] do_syscall_64+0xbd/0xfc0 [ 2827.716947][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2827.717087][ T44] RIP: 0033:0x7f45f51e234d [ 2827.717206][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2827.717372][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2827.717533][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2827.717695][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2827.717861][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2827.718030][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2827.718199][ T44] [ 2827.718281][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2827.718456][ T44] [ 2827.718456][ T44] Showing all locks held in the system: [ 2827.718615][ T44] 1 lock held by khungtaskd/44: [ 2827.718720][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2827.718937][ T44] 4 locks held by kworker/u16:1/68: [ 2827.719047][ T44] 2 locks held by kworker/u19:3/21685: [ 2827.719149][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2827.719359][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2827.719602][ T44] 1 lock held by modprobe/3789: [ 2827.719705][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2827.719916][ T44] [ 2827.719973][ T44] ============================================= [ 2827.719973][ T44] [ 2950.591834][ T44] INFO: task modprobe:3789 blocked for more than 737 seconds. [ 2950.592092][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2950.592289][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2950.592513][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 2950.592829][ T44] Call Trace: [ 2950.592920][ T44] [ 2950.592983][ T44] __schedule+0xae2/0x1720 [ 2950.593104][ T44] ? io_schedule_timeout+0x130/0x130 [ 2950.593223][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.593346][ T44] schedule+0xd4/0x260 [ 2950.593437][ T44] schedule_preempt_disabled+0x18/0x30 [ 2950.593554][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2950.593682][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2950.593802][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.593921][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2950.594033][ T44] ? register_pernet_subsys+0x19/0x40 [ 2950.594144][ T44] ? lock_acquire+0x10a/0x150 [ 2950.594258][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 2950.594371][ T44] down_write+0x1c6/0x1f0 [ 2950.594460][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2950.594600][ T44] ? static_obj+0x5d/0x90 [ 2950.594688][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2950.594801][ T44] register_pernet_subsys+0x19/0x40 [ 2950.594918][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2950.595030][ T44] do_one_initcall+0xa3/0x2e0 [ 2950.595140][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2950.595281][ T44] ? kasan_unpoison+0x44/0x70 [ 2950.595393][ T44] do_init_module+0x27b/0x820 [ 2950.595506][ T44] ? free_module+0x450/0x450 [ 2950.595616][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2950.595731][ T44] init_module_from_file+0x15d/0x180 [ 2950.595845][ T44] ? __do_sys_init_module+0x200/0x200 [ 2950.595960][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.596074][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2950.596183][ T44] idempotent_init_module+0x226/0x760 [ 2950.596294][ T44] ? init_module_from_file+0x180/0x180 [ 2950.596407][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.596516][ T44] ? cap_capable+0x181/0x3f0 [ 2950.596626][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2950.596741][ T44] do_syscall_64+0xbd/0xfc0 [ 2950.596862][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2950.596996][ T44] RIP: 0033:0x7f45f51e234d [ 2950.597109][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2950.597275][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 2950.597438][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 2950.597602][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 2950.597768][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 2950.597938][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 2950.598106][ T44] [ 2950.598188][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 2950.598364][ T44] [ 2950.598364][ T44] Showing all locks held in the system: [ 2950.598523][ T44] 1 lock held by khungtaskd/44: [ 2950.598627][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2950.598848][ T44] 4 locks held by kworker/u16:1/68: [ 2950.598953][ T44] 2 locks held by kworker/u19:3/21685: [ 2950.599060][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2950.599269][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2950.599504][ T44] 1 lock held by modprobe/3789: [ 2950.599607][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2950.599825][ T44] [ 2950.599877][ T44] ============================================= [ 2950.599877][ T44] [ 3073.471835][ T44] INFO: task modprobe:3789 blocked for more than 860 seconds. [ 3073.472107][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 3073.472302][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3073.472547][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 3073.472875][ T44] Call Trace: [ 3073.472979][ T44] [ 3073.473048][ T44] __schedule+0xae2/0x1720 [ 3073.473168][ T44] ? io_schedule_timeout+0x130/0x130 [ 3073.473286][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.473410][ T44] schedule+0xd4/0x260 [ 3073.473499][ T44] schedule_preempt_disabled+0x18/0x30 [ 3073.473620][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3073.473739][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3073.473865][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.473981][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3073.474092][ T44] ? register_pernet_subsys+0x19/0x40 [ 3073.474209][ T44] ? lock_acquire+0x10a/0x150 [ 3073.474321][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 3073.474435][ T44] down_write+0x1c6/0x1f0 [ 3073.474519][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3073.474658][ T44] ? static_obj+0x5d/0x90 [ 3073.474742][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3073.474861][ T44] register_pernet_subsys+0x19/0x40 [ 3073.474975][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3073.475089][ T44] do_one_initcall+0xa3/0x2e0 [ 3073.475198][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3073.475336][ T44] ? kasan_unpoison+0x44/0x70 [ 3073.475452][ T44] do_init_module+0x27b/0x820 [ 3073.475563][ T44] ? free_module+0x450/0x450 [ 3073.475674][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3073.475786][ T44] init_module_from_file+0x15d/0x180 [ 3073.475901][ T44] ? __do_sys_init_module+0x200/0x200 [ 3073.476016][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.476126][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3073.476236][ T44] idempotent_init_module+0x226/0x760 [ 3073.476347][ T44] ? init_module_from_file+0x180/0x180 [ 3073.476470][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.476579][ T44] ? cap_capable+0x181/0x3f0 [ 3073.476689][ T44] __x64_sys_finit_module+0xcd/0x160 [ 3073.476799][ T44] do_syscall_64+0xbd/0xfc0 [ 3073.476914][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3073.477054][ T44] RIP: 0033:0x7f45f51e234d [ 3073.477169][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3073.477340][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 3073.477506][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 3073.477668][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 3073.477836][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 3073.478000][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 3073.478167][ T44] [ 3073.478248][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 3073.478425][ T44] [ 3073.478425][ T44] Showing all locks held in the system: [ 3073.478580][ T44] 1 lock held by khungtaskd/44: [ 3073.478685][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3073.478903][ T44] 4 locks held by kworker/u16:1/68: [ 3073.479007][ T44] 2 locks held by kworker/u19:3/21685: [ 3073.479110][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3073.479321][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3073.479565][ T44] 1 lock held by modprobe/3789: [ 3073.479667][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3073.479881][ T44] [ 3073.479935][ T44] ============================================= [ 3073.479935][ T44] [ 3196.350833][ T44] INFO: task modprobe:3789 blocked for more than 983 seconds. [ 3196.351109][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 3196.351308][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3196.351535][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 3196.351852][ T44] Call Trace: [ 3196.351956][ T44] [ 3196.352033][ T44] __schedule+0xae2/0x1720 [ 3196.352187][ T44] ? io_schedule_timeout+0x130/0x130 [ 3196.352320][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.352438][ T44] schedule+0xd4/0x260 [ 3196.352526][ T44] schedule_preempt_disabled+0x18/0x30 [ 3196.352641][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3196.352758][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3196.352885][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.353000][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3196.353120][ T44] ? register_pernet_subsys+0x19/0x40 [ 3196.353235][ T44] ? lock_acquire+0x10a/0x150 [ 3196.353346][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 3196.353459][ T44] down_write+0x1c6/0x1f0 [ 3196.353543][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3196.353684][ T44] ? static_obj+0x5d/0x90 [ 3196.353767][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3196.353882][ T44] register_pernet_subsys+0x19/0x40 [ 3196.353994][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3196.354110][ T44] do_one_initcall+0xa3/0x2e0 [ 3196.354222][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3196.354360][ T44] ? kasan_unpoison+0x44/0x70 [ 3196.354473][ T44] do_init_module+0x27b/0x820 [ 3196.354585][ T44] ? free_module+0x450/0x450 [ 3196.354694][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3196.354804][ T44] init_module_from_file+0x15d/0x180 [ 3196.354918][ T44] ? __do_sys_init_module+0x200/0x200 [ 3196.355033][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.355146][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3196.355262][ T44] idempotent_init_module+0x226/0x760 [ 3196.355371][ T44] ? init_module_from_file+0x180/0x180 [ 3196.355484][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.355592][ T44] ? cap_capable+0x181/0x3f0 [ 3196.355703][ T44] __x64_sys_finit_module+0xcd/0x160 [ 3196.355817][ T44] do_syscall_64+0xbd/0xfc0 [ 3196.355927][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3196.356063][ T44] RIP: 0033:0x7f45f51e234d [ 3196.356181][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3196.356346][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 3196.356511][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 3196.356676][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 3196.356845][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 3196.357014][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 3196.357186][ T44] [ 3196.357267][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 3196.357445][ T44] [ 3196.357445][ T44] Showing all locks held in the system: [ 3196.357604][ T44] 1 lock held by khungtaskd/44: [ 3196.357710][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3196.357925][ T44] 4 locks held by kworker/u16:1/68: [ 3196.358030][ T44] 2 locks held by kworker/u19:3/21685: [ 3196.358136][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3196.358351][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3196.358586][ T44] 1 lock held by modprobe/3789: [ 3196.358688][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3196.358907][ T44] [ 3196.358964][ T44] ============================================= [ 3196.358964][ T44] [ 3319.231865][ T44] INFO: task modprobe:3789 blocked for more than 1105 seconds. [ 3319.232153][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 3319.232326][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3319.232523][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 3319.232796][ T44] Call Trace: [ 3319.232945][ T44] [ 3319.233014][ T44] __schedule+0xae2/0x1720 [ 3319.233156][ T44] ? io_schedule_timeout+0x130/0x130 [ 3319.233284][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3319.233418][ T44] schedule+0xd4/0x260 [ 3319.233517][ T44] schedule_preempt_disabled+0x18/0x30 [ 3319.233631][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3319.233752][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3319.233883][ T44] ? rcu_is_watching+0x15/0xd0 [ 3319.234002][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3319.234120][ T44] ? register_pernet_subsys+0x19/0x40 [ 3319.234241][ T44] ? lock_acquire+0x10a/0x150 [ 3319.234364][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 3319.234484][ T44] down_write+0x1c6/0x1f0 [ 3319.234572][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3319.234722][ T44] ? static_obj+0x5d/0x90 [ 3319.234818][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3319.234935][ T44] register_pernet_subsys+0x19/0x40 [ 3319.235048][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3319.235168][ T44] do_one_initcall+0xa3/0x2e0 [ 3319.235289][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3319.235432][ T44] ? kasan_unpoison+0x44/0x70 [ 3319.235546][ T44] do_init_module+0x27b/0x820 [ 3319.235660][ T44] ? free_module+0x450/0x450 [ 3319.235770][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3319.235891][ T44] init_module_from_file+0x15d/0x180 [ 3319.236022][ T44] ? __do_sys_init_module+0x200/0x200 [ 3319.236138][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3319.236247][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3319.236356][ T44] idempotent_init_module+0x226/0x760 [ 3319.236467][ T44] ? init_module_from_file+0x180/0x180 [ 3319.236581][ T44] ? rcu_is_watching+0x15/0xd0 [ 3319.236696][ T44] ? cap_capable+0x181/0x3f0 [ 3319.236817][ T44] __x64_sys_finit_module+0xcd/0x160 [ 3319.236928][ T44] do_syscall_64+0xbd/0xfc0 [ 3319.237039][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3319.237175][ T44] RIP: 0033:0x7f45f51e234d [ 3319.237297][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3319.237464][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 3319.237643][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 3319.237818][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 3319.237981][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 3319.238144][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 3319.238320][ T44] [ 3319.238408][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 3319.238585][ T44] [ 3319.238585][ T44] Showing all locks held in the system: [ 3319.238749][ T44] 1 lock held by khungtaskd/44: [ 3319.238863][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3319.239082][ T44] 4 locks held by kworker/u16:1/68: [ 3319.239188][ T44] 2 locks held by kworker/u19:3/21685: [ 3319.239293][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3319.239503][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3319.239750][ T44] 1 lock held by modprobe/3789: [ 3319.239861][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3319.240071][ T44] [ 3319.240127][ T44] ============================================= [ 3319.240127][ T44] [ 3442.111862][ T44] INFO: task modprobe:3789 blocked for more than 1228 seconds. [ 3442.112121][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 3442.112305][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3442.112506][ T44] task:modprobe state:D stack:25104 pid:3789 tgid:3789 ppid:21685 task_flags:0x400100 flags:0x00080000 [ 3442.112784][ T44] Call Trace: [ 3442.112889][ T44] [ 3442.112951][ T44] __schedule+0xae2/0x1720 [ 3442.113079][ T44] ? io_schedule_timeout+0x130/0x130 [ 3442.113195][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3442.113315][ T44] schedule+0xd4/0x260 [ 3442.113401][ T44] schedule_preempt_disabled+0x18/0x30 [ 3442.113515][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3442.113636][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3442.113759][ T44] ? rcu_is_watching+0x15/0xd0 [ 3442.113882][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3442.113998][ T44] ? register_pernet_subsys+0x19/0x40 [ 3442.114113][ T44] ? lock_acquire+0x10a/0x150 [ 3442.114228][ T44] ? cls_fl_exit+0xdb0/0xdb0 [cls_flower] [ 3442.114345][ T44] down_write+0x1c6/0x1f0 [ 3442.114431][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3442.114571][ T44] ? static_obj+0x5d/0x90 [ 3442.114669][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3442.114784][ T44] register_pernet_subsys+0x19/0x40 [ 3442.114903][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3442.115020][ T44] do_one_initcall+0xa3/0x2e0 [ 3442.115138][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3442.115283][ T44] ? kasan_unpoison+0x44/0x70 [ 3442.115403][ T44] do_init_module+0x27b/0x820 [ 3442.115542][ T44] ? free_module+0x450/0x450 [ 3442.115659][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3442.115776][ T44] init_module_from_file+0x15d/0x180 [ 3442.115895][ T44] ? __do_sys_init_module+0x200/0x200 [ 3442.116020][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3442.116136][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3442.116255][ T44] idempotent_init_module+0x226/0x760 [ 3442.116371][ T44] ? init_module_from_file+0x180/0x180 [ 3442.116489][ T44] ? rcu_is_watching+0x15/0xd0 [ 3442.116607][ T44] ? cap_capable+0x181/0x3f0 [ 3442.116724][ T44] __x64_sys_finit_module+0xcd/0x160 [ 3442.116845][ T44] do_syscall_64+0xbd/0xfc0 [ 3442.116960][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3442.117105][ T44] RIP: 0033:0x7f45f51e234d [ 3442.117225][ T44] RSP: 002b:00007ffefd3b2b08 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3442.117404][ T44] RAX: ffffffffffffffda RBX: 000055572d944ff0 RCX: 00007f45f51e234d [ 3442.117576][ T44] RDX: 0000000000000000 RSI: 000055571780ff2e RDI: 0000000000000000 [ 3442.117748][ T44] RBP: 00007ffefd3b2ba0 R08: 0000000000000000 R09: 0000000000000000 [ 3442.117926][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055571780ff2e [ 3442.118097][ T44] R13: 0000000000040000 R14: 000055572d944fa0 R15: 000055572d944570 [ 3442.118273][ T44] [ 3442.118360][ T44] INFO: task modprobe:3789 is blocked on an rw-semaphore, but the owner is not found. [ 3442.118543][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 3442.118737][ T44] [ 3442.118737][ T44] Showing all locks held in the system: [ 3442.118911][ T44] 1 lock held by khungtaskd/44: [ 3442.119023][ T44] #0: ffffffff875850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3442.119252][ T44] 4 locks held by kworker/u16:1/68: [ 3442.119362][ T44] 2 locks held by kworker/u19:3/21685: [ 3442.119475][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3442.119701][ T44] #1: ffa0000007087cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3442.119961][ T44] 1 lock held by modprobe/3789: [ 3442.120070][ T44] #0: ffffffff87c85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3442.120294][ T44] [ 3442.120350][ T44] ============================================= [ 3442.120350][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr