[ 1821.514323][ T12] ------------[ cut here ]------------ [ 1821.514715][ T12] conntrack cleanup blocked for 60s [ 1821.514717][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack], CPU#3: kworker/u16:0/12 [ 1821.515240][ T12] Modules linked in: nf_nat(+) cls_flower sch_ingress xt_conntrack nf_conntrack nf_defrag_ipv4 nf_defrag_ipv6 unix_diag xfrm_user xt_policy ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables [ 1821.515795][ T12] CPU: 3 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.19.0-rc1-virtme #1 PREEMPT(full) [ 1821.516078][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1821.516296][ T12] Workqueue: netns cleanup_net [ 1821.516435][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack] [ 1821.516648][ T12] Code: 00 48 8b 54 24 18 48 8b 05 b3 88 31 dc 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 5e 26 db e9 25 fd ff ff 48 8d 3d 46 86 10 00 <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df [ 1821.517116][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010297 [ 1821.517279][ T12] RAX: 0000000100173594 RBX: ffa00000000c7af8 RCX: 0000000000000001 [ 1821.517484][ T12] RDX: 0000000100173593 RSI: 0000000000000004 RDI: ffffffffc0601030 [ 1821.517699][ T12] RBP: 0000000000000001 R08: ffffffffc04f87ba R09: ffe21c00016f4e94 [ 1821.517914][ T12] R10: ffe21c00016f4e95 R11: 0000000000000001 R12: dffffc0000000000 [ 1821.518101][ T12] R13: ff1100000b7a74a0 R14: fffffbfff80c1c07 R15: ff1100000b2659c0 [ 1821.518299][ T12] FS: 0000000000000000(0000) GS:ff110000ce573000(0000) knlGS:0000000000000000 [ 1821.518521][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1821.518697][ T12] CR2: 000056314f3bfb28 CR3: 000000000a583004 CR4: 0000000000771ef0 [ 1821.519227][ T12] PKRU: 55555554 [ 1821.519328][ T12] Call Trace: [ 1821.519423][ T12] [ 1821.519492][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 1821.519655][ T12] ? kfree+0x119/0x580 [ 1821.519748][ T12] ? lock_acquire+0x10a/0x150 [ 1821.519872][ T12] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack] [ 1821.520032][ T12] ops_undo_list+0x2d7/0x8f0 [ 1821.520155][ T12] ? netns_install+0x280/0x280 [ 1821.520278][ T12] cleanup_net+0x3bc/0x890 [ 1821.520402][ T12] ? process_one_work+0xd16/0x1390 [ 1821.520529][ T12] ? net_passive_dec+0x190/0x190 [ 1821.520656][ T12] ? rcu_is_watching+0x15/0xd0 [ 1821.520777][ T12] ? process_one_work+0xd16/0x1390 [ 1821.520903][ T12] ? lock_acquire+0x10a/0x150 [ 1821.521022][ T12] ? rcu_is_watching+0x15/0xd0 [ 1821.521144][ T12] process_one_work+0xd57/0x1390 [ 1821.521268][ T12] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1821.521393][ T12] ? lock_acquire.part.0+0xbc/0x260 [ 1821.521516][ T12] ? assign_work+0x152/0x380 [ 1821.521643][ T12] worker_thread+0x4d6/0xd40 [ 1821.521767][ T12] ? process_one_work+0x1390/0x1390 [ 1821.521893][ T12] kthread+0x355/0x5b0 [ 1821.521986][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1821.522107][ T12] ? __lock_release.isra.0+0x59/0x170 [ 1821.522228][ T12] ? rcu_is_watching+0x15/0xd0 [ 1821.522354][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1821.522476][ T12] ret_from_fork+0x3fb/0x510 [ 1821.522602][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 1821.522755][ T12] ? __switch_to+0x53c/0xd00 [ 1821.522877][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1821.522999][ T12] ret_from_fork_asm+0x11/0x20 [ 1821.523128][ T12] [ 1821.523222][ T12] irq event stamp: 9393779 [ 1821.523350][ T12] hardirqs last enabled at (9393789): [] __up_console_sem+0x5a/0x70 [ 1821.523569][ T12] hardirqs last disabled at (9393796): [] __up_console_sem+0x3f/0x70 [ 1821.523784][ T12] softirqs last enabled at (9393392): [] handle_softirqs+0x56f/0x840 [ 1821.523996][ T12] softirqs last disabled at (9393387): [] irq_exit_rcu+0xa2/0xf0 [ 1821.524225][ T12] ---[ end trace 0000000000000000 ]--- [ 1967.543362][ T44] INFO: task modprobe:27887 blocked for more than 122 seconds. [ 1967.544123][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 1967.544310][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1967.544511][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 1967.544786][ T44] Call Trace: [ 1967.544879][ T44] [ 1967.544955][ T44] __schedule+0xae2/0x1720 [ 1967.545084][ T44] ? io_schedule_timeout+0x130/0x130 [ 1967.545204][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1967.545331][ T44] schedule+0xd4/0x260 [ 1967.545421][ T44] schedule_preempt_disabled+0x18/0x30 [ 1967.545538][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 1967.545663][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 1967.545791][ T44] ? rcu_is_watching+0x15/0xd0 [ 1967.545906][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 1967.546021][ T44] ? register_pernet_subsys+0x19/0x40 [ 1967.546137][ T44] ? lock_acquire+0x10a/0x150 [ 1967.546251][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 1967.546408][ T44] down_write+0x1c6/0x1f0 [ 1967.546495][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 1967.546641][ T44] ? static_obj+0x5d/0x90 [ 1967.546731][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 1967.546842][ T44] register_pernet_subsys+0x19/0x40 [ 1967.546952][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 1967.547064][ T44] do_one_initcall+0xa3/0x2e0 [ 1967.547176][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 1967.547324][ T44] ? kasan_unpoison+0x44/0x70 [ 1967.547439][ T44] do_init_module+0x27b/0x820 [ 1967.547725][ T44] ? free_module+0x450/0x450 [ 1967.547838][ T44] ? backing_file_read_iter+0x50e/0x730 [ 1967.547951][ T44] init_module_from_file+0x15d/0x180 [ 1967.548060][ T44] ? __do_sys_init_module+0x200/0x200 [ 1967.548175][ T44] ? __lock_release.isra.0+0x59/0x170 [ 1967.548297][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 1967.548407][ T44] idempotent_init_module+0x226/0x760 [ 1967.548517][ T44] ? init_module_from_file+0x180/0x180 [ 1967.548631][ T44] ? rcu_is_watching+0x15/0xd0 [ 1967.548744][ T44] ? cap_capable+0x181/0x3f0 [ 1967.548854][ T44] __x64_sys_finit_module+0xcd/0x160 [ 1967.548964][ T44] do_syscall_64+0xbd/0xfc0 [ 1967.549081][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1967.549216][ T44] RIP: 0033:0x7fbcd275234d [ 1967.549339][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 1967.549508][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 1967.549678][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 1967.549847][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 1967.550011][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 1967.550174][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 1967.550352][ T44] [ 1967.550437][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 1967.550623][ T44] [ 1967.550623][ T44] Showing all locks held in the system: [ 1967.550790][ T44] 4 locks held by kworker/u16:0/12: [ 1967.550903][ T44] 1 lock held by khungtaskd/44: [ 1967.551012][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1967.551236][ T44] 2 locks held by kworker/u20:3/9443: [ 1967.551349][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 1967.551561][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 1967.551814][ T44] 1 lock held by modprobe/27887: [ 1967.551919][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 1967.552134][ T44] [ 1967.552191][ T44] ============================================= [ 1967.552191][ T44] [ 2090.423356][ T44] INFO: task modprobe:27887 blocked for more than 245 seconds. [ 2090.423678][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2090.423886][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2090.424138][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2090.424472][ T44] Call Trace: [ 2090.424573][ T44] [ 2090.424649][ T44] __schedule+0xae2/0x1720 [ 2090.424793][ T44] ? io_schedule_timeout+0x130/0x130 [ 2090.424930][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.425051][ T44] schedule+0xd4/0x260 [ 2090.425144][ T44] schedule_preempt_disabled+0x18/0x30 [ 2090.425257][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2090.425380][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2090.425497][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.425621][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2090.425737][ T44] ? register_pernet_subsys+0x19/0x40 [ 2090.425855][ T44] ? lock_acquire+0x10a/0x150 [ 2090.425974][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2090.426089][ T44] down_write+0x1c6/0x1f0 [ 2090.426177][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2090.426348][ T44] ? static_obj+0x5d/0x90 [ 2090.426433][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2090.426545][ T44] register_pernet_subsys+0x19/0x40 [ 2090.426660][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2090.426776][ T44] do_one_initcall+0xa3/0x2e0 [ 2090.426887][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2090.427025][ T44] ? kasan_unpoison+0x44/0x70 [ 2090.427138][ T44] do_init_module+0x27b/0x820 [ 2090.427253][ T44] ? free_module+0x450/0x450 [ 2090.427368][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2090.427482][ T44] init_module_from_file+0x15d/0x180 [ 2090.427597][ T44] ? __do_sys_init_module+0x200/0x200 [ 2090.427725][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.427836][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2090.427948][ T44] idempotent_init_module+0x226/0x760 [ 2090.428064][ T44] ? init_module_from_file+0x180/0x180 [ 2090.428182][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.428301][ T44] ? cap_capable+0x181/0x3f0 [ 2090.428411][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2090.428520][ T44] do_syscall_64+0xbd/0xfc0 [ 2090.428635][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2090.428771][ T44] RIP: 0033:0x7fbcd275234d [ 2090.428889][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2090.429057][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2090.429225][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2090.429395][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2090.429561][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2090.429730][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2090.429908][ T44] [ 2090.429991][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2090.430173][ T44] [ 2090.430173][ T44] Showing all locks held in the system: [ 2090.430427][ T44] 4 locks held by kworker/u16:0/12: [ 2090.430537][ T44] 1 lock held by khungtaskd/44: [ 2090.430646][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2090.430864][ T44] 2 locks held by kworker/u20:3/9443: [ 2090.430967][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2090.431179][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2090.431442][ T44] 1 lock held by modprobe/27887: [ 2090.431546][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2090.431759][ T44] [ 2090.431813][ T44] ============================================= [ 2090.431813][ T44] [ 2213.303327][ T44] INFO: task modprobe:27887 blocked for more than 368 seconds. [ 2213.303616][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2213.303824][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2213.304074][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2213.304366][ T44] Call Trace: [ 2213.304463][ T44] [ 2213.304528][ T44] __schedule+0xae2/0x1720 [ 2213.304662][ T44] ? io_schedule_timeout+0x130/0x130 [ 2213.304784][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.304907][ T44] schedule+0xd4/0x260 [ 2213.304999][ T44] schedule_preempt_disabled+0x18/0x30 [ 2213.305121][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2213.305237][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2213.305360][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.305498][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2213.305612][ T44] ? register_pernet_subsys+0x19/0x40 [ 2213.305725][ T44] ? lock_acquire+0x10a/0x150 [ 2213.305839][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2213.305961][ T44] down_write+0x1c6/0x1f0 [ 2213.306049][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2213.306190][ T44] ? static_obj+0x5d/0x90 [ 2213.306276][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2213.306418][ T44] register_pernet_subsys+0x19/0x40 [ 2213.306534][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2213.306646][ T44] do_one_initcall+0xa3/0x2e0 [ 2213.306757][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2213.306899][ T44] ? kasan_unpoison+0x44/0x70 [ 2213.307019][ T44] do_init_module+0x27b/0x820 [ 2213.307132][ T44] ? free_module+0x450/0x450 [ 2213.307241][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2213.307358][ T44] init_module_from_file+0x15d/0x180 [ 2213.307470][ T44] ? __do_sys_init_module+0x200/0x200 [ 2213.307587][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.307697][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2213.307810][ T44] idempotent_init_module+0x226/0x760 [ 2213.307920][ T44] ? init_module_from_file+0x180/0x180 [ 2213.308034][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.308145][ T44] ? cap_capable+0x181/0x3f0 [ 2213.308260][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2213.308375][ T44] do_syscall_64+0xbd/0xfc0 [ 2213.308489][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2213.308629][ T44] RIP: 0033:0x7fbcd275234d [ 2213.308744][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2213.308910][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2213.309081][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2213.309245][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2213.309423][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2213.309590][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2213.309760][ T44] [ 2213.309844][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2213.310022][ T44] [ 2213.310022][ T44] Showing all locks held in the system: [ 2213.310184][ T44] 4 locks held by kworker/u16:0/12: [ 2213.310381][ T44] 1 lock held by khungtaskd/44: [ 2213.310487][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2213.310704][ T44] 2 locks held by kworker/u20:3/9443: [ 2213.310809][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2213.311026][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2213.311275][ T44] 1 lock held by modprobe/27887: [ 2213.311384][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2213.311598][ T44] [ 2213.311656][ T44] ============================================= [ 2213.311656][ T44] [ 2336.183324][ T44] INFO: task modprobe:27887 blocked for more than 491 seconds. [ 2336.183621][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2336.183830][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2336.184073][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2336.184403][ T44] Call Trace: [ 2336.184493][ T44] [ 2336.184555][ T44] __schedule+0xae2/0x1720 [ 2336.184677][ T44] ? io_schedule_timeout+0x130/0x130 [ 2336.184797][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.184917][ T44] schedule+0xd4/0x260 [ 2336.185005][ T44] schedule_preempt_disabled+0x18/0x30 [ 2336.185131][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2336.185250][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2336.185378][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.185492][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2336.185605][ T44] ? register_pernet_subsys+0x19/0x40 [ 2336.185718][ T44] ? lock_acquire+0x10a/0x150 [ 2336.185833][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2336.185951][ T44] down_write+0x1c6/0x1f0 [ 2336.186036][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2336.186191][ T44] ? static_obj+0x5d/0x90 [ 2336.186276][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2336.186422][ T44] register_pernet_subsys+0x19/0x40 [ 2336.186534][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2336.186656][ T44] do_one_initcall+0xa3/0x2e0 [ 2336.186771][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2336.186908][ T44] ? kasan_unpoison+0x44/0x70 [ 2336.187026][ T44] do_init_module+0x27b/0x820 [ 2336.187144][ T44] ? free_module+0x450/0x450 [ 2336.187254][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2336.187372][ T44] init_module_from_file+0x15d/0x180 [ 2336.187485][ T44] ? __do_sys_init_module+0x200/0x200 [ 2336.187600][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.187710][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2336.187821][ T44] idempotent_init_module+0x226/0x760 [ 2336.187931][ T44] ? init_module_from_file+0x180/0x180 [ 2336.188047][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.188157][ T44] ? cap_capable+0x181/0x3f0 [ 2336.188273][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2336.188389][ T44] do_syscall_64+0xbd/0xfc0 [ 2336.188498][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2336.188637][ T44] RIP: 0033:0x7fbcd275234d [ 2336.188753][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2336.188920][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2336.189092][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2336.189256][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2336.189424][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2336.189590][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2336.189761][ T44] [ 2336.189844][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2336.190022][ T44] [ 2336.190022][ T44] Showing all locks held in the system: [ 2336.190183][ T44] 4 locks held by kworker/u16:0/12: [ 2336.190379][ T44] 1 lock held by khungtaskd/44: [ 2336.190484][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2336.190701][ T44] 2 locks held by kworker/u20:3/9443: [ 2336.190806][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2336.191021][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2336.191272][ T44] 1 lock held by modprobe/27887: [ 2336.191384][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2336.191594][ T44] [ 2336.191648][ T44] ============================================= [ 2336.191648][ T44] [ 2459.062318][ T44] INFO: task modprobe:27887 blocked for more than 614 seconds. [ 2459.062597][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2459.062820][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2459.063062][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2459.063405][ T44] Call Trace: [ 2459.063517][ T44] [ 2459.063595][ T44] __schedule+0xae2/0x1720 [ 2459.063726][ T44] ? io_schedule_timeout+0x130/0x130 [ 2459.063848][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.063966][ T44] schedule+0xd4/0x260 [ 2459.064055][ T44] schedule_preempt_disabled+0x18/0x30 [ 2459.064172][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2459.064294][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2459.064415][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.064531][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2459.064647][ T44] ? register_pernet_subsys+0x19/0x40 [ 2459.064763][ T44] ? lock_acquire+0x10a/0x150 [ 2459.064876][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2459.064990][ T44] down_write+0x1c6/0x1f0 [ 2459.065075][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2459.065215][ T44] ? static_obj+0x5d/0x90 [ 2459.065340][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2459.065462][ T44] register_pernet_subsys+0x19/0x40 [ 2459.065575][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2459.065690][ T44] do_one_initcall+0xa3/0x2e0 [ 2459.065800][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2459.065937][ T44] ? kasan_unpoison+0x44/0x70 [ 2459.066050][ T44] do_init_module+0x27b/0x820 [ 2459.066165][ T44] ? free_module+0x450/0x450 [ 2459.066278][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2459.066398][ T44] init_module_from_file+0x15d/0x180 [ 2459.066512][ T44] ? __do_sys_init_module+0x200/0x200 [ 2459.066628][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.066746][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2459.066854][ T44] idempotent_init_module+0x226/0x760 [ 2459.066967][ T44] ? init_module_from_file+0x180/0x180 [ 2459.067081][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.067190][ T44] ? cap_capable+0x181/0x3f0 [ 2459.067306][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2459.067417][ T44] do_syscall_64+0xbd/0xfc0 [ 2459.067528][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2459.067666][ T44] RIP: 0033:0x7fbcd275234d [ 2459.067783][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2459.067949][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2459.068111][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2459.068274][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2459.068446][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2459.068608][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2459.068778][ T44] [ 2459.068861][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2459.069038][ T44] [ 2459.069038][ T44] Showing all locks held in the system: [ 2459.069200][ T44] 4 locks held by kworker/u16:0/12: [ 2459.069398][ T44] 1 lock held by khungtaskd/44: [ 2459.069501][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2459.069715][ T44] 2 locks held by kworker/u20:3/9443: [ 2459.069819][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2459.070035][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2459.070274][ T44] 1 lock held by modprobe/27887: [ 2459.070383][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2459.070597][ T44] [ 2459.070651][ T44] ============================================= [ 2459.070651][ T44] [ 2581.943317][ T44] INFO: task modprobe:27887 blocked for more than 737 seconds. [ 2581.943598][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2581.943819][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2581.944052][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2581.944388][ T44] Call Trace: [ 2581.944492][ T44] [ 2581.944568][ T44] __schedule+0xae2/0x1720 [ 2581.944711][ T44] ? io_schedule_timeout+0x130/0x130 [ 2581.944848][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.944965][ T44] schedule+0xd4/0x260 [ 2581.945052][ T44] schedule_preempt_disabled+0x18/0x30 [ 2581.945165][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2581.945296][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2581.945413][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.945527][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2581.945641][ T44] ? register_pernet_subsys+0x19/0x40 [ 2581.945754][ T44] ? lock_acquire+0x10a/0x150 [ 2581.945868][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2581.945984][ T44] down_write+0x1c6/0x1f0 [ 2581.946068][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2581.946206][ T44] ? static_obj+0x5d/0x90 [ 2581.946322][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2581.946434][ T44] register_pernet_subsys+0x19/0x40 [ 2581.946543][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2581.946659][ T44] do_one_initcall+0xa3/0x2e0 [ 2581.946778][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2581.946915][ T44] ? kasan_unpoison+0x44/0x70 [ 2581.947025][ T44] do_init_module+0x27b/0x820 [ 2581.947135][ T44] ? free_module+0x450/0x450 [ 2581.947243][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2581.947364][ T44] init_module_from_file+0x15d/0x180 [ 2581.947474][ T44] ? __do_sys_init_module+0x200/0x200 [ 2581.947598][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.947706][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2581.947815][ T44] idempotent_init_module+0x226/0x760 [ 2581.947926][ T44] ? init_module_from_file+0x180/0x180 [ 2581.948039][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.948147][ T44] ? cap_capable+0x181/0x3f0 [ 2581.948260][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2581.948383][ T44] do_syscall_64+0xbd/0xfc0 [ 2581.948497][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2581.948632][ T44] RIP: 0033:0x7fbcd275234d [ 2581.948750][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2581.948915][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2581.949079][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2581.949287][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2581.949451][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2581.949614][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2581.949782][ T44] [ 2581.949867][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2581.950043][ T44] [ 2581.950043][ T44] Showing all locks held in the system: [ 2581.950198][ T44] 4 locks held by kworker/u16:0/12: [ 2581.950398][ T44] 1 lock held by khungtaskd/44: [ 2581.950506][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2581.950720][ T44] 2 locks held by kworker/u20:3/9443: [ 2581.950824][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2581.951034][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2581.951276][ T44] 1 lock held by modprobe/27887: [ 2581.951383][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2581.951594][ T44] [ 2581.951648][ T44] ============================================= [ 2581.951648][ T44] [ 2704.823313][ T44] INFO: task modprobe:27887 blocked for more than 860 seconds. [ 2704.823599][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2704.823808][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2704.824055][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2704.824372][ T44] Call Trace: [ 2704.824470][ T44] [ 2704.824542][ T44] __schedule+0xae2/0x1720 [ 2704.824685][ T44] ? io_schedule_timeout+0x130/0x130 [ 2704.824816][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.824956][ T44] schedule+0xd4/0x260 [ 2704.825054][ T44] schedule_preempt_disabled+0x18/0x30 [ 2704.825171][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2704.825291][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2704.825408][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.825520][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2704.825635][ T44] ? register_pernet_subsys+0x19/0x40 [ 2704.825747][ T44] ? lock_acquire+0x10a/0x150 [ 2704.825861][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2704.825981][ T44] down_write+0x1c6/0x1f0 [ 2704.826066][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2704.826203][ T44] ? static_obj+0x5d/0x90 [ 2704.826316][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2704.826441][ T44] register_pernet_subsys+0x19/0x40 [ 2704.826551][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2704.826662][ T44] do_one_initcall+0xa3/0x2e0 [ 2704.826772][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2704.826912][ T44] ? kasan_unpoison+0x44/0x70 [ 2704.827029][ T44] do_init_module+0x27b/0x820 [ 2704.827142][ T44] ? free_module+0x450/0x450 [ 2704.827256][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2704.827372][ T44] init_module_from_file+0x15d/0x180 [ 2704.827483][ T44] ? __do_sys_init_module+0x200/0x200 [ 2704.827598][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.827709][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2704.827818][ T44] idempotent_init_module+0x226/0x760 [ 2704.827928][ T44] ? init_module_from_file+0x180/0x180 [ 2704.828049][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.828158][ T44] ? cap_capable+0x181/0x3f0 [ 2704.828267][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2704.828380][ T44] do_syscall_64+0xbd/0xfc0 [ 2704.828490][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2704.828624][ T44] RIP: 0033:0x7fbcd275234d [ 2704.828738][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2704.828907][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2704.829074][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2704.829239][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2704.829406][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2704.829574][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2704.829740][ T44] [ 2704.829838][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2704.830021][ T44] [ 2704.830021][ T44] Showing all locks held in the system: [ 2704.830178][ T44] 4 locks held by kworker/u16:0/12: [ 2704.830291][ T44] 1 lock held by khungtaskd/44: [ 2704.830397][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2704.830610][ T44] 2 locks held by kworker/u20:3/9443: [ 2704.830712][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2704.830922][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2704.831165][ T44] 1 lock held by modprobe/27887: [ 2704.831269][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2704.831572][ T44] [ 2704.831625][ T44] ============================================= [ 2704.831625][ T44] [ 2827.702312][ T44] INFO: task modprobe:27887 blocked for more than 983 seconds. [ 2827.702593][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2827.702812][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2827.703061][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2827.703375][ T44] Call Trace: [ 2827.703468][ T44] [ 2827.703531][ T44] __schedule+0xae2/0x1720 [ 2827.703653][ T44] ? io_schedule_timeout+0x130/0x130 [ 2827.703774][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.703896][ T44] schedule+0xd4/0x260 [ 2827.703986][ T44] schedule_preempt_disabled+0x18/0x30 [ 2827.704105][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2827.704226][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2827.704353][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.704466][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2827.704578][ T44] ? register_pernet_subsys+0x19/0x40 [ 2827.704690][ T44] ? lock_acquire+0x10a/0x150 [ 2827.704809][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2827.704926][ T44] down_write+0x1c6/0x1f0 [ 2827.705015][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2827.705154][ T44] ? static_obj+0x5d/0x90 [ 2827.705239][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2827.705382][ T44] register_pernet_subsys+0x19/0x40 [ 2827.705493][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2827.705605][ T44] do_one_initcall+0xa3/0x2e0 [ 2827.705716][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2827.705872][ T44] ? kasan_unpoison+0x44/0x70 [ 2827.705985][ T44] do_init_module+0x27b/0x820 [ 2827.706097][ T44] ? free_module+0x450/0x450 [ 2827.706207][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2827.706324][ T44] init_module_from_file+0x15d/0x180 [ 2827.706434][ T44] ? __do_sys_init_module+0x200/0x200 [ 2827.706552][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.706665][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2827.706785][ T44] idempotent_init_module+0x226/0x760 [ 2827.706895][ T44] ? init_module_from_file+0x180/0x180 [ 2827.707013][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.707122][ T44] ? cap_capable+0x181/0x3f0 [ 2827.707236][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2827.707349][ T44] do_syscall_64+0xbd/0xfc0 [ 2827.707462][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2827.707596][ T44] RIP: 0033:0x7fbcd275234d [ 2827.707712][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2827.707879][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2827.708046][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2827.708212][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2827.708378][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2827.708540][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2827.708709][ T44] [ 2827.708793][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2827.708972][ T44] [ 2827.708972][ T44] Showing all locks held in the system: [ 2827.709127][ T44] 4 locks held by kworker/u16:0/12: [ 2827.709233][ T44] 1 lock held by khungtaskd/44: [ 2827.709428][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2827.709645][ T44] 2 locks held by kworker/u20:3/9443: [ 2827.709757][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2827.709968][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2827.710205][ T44] 1 lock held by modprobe/27887: [ 2827.710314][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2827.710527][ T44] [ 2827.710580][ T44] ============================================= [ 2827.710580][ T44] [ 2950.583312][ T44] INFO: task modprobe:27887 blocked for more than 1105 seconds. [ 2950.583598][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 2950.583804][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2950.584036][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 2950.584367][ T44] Call Trace: [ 2950.584470][ T44] [ 2950.584544][ T44] __schedule+0xae2/0x1720 [ 2950.584665][ T44] ? io_schedule_timeout+0x130/0x130 [ 2950.584784][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.584908][ T44] schedule+0xd4/0x260 [ 2950.584997][ T44] schedule_preempt_disabled+0x18/0x30 [ 2950.585111][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2950.585229][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2950.585353][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.585468][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2950.585587][ T44] ? register_pernet_subsys+0x19/0x40 [ 2950.585703][ T44] ? lock_acquire+0x10a/0x150 [ 2950.585816][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 2950.585930][ T44] down_write+0x1c6/0x1f0 [ 2950.586015][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2950.586153][ T44] ? static_obj+0x5d/0x90 [ 2950.586239][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2950.586382][ T44] register_pernet_subsys+0x19/0x40 [ 2950.586501][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2950.586614][ T44] do_one_initcall+0xa3/0x2e0 [ 2950.586722][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2950.586859][ T44] ? kasan_unpoison+0x44/0x70 [ 2950.586972][ T44] do_init_module+0x27b/0x820 [ 2950.587084][ T44] ? free_module+0x450/0x450 [ 2950.587194][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2950.587315][ T44] init_module_from_file+0x15d/0x180 [ 2950.587426][ T44] ? __do_sys_init_module+0x200/0x200 [ 2950.587546][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.587657][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2950.587767][ T44] idempotent_init_module+0x226/0x760 [ 2950.587876][ T44] ? init_module_from_file+0x180/0x180 [ 2950.587993][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.588101][ T44] ? cap_capable+0x181/0x3f0 [ 2950.588212][ T44] __x64_sys_finit_module+0xcd/0x160 [ 2950.588326][ T44] do_syscall_64+0xbd/0xfc0 [ 2950.588435][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2950.588574][ T44] RIP: 0033:0x7fbcd275234d [ 2950.588688][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2950.588855][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 2950.589019][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 2950.589181][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 2950.589348][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 2950.589517][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 2950.589686][ T44] [ 2950.589769][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 2950.589958][ T44] [ 2950.589958][ T44] Showing all locks held in the system: [ 2950.590113][ T44] 4 locks held by kworker/u16:0/12: [ 2950.590219][ T44] 1 lock held by khungtaskd/44: [ 2950.590417][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2950.590632][ T44] 2 locks held by kworker/u20:3/9443: [ 2950.590734][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2950.590945][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2950.591195][ T44] 1 lock held by modprobe/27887: [ 2950.591303][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2950.591517][ T44] [ 2950.591571][ T44] ============================================= [ 2950.591571][ T44] [ 3073.463306][ T44] INFO: task modprobe:27887 blocked for more than 1228 seconds. [ 3073.463565][ T44] Tainted: G W 6.19.0-rc1-virtme #1 [ 3073.463761][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3073.463986][ T44] task:modprobe state:D stack:25128 pid:27887 tgid:27887 ppid:9443 task_flags:0x400100 flags:0x00080000 [ 3073.464302][ T44] Call Trace: [ 3073.464412][ T44] [ 3073.464484][ T44] __schedule+0xae2/0x1720 [ 3073.464628][ T44] ? io_schedule_timeout+0x130/0x130 [ 3073.464767][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.464886][ T44] schedule+0xd4/0x260 [ 3073.464973][ T44] schedule_preempt_disabled+0x18/0x30 [ 3073.465086][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3073.465202][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3073.465333][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.465449][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3073.465563][ T44] ? register_pernet_subsys+0x19/0x40 [ 3073.465676][ T44] ? lock_acquire+0x10a/0x150 [ 3073.465790][ T44] ? nf_nat_cleanup+0x650/0x650 [nf_nat] [ 3073.465903][ T44] down_write+0x1c6/0x1f0 [ 3073.465987][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3073.466132][ T44] ? static_obj+0x5d/0x90 [ 3073.466215][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3073.466367][ T44] register_pernet_subsys+0x19/0x40 [ 3073.466480][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3073.466592][ T44] do_one_initcall+0xa3/0x2e0 [ 3073.466702][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3073.466839][ T44] ? kasan_unpoison+0x44/0x70 [ 3073.466955][ T44] do_init_module+0x27b/0x820 [ 3073.467067][ T44] ? free_module+0x450/0x450 [ 3073.467177][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3073.467298][ T44] init_module_from_file+0x15d/0x180 [ 3073.467408][ T44] ? __do_sys_init_module+0x200/0x200 [ 3073.467524][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.467636][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3073.467748][ T44] idempotent_init_module+0x226/0x760 [ 3073.467864][ T44] ? init_module_from_file+0x180/0x180 [ 3073.467977][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.468086][ T44] ? cap_capable+0x181/0x3f0 [ 3073.468200][ T44] __x64_sys_finit_module+0xcd/0x160 [ 3073.468323][ T44] do_syscall_64+0xbd/0xfc0 [ 3073.468437][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3073.468574][ T44] RIP: 0033:0x7fbcd275234d [ 3073.468688][ T44] RSP: 002b:00007ffe13a7bea8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3073.468852][ T44] RAX: ffffffffffffffda RBX: 000055b6527e8ff0 RCX: 00007fbcd275234d [ 3073.469014][ T44] RDX: 0000000000000000 RSI: 000055b62ad21f2e RDI: 0000000000000000 [ 3073.469176][ T44] RBP: 00007ffe13a7bf40 R08: 0000000000000000 R09: 0000000000000000 [ 3073.469350][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055b62ad21f2e [ 3073.469514][ T44] R13: 0000000000040000 R14: 000055b6527e8fa0 R15: 000055b6527e8570 [ 3073.469683][ T44] [ 3073.469766][ T44] INFO: task modprobe:27887 is blocked on an rw-semaphore, but the owner is not found. [ 3073.469942][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 3073.470122][ T44] [ 3073.470122][ T44] Showing all locks held in the system: [ 3073.470278][ T44] 4 locks held by kworker/u16:0/12: [ 3073.470475][ T44] 1 lock held by khungtaskd/44: [ 3073.470578][ T44] #0: ffffffff9cb850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3073.470795][ T44] 2 locks held by kworker/u20:3/9443: [ 3073.470899][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound#2){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3073.471117][ T44] #1: ffa0000008f67cc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3073.471363][ T44] 1 lock held by modprobe/27887: [ 3073.471466][ T44] #0: ffffffff9d285bd0 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3073.471680][ T44] [ 3073.471738][ T44] ============================================= [ 3073.471738][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr