[ 1902.390710][ T12] ------------[ cut here ]------------ [ 1902.391143][ T12] conntrack cleanup blocked for 60s [ 1902.391146][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#1: kworker/u16:0/12 [ 1902.391591][ T12] Modules linked in: nf_nat(+) xt_conntrack nf_conntrack nf_defrag_ipv4 nf_defrag_ipv6 sctp_diag sctp xt_HL amt ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables [ 1902.392111][ T12] CPU: 1 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 1902.392380][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1902.392571][ T12] Workqueue: netns cleanup_net [ 1902.392734][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack] [ 1902.393005][ T12] Code: 00 48 8b 54 24 18 48 8b 05 c3 38 40 e4 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 be 2f e3 e9 25 fd ff ff 48 8d 3d 56 96 ae ff <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df [ 1902.393491][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010297 [ 1902.393678][ T12] RAX: 000000010018719b RBX: ffa00000000c7af8 RCX: 0000000000000001 [ 1902.393882][ T12] RDX: 000000010018719a RSI: 0000000000000004 RDI: ffffffffc02f7030 [ 1902.394082][ T12] RBP: 0000000000000001 R08: ffffffffc080d7aa R09: ffe21c000170dd9c [ 1902.394278][ T12] R10: ffe21c000170dd9d R11: 0000000000000001 R12: dffffc0000000000 [ 1902.394468][ T12] R13: ff1100000b86ece0 R14: fffffbfff8060807 R15: ff1100000e00fcc0 [ 1902.394670][ T12] FS: 0000000000000000(0000) GS:ff110000c608b000(0000) knlGS:0000000000000000 [ 1902.394904][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1902.395069][ T12] CR2: 00007ffe3b981fe0 CR3: 0000000051548001 CR4: 0000000000771ef0 [ 1902.395261][ T12] PKRU: 55555554 [ 1902.395363][ T12] Call Trace: [ 1902.395801][ T12] [ 1902.395875][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack] [ 1902.396037][ T12] ? kfree+0x119/0x580 [ 1902.396133][ T12] ? lock_acquire+0x10a/0x150 [ 1902.396265][ T12] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack] [ 1902.396424][ T12] ops_undo_list+0x2d7/0x8f0 [ 1902.396555][ T12] ? netns_install+0x280/0x280 [ 1902.396687][ T12] cleanup_net+0x3bc/0x890 [ 1902.396814][ T12] ? process_one_work+0xd16/0x1390 [ 1902.396941][ T12] ? net_passive_dec+0x190/0x190 [ 1902.397071][ T12] ? rcu_is_watching+0x15/0xd0 [ 1902.397196][ T12] ? process_one_work+0xd16/0x1390 [ 1902.397320][ T12] ? lock_acquire+0x10a/0x150 [ 1902.397444][ T12] ? rcu_is_watching+0x15/0xd0 [ 1902.397573][ T12] process_one_work+0xd57/0x1390 [ 1902.397709][ T12] ? pwq_dec_nr_in_flight+0x700/0x700 [ 1902.397837][ T12] ? lock_acquire.part.0+0xbc/0x260 [ 1902.397963][ T12] ? assign_work+0x152/0x380 [ 1902.398087][ T12] worker_thread+0x4d6/0xd40 [ 1902.398215][ T12] ? process_one_work+0x1390/0x1390 [ 1902.398339][ T12] kthread+0x355/0x5b0 [ 1902.398434][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1902.398568][ T12] ? __lock_release.isra.0+0x59/0x170 [ 1902.398705][ T12] ? rcu_is_watching+0x15/0xd0 [ 1902.398828][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1902.398952][ T12] ret_from_fork+0x3fb/0x510 [ 1902.399078][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 1902.399232][ T12] ? __switch_to+0x602/0xd00 [ 1902.399357][ T12] ? kthread_is_per_cpu+0xe0/0xe0 [ 1902.399481][ T12] ret_from_fork_asm+0x11/0x20 [ 1902.399621][ T12] [ 1902.399726][ T12] irq event stamp: 9467489 [ 1902.399852][ T12] hardirqs last enabled at (9467497): [] __up_console_sem+0x5a/0x70 [ 1902.400072][ T12] hardirqs last disabled at (9467504): [] __up_console_sem+0x3f/0x70 [ 1902.400288][ T12] softirqs last enabled at (9467230): [] handle_softirqs+0x56f/0x840 [ 1902.400512][ T12] softirqs last disabled at (9467225): [] irq_exit_rcu+0xa2/0xf0 [ 1902.400740][ T12] ---[ end trace 0000000000000000 ]--- [ 2090.396738][ T44] INFO: task modprobe:19227 blocked for more than 122 seconds. [ 2090.397282][ T44] Tainted: G W 6.18.0-virtme #1 [ 2090.397500][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2090.397853][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2090.398171][ T44] Call Trace: [ 2090.398306][ T44] [ 2090.398416][ T44] __schedule+0xae2/0x1720 [ 2090.398593][ T44] ? io_schedule_timeout+0x130/0x130 [ 2090.398771][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.398943][ T44] schedule+0xd4/0x260 [ 2090.399079][ T44] schedule_preempt_disabled+0x18/0x30 [ 2090.399236][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2090.399396][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2090.399558][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.399736][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2090.399900][ T44] ? register_pernet_subsys+0x19/0x40 [ 2090.400076][ T44] ? lock_acquire+0x10a/0x150 [ 2090.400237][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2090.400404][ T44] down_write+0x1c6/0x1f0 [ 2090.400532][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2090.400742][ T44] ? static_obj+0x5d/0x90 [ 2090.400878][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2090.401041][ T44] register_pernet_subsys+0x19/0x40 [ 2090.401205][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2090.401362][ T44] do_one_initcall+0xa3/0x2e0 [ 2090.401523][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2090.401737][ T44] ? kasan_unpoison+0x44/0x70 [ 2090.401890][ T44] do_init_module+0x27b/0x820 [ 2090.402379][ T44] ? free_module+0x450/0x450 [ 2090.402525][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2090.402705][ T44] init_module_from_file+0x15d/0x180 [ 2090.402851][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2090.403004][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2090.403153][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2090.403300][ T44] idempotent_init_module+0x226/0x760 [ 2090.403453][ T44] ? init_module_from_file+0x180/0x180 [ 2090.403616][ T44] ? rcu_is_watching+0x15/0xd0 [ 2090.403779][ T44] ? cap_capable+0x181/0x3f0 [ 2090.403928][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2090.404076][ T44] do_syscall_64+0xbd/0xfc0 [ 2090.404226][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2090.404396][ T44] RIP: 0033:0x7feb94d5634d [ 2090.404552][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2090.404781][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2090.404977][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2090.405174][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2090.405371][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2090.405572][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2090.405799][ T44] [ 2090.405921][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2090.406125][ T44] [ 2090.406125][ T44] Showing all locks held in the system: [ 2090.406318][ T44] 4 locks held by kworker/u16:0/12: [ 2090.406472][ T44] 2 locks held by kworker/u19:0/37: [ 2090.406617][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2090.406874][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2090.407149][ T44] 1 lock held by khungtaskd/44: [ 2090.407291][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2090.407547][ T44] 1 lock held by modprobe/19227: [ 2090.407707][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2090.407946][ T44] [ 2090.408040][ T44] ============================================= [ 2090.408040][ T44] [ 2213.275717][ T44] INFO: task modprobe:19227 blocked for more than 245 seconds. [ 2213.276076][ T44] Tainted: G W 6.18.0-virtme #1 [ 2213.276293][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2213.276561][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2213.276935][ T44] Call Trace: [ 2213.277085][ T44] [ 2213.277213][ T44] __schedule+0xae2/0x1720 [ 2213.277394][ T44] ? io_schedule_timeout+0x130/0x130 [ 2213.277560][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.277749][ T44] schedule+0xd4/0x260 [ 2213.277886][ T44] schedule_preempt_disabled+0x18/0x30 [ 2213.278045][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2213.278207][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2213.278389][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.278551][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2213.278725][ T44] ? register_pernet_subsys+0x19/0x40 [ 2213.278886][ T44] ? lock_acquire+0x10a/0x150 [ 2213.279057][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2213.279217][ T44] down_write+0x1c6/0x1f0 [ 2213.279348][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2213.279538][ T44] ? static_obj+0x5d/0x90 [ 2213.279692][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2213.279851][ T44] register_pernet_subsys+0x19/0x40 [ 2213.280014][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2213.280169][ T44] do_one_initcall+0xa3/0x2e0 [ 2213.280340][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2213.280534][ T44] ? kasan_unpoison+0x44/0x70 [ 2213.280717][ T44] do_init_module+0x27b/0x820 [ 2213.280875][ T44] ? free_module+0x450/0x450 [ 2213.281036][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2213.281191][ T44] init_module_from_file+0x15d/0x180 [ 2213.281347][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2213.281500][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2213.281658][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2213.281823][ T44] idempotent_init_module+0x226/0x760 [ 2213.281970][ T44] ? init_module_from_file+0x180/0x180 [ 2213.282118][ T44] ? rcu_is_watching+0x15/0xd0 [ 2213.282263][ T44] ? cap_capable+0x181/0x3f0 [ 2213.282416][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2213.282564][ T44] do_syscall_64+0xbd/0xfc0 [ 2213.282733][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2213.282902][ T44] RIP: 0033:0x7feb94d5634d [ 2213.283053][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2213.283248][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2213.283448][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2213.283647][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2213.283856][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2213.284048][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2213.284249][ T44] [ 2213.284375][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2213.284585][ T44] [ 2213.284585][ T44] Showing all locks held in the system: [ 2213.284785][ T44] 4 locks held by kworker/u16:0/12: [ 2213.284931][ T44] 2 locks held by kworker/u19:0/37: [ 2213.285076][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2213.285317][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2213.285591][ T44] 1 lock held by khungtaskd/44: [ 2213.285741][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2213.285987][ T44] 1 lock held by modprobe/19227: [ 2213.286127][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2213.286379][ T44] [ 2213.286474][ T44] ============================================= [ 2213.286474][ T44] [ 2336.156724][ T44] INFO: task modprobe:19227 blocked for more than 368 seconds. [ 2336.157074][ T44] Tainted: G W 6.18.0-virtme #1 [ 2336.157296][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2336.157577][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2336.157950][ T44] Call Trace: [ 2336.158100][ T44] [ 2336.158228][ T44] __schedule+0xae2/0x1720 [ 2336.158410][ T44] ? io_schedule_timeout+0x130/0x130 [ 2336.158575][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.158754][ T44] schedule+0xd4/0x260 [ 2336.158899][ T44] schedule_preempt_disabled+0x18/0x30 [ 2336.159063][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2336.159231][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2336.159395][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.159555][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2336.159731][ T44] ? register_pernet_subsys+0x19/0x40 [ 2336.159888][ T44] ? lock_acquire+0x10a/0x150 [ 2336.160061][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2336.160225][ T44] down_write+0x1c6/0x1f0 [ 2336.160361][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2336.160542][ T44] ? static_obj+0x5d/0x90 [ 2336.160693][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2336.160855][ T44] register_pernet_subsys+0x19/0x40 [ 2336.161014][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2336.161192][ T44] do_one_initcall+0xa3/0x2e0 [ 2336.161354][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2336.161538][ T44] ? kasan_unpoison+0x44/0x70 [ 2336.161713][ T44] do_init_module+0x27b/0x820 [ 2336.161871][ T44] ? free_module+0x450/0x450 [ 2336.162029][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2336.162193][ T44] init_module_from_file+0x15d/0x180 [ 2336.162352][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2336.162504][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2336.162652][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2336.162812][ T44] idempotent_init_module+0x226/0x760 [ 2336.162961][ T44] ? init_module_from_file+0x180/0x180 [ 2336.163111][ T44] ? rcu_is_watching+0x15/0xd0 [ 2336.163270][ T44] ? cap_capable+0x181/0x3f0 [ 2336.163417][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2336.163565][ T44] do_syscall_64+0xbd/0xfc0 [ 2336.163724][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2336.163894][ T44] RIP: 0033:0x7feb94d5634d [ 2336.164046][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2336.164248][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2336.164447][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2336.164638][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2336.164844][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2336.165038][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2336.165250][ T44] [ 2336.165372][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2336.165573][ T44] [ 2336.165573][ T44] Showing all locks held in the system: [ 2336.165771][ T44] 3 locks held by kworker/u16:0/12: [ 2336.165922][ T44] 2 locks held by kworker/u19:0/37: [ 2336.166067][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2336.166312][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2336.166572][ T44] 1 lock held by khungtaskd/44: [ 2336.166721][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2336.166968][ T44] 1 lock held by modprobe/19227: [ 2336.167107][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2336.167349][ T44] [ 2336.167443][ T44] ============================================= [ 2336.167443][ T44] [ 2459.036710][ T44] INFO: task modprobe:19227 blocked for more than 491 seconds. [ 2459.037079][ T44] Tainted: G W 6.18.0-virtme #1 [ 2459.037287][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2459.037553][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2459.037899][ T44] Call Trace: [ 2459.038049][ T44] [ 2459.038157][ T44] __schedule+0xae2/0x1720 [ 2459.038341][ T44] ? io_schedule_timeout+0x130/0x130 [ 2459.038511][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.038701][ T44] schedule+0xd4/0x260 [ 2459.038835][ T44] schedule_preempt_disabled+0x18/0x30 [ 2459.039000][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2459.039171][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2459.039341][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.039511][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2459.039686][ T44] ? register_pernet_subsys+0x19/0x40 [ 2459.039843][ T44] ? lock_acquire+0x10a/0x150 [ 2459.040009][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2459.040178][ T44] down_write+0x1c6/0x1f0 [ 2459.040306][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2459.040493][ T44] ? static_obj+0x5d/0x90 [ 2459.040632][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2459.040807][ T44] register_pernet_subsys+0x19/0x40 [ 2459.040970][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2459.041135][ T44] do_one_initcall+0xa3/0x2e0 [ 2459.041297][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2459.041484][ T44] ? kasan_unpoison+0x44/0x70 [ 2459.041638][ T44] do_init_module+0x27b/0x820 [ 2459.041798][ T44] ? free_module+0x450/0x450 [ 2459.041943][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2459.042097][ T44] init_module_from_file+0x15d/0x180 [ 2459.042243][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2459.042393][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2459.042539][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2459.042706][ T44] idempotent_init_module+0x226/0x760 [ 2459.042853][ T44] ? init_module_from_file+0x180/0x180 [ 2459.043002][ T44] ? rcu_is_watching+0x15/0xd0 [ 2459.043155][ T44] ? cap_capable+0x181/0x3f0 [ 2459.043306][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2459.043452][ T44] do_syscall_64+0xbd/0xfc0 [ 2459.043597][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2459.043788][ T44] RIP: 0033:0x7feb94d5634d [ 2459.043940][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2459.044145][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2459.044340][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2459.044533][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2459.044742][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2459.044932][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2459.045135][ T44] [ 2459.045254][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2459.045456][ T44] [ 2459.045456][ T44] Showing all locks held in the system: [ 2459.045647][ T44] 4 locks held by kworker/u16:0/12: [ 2459.045804][ T44] 2 locks held by kworker/u19:0/37: [ 2459.045945][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2459.046191][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2459.046461][ T44] 1 lock held by khungtaskd/44: [ 2459.046602][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2459.046860][ T44] 1 lock held by modprobe/19227: [ 2459.046998][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2459.047245][ T44] [ 2459.047344][ T44] ============================================= [ 2459.047344][ T44] [ 2581.915708][ T44] INFO: task modprobe:19227 blocked for more than 614 seconds. [ 2581.916036][ T44] Tainted: G W 6.18.0-virtme #1 [ 2581.916247][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2581.916510][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2581.916899][ T44] Call Trace: [ 2581.917040][ T44] [ 2581.917150][ T44] __schedule+0xae2/0x1720 [ 2581.917315][ T44] ? io_schedule_timeout+0x130/0x130 [ 2581.917476][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.917640][ T44] schedule+0xd4/0x260 [ 2581.917788][ T44] schedule_preempt_disabled+0x18/0x30 [ 2581.917959][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2581.918124][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2581.918290][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.918450][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2581.918610][ T44] ? register_pernet_subsys+0x19/0x40 [ 2581.918789][ T44] ? lock_acquire+0x10a/0x150 [ 2581.918959][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2581.919136][ T44] down_write+0x1c6/0x1f0 [ 2581.919275][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2581.919468][ T44] ? static_obj+0x5d/0x90 [ 2581.919597][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2581.919771][ T44] register_pernet_subsys+0x19/0x40 [ 2581.919934][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2581.920104][ T44] do_one_initcall+0xa3/0x2e0 [ 2581.920261][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2581.920455][ T44] ? kasan_unpoison+0x44/0x70 [ 2581.920616][ T44] do_init_module+0x27b/0x820 [ 2581.920779][ T44] ? free_module+0x450/0x450 [ 2581.920933][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2581.921082][ T44] init_module_from_file+0x15d/0x180 [ 2581.921236][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2581.921388][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2581.921535][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2581.921698][ T44] idempotent_init_module+0x226/0x760 [ 2581.921844][ T44] ? init_module_from_file+0x180/0x180 [ 2581.921997][ T44] ? rcu_is_watching+0x15/0xd0 [ 2581.922143][ T44] ? cap_capable+0x181/0x3f0 [ 2581.922302][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2581.922449][ T44] do_syscall_64+0xbd/0xfc0 [ 2581.922596][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2581.922778][ T44] RIP: 0033:0x7feb94d5634d [ 2581.922935][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2581.923129][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2581.923326][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2581.923517][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2581.923725][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2581.923924][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2581.924136][ T44] [ 2581.924255][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2581.924458][ T44] [ 2581.924458][ T44] Showing all locks held in the system: [ 2581.924644][ T44] 4 locks held by kworker/u16:0/12: [ 2581.924798][ T44] 2 locks held by kworker/u19:0/37: [ 2581.924941][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2581.925184][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2581.925444][ T44] 1 lock held by khungtaskd/44: [ 2581.925583][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2581.925835][ T44] 1 lock held by modprobe/19227: [ 2581.925985][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2581.926220][ T44] [ 2581.926311][ T44] ============================================= [ 2581.926311][ T44] [ 2704.796702][ T44] INFO: task modprobe:19227 blocked for more than 737 seconds. [ 2704.797031][ T44] Tainted: G W 6.18.0-virtme #1 [ 2704.797249][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2704.797514][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2704.797907][ T44] Call Trace: [ 2704.798057][ T44] [ 2704.798168][ T44] __schedule+0xae2/0x1720 [ 2704.798337][ T44] ? io_schedule_timeout+0x130/0x130 [ 2704.798546][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.798725][ T44] schedule+0xd4/0x260 [ 2704.798862][ T44] schedule_preempt_disabled+0x18/0x30 [ 2704.799029][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2704.799198][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2704.799359][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.799520][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2704.799702][ T44] ? register_pernet_subsys+0x19/0x40 [ 2704.799871][ T44] ? lock_acquire+0x10a/0x150 [ 2704.800036][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2704.800197][ T44] down_write+0x1c6/0x1f0 [ 2704.800326][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2704.800512][ T44] ? static_obj+0x5d/0x90 [ 2704.800641][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2704.800824][ T44] register_pernet_subsys+0x19/0x40 [ 2704.800988][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2704.801146][ T44] do_one_initcall+0xa3/0x2e0 [ 2704.801301][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2704.801486][ T44] ? kasan_unpoison+0x44/0x70 [ 2704.801646][ T44] do_init_module+0x27b/0x820 [ 2704.801832][ T44] ? free_module+0x450/0x450 [ 2704.802000][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2704.802153][ T44] init_module_from_file+0x15d/0x180 [ 2704.802301][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2704.802451][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2704.802600][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2704.802763][ T44] idempotent_init_module+0x226/0x760 [ 2704.802918][ T44] ? init_module_from_file+0x180/0x180 [ 2704.803067][ T44] ? rcu_is_watching+0x15/0xd0 [ 2704.803214][ T44] ? cap_capable+0x181/0x3f0 [ 2704.803361][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2704.803508][ T44] do_syscall_64+0xbd/0xfc0 [ 2704.803655][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2704.803842][ T44] RIP: 0033:0x7feb94d5634d [ 2704.804000][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2704.804197][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2704.804391][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2704.804580][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2704.804797][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2704.804988][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2704.805187][ T44] [ 2704.805305][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2704.805503][ T44] [ 2704.805503][ T44] Showing all locks held in the system: [ 2704.805706][ T44] 4 locks held by kworker/u16:0/12: [ 2704.805851][ T44] 2 locks held by kworker/u19:0/37: [ 2704.805987][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2704.806223][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2704.806484][ T44] 1 lock held by khungtaskd/44: [ 2704.806620][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2704.806880][ T44] 1 lock held by modprobe/19227: [ 2704.807017][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2704.807249][ T44] [ 2704.807340][ T44] ============================================= [ 2704.807340][ T44] [ 2827.675720][ T44] INFO: task modprobe:19227 blocked for more than 860 seconds. [ 2827.676060][ T44] Tainted: G W 6.18.0-virtme #1 [ 2827.676270][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2827.676527][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2827.676910][ T44] Call Trace: [ 2827.677065][ T44] [ 2827.677188][ T44] __schedule+0xae2/0x1720 [ 2827.677356][ T44] ? io_schedule_timeout+0x130/0x130 [ 2827.677518][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.677697][ T44] schedule+0xd4/0x260 [ 2827.677830][ T44] schedule_preempt_disabled+0x18/0x30 [ 2827.677990][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2827.678167][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2827.678331][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.678489][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2827.678650][ T44] ? register_pernet_subsys+0x19/0x40 [ 2827.678823][ T44] ? lock_acquire+0x10a/0x150 [ 2827.678986][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2827.679169][ T44] down_write+0x1c6/0x1f0 [ 2827.679301][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2827.679489][ T44] ? static_obj+0x5d/0x90 [ 2827.679617][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2827.679795][ T44] register_pernet_subsys+0x19/0x40 [ 2827.679949][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2827.680110][ T44] do_one_initcall+0xa3/0x2e0 [ 2827.680281][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2827.680470][ T44] ? kasan_unpoison+0x44/0x70 [ 2827.680625][ T44] do_init_module+0x27b/0x820 [ 2827.680796][ T44] ? free_module+0x450/0x450 [ 2827.680952][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2827.681111][ T44] init_module_from_file+0x15d/0x180 [ 2827.681265][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2827.681427][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2827.681572][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2827.681731][ T44] idempotent_init_module+0x226/0x760 [ 2827.681876][ T44] ? init_module_from_file+0x180/0x180 [ 2827.682023][ T44] ? rcu_is_watching+0x15/0xd0 [ 2827.682186][ T44] ? cap_capable+0x181/0x3f0 [ 2827.682331][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2827.682481][ T44] do_syscall_64+0xbd/0xfc0 [ 2827.682626][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2827.682813][ T44] RIP: 0033:0x7feb94d5634d [ 2827.682962][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2827.683168][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2827.683358][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2827.683554][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2827.683758][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2827.683948][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2827.684155][ T44] [ 2827.684277][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2827.684478][ T44] [ 2827.684478][ T44] Showing all locks held in the system: [ 2827.684660][ T44] 4 locks held by kworker/u16:0/12: [ 2827.684813][ T44] 2 locks held by kworker/u19:0/37: [ 2827.684952][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2827.685197][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2827.685452][ T44] 1 lock held by khungtaskd/44: [ 2827.685587][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2827.685839][ T44] 1 lock held by modprobe/19227: [ 2827.685976][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2827.686224][ T44] [ 2827.686315][ T44] ============================================= [ 2827.686315][ T44] [ 2950.556712][ T44] INFO: task modprobe:19227 blocked for more than 983 seconds. [ 2950.557070][ T44] Tainted: G W 6.18.0-virtme #1 [ 2950.557297][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 2950.557570][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 2950.557934][ T44] Call Trace: [ 2950.558075][ T44] [ 2950.558190][ T44] __schedule+0xae2/0x1720 [ 2950.558367][ T44] ? io_schedule_timeout+0x130/0x130 [ 2950.558540][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.558722][ T44] schedule+0xd4/0x260 [ 2950.558861][ T44] schedule_preempt_disabled+0x18/0x30 [ 2950.559021][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 2950.559185][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 2950.559351][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.559518][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 2950.559701][ T44] ? register_pernet_subsys+0x19/0x40 [ 2950.559862][ T44] ? lock_acquire+0x10a/0x150 [ 2950.560028][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 2950.560189][ T44] down_write+0x1c6/0x1f0 [ 2950.560323][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 2950.560507][ T44] ? static_obj+0x5d/0x90 [ 2950.560641][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 2950.560826][ T44] register_pernet_subsys+0x19/0x40 [ 2950.560987][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 2950.561148][ T44] do_one_initcall+0xa3/0x2e0 [ 2950.561304][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 2950.561480][ T44] ? kasan_unpoison+0x44/0x70 [ 2950.561630][ T44] do_init_module+0x27b/0x820 [ 2950.561797][ T44] ? free_module+0x450/0x450 [ 2950.561948][ T44] ? backing_file_read_iter+0x50e/0x730 [ 2950.562094][ T44] init_module_from_file+0x15d/0x180 [ 2950.562238][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 2950.562387][ T44] ? __lock_release.isra.0+0x59/0x170 [ 2950.562531][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 2950.562692][ T44] idempotent_init_module+0x226/0x760 [ 2950.562843][ T44] ? init_module_from_file+0x180/0x180 [ 2950.562995][ T44] ? rcu_is_watching+0x15/0xd0 [ 2950.563139][ T44] ? cap_capable+0x181/0x3f0 [ 2950.563284][ T44] __x64_sys_finit_module+0xcd/0x150 [ 2950.563429][ T44] do_syscall_64+0xbd/0xfc0 [ 2950.563578][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 2950.563759][ T44] RIP: 0033:0x7feb94d5634d [ 2950.563916][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 2950.564114][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 2950.564304][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 2950.564496][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 2950.564700][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 2950.564903][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 2950.565099][ T44] [ 2950.565217][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 2950.565420][ T44] [ 2950.565420][ T44] Showing all locks held in the system: [ 2950.565602][ T44] 4 locks held by kworker/u16:0/12: [ 2950.565769][ T44] 2 locks held by kworker/u19:0/37: [ 2950.565906][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 2950.566138][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 2950.566400][ T44] 1 lock held by khungtaskd/44: [ 2950.566541][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 2950.566796][ T44] 1 lock held by modprobe/19227: [ 2950.566933][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 2950.567169][ T44] [ 2950.567260][ T44] ============================================= [ 2950.567260][ T44] [ 3073.436733][ T44] INFO: task modprobe:19227 blocked for more than 1105 seconds. [ 3073.437165][ T44] Tainted: G W 6.18.0-virtme #1 [ 3073.437395][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3073.437732][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 3073.438100][ T44] Call Trace: [ 3073.438257][ T44] [ 3073.438377][ T44] __schedule+0xae2/0x1720 [ 3073.438570][ T44] ? io_schedule_timeout+0x130/0x130 [ 3073.438771][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.438963][ T44] schedule+0xd4/0x260 [ 3073.439111][ T44] schedule_preempt_disabled+0x18/0x30 [ 3073.439285][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3073.439469][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3073.439646][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.439839][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3073.440003][ T44] ? register_pernet_subsys+0x19/0x40 [ 3073.440171][ T44] ? lock_acquire+0x10a/0x150 [ 3073.440337][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 3073.440503][ T44] down_write+0x1c6/0x1f0 [ 3073.440645][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3073.440851][ T44] ? static_obj+0x5d/0x90 [ 3073.440987][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3073.441147][ T44] register_pernet_subsys+0x19/0x40 [ 3073.441312][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3073.441474][ T44] do_one_initcall+0xa3/0x2e0 [ 3073.441636][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3073.441852][ T44] ? kasan_unpoison+0x44/0x70 [ 3073.442017][ T44] do_init_module+0x27b/0x820 [ 3073.442180][ T44] ? free_module+0x450/0x450 [ 3073.442345][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3073.442507][ T44] init_module_from_file+0x15d/0x180 [ 3073.442668][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3073.442853][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3073.443020][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3073.443180][ T44] idempotent_init_module+0x226/0x760 [ 3073.443341][ T44] ? init_module_from_file+0x180/0x180 [ 3073.443507][ T44] ? rcu_is_watching+0x15/0xd0 [ 3073.443668][ T44] ? cap_capable+0x181/0x3f0 [ 3073.443853][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3073.444015][ T44] do_syscall_64+0xbd/0xfc0 [ 3073.444185][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3073.444372][ T44] RIP: 0033:0x7feb94d5634d [ 3073.444542][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3073.444773][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 3073.444994][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 3073.445214][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 3073.445425][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 3073.445641][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 3073.445875][ T44] [ 3073.446007][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 3073.446235][ T44] [ 3073.446235][ T44] Showing all locks held in the system: [ 3073.446449][ T44] 4 locks held by kworker/u16:0/12: [ 3073.446607][ T44] 2 locks held by kworker/u19:0/37: [ 3073.446772][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3073.447051][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3073.447342][ T44] 1 lock held by khungtaskd/44: [ 3073.447492][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3073.447778][ T44] 1 lock held by modprobe/19227: [ 3073.447936][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3073.448208][ T44] [ 3073.448312][ T44] ============================================= [ 3073.448312][ T44] [ 3196.315730][ T44] INFO: task modprobe:19227 blocked for more than 1228 seconds. [ 3196.316138][ T44] Tainted: G W 6.18.0-virtme #1 [ 3196.316362][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3196.316657][ T44] task:modprobe state:D stack:25136 pid:19227 tgid:19227 ppid:37 task_flags:0x400100 flags:0x00080000 [ 3196.317067][ T44] Call Trace: [ 3196.317216][ T44] [ 3196.317330][ T44] __schedule+0xae2/0x1720 [ 3196.317516][ T44] ? io_schedule_timeout+0x130/0x130 [ 3196.317712][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.317902][ T44] schedule+0xd4/0x260 [ 3196.318052][ T44] schedule_preempt_disabled+0x18/0x30 [ 3196.318229][ T44] rwsem_down_write_slowpath+0x40b/0xc10 [ 3196.318407][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10 [ 3196.318590][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.318783][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 3196.318961][ T44] ? register_pernet_subsys+0x19/0x40 [ 3196.319133][ T44] ? lock_acquire+0x10a/0x150 [ 3196.319297][ T44] ? nf_nat_cleanup+0x260/0x260 [nf_nat] [ 3196.319463][ T44] down_write+0x1c6/0x1f0 [ 3196.319598][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10 [ 3196.319801][ T44] ? static_obj+0x5d/0x90 [ 3196.319937][ T44] ? lockdep_init_map_type+0x5c/0x250 [ 3196.320118][ T44] register_pernet_subsys+0x19/0x40 [ 3196.320285][ T44] nf_nat_init+0xce/0x1000 [nf_nat] [ 3196.320445][ T44] do_one_initcall+0xa3/0x2e0 [ 3196.320608][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0 [ 3196.320808][ T44] ? kasan_unpoison+0x44/0x70 [ 3196.320973][ T44] do_init_module+0x27b/0x820 [ 3196.321146][ T44] ? free_module+0x450/0x450 [ 3196.321305][ T44] ? backing_file_read_iter+0x50e/0x730 [ 3196.321476][ T44] init_module_from_file+0x15d/0x180 [ 3196.321635][ T44] ? __do_sys_init_module+0x1f0/0x1f0 [ 3196.321814][ T44] ? __lock_release.isra.0+0x59/0x170 [ 3196.321974][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 3196.322140][ T44] idempotent_init_module+0x226/0x760 [ 3196.322305][ T44] ? init_module_from_file+0x180/0x180 [ 3196.322472][ T44] ? rcu_is_watching+0x15/0xd0 [ 3196.322631][ T44] ? cap_capable+0x181/0x3f0 [ 3196.322806][ T44] __x64_sys_finit_module+0xcd/0x150 [ 3196.322966][ T44] do_syscall_64+0xbd/0xfc0 [ 3196.323129][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3196.323318][ T44] RIP: 0033:0x7feb94d5634d [ 3196.323484][ T44] RSP: 002b:00007ffceb7896c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 [ 3196.323719][ T44] RAX: ffffffffffffffda RBX: 00005566b5e60dc0 RCX: 00007feb94d5634d [ 3196.323934][ T44] RDX: 0000000000000000 RSI: 000055668a317f2e RDI: 0000000000000000 [ 3196.324149][ T44] RBP: 00007ffceb789760 R08: 0000000000000000 R09: 0000000000000000 [ 3196.324364][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 000055668a317f2e [ 3196.324582][ T44] R13: 0000000000040000 R14: 00005566b5e60d70 R15: 00005566b5e60570 [ 3196.324812][ T44] [ 3196.324943][ T44] INFO: task modprobe:19227 is blocked on an rw-semaphore, but the owner is not found. [ 3196.325170][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings [ 3196.325402][ T44] [ 3196.325402][ T44] Showing all locks held in the system: [ 3196.325616][ T44] 4 locks held by kworker/u16:0/12: [ 3196.325789][ T44] 2 locks held by kworker/u19:0/37: [ 3196.325941][ T44] #0: ff11000001151d48 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 3196.326214][ T44] #1: ffa000000029fcc0 ((work_completion)(&sub_info->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 3196.326508][ T44] 1 lock held by khungtaskd/44: [ 3196.326660][ T44] #0: ffffffffa4f84c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 3196.326942][ T44] 1 lock held by modprobe/19227: [ 3196.327104][ T44] #0: ffffffffa5679190 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40 [ 3196.327363][ T44] [ 3196.327464][ T44] ============================================= [ 3196.327464][ T44] WAIT TIMEOUT stderr Ctrl-C stderr Ctrl-C stderr