[ 563.139668][ T6388] Mirror/redirect action on [ 580.393381][ C0] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2024249899 wd_nsec: 2024249849 [ 624.382368][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [migration/0:18] [ 624.382378][ C0] Modules linked in: act_skbedit act_ct nf_flow_table nf_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 cls_matchall act_mirred vxlan ip6_udp_tunnel udp_tunnel act_gact cls_flower dummy sch_ingress bridge stp llc 8021q vrf veth [ 624.382399][ C0] irq event stamp: 1162661 [ 624.382401][ C0] hardirqs last enabled at (1162660): [] irqentry_exit+0xf9/0x4d0 [ 624.382410][ C0] hardirqs last disabled at (1162661): [] sysvec_apic_timer_interrupt+0x12/0xf0 [ 624.382412][ C0] softirqs last enabled at (984904): [] handle_softirqs+0x56f/0x840 [ 624.382416][ C0] softirqs last disabled at (984907): [] irq_exit_rcu+0xa2/0xf0 [ 624.382423][ C0] CPU: 0 UID: 0 PID: 18 Comm: migration/0 Not tainted 6.18.0-virtme #1 PREEMPT(full) [ 624.382426][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 624.382428][ C0] Stopper: softlockup_fn+0x0/0xc0 <- watchdog_timer_fn+0x263/0x5d0 [ 624.382433][ C0] RIP: 0010:kmem_cache_alloc_noprof+0x4/0x6e0 [ 624.382438][ C0] Code: fd ff ff 48 89 d6 48 c7 c7 e0 a9 b5 92 48 89 14 24 e8 f0 a0 7d 00 48 8b 14 24 e9 e5 fb ff ff 0f 1f 80 00 00 00 00 f3 0f 1e fa <0f> 1f 44 00 00 4c 8d 54 24 08 48 83 e4 f0 41 ff 72 f8 55 48 89 e5 [ 624.382440][ C0] RSP: 0018:ffa0000000007a48 EFLAGS: 00000202 [ 624.382442][ C0] RAX: ff11000001042900 RBX: 0000000000000000 RCX: 0000000000000820 [ 624.382443][ C0] RDX: 0000000000000001 RSI: 0000000000092820 RDI: ff11000001042900 [ 624.382444][ C0] RBP: 00000000000000e0 R08: 0000000000000000 R09: 0000000000000001 [ 624.382445][ C0] R10: 00000000000000e0 R11: 0000000000000001 R12: ff11000013ee1c40 [ 624.382446][ C0] R13: 0000000000000820 R14: 0000000000000000 R15: 0000000000000001 [ 624.382449][ C0] FS: 0000000000000000(0000) GS:ff1100009baed000(0000) knlGS:0000000000000000 [ 624.382452][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 624.382453][ C0] CR2: 000055e25e2d8000 CR3: 0000000035134003 CR4: 0000000000771ef0 [ 624.382454][ C0] PKRU: 55555554 [ 624.382455][ C0] Call Trace: [ 624.382457][ C0] [ 624.382458][ C0] __alloc_object+0x30/0x250 [ 624.382467][ C0] __create_object+0x26/0xc0 [ 624.382469][ C0] ? kasan_save_track+0x14/0x30 [ 624.382473][ C0] kmem_cache_alloc_node_noprof+0x4b7/0x700 [ 624.382477][ C0] ? __alloc_skb+0xf1/0x350 [ 624.382481][ C0] __alloc_skb+0xf1/0x350 [ 624.382483][ C0] ? __alloc_skb+0x2a8/0x350 [ 624.382485][ C0] ? napi_skb_cache_get+0x7a0/0x7a0 [ 624.382487][ C0] ? __neigh_notify+0x2f/0x280 [ 624.382490][ C0] ? rcu_is_watching+0x15/0xd0 [ 624.382492][ C0] ? __neigh_notify+0x2f/0x280 [ 624.382494][ C0] ? lock_acquire+0x10a/0x150 [ 624.382498][ C0] __neigh_notify+0xc6/0x280 [ 624.382501][ C0] neigh_timer_handler+0x1e0/0xf80 [ 624.382503][ C0] ? call_timer_fn+0x114/0x300 [ 624.382505][ C0] ? lock_acquire+0x10a/0x150 [ 624.382508][ C0] ? neigh_periodic_work+0xb00/0xb00 [ 624.382510][ C0] call_timer_fn+0x164/0x300 [ 624.382513][ C0] ? detach_if_pending+0x1c0/0x1c0 [ 624.382515][ C0] ? debug_object_active_state+0x430/0x430 [ 624.382520][ C0] ? __lock_release.isra.0+0x59/0x170 [ 624.382523][ C0] ? rcu_is_watching+0x15/0xd0 [ 624.382525][ C0] __run_timers+0x600/0x930 [ 624.382528][ C0] ? neigh_periodic_work+0xb00/0xb00 [ 624.382531][ C0] ? find_held_lock+0x2b/0x80 [ 624.382533][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 624.382536][ C0] ? __lock_acquire+0x577/0xc10 [ 624.382541][ C0] ? __rwlock_init+0x150/0x150 [ 624.382544][ C0] ? lock_acquire+0x10a/0x150 [ 624.382548][ C0] run_timer_softirq+0xf3/0x170 [ 624.382550][ C0] ? __run_timers+0x930/0x930 [ 624.382553][ C0] ? handle_softirqs+0x19f/0x840 [ 624.382555][ C0] ? rcu_is_watching+0x15/0xd0 [ 624.382556][ C0] handle_softirqs+0x1d7/0x840 [ 624.382561][ C0] ? tasklet_unlock_wait+0x60/0x60 [ 624.382563][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 624.382566][ C0] irq_exit_rcu+0xa2/0xf0 [ 624.382568][ C0] common_interrupt+0xc9/0x100 [ 624.382570][ C0] [ 624.382571][ C0] [ 624.382572][ C0] asm_common_interrupt+0x26/0x40 [ 624.382575][ C0] RIP: 0010:preempt_count_sub+0x4e/0x170 [ 624.382579][ C0] Code: e0 07 48 c1 ee 03 83 c0 03 0f b6 0c 0e 38 c8 7c 08 84 c9 0f 85 d7 00 00 00 8b 0d 7d 7f e2 04 85 c9 75 19 65 8b 0d 62 66 32 04 <81> e1 ff ff ff 7f 39 ca 7f 16 81 fa fe 00 00 00 76 66 f7 da 65 01 [ 624.382580][ C0] RSP: 0018:ffa0000000127d48 EFLAGS: 00000246 [ 624.382581][ C0] RAX: 0000000000000003 RBX: ff1100002f626fc0 RCX: 0000000080000001 [ 624.382582][ C0] RDX: 0000000000000001 RSI: 1ffffffff28c6928 RDI: 0000000000000001 [ 624.382583][ C0] RBP: ffffffff8fa93e60 R08: 0000000000000000 R09: 0000000000000001 [ 624.382584][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ff1100002f627058 [ 624.382584][ C0] R13: dffffc0000000000 R14: ffe21c0005ec4e0a R15: 0000000000000000 [ 624.382586][ C0] ? lockup_detector_update_enable+0x50/0x50 [ 624.382592][ C0] ? preempt_count_add+0x7f/0x180 [ 624.382594][ C0] cpu_stopper_thread+0x272/0x450 [ 624.382599][ C0] smpboot_thread_fn+0x2fb/0x9b0 [ 624.382604][ C0] ? sort_range+0x20/0x20 [ 624.382606][ C0] kthread+0x355/0x5b0 [ 624.382608][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 624.382610][ C0] ? __lock_release.isra.0+0x59/0x170 [ 624.382612][ C0] ? rcu_is_watching+0x15/0xd0 [ 624.382614][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 624.382616][ C0] ret_from_fork+0x3fb/0x510 [ 624.382620][ C0] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 624.382623][ C0] ? __switch_to+0x602/0xd00 [ 624.382626][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 624.382628][ C0] ret_from_fork_asm+0x11/0x20 [ 624.382636][ C0] [ 627.260152][ C0] rcu: INFO: rcu_preempt self-detected stall on CPU [ 627.260437][ C0] rcu: 0-....: (22797 ticks this GP) idle=8af4/1/0x4000000000000000 softirq=291430/291430 fqs=6387 [ 627.261134][ C0] rcu: (t=26000 jiffies g=289669 q=542 ncpus=4) [ 627.261335][ C0] CPU: 0 UID: 0 PID: 18 Comm: migration/0 Tainted: G L 6.18.0-virtme #1 PREEMPT(full) [ 627.261339][ C0] Tainted: [L]=SOFTLOCKUP [ 627.261341][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 627.261342][ C0] Stopper: softlockup_fn+0x0/0xc0 <- watchdog_timer_fn+0x263/0x5d0 [ 627.261350][ C0] RIP: 0010:unwind_next_frame+0xfd3/0x1cc0 [ 627.261355][ C0] Code: e2 ff ff 4c 89 e1 4c 8b 44 24 20 48 89 c2 48 c1 e9 03 48 b8 00 00 00 00 00 fc ff df 80 3c 01 00 0f 85 19 09 00 00 49 89 55 58 <49> 8d be 98 00 00 00 4c 89 44 24 28 48 89 54 24 20 e8 c7 e1 ff ff [ 627.261357][ C0] RSP: 0018:ffa0000000007778 EFLAGS: 00000246 [ 627.261360][ C0] RAX: dffffc0000000000 RBX: 1ff4000000000ef8 RCX: 1ff4000000000f1a [ 627.261362][ C0] RDX: ffffffff8f80c9ce RSI: ffa0000000127c98 RDI: ffa0000000127d18 [ 627.261362][ C0] RBP: 0000000000000001 R08: ffffffff934cb5fa R09: ffffffff9327b0a0 [ 627.261363][ C0] R10: ffffffff934cb5fe R11: 0000000000000001 R12: ffa00000000078d0 [ 627.261364][ C0] R13: ffa0000000007878 R14: ffa0000000127c98 R15: ff11000001b24540 [ 627.261367][ C0] FS: 0000000000000000(0000) GS:ff1100009baed000(0000) knlGS:0000000000000000 [ 627.261370][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 627.261371][ C0] CR2: 000055e25e2d8000 CR3: 0000000035134003 CR4: 0000000000771ef0 [ 627.261372][ C0] PKRU: 55555554 [ 627.261372][ C0] Call Trace: [ 627.261373][ C0] [ 627.261376][ C0] ? asm_common_interrupt+0x26/0x40 [ 627.261381][ C0] ? kmem_cache_alloc_node_noprof+0x4b7/0x700 [ 627.261384][ C0] ? stack_access_ok+0x1d0/0x1d0 [ 627.261386][ C0] ? call_timer_fn+0x164/0x300 [ 627.261391][ C0] ? __unwind_start+0x3f6/0x8c0 [ 627.261394][ C0] ? write_profile+0xf0/0xf0 [ 627.261397][ C0] arch_stack_walk+0x9b/0x100 [ 627.261402][ C0] ? preempt_count_sub+0x4e/0x170 [ 627.261407][ C0] stack_trace_save+0x93/0xc0 [ 627.261409][ C0] ? stack_trace_snprint+0xd0/0xd0 [ 627.261414][ C0] set_track_prepare+0x46/0x80 [ 627.261417][ C0] ? kmem_cache_alloc_node_noprof+0x4b7/0x700 [ 627.261418][ C0] ? __alloc_skb+0xf1/0x350 [ 627.261422][ C0] ? __neigh_notify+0xc6/0x280 [ 627.261424][ C0] ? neigh_timer_handler+0x1e0/0xf80 [ 627.261425][ C0] ? call_timer_fn+0x164/0x300 [ 627.261426][ C0] ? __run_timers+0x600/0x930 [ 627.261428][ C0] ? run_timer_softirq+0xf3/0x170 [ 627.261430][ C0] ? handle_softirqs+0x1d7/0x840 [ 627.261433][ C0] ? irq_exit_rcu+0xa2/0xf0 [ 627.261434][ C0] ? common_interrupt+0xc9/0x100 [ 627.261438][ C0] ? asm_common_interrupt+0x26/0x40 [ 627.261440][ C0] __alloc_object+0xe8/0x250 [ 627.261443][ C0] __create_object+0x26/0xc0 [ 627.261445][ C0] ? kasan_save_track+0x14/0x30 [ 627.261448][ C0] kmem_cache_alloc_node_noprof+0x4b7/0x700 [ 627.261453][ C0] ? __alloc_skb+0xf1/0x350 [ 627.261454][ C0] __alloc_skb+0xf1/0x350 [ 627.261456][ C0] ? __alloc_skb+0x2a8/0x350 [ 627.261457][ C0] ? napi_skb_cache_get+0x7a0/0x7a0 [ 627.261459][ C0] ? __neigh_notify+0x2f/0x280 [ 627.261461][ C0] ? rcu_is_watching+0x15/0xd0 [ 627.261464][ C0] ? __neigh_notify+0x2f/0x280 [ 627.261465][ C0] ? lock_acquire+0x10a/0x150 [ 627.261469][ C0] __neigh_notify+0xc6/0x280 [ 627.261472][ C0] neigh_timer_handler+0x1e0/0xf80 [ 627.261473][ C0] ? call_timer_fn+0x114/0x300 [ 627.261475][ C0] ? lock_acquire+0x10a/0x150 [ 627.261478][ C0] ? neigh_periodic_work+0xb00/0xb00 [ 627.261479][ C0] call_timer_fn+0x164/0x300 [ 627.261482][ C0] ? detach_if_pending+0x1c0/0x1c0 [ 627.261484][ C0] ? debug_object_active_state+0x430/0x430 [ 627.261489][ C0] ? __lock_release.isra.0+0x59/0x170 [ 627.261491][ C0] ? rcu_is_watching+0x15/0xd0 [ 627.261494][ C0] __run_timers+0x600/0x930 [ 627.261497][ C0] ? neigh_periodic_work+0xb00/0xb00 [ 627.261499][ C0] ? find_held_lock+0x2b/0x80 [ 627.261501][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 627.261504][ C0] ? __lock_acquire+0x577/0xc10 [ 627.261509][ C0] ? __rwlock_init+0x150/0x150 [ 627.261512][ C0] ? lock_acquire+0x10a/0x150 [ 627.261516][ C0] run_timer_softirq+0xf3/0x170 [ 627.261518][ C0] ? __run_timers+0x930/0x930 [ 627.261521][ C0] ? handle_softirqs+0x19f/0x840 [ 627.261523][ C0] ? rcu_is_watching+0x15/0xd0 [ 627.261524][ C0] handle_softirqs+0x1d7/0x840 [ 627.261528][ C0] ? tasklet_unlock_wait+0x60/0x60 [ 627.261530][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 627.261534][ C0] irq_exit_rcu+0xa2/0xf0 [ 627.261535][ C0] common_interrupt+0xc9/0x100 [ 627.261537][ C0] [ 627.261538][ C0] [ 627.261539][ C0] asm_common_interrupt+0x26/0x40 [ 627.261541][ C0] RIP: 0010:preempt_count_sub+0x4e/0x170 [ 627.261543][ C0] Code: e0 07 48 c1 ee 03 83 c0 03 0f b6 0c 0e 38 c8 7c 08 84 c9 0f 85 d7 00 00 00 8b 0d 7d 7f e2 04 85 c9 75 19 65 8b 0d 62 66 32 04 <81> e1 ff ff ff 7f 39 ca 7f 16 81 fa fe 00 00 00 76 66 f7 da 65 01 [ 627.261544][ C0] RSP: 0018:ffa0000000127d48 EFLAGS: 00000246 [ 627.261545][ C0] RAX: 0000000000000003 RBX: ff1100002f626fc0 RCX: 0000000080000001 [ 627.261546][ C0] RDX: 0000000000000001 RSI: 1ffffffff28c6928 RDI: 0000000000000001 [ 627.261546][ C0] RBP: ffffffff8fa93e60 R08: 0000000000000000 R09: 0000000000000001 [ 627.261547][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ff1100002f627058 [ 627.261547][ C0] R13: dffffc0000000000 R14: ffe21c0005ec4e0a R15: 0000000000000000 [ 627.261549][ C0] ? lockup_detector_update_enable+0x50/0x50 [ 627.261555][ C0] ? preempt_count_add+0x7f/0x180 [ 627.261557][ C0] cpu_stopper_thread+0x272/0x450 [ 627.261562][ C0] smpboot_thread_fn+0x2fb/0x9b0 [ 627.261567][ C0] ? sort_range+0x20/0x20 [ 627.261569][ C0] kthread+0x355/0x5b0 [ 627.261571][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 627.261573][ C0] ? __lock_release.isra.0+0x59/0x170 [ 627.261575][ C0] ? rcu_is_watching+0x15/0xd0 [ 627.261577][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 627.261579][ C0] ret_from_fork+0x3fb/0x510 [ 627.261582][ C0] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 627.261585][ C0] ? __switch_to+0x602/0xd00 [ 627.261589][ C0] ? kthread_is_per_cpu+0xe0/0xe0 [ 627.261591][ C0] ret_from_fork_asm+0x11/0x20 [ 627.261598][ C0] [ 628.044272][ C0] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 22227140895 wd_nsec: 22227142174