[ 518.461762][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 259072 ms
[ 518.462210][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 259072000 usecs ago
[ 524.093742][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 264704 ms
[ 524.094211][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 264704000 usecs ago
[ 529.213749][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 269824 ms
[ 529.214419][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 269824000 usecs ago
[ 534.333746][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 274944 ms
[ 534.334228][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 274944000 usecs ago
[ 540.477744][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 281088 ms
[ 540.478190][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 281088000 usecs ago
[ 546.109729][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 286720 ms
[ 546.110181][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 286720000 usecs ago
[ 551.229745][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 291840 ms
[ 551.230185][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 291840000 usecs ago
[ 556.349749][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 296960 ms
[ 556.350406][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 296960000 usecs ago
[ 562.493752][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 303104 ms
[ 562.494377][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 303104000 usecs ago
[ 568.125743][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 308736 ms
[ 568.126171][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 308736000 usecs ago
[ 573.245727][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 313856 ms
[ 573.246180][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 313856000 usecs ago
[ 578.365741][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 318976 ms
[ 578.366196][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 318976000 usecs ago
[ 584.509729][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 325120 ms
[ 584.510213][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 325120000 usecs ago
[ 590.141751][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 330752 ms
[ 590.142217][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 330752000 usecs ago
[ 595.261757][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 335872 ms
[ 595.262229][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 335872000 usecs ago
[ 600.381768][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 340992 ms
[ 600.382381][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 340992000 usecs ago
[ 606.525733][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 347136 ms
[ 606.526369][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 347136000 usecs ago
[ 612.157735][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 352768 ms
[ 612.158385][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 352768000 usecs ago
[ 615.742738][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds.
[ 615.743030][ T44] Not tainted 6.18.0-virtme #1
[ 615.743154][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 615.743396][ T44] task:kworker/u16:0 state:D stack:27856 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 615.743689][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 615.743870][ T44] Call Trace:
[ 615.743964][ T44]
[ 615.744034][ T44] __schedule+0xae2/0x1720
[ 615.744176][ T44] ? io_schedule_timeout+0x130/0x130
[ 615.744303][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.744439][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.744569][ T44] schedule+0xd4/0x260
[ 615.744667][ T44] schedule_preempt_disabled+0x18/0x30
[ 615.744802][ T44] __mutex_lock+0xd76/0x1f20
[ 615.744925][ T44] ? addrconf_verify_work+0x12/0x30
[ 615.745057][ T44] ? ww_mutex_lock+0x160/0x160
[ 615.745198][ T44] ? process_one_work+0xd16/0x1390
[ 615.745337][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.745462][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.745594][ T44] ? addrconf_verify_work+0x12/0x30
[ 615.745729][ T44] addrconf_verify_work+0x12/0x30
[ 615.745850][ T44] process_one_work+0xd57/0x1390
[ 615.745984][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 615.746108][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 615.746262][ T44] ? assign_work+0x152/0x380
[ 615.746383][ T44] worker_thread+0x4d6/0xd40
[ 615.746522][ T44] ? process_one_work+0x1390/0x1390
[ 615.746643][ T44] kthread+0x355/0x5b0
[ 615.746747][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.746872][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.747001][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.747134][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.747266][ T44] ret_from_fork+0x3fb/0x510
[ 615.747388][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 615.747548][ T44] ? __switch_to+0x602/0xd00
[ 615.747673][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.747810][ T44] ret_from_fork_asm+0x11/0x20
[ 615.747937][ T44]
[ 615.748063][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:980.
[ 615.748304][ T44] INFO: task ip:980 blocked for more than 368 seconds.
[ 615.748446][ T44] Not tainted 6.18.0-virtme #1
[ 615.748568][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 615.748774][ T44] task:ip state:D stack:25456 pid:980 tgid:980 ppid:1 task_flags:0x400100 flags:0x00080002
[ 615.749058][ T44] Call Trace:
[ 615.749156][ T44]
[ 615.749219][ T44] __schedule+0xae2/0x1720
[ 615.749353][ T44] ? io_schedule_timeout+0x130/0x130
[ 615.749480][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.749607][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.749738][ T44] schedule+0xd4/0x260
[ 615.749829][ T44] schedule_preempt_disabled+0x18/0x30
[ 615.749962][ T44] __mutex_lock+0xd76/0x1f20
[ 615.750086][ T44] ? napi_enable+0x3b/0x80
[ 615.750226][ T44] ? ww_mutex_lock+0x160/0x160
[ 615.750347][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.750480][ T44] ? __asan_memset+0x27/0x50
[ 615.750604][ T44] ? sg_init_table+0x19/0x60
[ 615.750737][ T44] ? try_fill_recv+0x3ec/0x1750
[ 615.750867][ T44] ? napi_enable+0x3b/0x80
[ 615.750999][ T44] napi_enable+0x3b/0x80
[ 615.751096][ T44] __virtnet_rx_resume+0x156/0x290
[ 615.751232][ T44] ? queue_delayed_work_on+0x91/0x100
[ 615.751366][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 615.751501][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 615.751643][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 615.751775][ T44] dev_xdp_install+0x4ba/0x890
[ 615.751903][ T44] ? alloc_netdev_dummy+0x30/0x30
[ 615.752040][ T44] dev_xdp_attach+0x50d/0x1310
[ 615.752171][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 615.752303][ T44] ? mutex_is_locked+0x1c/0x50
[ 615.752425][ T44] ? rtnl_is_locked+0x15/0x20
[ 615.752557][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 615.752693][ T44] ? rtnl_newlink_create+0x900/0x900
[ 615.752829][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 615.752981][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 615.753112][ T44] ? validate_chain+0x30f/0x8e0
[ 615.753243][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 615.753375][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 615.753501][ T44] ? __lock_acquire+0x577/0xc10
[ 615.753650][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 615.753785][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 615.753905][ T44] ? lock_acquire+0x10a/0x150
[ 615.754034][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.754161][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.754297][ T44] ? trace_contention_end+0xd6/0x110
[ 615.754421][ T44] ? __mutex_lock+0x285/0x1f20
[ 615.754558][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 615.754684][ T44] ? ww_mutex_lock+0x160/0x160
[ 615.754818][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 615.754946][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 615.755084][ T44] rtnl_newlink+0x649/0xb40
[ 615.755217][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.755349][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 615.755471][ T44] ? __lock_acquire+0x577/0xc10
[ 615.755602][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 615.755733][ T44] ? find_held_lock+0x2b/0x80
[ 615.755857][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 615.755990][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.756112][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 615.756246][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 615.756368][ T44] ? rtnl_port_fill+0x940/0x940
[ 615.756497][ T44] ? __lock_acquire+0x577/0xc10
[ 615.756626][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 615.756786][ T44] ? find_held_lock+0x2b/0x80
[ 615.756913][ T44] netlink_rcv_skb+0x123/0x380
[ 615.757078][ T44] ? rtnl_port_fill+0x940/0x940
[ 615.757220][ T44] ? netlink_ack+0xcc0/0xcc0
[ 615.757360][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 615.757486][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 615.757622][ T44] netlink_unicast+0x4a3/0x770
[ 615.757758][ T44] ? netlink_attachskb+0x810/0x810
[ 615.757881][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 615.758013][ T44] ? __lock_acquire+0x577/0xc10
[ 615.758140][ T44] netlink_sendmsg+0x735/0xc60
[ 615.758278][ T44] ? netlink_unicast+0x770/0x770
[ 615.758402][ T44] ____sys_sendmsg+0x419/0x850
[ 615.758537][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 615.758674][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 615.758845][ T44] ? move_addr_to_kernel+0x40/0x40
[ 615.758970][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 615.759099][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 615.759226][ T44] ___sys_sendmsg+0xfd/0x180
[ 615.759356][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 615.759509][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 615.759656][ T44] __sys_sendmsg+0x124/0x1c0
[ 615.759787][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 615.759909][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 615.760036][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 615.760194][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 615.760323][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.760448][ T44] do_syscall_64+0xbd/0xfc0
[ 615.760582][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 615.760743][ T44] RIP: 0033:0x7fbfc1232c5e
[ 615.760874][ T44] RSP: 002b:00007ffddf4a4690 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 615.761066][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fbfc1232c5e
[ 615.761257][ T44] RDX: 0000000000000000 RSI: 00007ffddf4a4750 RDI: 0000000000000003
[ 615.761448][ T44] RBP: 00007ffddf4a46a0 R08: 0000000000000000 R09: 0000000000000000
[ 615.761629][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffddf4a4e10
[ 615.761820][ T44] R13: 000000006933744e R14: 0000000000000000 R15: 0000000000499600
[ 615.762009][ T44]
[ 615.762113][ T44] INFO: task ip:980 is blocked on a mutex likely owned by task kworker/3:0:33.
[ 615.762348][ T44] task:kworker/3:0 state:D stack:28264 pid:33 tgid:33 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 615.762618][ T44] Workqueue: events refill_work
[ 615.762750][ T44] Call Trace:
[ 615.762842][ T44]
[ 615.762908][ T44] __schedule+0xae2/0x1720
[ 615.763042][ T44] ? usleep_range_state+0xba/0x1b0
[ 615.763168][ T44] ? io_schedule_timeout+0x130/0x130
[ 615.763308][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.763437][ T44] ? usleep_range_state+0xba/0x1b0
[ 615.763567][ T44] schedule+0xd4/0x260
[ 615.763657][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 615.763833][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 615.763956][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 615.764092][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 615.764219][ T44] ? ktime_get+0x15e/0x220
[ 615.764349][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 615.764478][ T44] ? ktime_get+0xa9/0x220
[ 615.764579][ T44] usleep_range_state+0x133/0x1b0
[ 615.764700][ T44] ? schedule_hrtimeout+0x20/0x20
[ 615.764835][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 615.764955][ T44] ? refill_work+0x149/0x210
[ 615.765090][ T44] napi_disable_locked+0x379/0x5f0
[ 615.765216][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 615.765346][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 615.765506][ T44] napi_disable+0x43/0x80
[ 615.765607][ T44] refill_work+0x116/0x210
[ 615.765742][ T44] process_one_work+0xd57/0x1390
[ 615.765874][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 615.766007][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 615.766135][ T44] ? assign_work+0x152/0x380
[ 615.766269][ T44] worker_thread+0x4d6/0xd40
[ 615.766397][ T44] ? process_one_work+0x1390/0x1390
[ 615.766524][ T44] kthread+0x355/0x5b0
[ 615.766616][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.766747][ T44] ? __lock_release.isra.0+0x59/0x170
[ 615.766872][ T44] ? rcu_is_watching+0x15/0xd0
[ 615.767002][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.767128][ T44] ret_from_fork+0x3fb/0x510
[ 615.767258][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 615.767409][ T44] ? __switch_to+0x602/0xd00
[ 615.767537][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 615.767656][ T44] ret_from_fork_asm+0x11/0x20
[ 615.767793][ T44]
[ 615.767894][ T44]
[ 615.767894][ T44] Showing all locks held in the system:
[ 615.768077][ T44] 3 locks held by kworker/u16:0/12:
[ 615.768200][ T44] #0: ff110000089c6548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 615.768442][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 615.768839][ T44] #2: ffffffff8ea78aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 615.769052][ T44] 3 locks held by kworker/2:0/28:
[ 615.769172][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 615.769415][ T44] #1: ffa00000001ffcc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 615.769659][ T44] #2: ffffffff8ea78aa8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0
[ 615.769875][ T44] 3 locks held by kworker/3:0/33:
[ 615.769988][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 615.770230][ T44] #1: ffa0000000257cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 615.770498][ T44] #2: ff110000083b2c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 615.770716][ T44] 1 lock held by khungtaskd/44:
[ 615.770831][ T44] #0: ffffffff8e370ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 615.771109][ T44] 2 locks held by ip/980:
[ 615.771200][ T44] #0: ffffffff8ea78aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40
[ 615.771415][ T44] #1: ff110000083b2c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 615.771626][ T44] 1 lock held by xdp_helper/988:
[ 615.771749][ T44] #0: ffffffff8ea78aa8 (rtnl_mutex){+.+.}-{4:4}, at: xsk_bind+0x17f/0x1a10
[ 615.771962][ T44]
[ 615.772022][ T44] =============================================
[ 615.772022][ T44]
[ 617.277733][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 357888 ms
[ 617.278339][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 357888000 usecs ago
[ 622.397733][ C0] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 0: transmit queue 0 timed out 363008 ms
[ 622.398344][ C0] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 363008000 usecs ago