[ 75.054435][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 5105 ms
[ 75.055030][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 5105000 usecs ago
[ 80.190429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 10240 ms
[ 80.190801][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 10241000 usecs ago
[ 85.310428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 15360 ms
[ 85.310800][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 15361000 usecs ago
[ 91.454429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 21505 ms
[ 91.454800][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 21505000 usecs ago
[ 97.086429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 27137 ms
[ 97.086785][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 27137000 usecs ago
[ 102.206429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 32257 ms
[ 102.206780][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 32257000 usecs ago
[ 107.326428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 37377 ms
[ 107.326779][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 37377000 usecs ago
[ 113.470429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 43521 ms
[ 113.470786][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 43521000 usecs ago
[ 119.102429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 49153 ms
[ 119.102792][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 49153000 usecs ago
[ 124.222428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 54273 ms
[ 124.222781][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 54273000 usecs ago
[ 129.342429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 59393 ms
[ 129.342780][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 59393000 usecs ago
[ 135.486429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 65537 ms
[ 135.486788][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 65537000 usecs ago
[ 141.118431][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 71169 ms
[ 141.118799][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 71169000 usecs ago
[ 146.238430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 76289 ms
[ 146.238798][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 76289000 usecs ago
[ 151.358429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 81409 ms
[ 151.358797][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 81409000 usecs ago
[ 157.502428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 87553 ms
[ 157.502780][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 87553000 usecs ago
[ 163.134430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 93185 ms
[ 163.134803][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 93185000 usecs ago
[ 168.254429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 98305 ms
[ 168.254795][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 98305000 usecs ago
[ 173.374429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 103425 ms
[ 173.374831][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 103425000 usecs ago
[ 179.518429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 109569 ms
[ 179.518823][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 109569000 usecs ago
[ 185.150429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 115201 ms
[ 185.150817][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 115201000 usecs ago
[ 190.270429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 120321 ms
[ 190.270819][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 120321000 usecs ago
[ 195.390430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 125441 ms
[ 195.390815][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 125441000 usecs ago
[ 201.534432][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 131585 ms
[ 201.534846][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 131585000 usecs ago
[ 207.166432][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 137217 ms
[ 207.166848][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 137217000 usecs ago
[ 212.286430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 142337 ms
[ 212.286862][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 142337000 usecs ago
[ 217.406429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 147457 ms
[ 217.406813][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 147457000 usecs ago
[ 223.550429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 153601 ms
[ 223.550827][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 153601000 usecs ago
[ 229.182429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 159233 ms
[ 229.182917][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 159233000 usecs ago
[ 234.302429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 164353 ms
[ 234.302812][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 164353000 usecs ago
[ 240.446428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 170497 ms
[ 240.446823][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 170497000 usecs ago
[ 246.078439][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 176129 ms
[ 246.078839][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 176129000 usecs ago
[ 247.102473][ T44] INFO: task ip:342 blocked for more than 122 seconds.
[ 247.102868][ T44] Not tainted 6.18.0-rc7-virtme #1
[ 247.103015][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 247.103263][ T44] task:ip state:D stack:25496 pid:342 tgid:342 ppid:337 task_flags:0x400100 flags:0x00080001
[ 247.103662][ T44] Call Trace:
[ 247.103776][ T44]
[ 247.103854][ T44] __schedule+0x88d/0x1b90
[ 247.104006][ T44] ? io_schedule_timeout+0x130/0x130
[ 247.104148][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 247.104287][ T44] ? __lock_release.isra.0+0x59/0x170
[ 247.104426][ T44] ? __lock_release.isra.0+0x59/0x170
[ 247.104562][ T44] schedule+0xd4/0x260
[ 247.104661][ T44] schedule_preempt_disabled+0x18/0x30
[ 247.104790][ T44] __mutex_lock+0x9ae/0x1500
[ 247.104919][ T44] ? napi_enable+0x3b/0x80
[ 247.105053][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850
[ 247.105214][ T44] ? ww_mutex_lock+0x160/0x160
[ 247.105345][ T44] ? __asan_memset+0x27/0x50
[ 247.105484][ T44] ? sg_init_table+0x19/0x60
[ 247.105617][ T44] ? try_fill_recv+0x3ec/0x1750
[ 247.105745][ T44] ? napi_enable+0x3b/0x80
[ 247.105866][ T44] napi_enable+0x3b/0x80
[ 247.105958][ T44] __virtnet_rx_resume+0x156/0x290
[ 247.106082][ T44] ? queue_delayed_work_on+0x91/0x100
[ 247.106200][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 247.106323][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 247.106451][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 247.106567][ T44] dev_xdp_install+0x3e4/0x8e0
[ 247.106685][ T44] ? netif_skb_check_for_xdp+0x600/0x600
[ 247.106805][ T44] dev_xdp_attach+0x50d/0x1320
[ 247.107159][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 247.107275][ T44] ? __bpf_prog_get+0x320/0x320
[ 247.107399][ T44] dev_change_xdp_fd+0x182/0x240
[ 247.107529][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 247.107648][ T44] ? rtnl_newlink_create+0x900/0x900
[ 247.107769][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0
[ 247.107918][ T44] ? rcu_read_lock_any_held+0x41/0xa0
[ 247.108034][ T44] ? validate_chain+0x287/0x5f0
[ 247.108152][ T44] ? rcu_read_lock_any_held+0x6b/0xa0
[ 247.108274][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 247.108391][ T44] ? __lock_acquire+0x34c/0x740
[ 247.108520][ T44] ? trace_lock_acquire+0x88/0xd0
[ 247.108636][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 247.108752][ T44] ? lock_acquire+0x31/0x80
[ 247.108868][ T44] ? rtnl_newlink+0x5df/0xb20
[ 247.108985][ T44] ? rcu_is_watching+0x15/0xd0
[ 247.109099][ T44] ? rcu_is_watching+0x15/0xd0
[ 247.109217][ T44] ? trace_contention_end+0xd6/0x140
[ 247.109334][ T44] ? rtnl_newlink+0x5df/0xb20
[ 247.109463][ T44] ? __mutex_lock+0x32e/0x1500
[ 247.109584][ T44] ? ww_mutex_lock+0x160/0x160
[ 247.109697][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 247.109814][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 247.109932][ T44] rtnl_newlink+0x637/0xb20
[ 247.110052][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 247.110169][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 247.110284][ T44] ? find_held_lock+0x2b/0x80
[ 247.110400][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 247.110524][ T44] ? __lock_release.isra.0+0x59/0x170
[ 247.110640][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 247.110756][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 247.110872][ T44] ? rtnl_port_fill+0x940/0x940
[ 247.110990][ T44] ? __lock_acquire+0x34c/0x740
[ 247.111107][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 247.111221][ T44] ? find_held_lock+0x2b/0x80
[ 247.111338][ T44] netlink_rcv_skb+0x123/0x380
[ 247.111464][ T44] ? rtnl_port_fill+0x940/0x940
[ 247.111582][ T44] ? netlink_ack+0xcc0/0xcc0
[ 247.111701][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 247.111820][ T44] netlink_unicast+0x4a3/0x770
[ 247.111938][ T44] ? netlink_attachskb+0x810/0x810
[ 247.112057][ T44] ? __lock_acquire+0x34c/0x740
[ 247.112175][ T44] netlink_sendmsg+0x735/0xc60
[ 247.112293][ T44] ? netlink_unicast+0x770/0x770
[ 247.112409][ T44] ? __might_fault+0x97/0x140
[ 247.112535][ T44] ____sys_sendmsg+0x419/0x850
[ 247.112651][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 247.112767][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 247.112908][ T44] ? move_addr_to_kernel+0x40/0x40
[ 247.113022][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 247.113134][ T44] ? validate_chain+0x287/0x5f0
[ 247.113254][ T44] ___sys_sendmsg+0xfd/0x180
[ 247.113369][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680
[ 247.113521][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 247.113651][ T44] __sys_sendmsg+0x124/0x1c0
[ 247.113769][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 247.113883][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 247.113999][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680
[ 247.114148][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 247.114263][ T44] ? rcu_is_watching+0x15/0xd0
[ 247.114380][ T44] do_syscall_64+0xbb/0xfd0
[ 247.114514][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 247.114661][ T44] RIP: 0033:0x7f43be03dc5e
[ 247.114787][ T44] RSP: 002b:00007fffd2f08180 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 247.114965][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f43be03dc5e
[ 247.115139][ T44] RDX: 0000000000000000 RSI: 00007fffd2f08240 RDI: 0000000000000003
[ 247.115318][ T44] RBP: 00007fffd2f08190 R08: 0000000000000000 R09: 0000000000000000
[ 247.115503][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffd2f08900
[ 247.115678][ T44] R13: 000000006929c828 R14: 0000000000000000 R15: 0000000000499600
[ 247.115860][ T44]
[ 247.115955][ T44] INFO: task ip:342 is blocked on a mutex likely owned by task kworker/2:2:66.
[ 247.116154][ T44] task:kworker/2:2 state:R running task stack:27984 pid:66 tgid:66 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 247.116448][ T44] Workqueue: events refill_work
[ 247.116569][ T44] Call Trace:
[ 247.116659][ T44]
[ 247.116720][ T44] __schedule+0x88d/0x1b90
[ 247.116843][ T44] ? io_schedule_timeout+0x130/0x130
[ 247.116964][ T44] ? usleep_range_state+0xba/0x1b0
[ 247.117079][ T44] ? find_held_lock+0x2b/0x80
[ 247.117197][ T44] ? __lock_release.isra.0+0x59/0x170
[ 247.117319][ T44] ? usleep_range_state+0xba/0x1b0
[ 247.117443][ T44] schedule+0xd4/0x260
[ 247.117531][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 247.117675][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 247.117796][ T44] ? hrtimer_cb_get_time+0x90/0x90
[ 247.117914][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 247.118029][ T44] ? ktime_get+0x15e/0x220
[ 247.118143][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 247.118263][ T44] usleep_range_state+0x78/0x1b0
[ 247.118379][ T44] ? schedule_hrtimeout+0x20/0x20
[ 247.118510][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 247.118630][ T44] napi_disable_locked+0x379/0x5f0
[ 247.118747][ T44] ? _mutex_trylock_nest_lock+0x150/0x150
[ 247.118863][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 247.119011][ T44] napi_disable+0x43/0x80
[ 247.119099][ T44] refill_work+0x116/0x210
[ 247.119217][ T44] process_one_work+0xd57/0x1390
[ 247.119336][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 247.119462][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 247.119580][ T44] ? assign_work+0x152/0x380
[ 247.119701][ T44] worker_thread+0x4d6/0xd40
[ 247.119818][ T44] ? process_one_work+0x1390/0x1390
[ 247.119936][ T44] ? __kthread_parkme+0xb3/0x200
[ 247.120056][ T44] ? process_one_work+0x1390/0x1390
[ 247.120174][ T44] kthread+0x355/0x5b0
[ 247.120265][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 247.120383][ T44] ? __lock_release.isra.0+0x59/0x170
[ 247.120505][ T44] ? rcu_is_watching+0x15/0xd0
[ 247.120621][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 247.120740][ T44] ret_from_fork+0x1d4/0x270
[ 247.120858][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 247.120975][ T44] ret_from_fork_asm+0x11/0x20
[ 247.121097][ T44]
[ 247.121186][ T44]
[ 247.121186][ T44] Showing all locks held in the system:
[ 247.121365][ T44] 1 lock held by khungtaskd/44:
[ 247.121488][ T44] #0: ffffffff94178fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db
[ 247.121694][ T44] 3 locks held by kworker/2:2/66:
[ 247.121805][ T44] 3 locks held by kworker/u16:1/71:
[ 247.121917][ T44] #0: ff110000092acd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 247.122142][ T44] #1: ffa00000004c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 247.122429][ T44] #2: ffffffff94892368 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 247.122633][ T44] 2 locks held by ip/342:
[ 247.122716][ T44] #0: ffffffff94892368 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20
[ 247.122918][ T44] #1: ff11000008c2ac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 247.123115][ T44]
[ 247.123173][ T44] =============================================
[ 247.123173][ T44]
[ 251.198429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 181249 ms
[ 251.198844][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 181249000 usecs ago
[ 256.318430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 186369 ms
[ 256.318835][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 186369000 usecs ago
[ 262.462430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 192513 ms
[ 262.462871][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 192513000 usecs ago
[ 268.094429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 198145 ms
[ 268.094824][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 198145000 usecs ago
[ 273.214429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 203265 ms
[ 273.214829][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 203265000 usecs ago
[ 278.334429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 208385 ms
[ 278.334835][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 208385000 usecs ago
[ 284.478429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 214529 ms
[ 284.478834][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 214529000 usecs ago
[ 290.110429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 220161 ms
[ 290.110834][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 220161000 usecs ago
[ 295.230429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 225281 ms
[ 295.230813][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 225281000 usecs ago
[ 300.350428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 230401 ms
[ 300.350806][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 230401000 usecs ago
[ 306.494428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 236545 ms
[ 306.494831][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 236545000 usecs ago
[ 312.126429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 242177 ms
[ 312.126817][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 242177000 usecs ago
[ 317.246429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 247297 ms
[ 317.246824][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 247297000 usecs ago
[ 322.366428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 252417 ms
[ 322.366810][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 252417000 usecs ago
[ 328.510428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 258561 ms
[ 328.510814][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 258561000 usecs ago
[ 334.142429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 264193 ms
[ 334.142823][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 264193000 usecs ago
[ 339.262428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 269313 ms
[ 339.262811][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 269313000 usecs ago
[ 344.382428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 274433 ms
[ 344.382830][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 274433000 usecs ago
[ 350.526430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 280577 ms
[ 350.526814][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 280577000 usecs ago
[ 356.158429][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 286209 ms
[ 356.158813][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 286209000 usecs ago
[ 361.278430][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 291329 ms
[ 361.278829][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 291329000 usecs ago
[ 366.398428][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 296449 ms
[ 366.398806][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 296449000 usecs ago
[ 369.981465][ T44] INFO: task kworker/u16:1:71 blocked for more than 122 seconds.
[ 369.981815][ T44] Not tainted 6.18.0-rc7-virtme #1
[ 369.981962][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 369.982215][ T44] task:kworker/u16:1 state:D stack:28040 pid:71 tgid:71 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 369.982560][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 369.982752][ T44] Call Trace:
[ 369.982857][ T44]
[ 369.982931][ T44] __schedule+0x88d/0x1b90
[ 369.983071][ T44] ? io_schedule_timeout+0x130/0x130
[ 369.983207][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 369.983339][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.983475][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.983602][ T44] schedule+0xd4/0x260
[ 369.983708][ T44] schedule_preempt_disabled+0x18/0x30
[ 369.983834][ T44] __mutex_lock+0x9ae/0x1500
[ 369.983961][ T44] ? addrconf_verify_work+0x12/0x30
[ 369.984092][ T44] ? ww_mutex_lock+0x160/0x160
[ 369.984225][ T44] ? process_one_work+0xd16/0x1390
[ 369.984355][ T44] ? trace_lock_acquire+0x88/0xd0
[ 369.984478][ T44] ? trace_lock_acquire+0x88/0xd0
[ 369.984607][ T44] ? addrconf_verify_work+0x12/0x30
[ 369.984730][ T44] addrconf_verify_work+0x12/0x30
[ 369.984863][ T44] process_one_work+0xd57/0x1390
[ 369.984995][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 369.985117][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 369.985244][ T44] ? assign_work+0x152/0x380
[ 369.985361][ T44] worker_thread+0x4d6/0xd40
[ 369.985487][ T44] ? process_one_work+0x1390/0x1390
[ 369.985606][ T44] ? __kthread_parkme+0xb3/0x200
[ 369.985733][ T44] ? process_one_work+0x1390/0x1390
[ 369.985849][ T44] kthread+0x355/0x5b0
[ 369.985940][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 369.986060][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.986177][ T44] ? rcu_is_watching+0x15/0xd0
[ 369.986298][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 369.986426][ T44] ret_from_fork+0x1d4/0x270
[ 369.986546][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 369.986670][ T44] ret_from_fork_asm+0x11/0x20
[ 369.986793][ T44]
[ 369.986895][ T44] INFO: task kworker/u16:1:71 is blocked on a mutex likely owned by task ip:342.
[ 369.987092][ T44] INFO: task ip:342 blocked for more than 245 seconds.
[ 369.987230][ T44] Not tainted 6.18.0-rc7-virtme #1
[ 369.987344][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 369.987539][ T44] task:ip state:D stack:25496 pid:342 tgid:342 ppid:337 task_flags:0x400100 flags:0x00080001
[ 369.987811][ T44] Call Trace:
[ 369.987897][ T44]
[ 369.987957][ T44] __schedule+0x88d/0x1b90
[ 369.988075][ T44] ? io_schedule_timeout+0x130/0x130
[ 369.988199][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 369.988317][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.988436][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.988554][ T44] schedule+0xd4/0x260
[ 369.988647][ T44] schedule_preempt_disabled+0x18/0x30
[ 369.988763][ T44] __mutex_lock+0x9ae/0x1500
[ 369.988877][ T44] ? napi_enable+0x3b/0x80
[ 369.989000][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850
[ 369.989148][ T44] ? ww_mutex_lock+0x160/0x160
[ 369.989264][ T44] ? __asan_memset+0x27/0x50
[ 369.989384][ T44] ? sg_init_table+0x19/0x60
[ 369.989509][ T44] ? try_fill_recv+0x3ec/0x1750
[ 369.989631][ T44] ? napi_enable+0x3b/0x80
[ 369.989746][ T44] napi_enable+0x3b/0x80
[ 369.989834][ T44] __virtnet_rx_resume+0x156/0x290
[ 369.989969][ T44] ? queue_delayed_work_on+0x91/0x100
[ 369.990086][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 369.990206][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 369.990325][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 369.990447][ T44] dev_xdp_install+0x3e4/0x8e0
[ 369.990568][ T44] ? netif_skb_check_for_xdp+0x600/0x600
[ 369.990696][ T44] dev_xdp_attach+0x50d/0x1320
[ 369.990814][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 369.990929][ T44] ? __bpf_prog_get+0x320/0x320
[ 369.991049][ T44] dev_change_xdp_fd+0x182/0x240
[ 369.991166][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 369.991286][ T44] ? rtnl_newlink_create+0x900/0x900
[ 369.991401][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0
[ 369.991553][ T44] ? rcu_read_lock_any_held+0x41/0xa0
[ 369.991674][ T44] ? validate_chain+0x287/0x5f0
[ 369.991792][ T44] ? rcu_read_lock_any_held+0x6b/0xa0
[ 369.991907][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 369.992024][ T44] ? __lock_acquire+0x34c/0x740
[ 369.992144][ T44] ? trace_lock_acquire+0x88/0xd0
[ 369.992260][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 369.992380][ T44] ? lock_acquire+0x31/0x80
[ 369.992501][ T44] ? rtnl_newlink+0x5df/0xb20
[ 369.992620][ T44] ? rcu_is_watching+0x15/0xd0
[ 369.992736][ T44] ? rcu_is_watching+0x15/0xd0
[ 369.992854][ T44] ? trace_contention_end+0xd6/0x140
[ 369.992972][ T44] ? rtnl_newlink+0x5df/0xb20
[ 369.993089][ T44] ? __mutex_lock+0x32e/0x1500
[ 369.993209][ T44] ? ww_mutex_lock+0x160/0x160
[ 369.993329][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 369.993453][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 369.993572][ T44] rtnl_newlink+0x637/0xb20
[ 369.993696][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 369.993814][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 369.993935][ T44] ? find_held_lock+0x2b/0x80
[ 369.994051][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 369.994170][ T44] ? __lock_release.isra.0+0x59/0x170
[ 369.994290][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 369.994406][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 369.994528][ T44] ? rtnl_port_fill+0x940/0x940
[ 369.994651][ T44] ? __lock_acquire+0x34c/0x740
[ 369.994767][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 369.994884][ T44] ? find_held_lock+0x2b/0x80
[ 369.995002][ T44] netlink_rcv_skb+0x123/0x380
[ 369.995120][ T44] ? rtnl_port_fill+0x940/0x940
[ 369.995241][ T44] ? netlink_ack+0xcc0/0xcc0
[ 369.995360][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 369.995484][ T44] netlink_unicast+0x4a3/0x770
[ 369.995600][ T44] ? netlink_attachskb+0x810/0x810
[ 369.995724][ T44] ? __lock_acquire+0x34c/0x740
[ 369.995845][ T44] netlink_sendmsg+0x735/0xc60
[ 369.995964][ T44] ? netlink_unicast+0x770/0x770
[ 369.996090][ T44] ? __might_fault+0x97/0x140
[ 369.996209][ T44] ____sys_sendmsg+0x419/0x850
[ 369.996329][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 369.996451][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 369.996595][ T44] ? move_addr_to_kernel+0x40/0x40
[ 369.996715][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 369.996831][ T44] ? validate_chain+0x287/0x5f0
[ 369.996955][ T44] ___sys_sendmsg+0xfd/0x180
[ 369.997070][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680
[ 369.997214][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 369.997342][ T44] __sys_sendmsg+0x124/0x1c0
[ 369.997463][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 369.997578][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 369.997697][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680
[ 369.997849][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 369.997964][ T44] ? rcu_is_watching+0x15/0xd0
[ 369.998082][ T44] do_syscall_64+0xbb/0xfd0
[ 369.998201][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 369.998345][ T44] RIP: 0033:0x7f43be03dc5e
[ 369.998475][ T44] RSP: 002b:00007fffd2f08180 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 369.998654][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f43be03dc5e
[ 369.998830][ T44] RDX: 0000000000000000 RSI: 00007fffd2f08240 RDI: 0000000000000003
[ 369.999006][ T44] RBP: 00007fffd2f08190 R08: 0000000000000000 R09: 0000000000000000
[ 369.999178][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffd2f08900
[ 369.999352][ T44] R13: 000000006929c828 R14: 0000000000000000 R15: 0000000000499600
[ 369.999542][ T44]
[ 369.999633][ T44] INFO: task ip:342 is blocked on a mutex likely owned by task kworker/2:2:66.
[ 369.999826][ T44] task:kworker/2:2 state:D stack:27984 pid:66 tgid:66 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 370.000084][ T44] Workqueue: events refill_work
[ 370.000201][ T44] Call Trace:
[ 370.000288][ T44]
[ 370.000352][ T44] __schedule+0x88d/0x1b90
[ 370.000476][ T44] ? io_schedule_timeout+0x130/0x130
[ 370.000592][ T44] ? usleep_range_state+0xba/0x1b0
[ 370.000709][ T44] ? find_held_lock+0x2b/0x80
[ 370.000825][ T44] ? validate_chain+0x287/0x5f0
[ 370.000939][ T44] ? _raw_spin_unlock_irq+0x28/0x50
[ 370.001053][ T44] ? _raw_spin_unlock_irq+0x2e/0x50
[ 370.001173][ T44] ? usleep_range_state+0xba/0x1b0
[ 370.001289][ T44] schedule+0xd4/0x260
[ 370.001375][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 370.001561][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 370.001682][ T44] ? hrtimer_cb_get_time+0x90/0x90
[ 370.001801][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 370.001916][ T44] ? ktime_get+0x15e/0x220
[ 370.002036][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 370.002152][ T44] ? ktime_get+0xa9/0x220
[ 370.002239][ T44] usleep_range_state+0x133/0x1b0
[ 370.002356][ T44] ? schedule_hrtimeout+0x20/0x20
[ 370.002478][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 370.002596][ T44] napi_disable_locked+0x379/0x5f0
[ 370.002715][ T44] ? _mutex_trylock_nest_lock+0x150/0x150
[ 370.002834][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 370.002985][ T44] napi_disable+0x43/0x80
[ 370.003074][ T44] refill_work+0x116/0x210
[ 370.003192][ T44] process_one_work+0xd57/0x1390
[ 370.003313][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 370.003434][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 370.003558][ T44] ? assign_work+0x152/0x380
[ 370.003684][ T44] worker_thread+0x4d6/0xd40
[ 370.003803][ T44] ? process_one_work+0x1390/0x1390
[ 370.003922][ T44] ? __kthread_parkme+0xb3/0x200
[ 370.004038][ T44] ? process_one_work+0x1390/0x1390
[ 370.004156][ T44] kthread+0x355/0x5b0
[ 370.004246][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 370.004363][ T44] ? __lock_release.isra.0+0x59/0x170
[ 370.004491][ T44] ? rcu_is_watching+0x15/0xd0
[ 370.004611][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 370.004736][ T44] ret_from_fork+0x1d4/0x270
[ 370.004853][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 370.004969][ T44] ret_from_fork_asm+0x11/0x20
[ 370.005091][ T44]
[ 370.005179][ T44]
[ 370.005179][ T44] Showing all locks held in the system:
[ 370.005353][ T44] 1 lock held by khungtaskd/44:
[ 370.005476][ T44] #0: ffffffff94178fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db
[ 370.005683][ T44] 3 locks held by kworker/2:2/66:
[ 370.005799][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 370.006023][ T44] #1: ffa0000000477d30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 370.006285][ T44] #2: ff11000008c2ac98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 370.006490][ T44] 3 locks held by kworker/u16:1/71:
[ 370.006601][ T44] #0: ff110000092acd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 370.006833][ T44] #1: ffa00000004c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 370.007116][ T44] #2: ffffffff94892368 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 370.007318][ T44] 2 locks held by ip/342:
[ 370.007402][ T44] #0: ffffffff94892368 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20
[ 370.007607][ T44] #1: ff11000008c2ac98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 370.007810][ T44]
[ 370.007871][ T44] =============================================
[ 370.007871][ T44]
[ 372.542431][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 302593 ms
[ 372.542848][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 302593000 usecs ago
[ 378.174449][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 308225 ms
[ 378.174877][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 308225000 usecs ago