[ 836.426649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 175617 ms
[ 836.427128][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 175617000 usecs ago
[ 842.570648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 181761 ms
[ 842.571105][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 181761000 usecs ago
[ 848.202649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 187393 ms
[ 848.203078][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 187393000 usecs ago
[ 853.322648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 192513 ms
[ 853.323076][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 192513000 usecs ago
[ 859.466648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 198657 ms
[ 859.467084][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 198657000 usecs ago
[ 861.514680][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds.
[ 861.515004][ T44] Not tainted 6.18.0-rc7-virtme #1
[ 861.515148][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.515391][ T44] task:kworker/u16:0 state:D stack:28040 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.515765][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 861.515947][ T44] Call Trace:
[ 861.516051][ T44]
[ 861.516123][ T44] __schedule+0x88d/0x1b90
[ 861.516265][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.516403][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.516553][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.516698][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.516837][ T44] schedule+0xd4/0x260
[ 861.516934][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.517064][ T44] __mutex_lock+0x9ae/0x1500
[ 861.517198][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.517328][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.517467][ T44] ? process_one_work+0xd16/0x1390
[ 861.517610][ T44] ? trace_lock_acquire+0x88/0xd0
[ 861.517754][ T44] ? trace_lock_acquire+0x88/0xd0
[ 861.517885][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.518012][ T44] addrconf_verify_work+0x12/0x30
[ 861.518142][ T44] process_one_work+0xd57/0x1390
[ 861.518271][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.518400][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.518543][ T44] ? assign_work+0x152/0x380
[ 861.518675][ T44] worker_thread+0x4d6/0xd40
[ 861.518797][ T44] ? process_one_work+0x1390/0x1390
[ 861.518914][ T44] kthread+0x355/0x5b0
[ 861.519003][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.519121][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.519240][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.519363][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.519482][ T44] ret_from_fork+0x1d4/0x270
[ 861.519605][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.519729][ T44] ret_from_fork_asm+0x11/0x20
[ 861.519852][ T44]
[ 861.519966][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:3484.
[ 861.520175][ T44] INFO: task ip:3484 blocked for more than 368 seconds.
[ 861.520318][ T44] Not tainted 6.18.0-rc7-virtme #1
[ 861.520430][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.520627][ T44] task:ip state:D stack:25592 pid:3484 tgid:3484 ppid:1 task_flags:0x400100 flags:0x00080003
[ 861.520899][ T44] Call Trace:
[ 861.520988][ T44]
[ 861.521050][ T44] __schedule+0x88d/0x1b90
[ 861.521176][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.521295][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.521414][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.521537][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.521662][ T44] schedule+0xd4/0x260
[ 861.521752][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.521871][ T44] __mutex_lock+0x9ae/0x1500
[ 861.521993][ T44] ? napi_enable+0x3b/0x80
[ 861.522113][ T44] ? virtqueue_add_inbuf_ctx+0x1850/0x1850
[ 861.522261][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.522380][ T44] ? __asan_memset+0x27/0x50
[ 861.522498][ T44] ? sg_init_table+0x19/0x60
[ 861.522624][ T44] ? try_fill_recv+0x3ec/0x1750
[ 861.522755][ T44] ? napi_enable+0x3b/0x80
[ 861.522874][ T44] napi_enable+0x3b/0x80
[ 861.522968][ T44] __virtnet_rx_resume+0x156/0x290
[ 861.523086][ T44] ? queue_delayed_work_on+0x91/0x100
[ 861.523207][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 861.523327][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 861.523454][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 861.523575][ T44] dev_xdp_install+0x4ba/0x8e0
[ 861.523705][ T44] ? netif_skb_check_for_xdp+0x600/0x600
[ 861.523826][ T44] dev_xdp_attach+0x50d/0x1320
[ 861.523946][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 861.524064][ T44] ? mutex_is_locked+0x1c/0x50
[ 861.524183][ T44] ? rtnl_is_locked+0x15/0x20
[ 861.524301][ T44] ? dev_change_xdp_fd+0x9f/0x240
[ 861.524421][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 861.524548][ T44] ? rtnl_newlink_create+0x900/0x900
[ 861.524678][ T44] ? rcu_lockdep_current_cpu_online+0x3e/0x1b0
[ 861.524825][ T44] ? rcu_read_lock_any_held+0x41/0xa0
[ 861.524945][ T44] ? validate_chain+0x287/0x5f0
[ 861.525061][ T44] ? rcu_read_lock_any_held+0x6b/0xa0
[ 861.525178][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 861.525295][ T44] ? __lock_acquire+0x34c/0x740
[ 861.525416][ T44] ? trace_lock_acquire+0x88/0xd0
[ 861.525540][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.525663][ T44] ? lock_acquire+0x31/0x80
[ 861.525779][ T44] ? rtnl_newlink+0x5df/0xb20
[ 861.525894][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.526010][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.526128][ T44] ? trace_contention_end+0xd6/0x140
[ 861.526246][ T44] ? rtnl_newlink+0x5df/0xb20
[ 861.526364][ T44] ? __mutex_lock+0x32e/0x1500
[ 861.526485][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.526606][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 861.526733][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 861.526853][ T44] rtnl_newlink+0x637/0xb20
[ 861.526972][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.527090][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.527205][ T44] ? find_held_lock+0x2b/0x80
[ 861.527325][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.527441][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.527564][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.527689][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 861.527808][ T44] ? rtnl_port_fill+0x940/0x940
[ 861.527927][ T44] ? __lock_acquire+0x34c/0x740
[ 861.528050][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.528167][ T44] ? find_held_lock+0x2b/0x80
[ 861.528288][ T44] netlink_rcv_skb+0x123/0x380
[ 861.528410][ T44] ? rtnl_port_fill+0x940/0x940
[ 861.528531][ T44] ? netlink_ack+0xcc0/0xcc0
[ 861.528657][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 861.528777][ T44] netlink_unicast+0x4a3/0x770
[ 861.528900][ T44] ? netlink_attachskb+0x810/0x810
[ 861.529017][ T44] ? __lock_acquire+0x34c/0x740
[ 861.529137][ T44] netlink_sendmsg+0x735/0xc60
[ 861.529257][ T44] ? netlink_unicast+0x770/0x770
[ 861.529376][ T44] ? __might_fault+0x97/0x140
[ 861.529502][ T44] ____sys_sendmsg+0x419/0x850
[ 861.529624][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 861.529748][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 861.529899][ T44] ? move_addr_to_kernel+0x40/0x40
[ 861.530018][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 861.530136][ T44] ? validate_chain+0x287/0x5f0
[ 861.530254][ T44] ___sys_sendmsg+0xfd/0x180
[ 861.530372][ T44] ? __call_rcu_common.constprop.0+0xa5/0x680
[ 861.530519][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 861.530660][ T44] __sys_sendmsg+0x124/0x1c0
[ 861.530805][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 861.530924][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.531070][ T44] ? __call_rcu_common.constprop.0+0x2fa/0x680
[ 861.531217][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 861.531336][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.531458][ T44] do_syscall_64+0xbb/0xfd0
[ 861.531581][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 861.531733][ T44] RIP: 0033:0x7f543fbdbc5e
[ 861.531857][ T44] RSP: 002b:00007ffe34708420 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 861.532041][ T44] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f543fbdbc5e
[ 861.532223][ T44] RDX: 0000000000000000 RSI: 00007ffe347084e0 RDI: 0000000000000003
[ 861.532399][ T44] RBP: 00007ffe34708430 R08: 0000000000000000 R09: 0000000000000000
[ 861.532578][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffe34708ba0
[ 861.532763][ T44] R13: 00000000692ce2f6 R14: 0000000000000000 R15: 0000000000499600
[ 861.532946][ T44]
[ 861.533036][ T44] INFO: task ip:3484 is blocked on a mutex likely owned by task kworker/2:0:28.
[ 861.533232][ T44] task:kworker/2:0 state:D stack:27464 pid:28 tgid:28 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.533496][ T44] Workqueue: events refill_work
[ 861.533619][ T44] Call Trace:
[ 861.533712][ T44]
[ 861.533775][ T44] __schedule+0x88d/0x1b90
[ 861.533895][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.534014][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.534133][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.534249][ T44] ? find_held_lock+0x2b/0x80
[ 861.534372][ T44] ? _raw_spin_unlock_irqrestore+0x53/0x80
[ 861.534520][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.534635][ T44] schedule+0xd4/0x260
[ 861.534731][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 861.534878][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 861.534997][ T44] ? hrtimer_cb_get_time+0x90/0x90
[ 861.535116][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.535236][ T44] ? ktime_get+0x15e/0x220
[ 861.535354][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 861.535474][ T44] ? ktime_get+0xa9/0x220
[ 861.535567][ T44] usleep_range_state+0x133/0x1b0
[ 861.535693][ T44] ? schedule_hrtimeout+0x20/0x20
[ 861.535811][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.535930][ T44] napi_disable_locked+0x379/0x5f0
[ 861.536051][ T44] ? _mutex_trylock_nest_lock+0x150/0x150
[ 861.536170][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 861.536320][ T44] napi_disable+0x43/0x80
[ 861.536407][ T44] refill_work+0x116/0x210
[ 861.536530][ T44] process_one_work+0xd57/0x1390
[ 861.536657][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.536774][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.536895][ T44] ? assign_work+0x152/0x380
[ 861.537016][ T44] worker_thread+0x4d6/0xd40
[ 861.537139][ T44] ? process_one_work+0x1390/0x1390
[ 861.537257][ T44] kthread+0x355/0x5b0
[ 861.537347][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.537466][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.537586][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.537712][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.537835][ T44] ret_from_fork+0x1d4/0x270
[ 861.537951][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.538068][ T44] ret_from_fork_asm+0x11/0x20
[ 861.538190][ T44]
[ 861.538289][ T44]
[ 861.538289][ T44] Showing all locks held in the system:
[ 861.538459][ T44] 3 locks held by kworker/u16:0/12:
[ 861.538578][ T44] #0: ff110000091acd48 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.538911][ T44] #1: ffa00000000c7d30 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.539193][ T44] #2: ffffffffb3292a68 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 861.539396][ T44] 3 locks held by kworker/2:0/28:
[ 861.539510][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.539749][ T44] #1: ffa00000001ffd30 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.540006][ T44] #2: ff11000008522c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 861.540211][ T44] 1 lock held by khungtaskd/44:
[ 861.540324][ T44] #0: ffffffffb2b78fc0 (rcu_read_lock){....}-{1:3}, at: debug_show_all_locks+0x2b/0x1db
[ 861.540538][ T44] 2 locks held by ip/3484:
[ 861.540657][ T44] #0: ffffffffb3292a68 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5df/0xb20
[ 861.540859][ T44] #1: ff11000008522c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 861.541064][ T44] 3 locks held by kworker/2:1/3485:
[ 861.541184][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.541415][ T44] #1: ffa000000747fd30 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.541653][ T44] #2: ffffffffb3292a68 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0
[ 861.541857][ T44] 1 lock held by xdp_helper/3492:
[ 861.541967][ T44] #0: ffffffffb3292a68 (rtnl_mutex){+.+.}-{4:4}, at: xsk_bind+0x17f/0x1a10
[ 861.542168][ T44]
[ 861.542226][ T44] =============================================
[ 861.542226][ T44]
[ 865.098651][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 204289 ms
[ 865.099116][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 204289000 usecs ago
[ 870.218649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 209409 ms
[ 870.219079][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 209409000 usecs ago
[ 875.338648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 214529 ms
[ 875.339087][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 214529000 usecs ago
[ 881.481658][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 220672 ms
[ 881.482091][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 220672000 usecs ago
[ 887.114658][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 226305 ms
[ 887.115172][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 226305000 usecs ago
[ 892.234648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 231425 ms
[ 892.235079][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 231425000 usecs ago
[ 897.354649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 236545 ms
[ 897.355099][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 236545000 usecs ago
[ 903.498649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 242689 ms
[ 903.499081][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 242689000 usecs ago
[ 909.130647][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 248321 ms
[ 909.131092][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 248321000 usecs ago
[ 914.250648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 253441 ms
[ 914.251092][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 253441000 usecs ago
[ 919.370648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 258561 ms
[ 919.371073][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 258561000 usecs ago
[ 925.514649][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 264705 ms
[ 925.515091][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 264705000 usecs ago
[ 931.146647][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 270336 ms
[ 931.147090][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 270337000 usecs ago
[ 936.266648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 275457 ms
[ 936.267078][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 275457000 usecs ago
[ 941.386648][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 0 timed out 280576 ms
[ 941.387087][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 0, sq: output.0, vq: 0x1, name: output.0, 280577000 usecs ago