[ 777.532459][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 6144 ms
[ 777.533124][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 6144000 usecs ago
[ 783.163455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 11775 ms
[ 783.163863][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 11775000 usecs ago
[ 788.283454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 16895 ms
[ 788.283825][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 16895000 usecs ago
[ 793.404455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 22016 ms
[ 793.404844][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 22016000 usecs ago
[ 799.547466][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 28159 ms
[ 799.547868][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 28159000 usecs ago
[ 805.180453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 33792 ms
[ 805.180823][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 33792000 usecs ago
[ 810.299453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 38911 ms
[ 810.299818][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 38911000 usecs ago
[ 816.443455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 45055 ms
[ 816.443820][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 45055000 usecs ago
[ 822.075456][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 50687 ms
[ 822.075862][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 50687000 usecs ago
[ 827.195453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 55807 ms
[ 827.195815][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 55807000 usecs ago
[ 832.315455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 60927 ms
[ 832.315836][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 60927000 usecs ago
[ 838.460453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 67072 ms
[ 838.460839][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 67072000 usecs ago
[ 844.092455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 72704 ms
[ 844.092841][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 72704000 usecs ago
[ 849.212455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 77824 ms
[ 849.212841][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 77824000 usecs ago
[ 854.331455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 82943 ms
[ 854.331840][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 82943000 usecs ago
[ 860.476457][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 89088 ms
[ 860.476846][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 89088000 usecs ago
[ 861.500517][ T44] INFO: task ip:6006 blocked for more than 122 seconds.
[ 861.500915][ T44] Not tainted 6.18.0-virtme #1
[ 861.501061][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.501299][ T44] task:ip state:D stack:25520 pid:6006 tgid:6006 ppid:6001 task_flags:0x400100 flags:0x00080000
[ 861.501659][ T44] Call Trace:
[ 861.501769][ T44]
[ 861.501836][ T44] __schedule+0xae2/0x1720
[ 861.501969][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.502087][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.502207][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.502325][ T44] schedule+0xd4/0x260
[ 861.502414][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.502539][ T44] __mutex_lock+0xd76/0x1f20
[ 861.502658][ T44] ? napi_enable+0x3b/0x80
[ 861.502782][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.502898][ T44] ? __asan_memset+0x27/0x50
[ 861.503016][ T44] ? sg_init_table+0x19/0x60
[ 861.503136][ T44] ? try_fill_recv+0x3ec/0x1750
[ 861.503265][ T44] ? napi_enable+0x3b/0x80
[ 861.503380][ T44] napi_enable+0x3b/0x80
[ 861.503476][ T44] __virtnet_rx_resume+0x156/0x290
[ 861.503593][ T44] ? queue_delayed_work_on+0x91/0x100
[ 861.503713][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 861.503833][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 861.503952][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 861.504066][ T44] dev_xdp_install+0x3e4/0x890
[ 861.504183][ T44] ? alloc_netdev_dummy+0x30/0x30
[ 861.504309][ T44] dev_xdp_attach+0x50d/0x1310
[ 861.504786][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 861.504902][ T44] ? __bpf_prog_get+0x320/0x320
[ 861.505021][ T44] dev_change_xdp_fd+0x176/0x210
[ 861.505138][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 861.505259][ T44] ? rtnl_newlink_create+0x900/0x900
[ 861.505373][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 861.505531][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.505647][ T44] ? validate_chain+0x30f/0x8e0
[ 861.505763][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 861.505877][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 861.505993][ T44] ? __lock_acquire+0x577/0xc10
[ 861.506111][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.506232][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 861.506346][ T44] ? lock_acquire+0x10a/0x150
[ 861.506464][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.506580][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.506696][ T44] ? trace_contention_end+0xd6/0x110
[ 861.506811][ T44] ? __mutex_lock+0x285/0x1f20
[ 861.506927][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 861.507042][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.507157][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 861.507279][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 861.507398][ T44] rtnl_newlink+0x649/0xb40
[ 861.507522][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.507638][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.507755][ T44] ? __lock_acquire+0x577/0xc10
[ 861.507872][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.507984][ T44] ? find_held_lock+0x2b/0x80
[ 861.508101][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.508219][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.508343][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 861.508463][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 861.508580][ T44] ? rtnl_port_fill+0x940/0x940
[ 861.508695][ T44] ? __lock_acquire+0x577/0xc10
[ 861.508810][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.508924][ T44] ? find_held_lock+0x2b/0x80
[ 861.509039][ T44] netlink_rcv_skb+0x123/0x380
[ 861.509156][ T44] ? rtnl_port_fill+0x940/0x940
[ 861.509287][ T44] ? netlink_ack+0xcc0/0xcc0
[ 861.509405][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 861.509533][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 861.509650][ T44] netlink_unicast+0x4a3/0x770
[ 861.509767][ T44] ? netlink_attachskb+0x810/0x810
[ 861.509884][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.510000][ T44] ? __lock_acquire+0x577/0xc10
[ 861.510127][ T44] netlink_sendmsg+0x735/0xc60
[ 861.510254][ T44] ? netlink_unicast+0x770/0x770
[ 861.510374][ T44] ____sys_sendmsg+0x419/0x850
[ 861.510499][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 861.510613][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 861.510756][ T44] ? move_addr_to_kernel+0x40/0x40
[ 861.510872][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 861.510995][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.511113][ T44] ___sys_sendmsg+0xfd/0x180
[ 861.511232][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 861.511377][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 861.511512][ T44] __sys_sendmsg+0x124/0x1c0
[ 861.511628][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 861.511741][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.511861][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 861.512008][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 861.512124][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.512245][ T44] do_syscall_64+0xbd/0xfc0
[ 861.512363][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 861.512513][ T44] RIP: 0033:0x7f12c86dbc5e
[ 861.512636][ T44] RSP: 002b:00007ffd22a95d10 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 861.512819][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f12c86dbc5e
[ 861.512993][ T44] RDX: 0000000000000000 RSI: 00007ffd22a95dd0 RDI: 0000000000000003
[ 861.513171][ T44] RBP: 00007ffd22a95d20 R08: 0000000000000000 R09: 0000000000000000
[ 861.513350][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd22a96490
[ 861.513541][ T44] R13: 0000000069329655 R14: 0000000000000000 R15: 0000000000499600
[ 861.513720][ T44]
[ 861.513812][ T44] INFO: task ip:6006 is blocked on a mutex likely owned by task kworker/0:2:170.
[ 861.514004][ T44] task:kworker/0:2 state:D stack:27592 pid:170 tgid:170 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.514260][ T44] Workqueue: events refill_work
[ 861.514382][ T44] Call Trace:
[ 861.514477][ T44]
[ 861.514539][ T44] __schedule+0xae2/0x1720
[ 861.514657][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.514772][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.514886][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.515000][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.515121][ T44] schedule+0xd4/0x260
[ 861.515216][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 861.515359][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 861.515483][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 861.515600][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.515714][ T44] ? ktime_get+0x15e/0x220
[ 861.515829][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 861.515950][ T44] ? ktime_get+0xa9/0x220
[ 861.516037][ T44] usleep_range_state+0x133/0x1b0
[ 861.516152][ T44] ? schedule_hrtimeout+0x20/0x20
[ 861.516271][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.516386][ T44] ? refill_work+0x149/0x210
[ 861.516509][ T44] napi_disable_locked+0x379/0x5f0
[ 861.516624][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 861.516745][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 861.516891][ T44] napi_disable+0x43/0x80
[ 861.516979][ T44] refill_work+0x116/0x210
[ 861.517097][ T44] process_one_work+0xd57/0x1390
[ 861.517221][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.517335][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.517462][ T44] ? assign_work+0x152/0x380
[ 861.517578][ T44] worker_thread+0x4d6/0xd40
[ 861.517698][ T44] ? process_one_work+0x1390/0x1390
[ 861.517812][ T44] ? __kthread_parkme+0xb3/0x200
[ 861.517933][ T44] ? process_one_work+0x1390/0x1390
[ 861.518048][ T44] kthread+0x355/0x5b0
[ 861.518136][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.518254][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.518368][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.518494][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.518611][ T44] ret_from_fork+0x3fb/0x510
[ 861.518728][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 861.518871][ T44] ? __switch_to+0x602/0xd00
[ 861.518988][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.519103][ T44] ret_from_fork_asm+0x11/0x20
[ 861.519230][ T44]
[ 861.519326][ T44]
[ 861.519326][ T44] Showing all locks held in the system:
[ 861.519588][ T44] 3 locks held by kworker/u16:0/12:
[ 861.519702][ T44] #0: ff110000091ae548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.519926][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.520201][ T44] #2: ffffffff98878aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 861.520408][ T44] 1 lock held by khungtaskd/44:
[ 861.520528][ T44] #0: ffffffff98170ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 861.520754][ T44] 3 locks held by kworker/0:2/170:
[ 861.520862][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.521087][ T44] #1: ffa00000007b7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.521337][ T44] #2: ff11000008c22c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 861.521541][ T44] 2 locks held by ip/6006:
[ 861.521649][ T44] #0: ffffffff98878aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40
[ 861.521846][ T44] #1: ff11000008c22c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 861.522044][ T44]
[ 861.522103][ T44] =============================================
[ 861.522103][ T44]
[ 866.107469][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 94719 ms
[ 866.107870][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 94719000 usecs ago
[ 871.227460][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 99839 ms
[ 871.227856][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 99839000 usecs ago
[ 876.347460][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 104959 ms
[ 876.347906][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 104959000 usecs ago
[ 882.491455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 111103 ms
[ 882.491868][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 111103000 usecs ago
[ 888.123454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 116735 ms
[ 888.123866][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 116735000 usecs ago
[ 893.243455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 121855 ms
[ 893.243889][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 121855000 usecs ago
[ 898.363453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 126975 ms
[ 898.363922][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 126975000 usecs ago
[ 904.508454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 133120 ms
[ 904.508929][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 133120000 usecs ago
[ 910.139454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 138751 ms
[ 910.139926][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 138751000 usecs ago
[ 915.259454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 143871 ms
[ 915.259930][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 143871000 usecs ago
[ 920.380455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 148992 ms
[ 920.380933][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 148992000 usecs ago
[ 926.523454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 155135 ms
[ 926.523938][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 155135000 usecs ago
[ 932.155455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 160767 ms
[ 932.155945][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 160767000 usecs ago
[ 937.276454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 165888 ms
[ 937.276923][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 165888000 usecs ago
[ 942.395454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 171007 ms
[ 942.395937][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 171007000 usecs ago
[ 948.539455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 177151 ms
[ 948.539932][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 177151000 usecs ago
[ 954.171455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 182783 ms
[ 954.171928][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 182783000 usecs ago
[ 959.291453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 187903 ms
[ 959.291925][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 187903000 usecs ago
[ 964.411454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 193023 ms
[ 964.411920][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 193023000 usecs ago
[ 970.555453][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 199167 ms
[ 970.555930][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 199167000 usecs ago
[ 976.187462][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 204799 ms
[ 976.188040][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 204799000 usecs ago
[ 981.307455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 209919 ms
[ 981.307920][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 209919000 usecs ago
[ 984.379471][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds.
[ 984.379810][ T44] Not tainted 6.18.0-virtme #1
[ 984.379980][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 984.380242][ T44] task:kworker/u16:0 state:D stack:26384 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 984.380609][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 984.380808][ T44] Call Trace:
[ 984.380928][ T44]
[ 984.381015][ T44] __schedule+0xae2/0x1720
[ 984.381160][ T44] ? io_schedule_timeout+0x130/0x130
[ 984.381301][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.381443][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.381588][ T44] schedule+0xd4/0x260
[ 984.381689][ T44] schedule_preempt_disabled+0x18/0x30
[ 984.381828][ T44] __mutex_lock+0xd76/0x1f20
[ 984.381975][ T44] ? addrconf_verify_work+0x12/0x30
[ 984.382107][ T44] ? ww_mutex_lock+0x160/0x160
[ 984.382233][ T44] ? process_one_work+0xd16/0x1390
[ 984.382352][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.382480][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.382599][ T44] ? addrconf_verify_work+0x12/0x30
[ 984.382716][ T44] addrconf_verify_work+0x12/0x30
[ 984.382833][ T44] process_one_work+0xd57/0x1390
[ 984.382959][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 984.383076][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 984.383195][ T44] ? assign_work+0x152/0x380
[ 984.383316][ T44] worker_thread+0x4d6/0xd40
[ 984.383437][ T44] ? process_one_work+0x1390/0x1390
[ 984.383559][ T44] kthread+0x355/0x5b0
[ 984.383647][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.383766][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.383881][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.384002][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.384118][ T44] ret_from_fork+0x3fb/0x510
[ 984.384238][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 984.384381][ T44] ? __switch_to+0x602/0xd00
[ 984.384510][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.384633][ T44] ret_from_fork_asm+0x11/0x20
[ 984.384756][ T44]
[ 984.384873][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:6006.
[ 984.385082][ T44] INFO: task ip:6006 blocked for more than 245 seconds.
[ 984.385219][ T44] Not tainted 6.18.0-virtme #1
[ 984.385325][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 984.385524][ T44] task:ip state:D stack:25520 pid:6006 tgid:6006 ppid:6001 task_flags:0x400100 flags:0x00080000
[ 984.385780][ T44] Call Trace:
[ 984.385868][ T44]
[ 984.385927][ T44] __schedule+0xae2/0x1720
[ 984.386047][ T44] ? io_schedule_timeout+0x130/0x130
[ 984.386164][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.386281][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.386402][ T44] schedule+0xd4/0x260
[ 984.386495][ T44] schedule_preempt_disabled+0x18/0x30
[ 984.386610][ T44] __mutex_lock+0xd76/0x1f20
[ 984.386727][ T44] ? napi_enable+0x3b/0x80
[ 984.386843][ T44] ? ww_mutex_lock+0x160/0x160
[ 984.386959][ T44] ? __asan_memset+0x27/0x50
[ 984.387076][ T44] ? sg_init_table+0x19/0x60
[ 984.387200][ T44] ? try_fill_recv+0x3ec/0x1750
[ 984.387325][ T44] ? napi_enable+0x3b/0x80
[ 984.387439][ T44] napi_enable+0x3b/0x80
[ 984.387533][ T44] __virtnet_rx_resume+0x156/0x290
[ 984.387650][ T44] ? queue_delayed_work_on+0x91/0x100
[ 984.387767][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 984.387883][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 984.388004][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 984.388123][ T44] dev_xdp_install+0x3e4/0x890
[ 984.388242][ T44] ? alloc_netdev_dummy+0x30/0x30
[ 984.388360][ T44] dev_xdp_attach+0x50d/0x1310
[ 984.388489][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 984.388607][ T44] ? __bpf_prog_get+0x320/0x320
[ 984.388725][ T44] dev_change_xdp_fd+0x176/0x210
[ 984.388841][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 984.388963][ T44] ? rtnl_newlink_create+0x900/0x900
[ 984.389078][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 984.389226][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 984.389346][ T44] ? validate_chain+0x30f/0x8e0
[ 984.389467][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 984.389585][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 984.389702][ T44] ? __lock_acquire+0x577/0xc10
[ 984.389886][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 984.390004][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 984.390123][ T44] ? lock_acquire+0x10a/0x150
[ 984.390243][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.390360][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.390481][ T44] ? trace_contention_end+0xd6/0x110
[ 984.390598][ T44] ? __mutex_lock+0x285/0x1f20
[ 984.390719][ T44] ? rtnl_newlink+0x5f9/0xb40
[ 984.390837][ T44] ? ww_mutex_lock+0x160/0x160
[ 984.390954][ T44] ? nla_validate_int_range+0x5b0/0x5b0
[ 984.391073][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 984.391193][ T44] rtnl_newlink+0x649/0xb40
[ 984.391316][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.391434][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 984.391557][ T44] ? __lock_acquire+0x577/0xc10
[ 984.391678][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 984.391792][ T44] ? find_held_lock+0x2b/0x80
[ 984.391908][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 984.392025][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.392141][ T44] ? __rtnl_newlink+0xa40/0xa40
[ 984.392261][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 984.392378][ T44] ? rtnl_port_fill+0x940/0x940
[ 984.392504][ T44] ? __lock_acquire+0x577/0xc10
[ 984.392628][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 984.392742][ T44] ? find_held_lock+0x2b/0x80
[ 984.392860][ T44] netlink_rcv_skb+0x123/0x380
[ 984.392977][ T44] ? rtnl_port_fill+0x940/0x940
[ 984.393093][ T44] ? netlink_ack+0xcc0/0xcc0
[ 984.393216][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 984.393331][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 984.393455][ T44] netlink_unicast+0x4a3/0x770
[ 984.393572][ T44] ? netlink_attachskb+0x810/0x810
[ 984.393689][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 984.393806][ T44] ? __lock_acquire+0x577/0xc10
[ 984.393921][ T44] netlink_sendmsg+0x735/0xc60
[ 984.394039][ T44] ? netlink_unicast+0x770/0x770
[ 984.394160][ T44] ____sys_sendmsg+0x419/0x850
[ 984.394280][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 984.394399][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 984.394549][ T44] ? move_addr_to_kernel+0x40/0x40
[ 984.394666][ T44] ? stack_depot_save_flags+0x3e1/0x6e0
[ 984.394783][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 984.394902][ T44] ___sys_sendmsg+0xfd/0x180
[ 984.395017][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 984.395166][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 984.395306][ T44] __sys_sendmsg+0x124/0x1c0
[ 984.395425][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 984.395546][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 984.395661][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 984.395808][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 984.395923][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.396042][ T44] do_syscall_64+0xbd/0xfc0
[ 984.396160][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 984.396311][ T44] RIP: 0033:0x7f12c86dbc5e
[ 984.396434][ T44] RSP: 002b:00007ffd22a95d10 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 984.396621][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f12c86dbc5e
[ 984.396797][ T44] RDX: 0000000000000000 RSI: 00007ffd22a95dd0 RDI: 0000000000000003
[ 984.396972][ T44] RBP: 00007ffd22a95d20 R08: 0000000000000000 R09: 0000000000000000
[ 984.397145][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd22a96490
[ 984.397324][ T44] R13: 0000000069329655 R14: 0000000000000000 R15: 0000000000499600
[ 984.397515][ T44]
[ 984.397605][ T44] INFO: task ip:6006 is blocked on a mutex likely owned by task kworker/0:2:170.
[ 984.397798][ T44] task:kworker/0:2 state:D stack:27592 pid:170 tgid:170 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 984.398049][ T44] Workqueue: events refill_work
[ 984.398165][ T44] Call Trace:
[ 984.398257][ T44]
[ 984.398317][ T44] __schedule+0xae2/0x1720
[ 984.398436][ T44] ? usleep_range_state+0xba/0x1b0
[ 984.398560][ T44] ? io_schedule_timeout+0x130/0x130
[ 984.398675][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.398791][ T44] ? usleep_range_state+0xba/0x1b0
[ 984.398906][ T44] schedule+0xd4/0x260
[ 984.398995][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 984.399140][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 984.399264][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 984.399381][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 984.399500][ T44] ? ktime_get+0x15e/0x220
[ 984.399614][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 984.399730][ T44] ? ktime_get+0xa9/0x220
[ 984.399818][ T44] usleep_range_state+0x133/0x1b0
[ 984.399940][ T44] ? schedule_hrtimeout+0x20/0x20
[ 984.400058][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 984.400178][ T44] ? refill_work+0x149/0x210
[ 984.400300][ T44] napi_disable_locked+0x379/0x5f0
[ 984.400416][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 984.400544][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470
[ 984.400694][ T44] napi_disable+0x43/0x80
[ 984.400784][ T44] refill_work+0x116/0x210
[ 984.400904][ T44] process_one_work+0xd57/0x1390
[ 984.401026][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 984.401141][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 984.401263][ T44] ? assign_work+0x152/0x380
[ 984.401382][ T44] worker_thread+0x4d6/0xd40
[ 984.401507][ T44] ? process_one_work+0x1390/0x1390
[ 984.401622][ T44] ? __kthread_parkme+0xb3/0x200
[ 984.401739][ T44] ? process_one_work+0x1390/0x1390
[ 984.401858][ T44] kthread+0x355/0x5b0
[ 984.401945][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.402061][ T44] ? __lock_release.isra.0+0x59/0x170
[ 984.402176][ T44] ? rcu_is_watching+0x15/0xd0
[ 984.402296][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.402413][ T44] ret_from_fork+0x3fb/0x510
[ 984.402532][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 984.402682][ T44] ? __switch_to+0x602/0xd00
[ 984.402796][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 984.402912][ T44] ret_from_fork_asm+0x11/0x20
[ 984.403031][ T44]
[ 984.403129][ T44]
[ 984.403129][ T44] Showing all locks held in the system:
[ 984.403299][ T44] 3 locks held by kworker/u16:0/12:
[ 984.403409][ T44] #0: ff110000091ae548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 984.403729][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 984.404001][ T44] #2: ffffffff98878aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 984.404199][ T44] 1 lock held by khungtaskd/44:
[ 984.404311][ T44] #0: ffffffff98170ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 984.404545][ T44] 3 locks held by kworker/0:2/170:
[ 984.404654][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 984.404879][ T44] #1: ffa00000007b7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 984.405128][ T44] #2: ff11000008c22c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 984.405337][ T44] 2 locks held by ip/6006:
[ 984.405450][ T44] #0: ffffffff98878aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40
[ 984.405642][ T44] #1: ff11000008c22c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 984.405838][ T44]
[ 984.405895][ T44] =============================================
[ 984.405895][ T44]
[ 987.451457][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 216063 ms
[ 987.451941][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 216063000 usecs ago
[ 993.083454][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 221695 ms
[ 993.083939][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 221695000 usecs ago
[ 998.203455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 226815 ms
[ 998.203928][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 226815000 usecs ago
[ 1003.323455][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 3 timed out 231935 ms
[ 1003.323937][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 3, sq: output.3, vq: 0x7, name: output.3, 231935000 usecs ago