[ 625.516509][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 5632 ms
[ 625.517025][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 5632000 usecs ago
[ 631.147503][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 11263 ms
[ 631.147869][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 11263000 usecs ago
[ 636.268504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 16384 ms
[ 636.268879][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 16384000 usecs ago
[ 641.388505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 21504 ms
[ 641.388918][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 21504000 usecs ago
[ 647.532504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 27648 ms
[ 647.532859][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 27648000 usecs ago
[ 653.164505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 33280 ms
[ 653.164876][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 33280000 usecs ago
[ 658.284505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 38400 ms
[ 658.284921][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 38400000 usecs ago
[ 663.404505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 43520 ms
[ 663.405003][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 43520000 usecs ago
[ 669.548505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 49664 ms
[ 669.548915][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 49664000 usecs ago
[ 675.180504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 55296 ms
[ 675.180918][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 55296000 usecs ago
[ 680.300504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 60416 ms
[ 680.300919][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 60416000 usecs ago
[ 685.420504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 65536 ms
[ 685.420901][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 65536000 usecs ago
[ 691.564504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 71680 ms
[ 691.564947][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 71680000 usecs ago
[ 697.196504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 77312 ms
[ 697.196916][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 77312000 usecs ago
[ 702.316504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 82432 ms
[ 702.316925][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 82432000 usecs ago
[ 707.436504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 87552 ms
[ 707.436908][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 87552000 usecs ago
[ 713.580504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 93696 ms
[ 713.580932][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 93696000 usecs ago
[ 719.212504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 99328 ms
[ 719.212906][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 99328000 usecs ago
[ 724.332504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 104448 ms
[ 724.332958][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 104448000 usecs ago
[ 729.452504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 109568 ms
[ 729.452961][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 109568000 usecs ago
[ 735.596504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 115712 ms
[ 735.596948][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 115712000 usecs ago
[ 738.668506][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds.
[ 738.668820][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 738.668963][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 738.669193][ T44] task:kworker/u16:0 state:D stack:26576 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 738.669529][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 738.669698][ T44] Call Trace:
[ 738.669801][ T44]
[ 738.669871][ T44] __schedule+0xae2/0x1720
[ 738.670008][ T44] ? io_schedule_timeout+0x130/0x130
[ 738.670141][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.670270][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.670403][ T44] schedule+0xd4/0x260
[ 738.670505][ T44] schedule_preempt_disabled+0x18/0x30
[ 738.670629][ T44] __mutex_lock+0xd76/0x1f20
[ 738.670760][ T44] ? addrconf_verify_work+0x12/0x30
[ 738.670880][ T44] ? ww_mutex_lock+0x160/0x160
[ 738.671008][ T44] ? process_one_work+0xd16/0x1390
[ 738.671138][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.671261][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.671386][ T44] ? addrconf_verify_work+0x12/0x30
[ 738.671504][ T44] addrconf_verify_work+0x12/0x30
[ 738.671623][ T44] process_one_work+0xd57/0x1390
[ 738.671745][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 738.671858][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.671975][ T44] ? assign_work+0x152/0x380
[ 738.672097][ T44] worker_thread+0x4d6/0xd40
[ 738.672215][ T44] ? process_one_work+0x1390/0x1390
[ 738.672328][ T44] kthread+0x355/0x5b0
[ 738.672511][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.672627][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.672741][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.672854][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.672969][ T44] ret_from_fork+0x3fb/0x510
[ 738.673088][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 738.673230][ T44] ? __switch_to+0x53c/0xd00
[ 738.673343][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.673456][ T44] ret_from_fork_asm+0x11/0x20
[ 738.673581][ T44]
[ 738.673676][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5329.
[ 738.673868][ T44] INFO: task ip:5329 blocked for more than 122 seconds.
[ 738.674004][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 738.674113][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 738.674294][ T44] task:ip state:D stack:25520 pid:5329 tgid:5329 ppid:5324 task_flags:0x400100 flags:0x00080000
[ 738.674548][ T44] Call Trace:
[ 738.674635][ T44]
[ 738.674694][ T44] __schedule+0xae2/0x1720
[ 738.674809][ T44] ? io_schedule_timeout+0x130/0x130
[ 738.674925][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.675037][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.675157][ T44] schedule+0xd4/0x260
[ 738.675243][ T44] schedule_preempt_disabled+0x18/0x30
[ 738.675355][ T44] __mutex_lock+0xd76/0x1f20
[ 738.675470][ T44] ? napi_enable+0x3b/0x80
[ 738.675591][ T44] ? ww_mutex_lock+0x160/0x160
[ 738.675703][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.675817][ T44] ? __asan_memset+0x27/0x50
[ 738.675931][ T44] ? sg_init_table+0x19/0x60
[ 738.676047][ T44] ? try_fill_recv+0x3ec/0x1750
[ 738.676170][ T44] ? napi_enable+0x3b/0x80
[ 738.676283][ T44] napi_enable+0x3b/0x80
[ 738.676369][ T44] __virtnet_rx_resume+0x156/0x290
[ 738.676485][ T44] ? queue_delayed_work_on+0x91/0x100
[ 738.676604][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 738.676719][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 738.676836][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 738.676949][ T44] dev_xdp_install+0x3e4/0x890
[ 738.677063][ T44] ? netif_set_xps_queue+0x40/0x40
[ 738.677185][ T44] dev_xdp_attach+0x50d/0x1310
[ 738.677303][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 738.677417][ T44] ? __bpf_prog_get+0x320/0x320
[ 738.677539][ T44] dev_change_xdp_fd+0x176/0x210
[ 738.677654][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 738.677772][ T44] ? rtnl_newlink_create+0x900/0x900
[ 738.677885][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 738.678051][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 738.678173][ T44] ? validate_chain+0x37b/0xb70
[ 738.678288][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 738.678400][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 738.678520][ T44] ? __lock_acquire+0x577/0xc10
[ 738.678634][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.678748][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 738.678861][ T44] ? lock_acquire+0x10a/0x150
[ 738.678977][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.679095][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.679208][ T44] ? trace_contention_end+0xd6/0x110
[ 738.679322][ T44] ? __mutex_lock+0x285/0x1f20
[ 738.679435][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 738.679554][ T44] ? ww_mutex_lock+0x160/0x160
[ 738.679667][ T44] ? nla_get_range_signed+0x3d0/0x3d0
[ 738.679784][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 738.679908][ T44] rtnl_newlink+0x75c/0xe90
[ 738.680026][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.680143][ T44] ? rtnl_setlink+0x880/0x880
[ 738.680257][ T44] ? __lock_acquire+0x577/0xc10
[ 738.680371][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.680483][ T44] ? find_held_lock+0x2b/0x80
[ 738.680600][ T44] ? rtnl_setlink+0x880/0x880
[ 738.680713][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.680832][ T44] ? rtnl_setlink+0x880/0x880
[ 738.680947][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 738.681071][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 738.681186][ T44] ? __lock_acquire+0x577/0xc10
[ 738.681302][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.681415][ T44] ? find_held_lock+0x2b/0x80
[ 738.681535][ T44] netlink_rcv_skb+0x123/0x380
[ 738.681656][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 738.681770][ T44] ? netlink_ack+0xcc0/0xcc0
[ 738.681888][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 738.681999][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 738.682117][ T44] netlink_unicast+0x4a3/0x770
[ 738.682233][ T44] ? netlink_attachskb+0x810/0x810
[ 738.682347][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.682464][ T44] ? __lock_acquire+0x577/0xc10
[ 738.682583][ T44] netlink_sendmsg+0x735/0xc60
[ 738.682698][ T44] ? netlink_unicast+0x770/0x770
[ 738.682816][ T44] ____sys_sendmsg+0x419/0x850
[ 738.682932][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 738.683047][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 738.683191][ T44] ? move_addr_to_kernel+0x40/0x40
[ 738.683307][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 738.683423][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 738.683540][ T44] ___sys_sendmsg+0xfd/0x180
[ 738.683655][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 738.683796][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 738.683927][ T44] __sys_sendmsg+0x124/0x1c0
[ 738.684043][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 738.684161][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 738.684278][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 738.684423][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 738.684540][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.684655][ T44] do_syscall_64+0xbd/0xfc0
[ 738.684770][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 738.684912][ T44] RIP: 0033:0x7fa31df0dc5e
[ 738.685037][ T44] RSP: 002b:00007fff30b3c8c0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 738.685224][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007fa31df0dc5e
[ 738.685400][ T44] RDX: 0000000000000000 RSI: 00007fff30b3c980 RDI: 0000000000000003
[ 738.685581][ T44] RBP: 00007fff30b3c8d0 R08: 0000000000000000 R09: 0000000000000000
[ 738.685758][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fff30b3d040
[ 738.685933][ T44] R13: 00000000694c848c R14: 0000000000000000 R15: 0000000000499600
[ 738.686116][ T44]
[ 738.686202][ T44] INFO: task ip:5329 is blocked on a mutex likely owned by task kworker/3:0:33.
[ 738.686389][ T44] task:kworker/3:0 state:D stack:28312 pid:33 tgid:33 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 738.686645][ T44] Workqueue: events refill_work
[ 738.686760][ T44] Call Trace:
[ 738.686846][ T44]
[ 738.686907][ T44] __schedule+0xae2/0x1720
[ 738.687023][ T44] ? usleep_range_state+0xba/0x1b0
[ 738.687139][ T44] ? io_schedule_timeout+0x130/0x130
[ 738.687254][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.687372][ T44] ? usleep_range_state+0xba/0x1b0
[ 738.687489][ T44] schedule+0xd4/0x260
[ 738.687582][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 738.687724][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 738.687838][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 738.687953][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 738.688073][ T44] ? ktime_get+0x15e/0x220
[ 738.688187][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 738.688303][ T44] ? ktime_get+0xa9/0x220
[ 738.688390][ T44] usleep_range_state+0x133/0x1b0
[ 738.688506][ T44] ? schedule_hrtimeout+0x20/0x20
[ 738.688620][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 738.688733][ T44] ? refill_work+0x149/0x210
[ 738.688849][ T44] napi_disable_locked+0x379/0x5f0
[ 738.688962][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 738.689081][ T44] ? register_netdevice_notifier_net+0x40/0x40
[ 738.689224][ T44] napi_disable+0x43/0x80
[ 738.689310][ T44] refill_work+0x116/0x210
[ 738.689425][ T44] process_one_work+0xd57/0x1390
[ 738.689549][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 738.689662][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.689777][ T44] ? assign_work+0x152/0x380
[ 738.689897][ T44] worker_thread+0x4d6/0xd40
[ 738.690015][ T44] ? process_one_work+0x1390/0x1390
[ 738.690132][ T44] kthread+0x355/0x5b0
[ 738.690218][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.690331][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.690444][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.690567][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.690681][ T44] ret_from_fork+0x3fb/0x510
[ 738.690796][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 738.690937][ T44] ? __switch_to+0x53c/0xd00
[ 738.691048][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.691166][ T44] ret_from_fork_asm+0x11/0x20
[ 738.691285][ T44]
[ 738.691372][ T44]
[ 738.691372][ T44] Showing all locks held in the system:
[ 738.691543][ T44] 3 locks held by kworker/u16:0/12:
[ 738.691676][ T44] #0: ff110000090ff148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 738.691900][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 738.692174][ T44] #2: ffffffff89485768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 738.692374][ T44] 3 locks held by kworker/3:0/33:
[ 738.692483][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 738.692710][ T44] #1: ffa0000000257cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 738.692957][ T44] #2: ff11000008c72c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 738.693158][ T44] 1 lock held by khungtaskd/44:
[ 738.693266][ T44] #0: ffffffff88d71040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 738.693501][ T44] 2 locks held by ip/5329:
[ 738.693611][ T44] #0: ffffffff89485768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90
[ 738.693806][ T44] #1: ff11000008c72c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 738.694007][ T44]
[ 738.694069][ T44] =============================================
[ 738.694069][ T44]
[ 741.228505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 121344 ms
[ 741.228936][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 121344000 usecs ago
[ 746.348504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 126464 ms
[ 746.348957][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 126464000 usecs ago
[ 752.492504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 132608 ms
[ 752.492933][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 132608000 usecs ago
[ 758.124505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 138240 ms
[ 758.124936][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 138240000 usecs ago
[ 763.244510][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 143360 ms
[ 763.244942][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 143360000 usecs ago
[ 768.364505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 148480 ms
[ 768.364936][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 148480000 usecs ago
[ 774.508501][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 154624 ms
[ 774.508967][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 154624000 usecs ago
[ 780.140504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 160256 ms
[ 780.140938][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 160256000 usecs ago
[ 785.260505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 165376 ms
[ 785.260914][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 165376000 usecs ago
[ 790.380504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 170496 ms
[ 790.380938][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 170496000 usecs ago
[ 796.524504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 176640 ms
[ 796.524941][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 176640000 usecs ago
[ 802.155502][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 182271 ms
[ 802.155983][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 182271000 usecs ago
[ 807.276501][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 187392 ms
[ 807.276902][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 187392000 usecs ago
[ 812.396504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 192512 ms
[ 812.396942][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 192512000 usecs ago
[ 818.539503][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 198655 ms
[ 818.539942][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 198655000 usecs ago
[ 824.172504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 204288 ms
[ 824.172938][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 204288000 usecs ago
[ 829.292504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 209408 ms
[ 829.292955][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 209408000 usecs ago
[ 834.412504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 214528 ms
[ 834.412925][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 214528000 usecs ago
[ 840.556504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 220672 ms
[ 840.556948][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 220672000 usecs ago
[ 846.188504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 226304 ms
[ 846.188941][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 226304000 usecs ago
[ 851.308504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 231424 ms
[ 851.308941][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 231424000 usecs ago
[ 856.428504][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 236544 ms
[ 856.428941][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 236544000 usecs ago
[ 861.548506][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds.
[ 861.548770][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 861.548909][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.549148][ T44] task:kworker/u16:0 state:D stack:26576 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.549458][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 861.549644][ T44] Call Trace:
[ 861.549745][ T44]
[ 861.549811][ T44] __schedule+0xae2/0x1720
[ 861.549952][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.550085][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.550215][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.550345][ T44] schedule+0xd4/0x260
[ 861.550444][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.550578][ T44] __mutex_lock+0xd76/0x1f20
[ 861.550709][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.550830][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.550957][ T44] ? process_one_work+0xd16/0x1390
[ 861.551076][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.551197][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.551328][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.551458][ T44] addrconf_verify_work+0x12/0x30
[ 861.551585][ T44] process_one_work+0xd57/0x1390
[ 861.551707][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.551823][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.551945][ T44] ? assign_work+0x152/0x380
[ 861.552060][ T44] worker_thread+0x4d6/0xd40
[ 861.552177][ T44] ? process_one_work+0x1390/0x1390
[ 861.552291][ T44] kthread+0x355/0x5b0
[ 861.552378][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.552490][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.552610][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.552724][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.552836][ T44] ret_from_fork+0x3fb/0x510
[ 861.552952][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 861.553092][ T44] ? __switch_to+0x53c/0xd00
[ 861.553203][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.553316][ T44] ret_from_fork_asm+0x11/0x20
[ 861.553433][ T44]
[ 861.553530][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5329.
[ 861.553723][ T44] INFO: task ip:5329 blocked for more than 245 seconds.
[ 861.553857][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 861.553962][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.554147][ T44] task:ip state:D stack:25520 pid:5329 tgid:5329 ppid:5324 task_flags:0x400100 flags:0x00080000
[ 861.554397][ T44] Call Trace:
[ 861.554482][ T44]
[ 861.554546][ T44] __schedule+0xae2/0x1720
[ 861.554662][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.554778][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.554893][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.555006][ T44] schedule+0xd4/0x260
[ 861.555094][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.555207][ T44] __mutex_lock+0xd76/0x1f20
[ 861.555321][ T44] ? napi_enable+0x3b/0x80
[ 861.555435][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.555552][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.555664][ T44] ? __asan_memset+0x27/0x50
[ 861.555776][ T44] ? sg_init_table+0x19/0x60
[ 861.555897][ T44] ? try_fill_recv+0x3ec/0x1750
[ 861.556015][ T44] ? napi_enable+0x3b/0x80
[ 861.556127][ T44] napi_enable+0x3b/0x80
[ 861.556212][ T44] __virtnet_rx_resume+0x156/0x290
[ 861.556323][ T44] ? queue_delayed_work_on+0x91/0x100
[ 861.556436][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 861.556555][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 861.556672][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 861.556787][ T44] dev_xdp_install+0x3e4/0x890
[ 861.556904][ T44] ? netif_set_xps_queue+0x40/0x40
[ 861.557021][ T44] dev_xdp_attach+0x50d/0x1310
[ 861.557137][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 861.557250][ T44] ? __bpf_prog_get+0x320/0x320
[ 861.557365][ T44] dev_change_xdp_fd+0x176/0x210
[ 861.557478][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 861.557601][ T44] ? rtnl_newlink_create+0x900/0x900
[ 861.557714][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 861.557857][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.557969][ T44] ? validate_chain+0x37b/0xb70
[ 861.558080][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 861.558191][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 861.558304][ T44] ? __lock_acquire+0x577/0xc10
[ 861.558421][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.558538][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 861.558650][ T44] ? lock_acquire+0x10a/0x150
[ 861.558761][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.558878][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.558990][ T44] ? trace_contention_end+0xd6/0x110
[ 861.559103][ T44] ? __mutex_lock+0x285/0x1f20
[ 861.559217][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 861.559334][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.559446][ T44] ? nla_get_range_signed+0x3d0/0x3d0
[ 861.559566][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 861.559683][ T44] rtnl_newlink+0x75c/0xe90
[ 861.559797][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.559915][ T44] ? rtnl_setlink+0x880/0x880
[ 861.560028][ T44] ? __lock_acquire+0x577/0xc10
[ 861.560145][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.560257][ T44] ? find_held_lock+0x2b/0x80
[ 861.560372][ T44] ? rtnl_setlink+0x880/0x880
[ 861.560483][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.560600][ T44] ? rtnl_setlink+0x880/0x880
[ 861.560714][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 861.560827][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 861.560943][ T44] ? __lock_acquire+0x577/0xc10
[ 861.561059][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.561170][ T44] ? find_held_lock+0x2b/0x80
[ 861.561283][ T44] netlink_rcv_skb+0x123/0x380
[ 861.561396][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 861.561518][ T44] ? netlink_ack+0xcc0/0xcc0
[ 861.561639][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 861.561751][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 861.561871][ T44] netlink_unicast+0x4a3/0x770
[ 861.561984][ T44] ? netlink_attachskb+0x810/0x810
[ 861.562098][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.562213][ T44] ? __lock_acquire+0x577/0xc10
[ 861.562327][ T44] netlink_sendmsg+0x735/0xc60
[ 861.562440][ T44] ? netlink_unicast+0x770/0x770
[ 861.562560][ T44] ____sys_sendmsg+0x419/0x850
[ 861.562673][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 861.562789][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 861.562935][ T44] ? move_addr_to_kernel+0x40/0x40
[ 861.563050][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 861.563162][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.563276][ T44] ___sys_sendmsg+0xfd/0x180
[ 861.563389][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 861.563536][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 861.563660][ T44] __sys_sendmsg+0x124/0x1c0
[ 861.563773][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 861.563888][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.564001][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 861.564143][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 861.564261][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.564379][ T44] do_syscall_64+0xbd/0xfc0
[ 861.564500][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 861.564640][ T44] RIP: 0033:0x7fa31df0dc5e
[ 861.564766][ T44] RSP: 002b:00007fff30b3c8c0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 861.564941][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007fa31df0dc5e
[ 861.565110][ T44] RDX: 0000000000000000 RSI: 00007fff30b3c980 RDI: 0000000000000003
[ 861.565284][ T44] RBP: 00007fff30b3c8d0 R08: 0000000000000000 R09: 0000000000000000
[ 861.565454][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fff30b3d040
[ 861.565629][ T44] R13: 00000000694c848c R14: 0000000000000000 R15: 0000000000499600
[ 861.565808][ T44]
[ 861.565897][ T44] INFO: task ip:5329 is blocked on a mutex likely owned by task kworker/3:0:33.
[ 861.566087][ T44] task:kworker/3:0 state:D stack:28312 pid:33 tgid:33 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.566333][ T44] Workqueue: events refill_work
[ 861.566448][ T44] Call Trace:
[ 861.566536][ T44]
[ 861.566595][ T44] __schedule+0xae2/0x1720
[ 861.566716][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.566833][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.566950][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.567065][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.567179][ T44] schedule+0xd4/0x260
[ 861.567266][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 861.567406][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 861.567525][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 861.567642][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.567756][ T44] ? ktime_get+0x15e/0x220
[ 861.567872][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 861.567985][ T44] ? ktime_get+0xa9/0x220
[ 861.568071][ T44] usleep_range_state+0x133/0x1b0
[ 861.568189][ T44] ? schedule_hrtimeout+0x20/0x20
[ 861.568302][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.568423][ T44] ? refill_work+0x149/0x210
[ 861.568545][ T44] napi_disable_locked+0x379/0x5f0
[ 861.568659][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 861.568773][ T44] ? register_netdevice_notifier_net+0x40/0x40
[ 861.568922][ T44] napi_disable+0x43/0x80
[ 861.569009][ T44] refill_work+0x116/0x210
[ 861.569125][ T44] process_one_work+0xd57/0x1390
[ 861.569245][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.569359][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.569473][ T44] ? assign_work+0x152/0x380
[ 861.569591][ T44] worker_thread+0x4d6/0xd40
[ 861.569709][ T44] ? process_one_work+0x1390/0x1390
[ 861.569822][ T44] kthread+0x355/0x5b0
[ 861.569912][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.570028][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.570142][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.570255][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.570368][ T44] ret_from_fork+0x3fb/0x510
[ 861.570481][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 861.570628][ T44] ? __switch_to+0x53c/0xd00
[ 861.570740][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.570859][ T44] ret_from_fork_asm+0x11/0x20
[ 861.570980][ T44]
[ 861.571065][ T44]
[ 861.571065][ T44] Showing all locks held in the system:
[ 861.571227][ T44] 3 locks held by kworker/u16:0/12:
[ 861.571335][ T44] #0: ff110000090ff148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.571557][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.571829][ T44] #2: ffffffff89485768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 861.572023][ T44] 3 locks held by kworker/3:0/33:
[ 861.572131][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.572350][ T44] #1: ffa0000000257cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.572602][ T44] #2: ff11000008c72c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 861.572797][ T44] 1 lock held by khungtaskd/44:
[ 861.572911][ T44] #0: ffffffff88d71040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 861.573132][ T44] 2 locks held by ip/5329:
[ 861.573240][ T44] #0: ffffffff89485768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90
[ 861.573434][ T44] #1: ff11000008c72c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 861.573630][ T44]
[ 861.573686][ T44] =============================================
[ 861.573686][ T44]
[ 862.572505][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 1 timed out 242688 ms
[ 862.572947][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 1, sq: output.1, vq: 0x3, name: output.1, 242688000 usecs ago