[ 695.112815][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 5632 ms
[ 695.113342][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 5632000 usecs ago
[ 700.232807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 10752 ms
[ 700.233202][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 10752000 usecs ago
[ 705.352807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 15872 ms
[ 705.353189][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 15872000 usecs ago
[ 711.496807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 22016 ms
[ 711.497227][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 22016000 usecs ago
[ 717.128807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 27648 ms
[ 717.129203][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 27648000 usecs ago
[ 722.248808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 32768 ms
[ 722.249200][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 32768000 usecs ago
[ 727.368807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 37888 ms
[ 727.369208][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 37888000 usecs ago
[ 733.512808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 44032 ms
[ 733.513235][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 44032000 usecs ago
[ 738.632837][ T44] INFO: task ip:5791 blocked for more than 122 seconds.
[ 738.633148][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 738.633303][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 738.633557][ T44] task:ip state:D stack:25520 pid:5791 tgid:5791 ppid:5786 task_flags:0x400100 flags:0x00080000
[ 738.633888][ T44] Call Trace:
[ 738.634006][ T44]
[ 738.634082][ T44] __schedule+0xae2/0x1720
[ 738.634234][ T44] ? io_schedule_timeout+0x130/0x130
[ 738.634372][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.634500][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.634623][ T44] schedule+0xd4/0x260
[ 738.634716][ T44] schedule_preempt_disabled+0x18/0x30
[ 738.634844][ T44] __mutex_lock+0xd76/0x1f20
[ 738.634974][ T44] ? __folio_put+0x1f5/0x320
[ 738.635099][ T44] ? napi_enable+0x3b/0x80
[ 738.635235][ T44] ? ww_mutex_lock+0x160/0x160
[ 738.635360][ T44] ? dma_map_phys+0x1b1/0x220
[ 738.635481][ T44] ? __asan_memset+0x27/0x50
[ 738.635598][ T44] ? sg_init_table+0x19/0x60
[ 738.635717][ T44] ? try_fill_recv+0x3ec/0x1750
[ 738.635841][ T44] ? napi_enable+0x3b/0x80
[ 738.635960][ T44] napi_enable+0x3b/0x80
[ 738.636059][ T44] __virtnet_rx_resume+0x156/0x290
[ 738.636177][ T44] ? queue_delayed_work_on+0x91/0x100
[ 738.636303][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 738.636425][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 738.636545][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 738.636665][ T44] dev_xdp_install+0x3e4/0x890
[ 738.636908][ T44] ? netif_set_xps_queue+0x40/0x40
[ 738.637031][ T44] dev_xdp_attach+0x50d/0x1310
[ 738.637149][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 738.637266][ T44] ? __bpf_prog_get+0x320/0x320
[ 738.637387][ T44] dev_change_xdp_fd+0x176/0x210
[ 738.637509][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 738.637630][ T44] ? rtnl_newlink_create+0x900/0x900
[ 738.637750][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 738.637910][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 738.638045][ T44] ? validate_chain+0x37b/0xb70
[ 738.638162][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 738.638277][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 738.638395][ T44] ? __lock_acquire+0x577/0xc10
[ 738.638513][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.638629][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 738.638740][ T44] ? lock_acquire+0x10a/0x150
[ 738.638861][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.638979][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.639094][ T44] ? trace_contention_end+0xd6/0x110
[ 738.639212][ T44] ? __mutex_lock+0x285/0x1f20
[ 738.639328][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 738.639447][ T44] ? ww_mutex_lock+0x160/0x160
[ 738.639562][ T44] ? nla_get_range_signed+0x3d0/0x3d0
[ 738.639681][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 738.639807][ T44] rtnl_newlink+0x75c/0xe90
[ 738.639927][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.640045][ T44] ? rtnl_setlink+0x880/0x880
[ 738.640162][ T44] ? __lock_acquire+0x577/0xc10
[ 738.640279][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.640392][ T44] ? find_held_lock+0x2b/0x80
[ 738.640506][ T44] ? rtnl_setlink+0x880/0x880
[ 738.640620][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.640736][ T44] ? rtnl_setlink+0x880/0x880
[ 738.640854][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 738.640972][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 738.641086][ T44] ? __lock_acquire+0x577/0xc10
[ 738.641200][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.641312][ T44] ? find_held_lock+0x2b/0x80
[ 738.641428][ T44] netlink_rcv_skb+0x123/0x380
[ 738.641544][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 738.641657][ T44] ? netlink_ack+0xcc0/0xcc0
[ 738.641773][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 738.641894][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 738.642012][ T44] netlink_unicast+0x4a3/0x770
[ 738.642126][ T44] ? netlink_attachskb+0x810/0x810
[ 738.642240][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.642355][ T44] ? __lock_acquire+0x577/0xc10
[ 738.642470][ T44] netlink_sendmsg+0x735/0xc60
[ 738.642583][ T44] ? netlink_unicast+0x770/0x770
[ 738.642698][ T44] ____sys_sendmsg+0x419/0x850
[ 738.642818][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 738.642934][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 738.643076][ T44] ? move_addr_to_kernel+0x40/0x40
[ 738.643193][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 738.643307][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 738.643424][ T44] ___sys_sendmsg+0xfd/0x180
[ 738.643540][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 738.643685][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 738.643819][ T44] __sys_sendmsg+0x124/0x1c0
[ 738.643933][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 738.644068][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 738.644182][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 738.644327][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 738.644441][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.644561][ T44] do_syscall_64+0xbd/0xfc0
[ 738.644676][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 738.644826][ T44] RIP: 0033:0x7f07906b1c5e
[ 738.644954][ T44] RSP: 002b:00007ffe35684590 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 738.645139][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f07906b1c5e
[ 738.645318][ T44] RDX: 0000000000000000 RSI: 00007ffe35684650 RDI: 0000000000000003
[ 738.645493][ T44] RBP: 00007ffe356845a0 R08: 0000000000000000 R09: 0000000000000000
[ 738.645669][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffe35684d10
[ 738.645860][ T44] R13: 00000000694c139d R14: 0000000000000000 R15: 0000000000499600
[ 738.646046][ T44]
[ 738.646140][ T44] INFO: task ip:5791 is blocked on a mutex likely owned by task kworker/3:1:52.
[ 738.646336][ T44] task:kworker/3:1 state:D stack:28064 pid:52 tgid:52 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 738.646592][ T44] Workqueue: events refill_work
[ 738.646714][ T44] Call Trace:
[ 738.646806][ T44]
[ 738.646867][ T44] __schedule+0xae2/0x1720
[ 738.646989][ T44] ? usleep_range_state+0xba/0x1b0
[ 738.647106][ T44] ? io_schedule_timeout+0x130/0x130
[ 738.647223][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.647342][ T44] ? usleep_range_state+0xba/0x1b0
[ 738.647461][ T44] schedule+0xd4/0x260
[ 738.647551][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 738.647695][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 738.647818][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 738.647936][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 738.648056][ T44] ? ktime_get+0x15e/0x220
[ 738.648174][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 738.648288][ T44] ? ktime_get+0xa9/0x220
[ 738.648378][ T44] usleep_range_state+0x133/0x1b0
[ 738.648495][ T44] ? schedule_hrtimeout+0x20/0x20
[ 738.648609][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 738.648726][ T44] ? refill_work+0x149/0x210
[ 738.648847][ T44] napi_disable_locked+0x379/0x5f0
[ 738.648963][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 738.649085][ T44] ? register_netdevice_notifier_net+0x40/0x40
[ 738.649232][ T44] napi_disable+0x43/0x80
[ 738.649318][ T44] refill_work+0x116/0x210
[ 738.649436][ T44] process_one_work+0xd57/0x1390
[ 738.649555][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 738.649670][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 738.649790][ T44] ? assign_work+0x152/0x380
[ 738.649917][ T44] worker_thread+0x4d6/0xd40
[ 738.650037][ T44] ? process_one_work+0x1390/0x1390
[ 738.650152][ T44] ? __kthread_parkme+0xb3/0x200
[ 738.650269][ T44] ? process_one_work+0x1390/0x1390
[ 738.650386][ T44] kthread+0x355/0x5b0
[ 738.650474][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.650592][ T44] ? __lock_release.isra.0+0x59/0x170
[ 738.650709][ T44] ? rcu_is_watching+0x15/0xd0
[ 738.650832][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.650949][ T44] ret_from_fork+0x3fb/0x510
[ 738.651070][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 738.651216][ T44] ? __switch_to+0x53c/0xd00
[ 738.651331][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 738.651450][ T44] ret_from_fork_asm+0x11/0x20
[ 738.651576][ T44]
[ 738.651674][ T44]
[ 738.651674][ T44] Showing all locks held in the system:
[ 738.651927][ T44] 3 locks held by kworker/u16:0/12:
[ 738.652046][ T44] #0: ff1100000907f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 738.652271][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 738.652551][ T44] #2: ffffffff95685768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 738.652753][ T44] 1 lock held by khungtaskd/44:
[ 738.652866][ T44] #0: ffffffff94f71040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 738.653094][ T44] 3 locks held by kworker/3:1/52:
[ 738.653205][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 738.653433][ T44] #1: ffa000000038fcc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 738.653684][ T44] #2: ff11000008a62c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 738.653897][ T44] 2 locks held by ip/5791:
[ 738.654014][ T44] #0: ffffffff95685768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90
[ 738.654214][ T44] #1: ff11000008a62c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 738.654412][ T44]
[ 738.654471][ T44] =============================================
[ 738.654471][ T44]
[ 739.144808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 49664 ms
[ 739.145205][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 49664000 usecs ago
[ 744.264807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 54784 ms
[ 744.265196][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 54784000 usecs ago
[ 749.384803][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 59904 ms
[ 749.385203][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 59904000 usecs ago
[ 755.527808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 66047 ms
[ 755.528191][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 66047000 usecs ago
[ 761.160808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 71680 ms
[ 761.161208][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 71680000 usecs ago
[ 766.280808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 76800 ms
[ 766.281198][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 76800000 usecs ago
[ 771.400807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 81920 ms
[ 771.401189][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 81920000 usecs ago
[ 777.544807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 88064 ms
[ 777.545208][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 88064000 usecs ago
[ 783.176807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 93696 ms
[ 783.177217][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 93696000 usecs ago
[ 788.296808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 98816 ms
[ 788.297186][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 98816000 usecs ago
[ 793.416807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 103936 ms
[ 793.417233][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 103936000 usecs ago
[ 799.560807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 110080 ms
[ 799.561233][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 110080000 usecs ago
[ 805.192808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 115712 ms
[ 805.193296][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 115712000 usecs ago
[ 810.312807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 120832 ms
[ 810.313229][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 120832000 usecs ago
[ 816.455808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 126975 ms
[ 816.456240][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 126975000 usecs ago
[ 822.088808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 132608 ms
[ 822.089240][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 132608000 usecs ago
[ 827.208807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 137728 ms
[ 827.209237][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 137728000 usecs ago
[ 832.328808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 142848 ms
[ 832.329274][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 142848000 usecs ago
[ 838.471808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 148991 ms
[ 838.472235][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 148991000 usecs ago
[ 844.104808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 154624 ms
[ 844.105232][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 154624000 usecs ago
[ 849.224807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 159744 ms
[ 849.225253][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 159744000 usecs ago
[ 854.344808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 164864 ms
[ 854.345234][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 164864000 usecs ago
[ 860.487808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 171007 ms
[ 860.488236][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 171007000 usecs ago
[ 861.512815][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds.
[ 861.513064][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 861.513198][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.513428][ T44] task:kworker/u16:0 state:D stack:26160 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.513721][ T44] Workqueue: ipv6_addrconf addrconf_verify_work
[ 861.513900][ T44] Call Trace:
[ 861.513997][ T44]
[ 861.514067][ T44] __schedule+0xae2/0x1720
[ 861.514197][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.514325][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.514456][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.514585][ T44] schedule+0xd4/0x260
[ 861.514678][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.514803][ T44] __mutex_lock+0xd76/0x1f20
[ 861.514923][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.515043][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.515181][ T44] ? process_one_work+0xd16/0x1390
[ 861.515302][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.515421][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.515541][ T44] ? addrconf_verify_work+0x12/0x30
[ 861.515660][ T44] addrconf_verify_work+0x12/0x30
[ 861.515774][ T44] process_one_work+0xd57/0x1390
[ 861.515896][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.516012][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.516135][ T44] ? assign_work+0x152/0x380
[ 861.516251][ T44] worker_thread+0x4d6/0xd40
[ 861.516369][ T44] ? process_one_work+0x1390/0x1390
[ 861.516483][ T44] kthread+0x355/0x5b0
[ 861.516569][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.516683][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.516802][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.516920][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.517036][ T44] ret_from_fork+0x3fb/0x510
[ 861.517153][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 861.517295][ T44] ? __switch_to+0x53c/0xd00
[ 861.517410][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.517525][ T44] ret_from_fork_asm+0x11/0x20
[ 861.517644][ T44]
[ 861.517741][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:5791.
[ 861.517952][ T44] INFO: task ip:5791 blocked for more than 245 seconds.
[ 861.518091][ T44] Not tainted 6.19.0-rc1-virtme #1
[ 861.518198][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 861.518384][ T44] task:ip state:D stack:25520 pid:5791 tgid:5791 ppid:5786 task_flags:0x400100 flags:0x00080000
[ 861.518631][ T44] Call Trace:
[ 861.518718][ T44]
[ 861.518776][ T44] __schedule+0xae2/0x1720
[ 861.518897][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.519012][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.519128][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.519243][ T44] schedule+0xd4/0x260
[ 861.519330][ T44] schedule_preempt_disabled+0x18/0x30
[ 861.519445][ T44] __mutex_lock+0xd76/0x1f20
[ 861.519565][ T44] ? __folio_put+0x1f5/0x320
[ 861.519679][ T44] ? napi_enable+0x3b/0x80
[ 861.519801][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.519917][ T44] ? dma_map_phys+0x1b1/0x220
[ 861.520033][ T44] ? __asan_memset+0x27/0x50
[ 861.520149][ T44] ? sg_init_table+0x19/0x60
[ 861.520264][ T44] ? try_fill_recv+0x3ec/0x1750
[ 861.520384][ T44] ? napi_enable+0x3b/0x80
[ 861.520499][ T44] napi_enable+0x3b/0x80
[ 861.520585][ T44] __virtnet_rx_resume+0x156/0x290
[ 861.520699][ T44] ? queue_delayed_work_on+0x91/0x100
[ 861.520819][ T44] virtnet_rx_resume_all+0xe7/0x1a0
[ 861.520935][ T44] virtnet_xdp_set+0xef7/0x1aa0
[ 861.521056][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0
[ 861.521173][ T44] dev_xdp_install+0x3e4/0x890
[ 861.521288][ T44] ? netif_set_xps_queue+0x40/0x40
[ 861.521406][ T44] dev_xdp_attach+0x50d/0x1310
[ 861.521521][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0
[ 861.521636][ T44] ? __bpf_prog_get+0x320/0x320
[ 861.521752][ T44] dev_change_xdp_fd+0x176/0x210
[ 861.521875][ T44] do_setlink.isra.0+0x1c2d/0x2880
[ 861.521994][ T44] ? rtnl_newlink_create+0x900/0x900
[ 861.522110][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0
[ 861.522250][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.522364][ T44] ? validate_chain+0x37b/0xb70
[ 861.522478][ T44] ? rcu_read_lock_any_held+0x66/0x90
[ 861.522591][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 861.522705][ T44] ? __lock_acquire+0x577/0xc10
[ 861.522826][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.522941][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 861.523055][ T44] ? lock_acquire+0x10a/0x150
[ 861.523169][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.523283][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.523397][ T44] ? trace_contention_end+0xd6/0x110
[ 861.523510][ T44] ? __mutex_lock+0x285/0x1f20
[ 861.523628][ T44] ? rtnl_newlink+0x6fc/0xe90
[ 861.523747][ T44] ? ww_mutex_lock+0x160/0x160
[ 861.523866][ T44] ? nla_get_range_signed+0x3d0/0x3d0
[ 861.523984][ T44] ? __rtnl_newlink+0x3fa/0xa40
[ 861.524105][ T44] rtnl_newlink+0x75c/0xe90
[ 861.524221][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.524335][ T44] ? rtnl_setlink+0x880/0x880
[ 861.524449][ T44] ? __lock_acquire+0x577/0xc10
[ 861.524566][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.524678][ T44] ? find_held_lock+0x2b/0x80
[ 861.524792][ T44] ? rtnl_setlink+0x880/0x880
[ 861.524911][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.525025][ T44] ? rtnl_setlink+0x880/0x880
[ 861.525139][ T44] rtnetlink_rcv_msg+0x6fe/0xb90
[ 861.525254][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 861.525369][ T44] ? __lock_acquire+0x577/0xc10
[ 861.525486][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.525598][ T44] ? find_held_lock+0x2b/0x80
[ 861.525713][ T44] netlink_rcv_skb+0x123/0x380
[ 861.525836][ T44] ? rtnl_fdb_dump+0x620/0x620
[ 861.525950][ T44] ? netlink_ack+0xcc0/0xcc0
[ 861.526069][ T44] ? netlink_deliver_tap+0xc5/0x330
[ 861.526182][ T44] ? netlink_deliver_tap+0x13f/0x330
[ 861.526299][ T44] netlink_unicast+0x4a3/0x770
[ 861.526414][ T44] ? netlink_attachskb+0x810/0x810
[ 861.526528][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.526643][ T44] ? __lock_acquire+0x577/0xc10
[ 861.526758][ T44] netlink_sendmsg+0x735/0xc60
[ 861.526878][ T44] ? netlink_unicast+0x770/0x770
[ 861.526997][ T44] ____sys_sendmsg+0x419/0x850
[ 861.527114][ T44] ? copy_msghdr_from_user+0x270/0x430
[ 861.527230][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0
[ 861.527374][ T44] ? move_addr_to_kernel+0x40/0x40
[ 861.527489][ T44] ? stack_depot_save_flags+0x3f1/0x6f0
[ 861.527602][ T44] ? rcu_read_lock_any_held+0x3c/0x90
[ 861.527718][ T44] ___sys_sendmsg+0xfd/0x180
[ 861.527836][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00
[ 861.527980][ T44] ? copy_msghdr_from_user+0x430/0x430
[ 861.528112][ T44] __sys_sendmsg+0x124/0x1c0
[ 861.528227][ T44] ? __sys_sendmsg_sock+0x20/0x20
[ 861.528341][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.528455][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00
[ 861.528602][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 861.528716][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.528837][ T44] do_syscall_64+0xbd/0xfc0
[ 861.528952][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 861.529096][ T44] RIP: 0033:0x7f07906b1c5e
[ 861.529217][ T44] RSP: 002b:00007ffe35684590 EFLAGS: 00000202 ORIG_RAX: 000000000000002e
[ 861.529390][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f07906b1c5e
[ 861.529564][ T44] RDX: 0000000000000000 RSI: 00007ffe35684650 RDI: 0000000000000003
[ 861.529739][ T44] RBP: 00007ffe356845a0 R08: 0000000000000000 R09: 0000000000000000
[ 861.529920][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffe35684d10
[ 861.530096][ T44] R13: 00000000694c139d R14: 0000000000000000 R15: 0000000000499600
[ 861.530273][ T44]
[ 861.530362][ T44] INFO: task ip:5791 is blocked on a mutex likely owned by task kworker/3:1:52.
[ 861.530557][ T44] task:kworker/3:1 state:D stack:28064 pid:52 tgid:52 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 861.530807][ T44] Workqueue: events refill_work
[ 861.530920][ T44] Call Trace:
[ 861.531005][ T44]
[ 861.531069][ T44] ? __schedule+0xae2/0x1720
[ 861.531186][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.531301][ T44] ? io_schedule_timeout+0x130/0x130
[ 861.531416][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.531532][ T44] ? usleep_range_state+0xba/0x1b0
[ 861.531644][ T44] ? schedule+0xd4/0x260
[ 861.531731][ T44] ? schedule_hrtimeout_range_clock+0x1da/0x2f0
[ 861.531878][ T44] ? schedule_timeout_idle+0xe0/0xe0
[ 861.531997][ T44] ? __hrtimer_cb_get_time+0x50/0x50
[ 861.532116][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 861.532228][ T44] ? ktime_get+0x15e/0x220
[ 861.532342][ T44] ? kvm_clock_get_cycles+0x18/0x30
[ 861.532455][ T44] ? ktime_get+0xa9/0x220
[ 861.532542][ T44] ? usleep_range_state+0x133/0x1b0
[ 861.532655][ T44] ? schedule_hrtimeout+0x20/0x20
[ 861.532770][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 861.532889][ T44] ? refill_work+0x149/0x210
[ 861.533005][ T44] ? napi_disable_locked+0x379/0x5f0
[ 861.533121][ T44] ? _mutex_trylock_nest_lock+0x340/0x340
[ 861.533235][ T44] ? register_netdevice_notifier_net+0x40/0x40
[ 861.533376][ T44] ? napi_disable+0x43/0x80
[ 861.533489][ T44] ? refill_work+0x116/0x210
[ 861.533605][ T44] ? process_one_work+0xd57/0x1390
[ 861.533724][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 861.533845][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 861.533960][ T44] ? assign_work+0x152/0x380
[ 861.534078][ T44] ? worker_thread+0x4d6/0xd40
[ 861.534194][ T44] ? process_one_work+0x1390/0x1390
[ 861.534307][ T44] ? __kthread_parkme+0xb3/0x200
[ 861.534422][ T44] ? process_one_work+0x1390/0x1390
[ 861.534537][ T44] ? kthread+0x355/0x5b0
[ 861.534623][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.534735][ T44] ? __lock_release.isra.0+0x59/0x170
[ 861.534856][ T44] ? rcu_is_watching+0x15/0xd0
[ 861.534970][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.535087][ T44] ? ret_from_fork+0x3fb/0x510
[ 861.535200][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 861.535343][ T44] ? __switch_to+0x53c/0xd00
[ 861.535456][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 861.535569][ T44] ? ret_from_fork_asm+0x11/0x20
[ 861.535687][ T44]
[ 861.535780][ T44]
[ 861.535780][ T44] Showing all locks held in the system:
[ 861.536043][ T44] 3 locks held by kworker/u16:0/12:
[ 861.536156][ T44] #0: ff1100000907f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.536378][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.536654][ T44] #2: ffffffff95685768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30
[ 861.536855][ T44] 1 lock held by khungtaskd/44:
[ 861.536965][ T44] #0: ffffffff94f71040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 861.537191][ T44] 3 locks held by kworker/3:1/52:
[ 861.537301][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390
[ 861.537521][ T44] #1: ffa000000038fcc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390
[ 861.537767][ T44] #2: ff11000008a62c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80
[ 861.537971][ T44] 2 locks held by ip/5791:
[ 861.538085][ T44] #0: ffffffff95685768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90
[ 861.538279][ T44] #1: ff11000008a62c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80
[ 861.538473][ T44]
[ 861.538530][ T44] =============================================
[ 861.538530][ T44]
[ 866.120808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 176640 ms
[ 866.121231][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 176640000 usecs ago
[ 871.240807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 181760 ms
[ 871.241267][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 181760000 usecs ago
[ 876.360807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 186880 ms
[ 876.361263][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 186880000 usecs ago
[ 882.504808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 193024 ms
[ 882.505249][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 193024000 usecs ago
[ 888.136807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 198656 ms
[ 888.137232][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 198656000 usecs ago
[ 893.256808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 203776 ms
[ 893.257227][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 203776000 usecs ago
[ 898.376808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 208896 ms
[ 898.377271][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 208896000 usecs ago
[ 904.520807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 215040 ms
[ 904.521233][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 215040000 usecs ago
[ 910.152807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 220672 ms
[ 910.153227][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 220672000 usecs ago
[ 915.272807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 225792 ms
[ 915.273235][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 225792000 usecs ago
[ 920.392807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 230912 ms
[ 920.393238][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 230912000 usecs ago
[ 926.536808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 237056 ms
[ 926.537237][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 237056000 usecs ago
[ 932.168808][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 242688 ms
[ 932.169228][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 242688000 usecs ago
[ 937.288807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 247808 ms
[ 937.289237][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 247808000 usecs ago
[ 942.408807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 252928 ms
[ 942.409280][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 252928000 usecs ago
[ 948.552807][ C2] virtio_net virtio2 enp0s1: NETDEV WATCHDOG: CPU: 2: transmit queue 2 timed out 259072 ms
[ 948.553242][ C2] virtio_net virtio2 enp0s1: TX timeout on queue: 2, sq: output.2, vq: 0x5, name: output.2, 259072000 usecs ago