[ 369.985881][ T44] INFO: task ip:972 blocked for more than 122 seconds. [ 369.986226][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 369.986384][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 369.986619][ T44] task:ip state:D stack:24976 pid:972 tgid:972 ppid:1 task_flags:0x400100 flags:0x00080002 [ 369.986943][ T44] Call Trace: [ 369.987050][ T44] [ 369.987129][ T44] __schedule+0xae2/0x1720 [ 369.987278][ T44] ? io_schedule_timeout+0x130/0x130 [ 369.987415][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.987544][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.987667][ T44] schedule+0xd4/0x260 [ 369.987763][ T44] schedule_preempt_disabled+0x18/0x30 [ 369.987887][ T44] __mutex_lock+0xd76/0x1f20 [ 369.988010][ T44] ? __folio_put+0x1f5/0x320 [ 369.988131][ T44] ? napi_enable+0x3b/0x80 [ 369.988258][ T44] ? ww_mutex_lock+0x160/0x160 [ 369.988380][ T44] ? dma_map_phys+0x1b1/0x220 [ 369.988507][ T44] ? __asan_memset+0x27/0x50 [ 369.988624][ T44] ? sg_init_table+0x19/0x60 [ 369.988742][ T44] ? try_fill_recv+0x3ec/0x1750 [ 369.988866][ T44] ? napi_enable+0x3b/0x80 [ 369.988981][ T44] napi_enable+0x3b/0x80 [ 369.989068][ T44] __virtnet_rx_resume+0x156/0x290 [ 369.989183][ T44] ? queue_delayed_work_on+0x91/0x100 [ 369.989303][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 369.989422][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 369.989544][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 369.989658][ T44] dev_xdp_install+0x3e4/0x890 [ 369.989773][ T44] ? netif_set_xps_queue+0x40/0x40 [ 369.990139][ T44] dev_xdp_attach+0x50d/0x1310 [ 369.990261][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 369.990375][ T44] ? __bpf_prog_get+0x320/0x320 [ 369.990495][ T44] dev_change_xdp_fd+0x176/0x210 [ 369.990610][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 369.990731][ T44] ? rtnl_newlink_create+0x900/0x900 [ 369.990849][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 369.990994][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 369.991108][ T44] ? validate_chain+0x37b/0xb70 [ 369.991224][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 369.991338][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 369.991457][ T44] ? __lock_acquire+0x577/0xc10 [ 369.991576][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.991692][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 369.991803][ T44] ? lock_acquire+0x10a/0x150 [ 369.991922][ T44] ? rcu_is_watching+0x15/0xd0 [ 369.992035][ T44] ? rcu_is_watching+0x15/0xd0 [ 369.992148][ T44] ? trace_contention_end+0xd6/0x110 [ 369.992265][ T44] ? __mutex_lock+0x285/0x1f20 [ 369.992381][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 369.992502][ T44] ? ww_mutex_lock+0x160/0x160 [ 369.992614][ T44] ? nla_get_range_signed+0x3d0/0x3d0 [ 369.992732][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 369.992851][ T44] rtnl_newlink+0x75c/0xe90 [ 369.992968][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.993082][ T44] ? rtnl_setlink+0x880/0x880 [ 369.993197][ T44] ? __lock_acquire+0x577/0xc10 [ 369.993311][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.993424][ T44] ? find_held_lock+0x2b/0x80 [ 369.993539][ T44] ? rtnl_setlink+0x880/0x880 [ 369.993653][ T44] ? __lock_release.isra.0+0x59/0x170 [ 369.993770][ T44] ? rtnl_setlink+0x880/0x880 [ 369.993888][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 369.994003][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 369.994115][ T44] ? __lock_acquire+0x577/0xc10 [ 369.994230][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.994344][ T44] ? find_held_lock+0x2b/0x80 [ 369.994463][ T44] netlink_rcv_skb+0x123/0x380 [ 369.994577][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 369.994708][ T44] ? netlink_ack+0xcc0/0xcc0 [ 369.994826][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 369.994962][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 369.995078][ T44] netlink_unicast+0x4a3/0x770 [ 369.995194][ T44] ? netlink_attachskb+0x810/0x810 [ 369.995307][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 369.995422][ T44] ? __lock_acquire+0x577/0xc10 [ 369.995541][ T44] netlink_sendmsg+0x735/0xc60 [ 369.995656][ T44] ? netlink_unicast+0x770/0x770 [ 369.995774][ T44] ____sys_sendmsg+0x419/0x850 [ 369.995898][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 369.996012][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 369.996154][ T44] ? move_addr_to_kernel+0x40/0x40 [ 369.996271][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 369.996385][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 369.996503][ T44] ___sys_sendmsg+0xfd/0x180 [ 369.996622][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 369.996765][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 369.996904][ T44] __sys_sendmsg+0x124/0x1c0 [ 369.997019][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 369.997133][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 369.997247][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 369.997393][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 369.997512][ T44] ? rcu_is_watching+0x15/0xd0 [ 369.997627][ T44] do_syscall_64+0xbd/0xfc0 [ 369.997743][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 369.997891][ T44] RIP: 0033:0x7f3cedc7cc5e [ 369.998014][ T44] RSP: 002b:00007ffd7c063970 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 369.998189][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f3cedc7cc5e [ 369.998366][ T44] RDX: 0000000000000000 RSI: 00007ffd7c063a30 RDI: 0000000000000003 [ 369.998542][ T44] RBP: 00007ffd7c063980 R08: 0000000000000000 R09: 0000000000000000 [ 369.998714][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd7c0640f0 [ 369.998889][ T44] R13: 00000000694b9ef9 R14: 0000000000000000 R15: 0000000000499600 [ 369.999069][ T44] [ 369.999160][ T44] INFO: task ip:972 is blocked on a mutex likely owned by task kworker/1:0:23. [ 369.999351][ T44] task:kworker/1:0 state:D stack:27808 pid:23 tgid:23 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 369.999599][ T44] Workqueue: events refill_work [ 369.999715][ T44] Call Trace: [ 369.999800][ T44] [ 369.999866][ T44] __schedule+0xae2/0x1720 [ 369.999985][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.000099][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.000213][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.000327][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.000440][ T44] schedule+0xd4/0x260 [ 370.000525][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 370.000666][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 370.000783][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 370.000903][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 370.001016][ T44] ? ktime_get+0x15e/0x220 [ 370.001129][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 370.001242][ T44] ? ktime_get+0xa9/0x220 [ 370.001326][ T44] ? irqentry_exit+0xf9/0x4d0 [ 370.001442][ T44] usleep_range_state+0x133/0x1b0 [ 370.001558][ T44] ? schedule_hrtimeout+0x20/0x20 [ 370.001671][ T44] ? __free_object+0x2ad/0x4b0 [ 370.001786][ T44] napi_disable_locked+0x379/0x5f0 [ 370.001902][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 370.002016][ T44] ? register_netdevice_notifier_net+0x40/0x40 [ 370.002168][ T44] napi_disable+0x43/0x80 [ 370.002253][ T44] refill_work+0x116/0x210 [ 370.002370][ T44] process_one_work+0xd57/0x1390 [ 370.002491][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 370.002603][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.002718][ T44] ? assign_work+0x152/0x380 [ 370.002833][ T44] worker_thread+0x4d6/0xd40 [ 370.002955][ T44] ? process_one_work+0x1390/0x1390 [ 370.003068][ T44] kthread+0x355/0x5b0 [ 370.003157][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.003272][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.003386][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.003502][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.003614][ T44] ret_from_fork+0x3fb/0x510 [ 370.003728][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 370.003874][ T44] ? __switch_to+0x53c/0xd00 [ 370.003988][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.004102][ T44] ret_from_fork_asm+0x11/0x20 [ 370.004225][ T44] [ 370.004319][ T44] [ 370.004319][ T44] Showing all locks held in the system: [ 370.004486][ T44] 3 locks held by kworker/0:0/9: [ 370.004596][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.004822][ T44] #1: ffa0000000097cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.005050][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 370.005246][ T44] 3 locks held by kworker/u16:0/12: [ 370.005354][ T44] #0: ff1100000902f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.005579][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.005858][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 370.006051][ T44] 3 locks held by kworker/1:0/23: [ 370.006161][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.006382][ T44] #1: ffa00000001a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.006632][ T44] #2: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 370.006827][ T44] 1 lock held by khungtaskd/44: [ 370.006941][ T44] #0: ffffffff8c171040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 370.007168][ T44] 2 locks held by ip/972: [ 370.007251][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90 [ 370.007445][ T44] #1: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 370.007641][ T44] 1 lock held by ip/1038: [ 370.007722][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.007916][ T44] [ 370.007976][ T44] ============================================= [ 370.007976][ T44] [ 492.864859][ T44] INFO: task kworker/0:0:9 blocked for more than 122 seconds. [ 492.865163][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 492.865323][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.865595][ T44] task:kworker/0:0 state:D stack:28120 pid:9 tgid:9 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.865899][ T44] Workqueue: events xp_release_deferred [ 492.866036][ T44] Call Trace: [ 492.866140][ T44] [ 492.866208][ T44] __schedule+0xae2/0x1720 [ 492.866342][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.866474][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.866603][ T44] schedule+0xd4/0x260 [ 492.866700][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.866817][ T44] __mutex_lock+0xd76/0x1f20 [ 492.866942][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.867061][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.867179][ T44] ? __lock_acquire+0x577/0xc10 [ 492.867302][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.867421][ T44] ? process_one_work+0xd16/0x1390 [ 492.867545][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.867662][ T44] xp_release_deferred+0x1b/0x1e0 [ 492.867779][ T44] process_one_work+0xd57/0x1390 [ 492.867901][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.868013][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.868128][ T44] ? assign_work+0x152/0x380 [ 492.868243][ T44] worker_thread+0x4d6/0xd40 [ 492.868365][ T44] ? process_one_work+0x1390/0x1390 [ 492.868481][ T44] kthread+0x355/0x5b0 [ 492.868567][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.868683][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.868798][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.868918][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.869031][ T44] ret_from_fork+0x3fb/0x510 [ 492.869145][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.869289][ T44] ? __switch_to+0x53c/0xd00 [ 492.869401][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.869518][ T44] ret_from_fork_asm+0x11/0x20 [ 492.869638][ T44] [ 492.869735][ T44] INFO: task kworker/0:0:9 is blocked on a mutex likely owned by task ip:972. [ 492.869927][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 492.870084][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 492.870188][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.870367][ T44] task:kworker/u16:0 state:D stack:27232 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.870615][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 492.870754][ T44] Call Trace: [ 492.870845][ T44] [ 492.870903][ T44] __schedule+0xae2/0x1720 [ 492.871023][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.871138][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.871250][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.871365][ T44] schedule+0xd4/0x260 [ 492.871453][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.871565][ T44] __mutex_lock+0xd76/0x1f20 [ 492.871682][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.871796][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.871918][ T44] ? process_one_work+0xd16/0x1390 [ 492.872031][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.872143][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.872258][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.872371][ T44] addrconf_verify_work+0x12/0x30 [ 492.872497][ T44] process_one_work+0xd57/0x1390 [ 492.872614][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.872727][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.872847][ T44] ? assign_work+0x152/0x380 [ 492.872961][ T44] worker_thread+0x4d6/0xd40 [ 492.873079][ T44] ? process_one_work+0x1390/0x1390 [ 492.873191][ T44] kthread+0x355/0x5b0 [ 492.873281][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.873395][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.873510][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.873624][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.873737][ T44] ret_from_fork+0x3fb/0x510 [ 492.873853][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.873995][ T44] ? __switch_to+0x53c/0xd00 [ 492.874106][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.874221][ T44] ret_from_fork_asm+0x11/0x20 [ 492.874340][ T44] [ 492.874429][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:972. [ 492.874627][ T44] INFO: task ip:972 blocked for more than 245 seconds. [ 492.874756][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 492.874865][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.875052][ T44] task:ip state:D stack:24976 pid:972 tgid:972 ppid:1 task_flags:0x400100 flags:0x00080002 [ 492.875299][ T44] Call Trace: [ 492.875383][ T44] [ 492.875446][ T44] __schedule+0xae2/0x1720 [ 492.875562][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.875675][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.875788][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.875905][ T44] schedule+0xd4/0x260 [ 492.875991][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.876103][ T44] __mutex_lock+0xd76/0x1f20 [ 492.876216][ T44] ? __folio_put+0x1f5/0x320 [ 492.876328][ T44] ? napi_enable+0x3b/0x80 [ 492.876447][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.876559][ T44] ? dma_map_phys+0x1b1/0x220 [ 492.876675][ T44] ? __asan_memset+0x27/0x50 [ 492.876789][ T44] ? sg_init_table+0x19/0x60 [ 492.876909][ T44] ? try_fill_recv+0x3ec/0x1750 [ 492.877024][ T44] ? napi_enable+0x3b/0x80 [ 492.877136][ T44] napi_enable+0x3b/0x80 [ 492.877222][ T44] __virtnet_rx_resume+0x156/0x290 [ 492.877334][ T44] ? queue_delayed_work_on+0x91/0x100 [ 492.877451][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 492.877567][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 492.877684][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 492.877795][ T44] dev_xdp_install+0x3e4/0x890 [ 492.877914][ T44] ? netif_set_xps_queue+0x40/0x40 [ 492.878034][ T44] dev_xdp_attach+0x50d/0x1310 [ 492.878148][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 492.878263][ T44] ? __bpf_prog_get+0x320/0x320 [ 492.878379][ T44] dev_change_xdp_fd+0x176/0x210 [ 492.878496][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 492.878611][ T44] ? rtnl_newlink_create+0x900/0x900 [ 492.878723][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 492.878867][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.878979][ T44] ? validate_chain+0x37b/0xb70 [ 492.879093][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 492.879204][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 492.879317][ T44] ? __lock_acquire+0x577/0xc10 [ 492.879433][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.879546][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 492.879659][ T44] ? lock_acquire+0x10a/0x150 [ 492.879770][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.879886][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.880001][ T44] ? trace_contention_end+0xd6/0x110 [ 492.880115][ T44] ? __mutex_lock+0x285/0x1f20 [ 492.880230][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 492.880342][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.880460][ T44] ? nla_get_range_signed+0x3d0/0x3d0 [ 492.880575][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 492.880692][ T44] rtnl_newlink+0x75c/0xe90 [ 492.880808][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.880929][ T44] ? rtnl_setlink+0x880/0x880 [ 492.881043][ T44] ? __lock_acquire+0x577/0xc10 [ 492.881156][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.881267][ T44] ? find_held_lock+0x2b/0x80 [ 492.881382][ T44] ? rtnl_setlink+0x880/0x880 [ 492.881496][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.881608][ T44] ? rtnl_setlink+0x880/0x880 [ 492.881723][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 492.881845][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 492.881957][ T44] ? __lock_acquire+0x577/0xc10 [ 492.882075][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.882186][ T44] ? find_held_lock+0x2b/0x80 [ 492.882300][ T44] netlink_rcv_skb+0x123/0x380 [ 492.882416][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 492.882532][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.882651][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 492.882761][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.882879][ T44] netlink_unicast+0x4a3/0x770 [ 492.882993][ T44] ? netlink_attachskb+0x810/0x810 [ 492.883105][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.883218][ T44] ? __lock_acquire+0x577/0xc10 [ 492.883333][ T44] netlink_sendmsg+0x735/0xc60 [ 492.883451][ T44] ? netlink_unicast+0x770/0x770 [ 492.883566][ T44] ____sys_sendmsg+0x419/0x850 [ 492.883680][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.883792][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.883935][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.884049][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 492.884161][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.884276][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.884387][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 492.884531][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.884655][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.884768][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.884885][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.884996][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 492.885142][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 492.885254][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.885368][ T44] do_syscall_64+0xbd/0xfc0 [ 492.885484][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.885623][ T44] RIP: 0033:0x7f3cedc7cc5e [ 492.885743][ T44] RSP: 002b:00007ffd7c063970 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.885924][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f3cedc7cc5e [ 492.886095][ T44] RDX: 0000000000000000 RSI: 00007ffd7c063a30 RDI: 0000000000000003 [ 492.886266][ T44] RBP: 00007ffd7c063980 R08: 0000000000000000 R09: 0000000000000000 [ 492.886441][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd7c0640f0 [ 492.886613][ T44] R13: 00000000694b9ef9 R14: 0000000000000000 R15: 0000000000499600 [ 492.886789][ T44] [ 492.886879][ T44] INFO: task ip:972 is blocked on a mutex likely owned by task kworker/1:0:23. [ 492.887065][ T44] task:kworker/1:0 state:D stack:27808 pid:23 tgid:23 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.887309][ T44] Workqueue: events refill_work [ 492.887426][ T44] Call Trace: [ 492.887513][ T44] [ 492.887572][ T44] __schedule+0xae2/0x1720 [ 492.887687][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.887799][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.887918][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.888039][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.888150][ T44] schedule+0xd4/0x260 [ 492.888239][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 492.888379][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 492.888500][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 492.888615][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.888726][ T44] ? ktime_get+0x15e/0x220 [ 492.888843][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 492.888959][ T44] ? ktime_get+0xa9/0x220 [ 492.889047][ T44] ? irqentry_exit+0xf9/0x4d0 [ 492.889161][ T44] usleep_range_state+0x133/0x1b0 [ 492.889276][ T44] ? schedule_hrtimeout+0x20/0x20 [ 492.889390][ T44] ? __free_object+0x2ad/0x4b0 [ 492.889508][ T44] napi_disable_locked+0x379/0x5f0 [ 492.889621][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 492.889734][ T44] ? register_netdevice_notifier_net+0x40/0x40 [ 492.889882][ T44] napi_disable+0x43/0x80 [ 492.889967][ T44] refill_work+0x116/0x210 [ 492.890081][ T44] process_one_work+0xd57/0x1390 [ 492.890197][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.890309][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.890426][ T44] ? assign_work+0x152/0x380 [ 492.890540][ T44] worker_thread+0x4d6/0xd40 [ 492.890656][ T44] ? process_one_work+0x1390/0x1390 [ 492.890848][ T44] kthread+0x355/0x5b0 [ 492.890933][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.891044][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.891158][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.891272][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.891443][ T44] ret_from_fork+0x3fb/0x510 [ 492.891557][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.891700][ T44] ? __switch_to+0x53c/0xd00 [ 492.891874][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.891987][ T44] ret_from_fork_asm+0x11/0x20 [ 492.892104][ T44] [ 492.892196][ T44] INFO: task ip:1038 blocked for more than 122 seconds. [ 492.892376][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 492.892483][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.892667][ T44] task:ip state:D stack:25624 pid:1038 tgid:1038 ppid:1037 task_flags:0x400100 flags:0x00080000 [ 492.892964][ T44] Call Trace: [ 492.893049][ T44] [ 492.893107][ T44] __schedule+0xae2/0x1720 [ 492.893222][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.893394][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.893512][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.893627][ T44] schedule+0xd4/0x260 [ 492.893713][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.893885][ T44] __mutex_lock+0xd76/0x1f20 [ 492.893998][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.894110][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.894220][ T44] ? write_profile+0xf0/0xf0 [ 492.894390][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.894511][ T44] ? find_held_lock+0x2b/0x80 [ 492.894625][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.894740][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.894856][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.894970][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 492.895082][ T44] ? __lock_acquire+0x577/0xc10 [ 492.895201][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.895317][ T44] ? find_held_lock+0x2b/0x80 [ 492.895437][ T44] netlink_rcv_skb+0x123/0x380 [ 492.895550][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 492.895666][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.895847][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 492.895960][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.896075][ T44] netlink_unicast+0x4a3/0x770 [ 492.896194][ T44] ? netlink_attachskb+0x810/0x810 [ 492.896368][ T44] ? __lock_acquire+0x577/0xc10 [ 492.896484][ T44] netlink_sendmsg+0x735/0xc60 [ 492.896597][ T44] ? netlink_unicast+0x770/0x770 [ 492.896715][ T44] ____sys_sendmsg+0x419/0x850 [ 492.896891][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.897003][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.897147][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.897259][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.897431][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 492.897570][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.897683][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.897797][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.897918][ T44] ? __lock_acquire+0x577/0xc10 [ 492.898035][ T44] ? find_held_lock+0x2b/0x80 [ 492.898154][ T44] ? move_addr_to_user+0x43/0x60 [ 492.898267][ T44] ? do_getsockname+0xcd/0x150 [ 492.898381][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.898499][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.898616][ T44] ? __sys_getsockname+0x91/0xf0 [ 492.898728][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.898902][ T44] do_syscall_64+0xbd/0xfc0 [ 492.899018][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.899158][ T44] RIP: 0033:0x7f6a41e2ec5e [ 492.899276][ T44] RSP: 002b:00007ffc71404800 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.899509][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f6a41e2ec5e [ 492.899678][ T44] RDX: 0000000000000000 RSI: 00007ffc714048c0 RDI: 0000000000000004 [ 492.899913][ T44] RBP: 00007ffc71404810 R08: 0000000000000000 R09: 0000000000000000 [ 492.900083][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc7140668b [ 492.900252][ T44] R13: 00000000694b9fc9 R14: 000000000000000d R15: 00007ffc71404970 [ 492.900491][ T44] [ 492.900580][ T44] INFO: task ip:1038 is blocked on a mutex likely owned by task ip:972. [ 492.900743][ T44] [ 492.900743][ T44] Showing all locks held in the system: [ 492.900911][ T44] 3 locks held by kworker/0:0/9: [ 492.901021][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.901243][ T44] #1: ffa0000000097cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.901466][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 492.901664][ T44] 3 locks held by kworker/u16:0/12: [ 492.901826][ T44] #0: ff1100000902f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.902051][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.902376][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 492.902575][ T44] 3 locks held by kworker/1:0/23: [ 492.902686][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.902964][ T44] #1: ffa00000001a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.903211][ T44] #2: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 492.903461][ T44] 1 lock held by khungtaskd/44: [ 492.903569][ T44] #0: ffffffff8c171040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 492.903851][ T44] 2 locks held by ip/972: [ 492.903933][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90 [ 492.904125][ T44] #1: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 492.904372][ T44] 1 lock held by ip/1038: [ 492.904457][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.904647][ T44] [ 492.904708][ T44] ============================================= [ 492.904708][ T44] [ 615.745859][ T44] INFO: task kworker/0:0:9 blocked for more than 245 seconds. [ 615.746131][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 615.746265][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.746492][ T44] task:kworker/0:0 state:D stack:28120 pid:9 tgid:9 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.746791][ T44] Workqueue: events xp_release_deferred [ 615.746940][ T44] Call Trace: [ 615.747035][ T44] [ 615.747099][ T44] __schedule+0xae2/0x1720 [ 615.747227][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.747353][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.747481][ T44] schedule+0xd4/0x260 [ 615.747574][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.747700][ T44] __mutex_lock+0xd76/0x1f20 [ 615.747826][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 615.747958][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.748076][ T44] ? __lock_acquire+0x577/0xc10 [ 615.748194][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.748310][ T44] ? process_one_work+0xd16/0x1390 [ 615.748434][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 615.748555][ T44] xp_release_deferred+0x1b/0x1e0 [ 615.748672][ T44] process_one_work+0xd57/0x1390 [ 615.748793][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.748915][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.749034][ T44] ? assign_work+0x152/0x380 [ 615.749150][ T44] worker_thread+0x4d6/0xd40 [ 615.749269][ T44] ? process_one_work+0x1390/0x1390 [ 615.749381][ T44] kthread+0x355/0x5b0 [ 615.749472][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.749587][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.749701][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.749814][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.749931][ T44] ret_from_fork+0x3fb/0x510 [ 615.750044][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 615.750186][ T44] ? __switch_to+0x53c/0xd00 [ 615.750301][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.750417][ T44] ret_from_fork_asm+0x11/0x20 [ 615.750536][ T44] [ 615.750627][ T44] INFO: task kworker/0:0:9 is blocked on a mutex likely owned by task ip:972. [ 615.750818][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 615.750982][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 615.751092][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.751275][ T44] task:kworker/u16:0 state:D stack:27232 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.751527][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 615.751670][ T44] Call Trace: [ 615.751755][ T44] [ 615.751815][ T44] __schedule+0xae2/0x1720 [ 615.751935][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.752054][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.752166][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.752281][ T44] schedule+0xd4/0x260 [ 615.752368][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.752485][ T44] __mutex_lock+0xd76/0x1f20 [ 615.752599][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.752717][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.752834][ T44] ? process_one_work+0xd16/0x1390 [ 615.752957][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.753070][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.753185][ T44] ? addrconf_verify_work+0x12/0x30 [ 615.753298][ T44] addrconf_verify_work+0x12/0x30 [ 615.753415][ T44] process_one_work+0xd57/0x1390 [ 615.753533][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.753655][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.753770][ T44] ? assign_work+0x152/0x380 [ 615.753893][ T44] worker_thread+0x4d6/0xd40 [ 615.754010][ T44] ? process_one_work+0x1390/0x1390 [ 615.754122][ T44] kthread+0x355/0x5b0 [ 615.754207][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.754320][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.754438][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.754550][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.754664][ T44] ret_from_fork+0x3fb/0x510 [ 615.754777][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 615.754922][ T44] ? __switch_to+0x53c/0xd00 [ 615.755034][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.755148][ T44] ret_from_fork_asm+0x11/0x20 [ 615.755265][ T44] [ 615.755356][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:972. [ 615.755555][ T44] INFO: task ip:972 blocked for more than 368 seconds. [ 615.755685][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 615.755790][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.755973][ T44] task:ip state:D stack:24976 pid:972 tgid:972 ppid:1 task_flags:0x400100 flags:0x00080002 [ 615.756219][ T44] Call Trace: [ 615.756304][ T44] [ 615.756362][ T44] __schedule+0xae2/0x1720 [ 615.756482][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.756596][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.756707][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.756822][ T44] schedule+0xd4/0x260 [ 615.756917][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.757030][ T44] __mutex_lock+0xd76/0x1f20 [ 615.757145][ T44] ? __folio_put+0x1f5/0x320 [ 615.757258][ T44] ? napi_enable+0x3b/0x80 [ 615.757371][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.757488][ T44] ? dma_map_phys+0x1b1/0x220 [ 615.757600][ T44] ? __asan_memset+0x27/0x50 [ 615.757714][ T44] ? sg_init_table+0x19/0x60 [ 615.757831][ T44] ? try_fill_recv+0x3ec/0x1750 [ 615.757952][ T44] ? napi_enable+0x3b/0x80 [ 615.758064][ T44] napi_enable+0x3b/0x80 [ 615.758150][ T44] __virtnet_rx_resume+0x156/0x290 [ 615.758263][ T44] ? queue_delayed_work_on+0x91/0x100 [ 615.758376][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 615.758493][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 615.758612][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 615.758723][ T44] dev_xdp_install+0x3e4/0x890 [ 615.758845][ T44] ? netif_set_xps_queue+0x40/0x40 [ 615.758961][ T44] dev_xdp_attach+0x50d/0x1310 [ 615.759077][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 615.759189][ T44] ? __bpf_prog_get+0x320/0x320 [ 615.759305][ T44] dev_change_xdp_fd+0x176/0x210 [ 615.759426][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 615.759541][ T44] ? rtnl_newlink_create+0x900/0x900 [ 615.759653][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 615.759792][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 615.759908][ T44] ? validate_chain+0x37b/0xb70 [ 615.760019][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 615.760133][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 615.760247][ T44] ? __lock_acquire+0x577/0xc10 [ 615.760361][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.760478][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 615.760592][ T44] ? lock_acquire+0x10a/0x150 [ 615.760702][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.760813][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.760929][ T44] ? trace_contention_end+0xd6/0x110 [ 615.761045][ T44] ? __mutex_lock+0x285/0x1f20 [ 615.761159][ T44] ? rtnl_newlink+0x6fc/0xe90 [ 615.761271][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.761383][ T44] ? nla_get_range_signed+0x3d0/0x3d0 [ 615.761501][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 615.761617][ T44] rtnl_newlink+0x75c/0xe90 [ 615.761733][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.761848][ T44] ? rtnl_setlink+0x880/0x880 [ 615.761963][ T44] ? __lock_acquire+0x577/0xc10 [ 615.762078][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.762190][ T44] ? find_held_lock+0x2b/0x80 [ 615.762302][ T44] ? rtnl_setlink+0x880/0x880 [ 615.762416][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.762529][ T44] ? rtnl_setlink+0x880/0x880 [ 615.762642][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 615.762755][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 615.762874][ T44] ? __lock_acquire+0x577/0xc10 [ 615.762987][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.763098][ T44] ? find_held_lock+0x2b/0x80 [ 615.763214][ T44] netlink_rcv_skb+0x123/0x380 [ 615.763327][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 615.763449][ T44] ? netlink_ack+0xcc0/0xcc0 [ 615.763566][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 615.763680][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 615.763796][ T44] netlink_unicast+0x4a3/0x770 [ 615.763913][ T44] ? netlink_attachskb+0x810/0x810 [ 615.764026][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.764139][ T44] ? __lock_acquire+0x577/0xc10 [ 615.764251][ T44] netlink_sendmsg+0x735/0xc60 [ 615.764365][ T44] ? netlink_unicast+0x770/0x770 [ 615.764484][ T44] ____sys_sendmsg+0x419/0x850 [ 615.764599][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 615.764712][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 615.764857][ T44] ? move_addr_to_kernel+0x40/0x40 [ 615.764971][ T44] ? stack_depot_save_flags+0x3f1/0x6f0 [ 615.765083][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 615.765197][ T44] ___sys_sendmsg+0xfd/0x180 [ 615.765312][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 615.765457][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 615.765580][ T44] __sys_sendmsg+0x124/0x1c0 [ 615.765693][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 615.765805][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.765921][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 615.766064][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 615.766180][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.766295][ T44] do_syscall_64+0xbd/0xfc0 [ 615.766411][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 615.766551][ T44] RIP: 0033:0x7f3cedc7cc5e [ 615.766669][ T44] RSP: 002b:00007ffd7c063970 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 615.766846][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f3cedc7cc5e [ 615.767021][ T44] RDX: 0000000000000000 RSI: 00007ffd7c063a30 RDI: 0000000000000003 [ 615.767193][ T44] RBP: 00007ffd7c063980 R08: 0000000000000000 R09: 0000000000000000 [ 615.767362][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffd7c0640f0 [ 615.767535][ T44] R13: 00000000694b9ef9 R14: 0000000000000000 R15: 0000000000499600 [ 615.767712][ T44] [ 615.767800][ T44] INFO: task ip:972 is blocked on a mutex likely owned by task kworker/1:0:23. [ 615.767991][ T44] task:kworker/1:0 state:D stack:27808 pid:23 tgid:23 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 615.768235][ T44] Workqueue: events refill_work [ 615.768348][ T44] Call Trace: [ 615.768437][ T44] [ 615.768497][ T44] __schedule+0xae2/0x1720 [ 615.768614][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.768727][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.768848][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.768964][ T44] ? usleep_range_state+0xba/0x1b0 [ 615.769077][ T44] schedule+0xd4/0x260 [ 615.769163][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 615.769304][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 615.769426][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 615.769542][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 615.769655][ T44] ? ktime_get+0x15e/0x220 [ 615.769770][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 615.769887][ T44] ? ktime_get+0xa9/0x220 [ 615.769973][ T44] ? irqentry_exit+0xf9/0x4d0 [ 615.770086][ T44] usleep_range_state+0x133/0x1b0 [ 615.770204][ T44] ? schedule_hrtimeout+0x20/0x20 [ 615.770318][ T44] ? __free_object+0x2ad/0x4b0 [ 615.770437][ T44] napi_disable_locked+0x379/0x5f0 [ 615.770551][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 615.770666][ T44] ? register_netdevice_notifier_net+0x40/0x40 [ 615.770810][ T44] napi_disable+0x43/0x80 [ 615.770900][ T44] refill_work+0x116/0x210 [ 615.771020][ T44] process_one_work+0xd57/0x1390 [ 615.771137][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 615.771250][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.771367][ T44] ? assign_work+0x152/0x380 [ 615.771485][ T44] worker_thread+0x4d6/0xd40 [ 615.771602][ T44] ? process_one_work+0x1390/0x1390 [ 615.771772][ T44] kthread+0x355/0x5b0 [ 615.771866][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.771979][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.772092][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.772207][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.772377][ T44] ret_from_fork+0x3fb/0x510 [ 615.772491][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 615.772634][ T44] ? __switch_to+0x53c/0xd00 [ 615.772802][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 615.772922][ T44] ret_from_fork_asm+0x11/0x20 [ 615.773044][ T44] [ 615.773132][ T44] INFO: task ip:1038 blocked for more than 245 seconds. [ 615.773270][ T44] Not tainted 6.19.0-rc1-virtme #1 [ 615.773375][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 615.773562][ T44] task:ip state:D stack:25624 pid:1038 tgid:1038 ppid:1037 task_flags:0x400100 flags:0x00080000 [ 615.773869][ T44] Call Trace: [ 615.773956][ T44] [ 615.774015][ T44] __schedule+0xae2/0x1720 [ 615.774130][ T44] ? io_schedule_timeout+0x130/0x130 [ 615.774302][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.774416][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.774532][ T44] schedule+0xd4/0x260 [ 615.774619][ T44] schedule_preempt_disabled+0x18/0x30 [ 615.774789][ T44] __mutex_lock+0xd76/0x1f20 [ 615.774908][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.775022][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.775136][ T44] ? write_profile+0xf0/0xf0 [ 615.775308][ T44] ? ww_mutex_lock+0x160/0x160 [ 615.775430][ T44] ? find_held_lock+0x2b/0x80 [ 615.775546][ T44] ? __lock_release.isra.0+0x59/0x170 [ 615.775662][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.775830][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.775951][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 615.776065][ T44] ? __lock_acquire+0x577/0xc10 [ 615.776181][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 615.776349][ T44] ? find_held_lock+0x2b/0x80 [ 615.776475][ T44] netlink_rcv_skb+0x123/0x380 [ 615.776588][ T44] ? rtnl_fdb_dump+0x620/0x620 [ 615.776702][ T44] ? netlink_ack+0xcc0/0xcc0 [ 615.776879][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 615.776991][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 615.777106][ T44] netlink_unicast+0x4a3/0x770 [ 615.777220][ T44] ? netlink_attachskb+0x810/0x810 [ 615.777389][ T44] ? __lock_acquire+0x577/0xc10 [ 615.777509][ T44] netlink_sendmsg+0x735/0xc60 [ 615.777623][ T44] ? netlink_unicast+0x770/0x770 [ 615.777740][ T44] ____sys_sendmsg+0x419/0x850 [ 615.777859][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 615.777975][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 615.778114][ T44] ? move_addr_to_kernel+0x40/0x40 [ 615.778228][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 615.778342][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 615.778485][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 615.778600][ T44] ___sys_sendmsg+0xfd/0x180 [ 615.778715][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 615.778888][ T44] ? __lock_acquire+0x577/0xc10 [ 615.779004][ T44] ? find_held_lock+0x2b/0x80 [ 615.779121][ T44] ? move_addr_to_user+0x43/0x60 [ 615.779236][ T44] ? do_getsockname+0xcd/0x150 [ 615.779410][ T44] __sys_sendmsg+0x124/0x1c0 [ 615.779527][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 615.779649][ T44] ? __sys_getsockname+0x91/0xf0 [ 615.779762][ T44] ? rcu_is_watching+0x15/0xd0 [ 615.779938][ T44] do_syscall_64+0xbd/0xfc0 [ 615.780051][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 615.780192][ T44] RIP: 0033:0x7f6a41e2ec5e [ 615.780313][ T44] RSP: 002b:00007ffc71404800 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 615.780546][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f6a41e2ec5e [ 615.780714][ T44] RDX: 0000000000000000 RSI: 00007ffc714048c0 RDI: 0000000000000004 [ 615.780889][ T44] RBP: 00007ffc71404810 R08: 0000000000000000 R09: 0000000000000000 [ 615.781061][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc7140668b [ 615.781229][ T44] R13: 00000000694b9fc9 R14: 000000000000000d R15: 00007ffc71404970 [ 615.781406][ T44] [ 615.781497][ T44] INFO: task ip:1038 is blocked on a mutex likely owned by task ip:972. [ 615.781657][ T44] [ 615.781657][ T44] Showing all locks held in the system: [ 615.781875][ T44] 3 locks held by kworker/0:0/9: [ 615.781983][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.782201][ T44] #1: ffa0000000097cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.782420][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 615.782617][ T44] 3 locks held by kworker/u16:0/12: [ 615.782778][ T44] #0: ff1100000902f148 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.782999][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.783321][ T44] #2: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 615.783517][ T44] 3 locks held by kworker/1:0/23: [ 615.783624][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 615.783846][ T44] #1: ffa00000001a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 615.784088][ T44] #2: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 615.784341][ T44] 1 lock held by khungtaskd/44: [ 615.784453][ T44] #0: ffffffff8c171040 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 615.784729][ T44] 2 locks held by ip/972: [ 615.784810][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x6fc/0xe90 [ 615.785006][ T44] #1: ff110000089e2c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 615.785256][ T44] 1 lock held by ip/1038: [ 615.785337][ T44] #0: ffffffff8c885768 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 615.785537][ T44] [ 615.785592][ T44] ============================================= [ 615.785592][ T44]