[ 247.128249][ T44] INFO: task ip:259 blocked for more than 122 seconds. [ 247.128615][ T44] Not tainted 6.18.0-virtme #1 [ 247.128750][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 247.128973][ T44] task:ip state:D stack:25520 pid:259 tgid:259 ppid:1 task_flags:0x400100 flags:0x00080002 [ 247.129300][ T44] Call Trace: [ 247.129401][ T44] [ 247.129471][ T44] __schedule+0xae2/0x1720 [ 247.129615][ T44] ? io_schedule_timeout+0x130/0x130 [ 247.129749][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.129874][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.130000][ T44] schedule+0xd4/0x260 [ 247.130098][ T44] schedule_preempt_disabled+0x18/0x30 [ 247.130234][ T44] __mutex_lock+0xd76/0x1f20 [ 247.130362][ T44] ? napi_enable+0x3b/0x80 [ 247.130493][ T44] ? ww_mutex_lock+0x160/0x160 [ 247.130618][ T44] ? __asan_memset+0x27/0x50 [ 247.130743][ T44] ? sg_init_table+0x19/0x60 [ 247.130868][ T44] ? try_fill_recv+0x3ec/0x1750 [ 247.130991][ T44] ? napi_enable+0x3b/0x80 [ 247.131116][ T44] napi_enable+0x3b/0x80 [ 247.131212][ T44] __virtnet_rx_resume+0x156/0x290 [ 247.131331][ T44] ? queue_delayed_work_on+0x91/0x100 [ 247.131454][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 247.131576][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 247.131703][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 247.131819][ T44] dev_xdp_install+0x3e4/0x890 [ 247.131930][ T44] ? alloc_netdev_dummy+0x30/0x30 [ 247.132047][ T44] dev_xdp_attach+0x50d/0x1310 [ 247.132159][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 247.132276][ T44] ? __bpf_prog_get+0x320/0x320 [ 247.132628][ T44] dev_change_xdp_fd+0x176/0x210 [ 247.132744][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 247.132871][ T44] ? rtnl_newlink_create+0x900/0x900 [ 247.132982][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 247.133120][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 247.133236][ T44] ? validate_chain+0x30f/0x8e0 [ 247.133347][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 247.133454][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 247.133565][ T44] ? __lock_acquire+0x577/0xc10 [ 247.133679][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 247.133792][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 247.133902][ T44] ? lock_acquire+0x10a/0x150 [ 247.134013][ T44] ? rcu_is_watching+0x15/0xd0 [ 247.134122][ T44] ? rcu_is_watching+0x15/0xd0 [ 247.134242][ T44] ? trace_contention_end+0xd6/0x110 [ 247.134353][ T44] ? __mutex_lock+0x285/0x1f20 [ 247.134462][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 247.134572][ T44] ? ww_mutex_lock+0x160/0x160 [ 247.134686][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 247.134805][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 247.134965][ T44] rtnl_newlink+0x649/0xb40 [ 247.135083][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.135190][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 247.135305][ T44] ? __lock_acquire+0x577/0xc10 [ 247.135414][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 247.135520][ T44] ? find_held_lock+0x2b/0x80 [ 247.135631][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 247.135738][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.135857][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 247.135970][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 247.136082][ T44] ? rtnl_port_fill+0x940/0x940 [ 247.136190][ T44] ? __lock_acquire+0x577/0xc10 [ 247.136311][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 247.136419][ T44] ? find_held_lock+0x2b/0x80 [ 247.136528][ T44] netlink_rcv_skb+0x123/0x380 [ 247.136638][ T44] ? rtnl_port_fill+0x940/0x940 [ 247.136751][ T44] ? netlink_ack+0xcc0/0xcc0 [ 247.136866][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 247.136972][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 247.137082][ T44] netlink_unicast+0x4a3/0x770 [ 247.137191][ T44] ? netlink_attachskb+0x810/0x810 [ 247.137306][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 247.137414][ T44] ? __lock_acquire+0x577/0xc10 [ 247.137529][ T44] netlink_sendmsg+0x735/0xc60 [ 247.137641][ T44] ? netlink_unicast+0x770/0x770 [ 247.137753][ T44] ____sys_sendmsg+0x419/0x850 [ 247.137868][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 247.137975][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 247.138109][ T44] ? move_addr_to_kernel+0x40/0x40 [ 247.138224][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 247.138335][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 247.138445][ T44] ___sys_sendmsg+0xfd/0x180 [ 247.138553][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 247.138689][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 247.138816][ T44] __sys_sendmsg+0x124/0x1c0 [ 247.138927][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 247.139035][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 247.139151][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 247.139298][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 247.139407][ T44] ? rcu_is_watching+0x15/0xd0 [ 247.139517][ T44] do_syscall_64+0xbd/0xfc0 [ 247.139626][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 247.139763][ T44] RIP: 0033:0x7f0af3df8c5e [ 247.139888][ T44] RSP: 002b:00007ffde11cc8c0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 247.140056][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f0af3df8c5e [ 247.140225][ T44] RDX: 0000000000000000 RSI: 00007ffde11cc980 RDI: 0000000000000003 [ 247.140389][ T44] RBP: 00007ffde11cc8d0 R08: 0000000000000000 R09: 0000000000000000 [ 247.140552][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffde11cd040 [ 247.140718][ T44] R13: 000000006934c55a R14: 0000000000000000 R15: 0000000000499600 [ 247.140895][ T44] [ 247.140979][ T44] INFO: task ip:259 is blocked on a mutex likely owned by task kworker/0:1:10. [ 247.141158][ T44] task:kworker/0:1 state:D stack:28784 pid:10 tgid:10 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 247.141406][ T44] Workqueue: events refill_work [ 247.141519][ T44] Call Trace: [ 247.141603][ T44] [ 247.141662][ T44] __schedule+0xae2/0x1720 [ 247.141775][ T44] ? usleep_range_state+0xba/0x1b0 [ 247.141890][ T44] ? io_schedule_timeout+0x130/0x130 [ 247.141999][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.142108][ T44] ? usleep_range_state+0xba/0x1b0 [ 247.142224][ T44] schedule+0xd4/0x260 [ 247.142306][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 247.142441][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 247.142558][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 247.142670][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 247.142782][ T44] ? ktime_get+0x15e/0x220 [ 247.142892][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 247.143007][ T44] ? ktime_get+0xa9/0x220 [ 247.143093][ T44] usleep_range_state+0x133/0x1b0 [ 247.143207][ T44] ? schedule_hrtimeout+0x20/0x20 [ 247.143317][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 247.143423][ T44] ? refill_work+0x149/0x210 [ 247.143533][ T44] napi_disable_locked+0x379/0x5f0 [ 247.143642][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 247.143753][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 247.143894][ T44] napi_disable+0x43/0x80 [ 247.143975][ T44] refill_work+0x116/0x210 [ 247.144087][ T44] process_one_work+0xd57/0x1390 [ 247.144208][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 247.144317][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 247.144426][ T44] ? assign_work+0x152/0x380 [ 247.144538][ T44] worker_thread+0x4d6/0xd40 [ 247.144651][ T44] ? process_one_work+0x1390/0x1390 [ 247.144759][ T44] kthread+0x355/0x5b0 [ 247.144847][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 247.144954][ T44] ? __lock_release.isra.0+0x59/0x170 [ 247.145062][ T44] ? rcu_is_watching+0x15/0xd0 [ 247.145171][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 247.145285][ T44] ret_from_fork+0x3fb/0x510 [ 247.145396][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 247.145530][ T44] ? __switch_to+0x602/0xd00 [ 247.145641][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 247.145749][ T44] ret_from_fork_asm+0x11/0x20 [ 247.145897][ T44] [ 247.145989][ T44] [ 247.145989][ T44] Showing all locks held in the system: [ 247.146149][ T44] 3 locks held by kworker/0:1/10: [ 247.146263][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 247.146474][ T44] #1: ffa00000000a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 247.146705][ T44] #2: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 247.146898][ T44] 3 locks held by kworker/u16:0/12: [ 247.147003][ T44] #0: ff1100000913e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 247.147215][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 247.147471][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 247.147659][ T44] 1 lock held by khungtaskd/44: [ 247.147763][ T44] #0: ffffffff9db70ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 247.147977][ T44] 3 locks held by kworker/2:1/65: [ 247.148078][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 247.148289][ T44] #1: ffa0000000467cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 247.148497][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 247.148680][ T44] 2 locks held by ip/259: [ 247.148757][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40 [ 247.148947][ T44] #1: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 247.149130][ T44] 1 lock held by ip/324: [ 247.149218][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 247.149401][ T44] [ 247.149455][ T44] ============================================= [ 247.149455][ T44] [ 370.008223][ T44] INFO: task kworker/u16:0:12 blocked for more than 122 seconds. [ 370.008477][ T44] Not tainted 6.18.0-virtme #1 [ 370.008600][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 370.008782][ T44] task:kworker/u16:0 state:D stack:27936 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 370.009038][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 370.009184][ T44] Call Trace: [ 370.009294][ T44] [ 370.009355][ T44] __schedule+0xae2/0x1720 [ 370.009476][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.009586][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.009697][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.009807][ T44] schedule+0xd4/0x260 [ 370.009895][ T44] schedule_preempt_disabled+0x18/0x30 [ 370.010002][ T44] __mutex_lock+0xd76/0x1f20 [ 370.010110][ T44] ? addrconf_verify_work+0x12/0x30 [ 370.010230][ T44] ? ww_mutex_lock+0x160/0x160 [ 370.010342][ T44] ? process_one_work+0xd16/0x1390 [ 370.010453][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.010561][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.010669][ T44] ? addrconf_verify_work+0x12/0x30 [ 370.010783][ T44] addrconf_verify_work+0x12/0x30 [ 370.010897][ T44] process_one_work+0xd57/0x1390 [ 370.011016][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 370.011125][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.011245][ T44] ? assign_work+0x152/0x380 [ 370.011355][ T44] worker_thread+0x4d6/0xd40 [ 370.011468][ T44] ? process_one_work+0x1390/0x1390 [ 370.011574][ T44] kthread+0x355/0x5b0 [ 370.011656][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.011765][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.011883][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.011993][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.012102][ T44] ret_from_fork+0x3fb/0x510 [ 370.012217][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 370.012352][ T44] ? __switch_to+0x602/0xd00 [ 370.012492][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.012599][ T44] ret_from_fork_asm+0x11/0x20 [ 370.012718][ T44] [ 370.012821][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:259. [ 370.013008][ T44] INFO: task kworker/2:1:65 blocked for more than 122 seconds. [ 370.013162][ T44] Not tainted 6.18.0-virtme #1 [ 370.013268][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 370.013443][ T44] task:kworker/2:1 state:D stack:27344 pid:65 tgid:65 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 370.013681][ T44] Workqueue: events xp_release_deferred [ 370.013790][ T44] Call Trace: [ 370.013875][ T44] [ 370.013931][ T44] __schedule+0xae2/0x1720 [ 370.014043][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.014151][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.014268][ T44] schedule+0xd4/0x260 [ 370.014351][ T44] schedule_preempt_disabled+0x18/0x30 [ 370.014460][ T44] __mutex_lock+0xd76/0x1f20 [ 370.014569][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 370.014676][ T44] ? lockdep_unlock+0x54/0xc0 [ 370.014789][ T44] ? ww_mutex_lock+0x160/0x160 [ 370.014904][ T44] ? __lock_acquire+0x577/0xc10 [ 370.015013][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.015139][ T44] ? process_one_work+0xd16/0x1390 [ 370.015254][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 370.015361][ T44] xp_release_deferred+0x1b/0x1e0 [ 370.015473][ T44] process_one_work+0xd57/0x1390 [ 370.015585][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 370.015694][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.015806][ T44] ? assign_work+0x152/0x380 [ 370.015924][ T44] worker_thread+0x4d6/0xd40 [ 370.016034][ T44] ? process_one_work+0x1390/0x1390 [ 370.016143][ T44] ? __kthread_parkme+0xb3/0x200 [ 370.016265][ T44] ? process_one_work+0x1390/0x1390 [ 370.016376][ T44] kthread+0x355/0x5b0 [ 370.016463][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.016574][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.016685][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.016793][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.016908][ T44] ret_from_fork+0x3fb/0x510 [ 370.017017][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 370.017153][ T44] ? __switch_to+0x602/0xd00 [ 370.017265][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.017376][ T44] ret_from_fork_asm+0x11/0x20 [ 370.017493][ T44] [ 370.017578][ T44] INFO: task kworker/2:1:65 is blocked on a mutex likely owned by task ip:259. [ 370.017756][ T44] INFO: task ip:259 blocked for more than 245 seconds. [ 370.017885][ T44] Not tainted 6.18.0-virtme #1 [ 370.017986][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 370.018157][ T44] task:ip state:D stack:25520 pid:259 tgid:259 ppid:1 task_flags:0x400100 flags:0x00080002 [ 370.018398][ T44] Call Trace: [ 370.018481][ T44] [ 370.018559][ T44] __schedule+0xae2/0x1720 [ 370.018670][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.018781][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.018894][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.019012][ T44] schedule+0xd4/0x260 [ 370.019100][ T44] schedule_preempt_disabled+0x18/0x30 [ 370.019213][ T44] __mutex_lock+0xd76/0x1f20 [ 370.019323][ T44] ? napi_enable+0x3b/0x80 [ 370.019436][ T44] ? ww_mutex_lock+0x160/0x160 [ 370.019546][ T44] ? __asan_memset+0x27/0x50 [ 370.019660][ T44] ? sg_init_table+0x19/0x60 [ 370.019773][ T44] ? try_fill_recv+0x3ec/0x1750 [ 370.019897][ T44] ? napi_enable+0x3b/0x80 [ 370.020007][ T44] napi_enable+0x3b/0x80 [ 370.020089][ T44] __virtnet_rx_resume+0x156/0x290 [ 370.020205][ T44] ? queue_delayed_work_on+0x91/0x100 [ 370.020315][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 370.020425][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 370.020538][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 370.020650][ T44] dev_xdp_install+0x3e4/0x890 [ 370.020760][ T44] ? alloc_netdev_dummy+0x30/0x30 [ 370.020878][ T44] dev_xdp_attach+0x50d/0x1310 [ 370.020989][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 370.021100][ T44] ? __bpf_prog_get+0x320/0x320 [ 370.021215][ T44] dev_change_xdp_fd+0x176/0x210 [ 370.021326][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 370.021437][ T44] ? rtnl_newlink_create+0x900/0x900 [ 370.021550][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 370.021684][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 370.021793][ T44] ? validate_chain+0x30f/0x8e0 [ 370.021906][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 370.022020][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 370.022129][ T44] ? __lock_acquire+0x577/0xc10 [ 370.022246][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 370.022358][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 370.022465][ T44] ? lock_acquire+0x10a/0x150 [ 370.022571][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.022680][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.022787][ T44] ? trace_contention_end+0xd6/0x110 [ 370.022898][ T44] ? __mutex_lock+0x285/0x1f20 [ 370.023006][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 370.023118][ T44] ? ww_mutex_lock+0x160/0x160 [ 370.023232][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 370.023343][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 370.023455][ T44] rtnl_newlink+0x649/0xb40 [ 370.023565][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.023679][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 370.023789][ T44] ? __lock_acquire+0x577/0xc10 [ 370.023904][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.024021][ T44] ? find_held_lock+0x2b/0x80 [ 370.024130][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 370.024240][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.024348][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 370.024460][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 370.024572][ T44] ? rtnl_port_fill+0x940/0x940 [ 370.024680][ T44] ? __lock_acquire+0x577/0xc10 [ 370.024790][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.024906][ T44] ? find_held_lock+0x2b/0x80 [ 370.025015][ T44] netlink_rcv_skb+0x123/0x380 [ 370.025125][ T44] ? rtnl_port_fill+0x940/0x940 [ 370.025237][ T44] ? netlink_ack+0xcc0/0xcc0 [ 370.025349][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 370.025455][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 370.025570][ T44] netlink_unicast+0x4a3/0x770 [ 370.025682][ T44] ? netlink_attachskb+0x810/0x810 [ 370.025792][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.025907][ T44] ? __lock_acquire+0x577/0xc10 [ 370.026015][ T44] netlink_sendmsg+0x735/0xc60 [ 370.026125][ T44] ? netlink_unicast+0x770/0x770 [ 370.026241][ T44] ____sys_sendmsg+0x419/0x850 [ 370.026351][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 370.026462][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 370.026595][ T44] ? move_addr_to_kernel+0x40/0x40 [ 370.026704][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 370.026813][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 370.026934][ T44] ___sys_sendmsg+0xfd/0x180 [ 370.027041][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 370.027177][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 370.027306][ T44] __sys_sendmsg+0x124/0x1c0 [ 370.027415][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 370.027528][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 370.027637][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 370.027776][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 370.027891][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.027999][ T44] do_syscall_64+0xbd/0xfc0 [ 370.028112][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 370.028252][ T44] RIP: 0033:0x7f0af3df8c5e [ 370.028368][ T44] RSP: 002b:00007ffde11cc8c0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 370.028534][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f0af3df8c5e [ 370.028697][ T44] RDX: 0000000000000000 RSI: 00007ffde11cc980 RDI: 0000000000000003 [ 370.028866][ T44] RBP: 00007ffde11cc8d0 R08: 0000000000000000 R09: 0000000000000000 [ 370.029027][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffde11cd040 [ 370.029188][ T44] R13: 000000006934c55a R14: 0000000000000000 R15: 0000000000499600 [ 370.029361][ T44] [ 370.029443][ T44] INFO: task ip:259 is blocked on a mutex likely owned by task kworker/0:1:10. [ 370.029623][ T44] task:kworker/0:1 state:D stack:28784 pid:10 tgid:10 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 370.029862][ T44] Workqueue: events refill_work [ 370.029973][ T44] Call Trace: [ 370.030055][ T44] [ 370.030112][ T44] __schedule+0xae2/0x1720 [ 370.030228][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.030337][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.030447][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.030557][ T44] ? usleep_range_state+0xba/0x1b0 [ 370.030668][ T44] schedule+0xd4/0x260 [ 370.030752][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 370.030896][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 370.031007][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 370.031121][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 370.031237][ T44] ? ktime_get+0x15e/0x220 [ 370.031345][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 370.031455][ T44] ? ktime_get+0xa9/0x220 [ 370.031539][ T44] usleep_range_state+0x133/0x1b0 [ 370.031648][ T44] ? schedule_hrtimeout+0x20/0x20 [ 370.031757][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 370.031872][ T44] ? refill_work+0x149/0x210 [ 370.031983][ T44] napi_disable_locked+0x379/0x5f0 [ 370.032091][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 370.032206][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 370.032344][ T44] napi_disable+0x43/0x80 [ 370.032427][ T44] refill_work+0x116/0x210 [ 370.032538][ T44] process_one_work+0xd57/0x1390 [ 370.032651][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 370.032763][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.032877][ T44] ? assign_work+0x152/0x380 [ 370.032985][ T44] worker_thread+0x4d6/0xd40 [ 370.033097][ T44] ? process_one_work+0x1390/0x1390 [ 370.033209][ T44] kthread+0x355/0x5b0 [ 370.033420][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.033529][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.033640][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.033748][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.033916][ T44] ret_from_fork+0x3fb/0x510 [ 370.034025][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 370.034159][ T44] ? __switch_to+0x602/0xd00 [ 370.034271][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 370.034438][ T44] ret_from_fork_asm+0x11/0x20 [ 370.034554][ T44] [ 370.034643][ T44] INFO: task ip:324 blocked for more than 122 seconds. [ 370.034766][ T44] Not tainted 6.18.0-virtme #1 [ 370.034869][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 370.035039][ T44] task:ip state:D stack:25768 pid:324 tgid:324 ppid:323 task_flags:0x400100 flags:0x00080000 [ 370.035338][ T44] Call Trace: [ 370.035419][ T44] [ 370.035474][ T44] __schedule+0xae2/0x1720 [ 370.035584][ T44] ? io_schedule_timeout+0x130/0x130 [ 370.035695][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.035863][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.035974][ T44] schedule+0xd4/0x260 [ 370.036055][ T44] schedule_preempt_disabled+0x18/0x30 [ 370.036165][ T44] __mutex_lock+0xd76/0x1f20 [ 370.036336][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.036459][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.036568][ T44] ? write_profile+0xf0/0xf0 [ 370.036685][ T44] ? ww_mutex_lock+0x160/0x160 [ 370.036861][ T44] ? find_held_lock+0x2b/0x80 [ 370.036972][ T44] ? __lock_release.isra.0+0x59/0x170 [ 370.037087][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.037197][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.037373][ T44] ? rtnl_port_fill+0x940/0x940 [ 370.037483][ T44] ? __lock_acquire+0x577/0xc10 [ 370.037593][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.037702][ T44] ? find_held_lock+0x2b/0x80 [ 370.037874][ T44] netlink_rcv_skb+0x123/0x380 [ 370.037983][ T44] ? rtnl_port_fill+0x940/0x940 [ 370.038097][ T44] ? netlink_ack+0xcc0/0xcc0 [ 370.038214][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 370.038382][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 370.038494][ T44] netlink_unicast+0x4a3/0x770 [ 370.038609][ T44] ? netlink_attachskb+0x810/0x810 [ 370.038720][ T44] ? __lock_acquire+0x577/0xc10 [ 370.038893][ T44] netlink_sendmsg+0x735/0xc60 [ 370.039006][ T44] ? netlink_unicast+0x770/0x770 [ 370.039119][ T44] ____sys_sendmsg+0x419/0x850 [ 370.039233][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 370.039398][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 370.039532][ T44] ? move_addr_to_kernel+0x40/0x40 [ 370.039639][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 370.039758][ T44] ? __lock_acquire+0x577/0xc10 [ 370.039933][ T44] ___sys_sendmsg+0xfd/0x180 [ 370.040041][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 370.040154][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 370.040265][ T44] ? __might_fault+0x97/0x140 [ 370.040437][ T44] ? _copy_to_user+0x4b/0x70 [ 370.040547][ T44] __sys_sendmsg+0x124/0x1c0 [ 370.040656][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 370.040770][ T44] ? rcu_is_watching+0x15/0xd0 [ 370.040887][ T44] do_syscall_64+0xbd/0xfc0 [ 370.040997][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 370.041130][ T44] RIP: 0033:0x7fb3111bbc5e [ 370.041316][ T44] RSP: 002b:00007fffda401ad0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 370.041478][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb3111bbc5e [ 370.041637][ T44] RDX: 0000000000000000 RSI: 00007fffda401b90 RDI: 0000000000000004 [ 370.041862][ T44] RBP: 00007fffda401ae0 R08: 0000000000000000 R09: 0000000000000000 [ 370.042023][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffda4036bf [ 370.042185][ T44] R13: 000000006934c62a R14: 000000000000000d R15: 00007fffda401c40 [ 370.042356][ T44] [ 370.042441][ T44] INFO: task ip:324 is blocked on a mutex likely owned by task ip:259. [ 370.042595][ T44] [ 370.042595][ T44] Showing all locks held in the system: [ 370.042804][ T44] 3 locks held by kworker/0:1/10: [ 370.042912][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.043122][ T44] #1: ffa00000000a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.043420][ T44] #2: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 370.043604][ T44] 3 locks held by kworker/u16:0/12: [ 370.043758][ T44] #0: ff1100000913e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.043967][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.044282][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 370.044466][ T44] 1 lock held by khungtaskd/44: [ 370.044568][ T44] #0: ffffffff9db70ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 370.044827][ T44] 3 locks held by kworker/2:1/65: [ 370.044934][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 370.045190][ T44] #1: ffa0000000467cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 370.045402][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 370.045636][ T44] 2 locks held by ip/259: [ 370.045717][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40 [ 370.045901][ T44] #1: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 370.046135][ T44] 1 lock held by ip/324: [ 370.046217][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 370.046398][ T44] [ 370.046451][ T44] ============================================= [ 370.046451][ T44] [ 492.889244][ T44] INFO: task kworker/u16:0:12 blocked for more than 245 seconds. [ 492.889502][ T44] Not tainted 6.18.0-virtme #1 [ 492.889605][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.889790][ T44] task:kworker/u16:0 state:D stack:27936 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.890055][ T44] Workqueue: ipv6_addrconf addrconf_verify_work [ 492.890195][ T44] Call Trace: [ 492.890304][ T44] [ 492.890366][ T44] __schedule+0xae2/0x1720 [ 492.890485][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.890593][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.890707][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.890822][ T44] schedule+0xd4/0x260 [ 492.890910][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.891020][ T44] __mutex_lock+0xd76/0x1f20 [ 492.891136][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.891256][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.891369][ T44] ? process_one_work+0xd16/0x1390 [ 492.891482][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.891598][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.891718][ T44] ? addrconf_verify_work+0x12/0x30 [ 492.891829][ T44] addrconf_verify_work+0x12/0x30 [ 492.891948][ T44] process_one_work+0xd57/0x1390 [ 492.892068][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.892261][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.892391][ T44] ? assign_work+0x152/0x380 [ 492.892530][ T44] worker_thread+0x4d6/0xd40 [ 492.892701][ T44] ? process_one_work+0x1390/0x1390 [ 492.892820][ T44] kthread+0x355/0x5b0 [ 492.892948][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.893108][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.893280][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.893446][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.893610][ T44] ret_from_fork+0x3fb/0x510 [ 492.893788][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.894004][ T44] ? __switch_to+0x602/0xd00 [ 492.894173][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.894357][ T44] ret_from_fork_asm+0x11/0x20 [ 492.894536][ T44] [ 492.894687][ T44] INFO: task kworker/u16:0:12 is blocked on a mutex likely owned by task ip:259. [ 492.894979][ T44] INFO: task kworker/2:1:65 blocked for more than 245 seconds. [ 492.895211][ T44] Not tainted 6.18.0-virtme #1 [ 492.895363][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.895636][ T44] task:kworker/2:1 state:D stack:27344 pid:65 tgid:65 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.896002][ T44] Workqueue: events xp_release_deferred [ 492.896172][ T44] Call Trace: [ 492.896310][ T44] [ 492.896398][ T44] __schedule+0xae2/0x1720 [ 492.896572][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.896743][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.896916][ T44] schedule+0xd4/0x260 [ 492.897032][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.897165][ T44] __mutex_lock+0xd76/0x1f20 [ 492.897287][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.897408][ T44] ? lockdep_unlock+0x54/0xc0 [ 492.897527][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.897639][ T44] ? __lock_acquire+0x577/0xc10 [ 492.897807][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.897959][ T44] ? process_one_work+0xd16/0x1390 [ 492.898070][ T44] ? xp_release_deferred+0x1b/0x1e0 [ 492.898180][ T44] xp_release_deferred+0x1b/0x1e0 [ 492.898313][ T44] process_one_work+0xd57/0x1390 [ 492.898427][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.898558][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.898674][ T44] ? assign_work+0x152/0x380 [ 492.898817][ T44] worker_thread+0x4d6/0xd40 [ 492.898934][ T44] ? process_one_work+0x1390/0x1390 [ 492.899042][ T44] ? __kthread_parkme+0xb3/0x200 [ 492.899160][ T44] ? process_one_work+0x1390/0x1390 [ 492.899272][ T44] kthread+0x355/0x5b0 [ 492.899353][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.899460][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.899568][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.899673][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.899798][ T44] ret_from_fork+0x3fb/0x510 [ 492.899908][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.900044][ T44] ? __switch_to+0x602/0xd00 [ 492.900151][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.900262][ T44] ret_from_fork_asm+0x11/0x20 [ 492.900373][ T44] [ 492.900466][ T44] INFO: task kworker/2:1:65 is blocked on a mutex likely owned by task ip:259. [ 492.900643][ T44] INFO: task ip:259 blocked for more than 368 seconds. [ 492.900776][ T44] Not tainted 6.18.0-virtme #1 [ 492.900875][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.901046][ T44] task:ip state:D stack:25520 pid:259 tgid:259 ppid:1 task_flags:0x400100 flags:0x00080002 [ 492.901280][ T44] Call Trace: [ 492.901358][ T44] [ 492.901412][ T44] __schedule+0xae2/0x1720 [ 492.901522][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.901628][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.901740][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.901850][ T44] schedule+0xd4/0x260 [ 492.901936][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.902041][ T44] __mutex_lock+0xd76/0x1f20 [ 492.902146][ T44] ? napi_enable+0x3b/0x80 [ 492.902265][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.902379][ T44] ? __asan_memset+0x27/0x50 [ 492.902490][ T44] ? sg_init_table+0x19/0x60 [ 492.902606][ T44] ? try_fill_recv+0x3ec/0x1750 [ 492.902752][ T44] ? napi_enable+0x3b/0x80 [ 492.902892][ T44] napi_enable+0x3b/0x80 [ 492.902976][ T44] __virtnet_rx_resume+0x156/0x290 [ 492.903092][ T44] ? queue_delayed_work_on+0x91/0x100 [ 492.903216][ T44] virtnet_rx_resume_all+0xe7/0x1a0 [ 492.903331][ T44] virtnet_xdp_set+0xef7/0x1aa0 [ 492.903451][ T44] ? virtnet_xdp_set+0x1aa0/0x1aa0 [ 492.903569][ T44] dev_xdp_install+0x3e4/0x890 [ 492.903692][ T44] ? alloc_netdev_dummy+0x30/0x30 [ 492.903810][ T44] dev_xdp_attach+0x50d/0x1310 [ 492.903930][ T44] ? bpf_xdp_link_update+0x6e0/0x6e0 [ 492.904041][ T44] ? __bpf_prog_get+0x320/0x320 [ 492.904157][ T44] dev_change_xdp_fd+0x176/0x210 [ 492.904276][ T44] do_setlink.isra.0+0x1c2d/0x2880 [ 492.904392][ T44] ? rtnl_newlink_create+0x900/0x900 [ 492.904509][ T44] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 492.904646][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.904759][ T44] ? validate_chain+0x30f/0x8e0 [ 492.904876][ T44] ? rcu_read_lock_any_held+0x66/0x90 [ 492.904981][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.905090][ T44] ? __lock_acquire+0x577/0xc10 [ 492.905198][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.905311][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 492.905417][ T44] ? lock_acquire+0x10a/0x150 [ 492.905528][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.905635][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.905747][ T44] ? trace_contention_end+0xd6/0x110 [ 492.905854][ T44] ? __mutex_lock+0x285/0x1f20 [ 492.905967][ T44] ? rtnl_newlink+0x5f9/0xb40 [ 492.906073][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.906179][ T44] ? nla_validate_int_range+0x5b0/0x5b0 [ 492.906292][ T44] ? __rtnl_newlink+0x3fa/0xa40 [ 492.906402][ T44] rtnl_newlink+0x649/0xb40 [ 492.906521][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.906633][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.906744][ T44] ? __lock_acquire+0x577/0xc10 [ 492.906852][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.906961][ T44] ? find_held_lock+0x2b/0x80 [ 492.907070][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.907180][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.907298][ T44] ? __rtnl_newlink+0xa40/0xa40 [ 492.907407][ T44] rtnetlink_rcv_msg+0x6fe/0xb90 [ 492.907516][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.907625][ T44] ? __lock_acquire+0x577/0xc10 [ 492.907742][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.907852][ T44] ? find_held_lock+0x2b/0x80 [ 492.907975][ T44] netlink_rcv_skb+0x123/0x380 [ 492.908086][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.908207][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.908319][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 492.908423][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.908529][ T44] netlink_unicast+0x4a3/0x770 [ 492.908636][ T44] ? netlink_attachskb+0x810/0x810 [ 492.908744][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.908848][ T44] ? __lock_acquire+0x577/0xc10 [ 492.908960][ T44] netlink_sendmsg+0x735/0xc60 [ 492.909066][ T44] ? netlink_unicast+0x770/0x770 [ 492.909174][ T44] ____sys_sendmsg+0x419/0x850 [ 492.909285][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.909390][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.909520][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.909625][ T44] ? stack_depot_save_flags+0x3e1/0x6e0 [ 492.909737][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.909843][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.909951][ T44] ? __call_rcu_common.constprop.0+0xa6/0xa00 [ 492.910084][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.910208][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.910315][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.910420][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.910527][ T44] ? __call_rcu_common.constprop.0+0x3bd/0xa00 [ 492.910661][ T44] ? do_raw_spin_unlock+0x59/0x250 [ 492.910775][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.910890][ T44] do_syscall_64+0xbd/0xfc0 [ 492.911001][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.911139][ T44] RIP: 0033:0x7f0af3df8c5e [ 492.911262][ T44] RSP: 002b:00007ffde11cc8c0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.911432][ T44] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f0af3df8c5e [ 492.911597][ T44] RDX: 0000000000000000 RSI: 00007ffde11cc980 RDI: 0000000000000003 [ 492.911798][ T44] RBP: 00007ffde11cc8d0 R08: 0000000000000000 R09: 0000000000000000 [ 492.911967][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffde11cd040 [ 492.912133][ T44] R13: 000000006934c55a R14: 0000000000000000 R15: 0000000000499600 [ 492.912312][ T44] [ 492.912396][ T44] INFO: task ip:259 is blocked on a mutex likely owned by task kworker/0:1:10. [ 492.912573][ T44] task:kworker/0:1 state:D stack:28784 pid:10 tgid:10 ppid:2 task_flags:0x4208060 flags:0x00080000 [ 492.912807][ T44] Workqueue: events refill_work [ 492.912923][ T44] Call Trace: [ 492.913004][ T44] [ 492.913058][ T44] __schedule+0xae2/0x1720 [ 492.913168][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.913285][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.913390][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.913496][ T44] ? usleep_range_state+0xba/0x1b0 [ 492.913601][ T44] schedule+0xd4/0x260 [ 492.913695][ T44] schedule_hrtimeout_range_clock+0x1da/0x2f0 [ 492.913828][ T44] ? schedule_timeout_idle+0xe0/0xe0 [ 492.913939][ T44] ? __hrtimer_cb_get_time+0x50/0x50 [ 492.914050][ T44] ? lockdep_hardirqs_on+0x84/0x130 [ 492.914153][ T44] ? ktime_get+0x15e/0x220 [ 492.914262][ T44] ? kvm_clock_get_cycles+0x18/0x30 [ 492.914375][ T44] ? ktime_get+0xa9/0x220 [ 492.914456][ T44] usleep_range_state+0x133/0x1b0 [ 492.914571][ T44] ? schedule_hrtimeout+0x20/0x20 [ 492.914691][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0 [ 492.914813][ T44] ? refill_work+0x149/0x210 [ 492.914934][ T44] napi_disable_locked+0x379/0x5f0 [ 492.915055][ T44] ? _mutex_trylock_nest_lock+0x340/0x340 [ 492.915165][ T44] ? netdev_bind_sb_channel_queue+0x470/0x470 [ 492.915326][ T44] napi_disable+0x43/0x80 [ 492.915414][ T44] refill_work+0x116/0x210 [ 492.915534][ T44] process_one_work+0xd57/0x1390 [ 492.915655][ T44] ? pwq_dec_nr_in_flight+0x700/0x700 [ 492.915768][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.915884][ T44] ? assign_work+0x152/0x380 [ 492.915996][ T44] worker_thread+0x4d6/0xd40 [ 492.916109][ T44] ? process_one_work+0x1390/0x1390 [ 492.916220][ T44] kthread+0x355/0x5b0 [ 492.916367][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.916475][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.916595][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.916724][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.916848][ T44] ret_from_fork+0x3fb/0x510 [ 492.916968][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140 [ 492.917109][ T44] ? __switch_to+0x602/0xd00 [ 492.917229][ T44] ? kthread_is_per_cpu+0xe0/0xe0 [ 492.917417][ T44] ret_from_fork_asm+0x11/0x20 [ 492.917546][ T44] [ 492.917642][ T44] INFO: task ip:324 blocked for more than 245 seconds. [ 492.917783][ T44] Not tainted 6.18.0-virtme #1 [ 492.917948][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 492.918119][ T44] task:ip state:D stack:25768 pid:324 tgid:324 ppid:323 task_flags:0x400100 flags:0x00080000 [ 492.918413][ T44] Call Trace: [ 492.918494][ T44] [ 492.918553][ T44] __schedule+0xae2/0x1720 [ 492.918672][ T44] ? io_schedule_timeout+0x130/0x130 [ 492.918800][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.918988][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.919111][ T44] schedule+0xd4/0x260 [ 492.919210][ T44] schedule_preempt_disabled+0x18/0x30 [ 492.919329][ T44] __mutex_lock+0xd76/0x1f20 [ 492.919454][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.919571][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.919695][ T44] ? write_profile+0xf0/0xf0 [ 492.919812][ T44] ? ww_mutex_lock+0x160/0x160 [ 492.920002][ T44] ? find_held_lock+0x2b/0x80 [ 492.920125][ T44] ? __lock_release.isra.0+0x59/0x170 [ 492.920248][ T44] ? rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.920364][ T44] rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.920549][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.920668][ T44] ? __lock_acquire+0x577/0xc10 [ 492.920801][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.920925][ T44] ? find_held_lock+0x2b/0x80 [ 492.921109][ T44] netlink_rcv_skb+0x123/0x380 [ 492.921233][ T44] ? rtnl_port_fill+0x940/0x940 [ 492.921352][ T44] ? netlink_ack+0xcc0/0xcc0 [ 492.921477][ T44] ? netlink_deliver_tap+0xc5/0x330 [ 492.921658][ T44] ? netlink_deliver_tap+0x13f/0x330 [ 492.921786][ T44] netlink_unicast+0x4a3/0x770 [ 492.921913][ T44] ? netlink_attachskb+0x810/0x810 [ 492.922034][ T44] ? __lock_acquire+0x577/0xc10 [ 492.922224][ T44] netlink_sendmsg+0x735/0xc60 [ 492.922343][ T44] ? netlink_unicast+0x770/0x770 [ 492.922460][ T44] ____sys_sendmsg+0x419/0x850 [ 492.922573][ T44] ? copy_msghdr_from_user+0x270/0x430 [ 492.922755][ T44] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 492.922913][ T44] ? move_addr_to_kernel+0x40/0x40 [ 492.923023][ T44] ? rcu_read_lock_any_held+0x3c/0x90 [ 492.923153][ T44] ? __lock_acquire+0x577/0xc10 [ 492.923327][ T44] ___sys_sendmsg+0xfd/0x180 [ 492.923437][ T44] ? copy_msghdr_from_user+0x430/0x430 [ 492.923549][ T44] ? lock_acquire.part.0+0xbc/0x260 [ 492.923657][ T44] ? __might_fault+0x97/0x140 [ 492.923836][ T44] ? _copy_to_user+0x4b/0x70 [ 492.923952][ T44] __sys_sendmsg+0x124/0x1c0 [ 492.924059][ T44] ? __sys_sendmsg_sock+0x20/0x20 [ 492.924171][ T44] ? rcu_is_watching+0x15/0xd0 [ 492.924286][ T44] do_syscall_64+0xbd/0xfc0 [ 492.924396][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 492.924529][ T44] RIP: 0033:0x7fb3111bbc5e [ 492.924643][ T44] RSP: 002b:00007fffda401ad0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 492.924882][ T44] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb3111bbc5e [ 492.925044][ T44] RDX: 0000000000000000 RSI: 00007fffda401b90 RDI: 0000000000000004 [ 492.925273][ T44] RBP: 00007fffda401ae0 R08: 0000000000000000 R09: 0000000000000000 [ 492.925432][ T44] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fffda4036bf [ 492.925598][ T44] R13: 000000006934c62a R14: 000000000000000d R15: 00007fffda401c40 [ 492.925842][ T44] [ 492.925940][ T44] INFO: task ip:324 is blocked on a mutex likely owned by task ip:259. [ 492.926107][ T44] [ 492.926107][ T44] Showing all locks held in the system: [ 492.926400][ T44] 3 locks held by kworker/0:1/10: [ 492.926511][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.926740][ T44] #1: ffa00000000a7cc0 ((work_completion)(&(&vi->refill)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.926986][ T44] #2: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_disable+0x3b/0x80 [ 492.927246][ T44] 3 locks held by kworker/u16:0/12: [ 492.927383][ T44] #0: ff1100000913e548 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.927652][ T44] #1: ffa00000000c7cc0 ((work_completion)(&(&net->ipv6.addr_chk_work)->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.928114][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_verify_work+0x12/0x30 [ 492.928424][ T44] 1 lock held by khungtaskd/44: [ 492.928586][ T44] #0: ffffffff9db70ba0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 492.929042][ T44] 3 locks held by kworker/2:1/65: [ 492.929215][ T44] #0: ff11000001139b48 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xcb4/0x1390 [ 492.929642][ T44] #1: ffa0000000467cc0 ((work_completion)(&pool->work)){+.+.}-{0:0}, at: process_one_work+0xd16/0x1390 [ 492.929982][ T44] #2: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: xp_release_deferred+0x1b/0x1e0 [ 492.930278][ T44] 2 locks held by ip/259: [ 492.930392][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x5f9/0xb40 [ 492.930677][ T44] #1: ff11000008b22c98 (&dev->lock){+.+.}-{4:4}, at: napi_enable+0x3b/0x80 [ 492.931081][ T44] 1 lock held by ip/324: [ 492.931210][ T44] #0: ffffffff9e278aa8 (rtnl_mutex){+.+.}-{4:4}, at: rtnetlink_rcv_msg+0x2ab/0xb90 [ 492.931499][ T44] [ 492.931583][ T44] ============================================= [ 492.931583][ T44]