[ 11.364061][ T281] ip (281) used greatest stack depth: 24144 bytes left [ 15.650230][ T12] [ 15.650338][ T12] ====================================================== [ 15.650496][ T12] WARNING: possible circular locking dependency detected [ 15.650646][ T12] 7.3.0-rc3-virtme #1 Tainted: G W [ 15.650794][ T12] ------------------------------------------------------ [ 15.650938][ T12] kworker/u16:0/12 is trying to acquire lock: [ 15.651083][ T12] ff110000166f4e10 (&dev_instance_lock_key#2){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.651365][ T12] [ 15.651365][ T12] but task is already holding lock: [ 15.651545][ T12] ff11000015ce1e10 (&dev_instance_lock_key){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.651808][ T12] [ 15.651808][ T12] which lock already depends on the new lock. [ 15.651808][ T12] [ 15.652039][ T12] [ 15.652039][ T12] the existing dependency chain (in reverse order) is: [ 15.652244][ T12] [ 15.652244][ T12] -> #1 (&dev_instance_lock_key){+.+.}-{4:4}: [ 15.652421][ T12] __lock_acquire+0x4ff/0x900 [ 15.652542][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.652658][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.652777][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.652919][ T12] default_device_exit_batch+0x543/0x820 [ 15.653060][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.653180][ T12] cleanup_net+0x431/0x940 [ 15.653297][ T12] process_one_work+0xe3e/0x1560 [ 15.653412][ T12] worker_thread+0x4f1/0xd60 [ 15.653529][ T12] kthread+0x367/0x460 [ 15.653643][ T12] ret_from_fork+0x474/0x6b0 [ 15.653758][ T12] ret_from_fork_asm+0x11/0x20 [ 15.653874][ T12] [ 15.653874][ T12] -> #0 (&dev_instance_lock_key#2){+.+.}-{4:4}: [ 15.654048][ T12] check_prev_add+0xd8/0xe90 [ 15.654163][ T12] validate_chain+0x6b8/0xc20 [ 15.654279][ T12] __lock_acquire+0x4ff/0x900 [ 15.654393][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.654507][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.654622][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.654762][ T12] default_device_exit_batch+0x543/0x820 [ 15.654903][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.655014][ T12] cleanup_net+0x431/0x940 [ 15.655128][ T12] process_one_work+0xe3e/0x1560 [ 15.655262][ T12] worker_thread+0x4f1/0xd60 [ 15.655379][ T12] kthread+0x367/0x460 [ 15.655496][ T12] ret_from_fork+0x474/0x6b0 [ 15.655616][ T12] ret_from_fork_asm+0x11/0x20 [ 15.655731][ T12] [ 15.655731][ T12] other info that might help us debug this: [ 15.655731][ T12] [ 15.655958][ T12] Possible unsafe locking scenario: [ 15.655958][ T12] [ 15.656131][ T12] CPU0 CPU1 [ 15.656252][ T12] ---- ---- [ 15.656370][ T12] lock(&dev_instance_lock_key); [ 15.656489][ T12] lock(&dev_instance_lock_key#2); [ 15.656663][ T12] lock(&dev_instance_lock_key); [ 15.656834][ T12] lock(&dev_instance_lock_key#2); [ 15.656951][ T12] [ 15.656951][ T12] *** DEADLOCK *** [ 15.656951][ T12] [ 15.657121][ T12] locks held by kworker/u16:0/12: 6, last CPU#2: [ 15.657269][ T12] #0: ff11000001a21d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd9a/0x1560 [ 15.657501][ T12] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdfc/0x1560 [ 15.657700][ T12] #2: ffffffff95f019a8 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 15.657907][ T12] #3: ffffffff95f1d360 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0xa8/0x820 [ 15.658136][ T12] #4: ff110000183e9e10 (&dev_instance_lock_key#2){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658400][ T12] #5: ff11000015ce1e10 (&dev_instance_lock_key){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658658][ T12] [ 15.658658][ T12] stack backtrace: [ 15.658804][ T12] CPU: 2 UID: 0 PID: 12 Comm: kworker/u16:0 Tainted: G W 7.3.0-rc3-virtme #1 PREEMPT(full) [ 15.658807][ T12] Tainted: [W]=WARN [ 15.658808][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.658810][ T12] Workqueue: netns cleanup_net [ 15.658814][ T12] Call Trace: [ 15.658815][ T12] [ 15.658817][ T12] dump_stack_lvl+0x6f/0xa0 [ 15.658820][ T12] print_circular_bug.cold+0x38/0x46 [ 15.658823][ T12] check_noncircular+0x171/0x1a0 [ 15.658826][ T12] check_prev_add+0xd8/0xe90 [ 15.658828][ T12] ? lock_acquire.part.0+0xd4/0x280 [ 15.658830][ T12] validate_chain+0x6b8/0xc20 [ 15.658832][ T12] __lock_acquire+0x4ff/0x900 [ 15.658835][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.658836][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658838][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.658841][ T12] ? lock_acquire+0x13c/0x160 [ 15.658843][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.658844][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658846][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658847][ T12] ? __lock_acquire+0x4ff/0x900 [ 15.658849][ T12] ? ww_mutex_lock+0x160/0x160 [ 15.658851][ T12] ? find_held_lock+0x2b/0x80 [ 15.658853][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.658854][ T12] ? mark_held_locks+0x40/0x70 [ 15.658856][ T12] ? kfree+0x22/0x590 [ 15.658859][ T12] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 15.658860][ T12] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 15.658863][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658864][ T12] ? rtnl_is_locked+0x15/0x20 [ 15.658866][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.658867][ T12] ? ops_undo_list+0x2ce/0x8f0 [ 15.658869][ T12] ? worker_thread+0x4f1/0xd60 [ 15.658870][ T12] ? kthread+0x367/0x460 [ 15.658872][ T12] ? ret_from_fork+0x474/0x6b0 [ 15.658873][ T12] ? ret_from_fork_asm+0x11/0x20 [ 15.658875][ T12] ? unregister_netdevice_queued+0x80/0x80 [ 15.658877][ T12] ? unregister_netdevice_many+0x20/0x20 [ 15.658879][ T12] default_device_exit_batch+0x543/0x820 [ 15.658881][ T12] ? unregister_netdevice_queue+0x470/0x470 [ 15.658883][ T12] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 15.658885][ T12] ? fou_exit_net+0x30/0x110 [ 15.658888][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.658890][ T12] ? lockdep_hardirqs_on+0x91/0x130 [ 15.658893][ T12] ? netns_install+0x2a0/0x2a0 [ 15.658894][ T12] ? __lock_release.isra.0+0x69/0x1a0 [ 15.658896][ T12] ? idr_destroy+0x121/0x250 [ 15.658899][ T12] cleanup_net+0x431/0x940 [ 15.658901][ T12] ? net_passive_dec+0x230/0x230 [ 15.658903][ T12] ? lock_acquire+0x13c/0x160 [ 15.658905][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.658906][ T12] process_one_work+0xe3e/0x1560 [ 15.658909][ T12] ? __queue_delayed_work+0x470/0x470 [ 15.658910][ T12] ? lock_acquire.part.0+0xd4/0x280 [ 15.658913][ T12] worker_thread+0x4f1/0xd60 [ 15.658915][ T12] ? rescuer_thread+0x1340/0x1340 [ 15.658916][ T12] kthread+0x367/0x460 [ 15.658918][ T12] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 15.658921][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 15.658923][ T12] ret_from_fork+0x474/0x6b0 [ 15.658925][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 15.658927][ T12] ? __switch_to+0x5a3/0xe00 [ 15.658929][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 15.658931][ T12] ret_from_fork_asm+0x11/0x20 [ 15.658935][ T12]