[ 10.491505][ T255] ip (255) used greatest stack depth: 23976 bytes left [ 12.138362][ T317] ip (317) used greatest stack depth: 23664 bytes left [ 15.415348][ T12] [ 15.415455][ T12] ====================================================== [ 15.415617][ T12] WARNING: possible circular locking dependency detected [ 15.415769][ T12] 7.3.0-rc3-virtme #1 Tainted: G W [ 15.415921][ T12] ------------------------------------------------------ [ 15.416070][ T12] kworker/u16:0/12 is trying to acquire lock: [ 15.416219][ T12] ff1100000c5d4e10 (&dev_instance_lock_key#2){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.416510][ T12] [ 15.416510][ T12] but task is already holding lock: [ 15.416697][ T12] ff1100000ff11e10 (&dev_instance_lock_key){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.416963][ T12] [ 15.416963][ T12] which lock already depends on the new lock. [ 15.416963][ T12] [ 15.417198][ T12] [ 15.417198][ T12] the existing dependency chain (in reverse order) is: [ 15.417406][ T12] [ 15.417406][ T12] -> #1 (&dev_instance_lock_key){+.+.}-{4:4}: [ 15.417586][ T12] __lock_acquire+0x4ff/0x900 [ 15.417716][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.417834][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.417954][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.418096][ T12] default_device_exit_batch+0x543/0x820 [ 15.418239][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.418355][ T12] cleanup_net+0x431/0x940 [ 15.418472][ T12] process_one_work+0xe3e/0x1560 [ 15.418591][ T12] worker_thread+0x4f1/0xd60 [ 15.418710][ T12] kthread+0x367/0x460 [ 15.418827][ T12] ret_from_fork+0x474/0x6b0 [ 15.418943][ T12] ret_from_fork_asm+0x11/0x20 [ 15.419062][ T12] [ 15.419062][ T12] -> #0 (&dev_instance_lock_key#2){+.+.}-{4:4}: [ 15.419238][ T12] check_prev_add+0xd8/0xe90 [ 15.419357][ T12] validate_chain+0x6b8/0xc20 [ 15.419470][ T12] __lock_acquire+0x4ff/0x900 [ 15.419584][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.419705][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.419820][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.419963][ T12] default_device_exit_batch+0x543/0x820 [ 15.420107][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.420224][ T12] cleanup_net+0x431/0x940 [ 15.420339][ T12] process_one_work+0xe3e/0x1560 [ 15.420456][ T12] worker_thread+0x4f1/0xd60 [ 15.420571][ T12] kthread+0x367/0x460 [ 15.420693][ T12] ret_from_fork+0x474/0x6b0 [ 15.420814][ T12] ret_from_fork_asm+0x11/0x20 [ 15.420930][ T12] [ 15.420930][ T12] other info that might help us debug this: [ 15.420930][ T12] [ 15.421156][ T12] Possible unsafe locking scenario: [ 15.421156][ T12] [ 15.421332][ T12] CPU0 CPU1 [ 15.421448][ T12] ---- ---- [ 15.421567][ T12] lock(&dev_instance_lock_key); [ 15.421692][ T12] lock(&dev_instance_lock_key#2); [ 15.421867][ T12] lock(&dev_instance_lock_key); [ 15.422040][ T12] lock(&dev_instance_lock_key#2); [ 15.422158][ T12] [ 15.422158][ T12] *** DEADLOCK *** [ 15.422158][ T12] [ 15.422327][ T12] locks held by kworker/u16:0/12: 6, last CPU#0: [ 15.422473][ T12] #0: ff11000001a21d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd9a/0x1560 [ 15.422712][ T12] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdfc/0x1560 [ 15.422916][ T12] #2: ffffffff9e3019a8 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 15.423122][ T12] #3: ffffffff9e31d360 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0xa8/0x820 [ 15.423354][ T12] #4: ff11000008a71e10 (&dev_instance_lock_key#2){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.423616][ T12] #5: ff1100000ff11e10 (&dev_instance_lock_key){+.+.}-{4:4}, at: unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.423872][ T12] [ 15.423872][ T12] stack backtrace: [ 15.424018][ T12] CPU: 0 UID: 0 PID: 12 Comm: kworker/u16:0 Tainted: G W 7.3.0-rc3-virtme #1 PREEMPT(full) [ 15.424022][ T12] Tainted: [W]=WARN [ 15.424023][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.424024][ T12] Workqueue: netns cleanup_net [ 15.424028][ T12] Call Trace: [ 15.424029][ T12] [ 15.424031][ T12] dump_stack_lvl+0x6f/0xa0 [ 15.424034][ T12] print_circular_bug.cold+0x38/0x46 [ 15.424037][ T12] check_noncircular+0x171/0x1a0 [ 15.424041][ T12] check_prev_add+0xd8/0xe90 [ 15.424042][ T12] ? lock_acquire.part.0+0xd4/0x280 [ 15.424045][ T12] validate_chain+0x6b8/0xc20 [ 15.424047][ T12] __lock_acquire+0x4ff/0x900 [ 15.424050][ T12] lock_acquire.part.0+0xd4/0x280 [ 15.424051][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.424053][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.424056][ T12] ? lock_acquire+0x13c/0x160 [ 15.424058][ T12] __mutex_lock+0x1ae/0x1f10 [ 15.424060][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.424061][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.424063][ T12] ? __lock_acquire+0x4ff/0x900 [ 15.424065][ T12] ? ww_mutex_lock+0x160/0x160 [ 15.424066][ T12] ? find_held_lock+0x2b/0x80 [ 15.424068][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.424069][ T12] ? mark_held_locks+0x40/0x70 [ 15.424071][ T12] ? kfree+0x22/0x590 [ 15.424074][ T12] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 15.424076][ T12] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 15.424079][ T12] ? unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.424080][ T12] ? rtnl_is_locked+0x15/0x20 [ 15.424082][ T12] unregister_netdevice_many_notify+0x3ef/0x1b40 [ 15.424083][ T12] ? ops_undo_list+0x2ce/0x8f0 [ 15.424085][ T12] ? worker_thread+0x4f1/0xd60 [ 15.424086][ T12] ? kthread+0x367/0x460 [ 15.424088][ T12] ? ret_from_fork+0x474/0x6b0 [ 15.424089][ T12] ? ret_from_fork_asm+0x11/0x20 [ 15.424091][ T12] ? unregister_netdevice_queued+0x80/0x80 [ 15.424093][ T12] ? unregister_netdevice_many+0x20/0x20 [ 15.424095][ T12] default_device_exit_batch+0x543/0x820 [ 15.424097][ T12] ? unregister_netdevice_queue+0x470/0x470 [ 15.424099][ T12] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 15.424101][ T12] ? fou_exit_net+0x30/0x110 [ 15.424104][ T12] ops_undo_list+0x2ce/0x8f0 [ 15.424106][ T12] ? lockdep_hardirqs_on+0x91/0x130 [ 15.424109][ T12] ? netns_install+0x2a0/0x2a0 [ 15.424110][ T12] ? __lock_release.isra.0+0x69/0x1a0 [ 15.424112][ T12] ? idr_destroy+0x121/0x250 [ 15.424115][ T12] cleanup_net+0x431/0x940 [ 15.424117][ T12] ? net_passive_dec+0x230/0x230 [ 15.424119][ T12] ? lock_acquire+0x13c/0x160 [ 15.424121][ T12] ? rcu_is_watching+0x16/0xd0 [ 15.424123][ T12] process_one_work+0xe3e/0x1560 [ 15.424125][ T12] ? __queue_delayed_work+0x470/0x470 [ 15.424126][ T12] ? lock_acquire.part.0+0xd4/0x280 [ 15.424129][ T12] worker_thread+0x4f1/0xd60 [ 15.424132][ T12] ? rescuer_thread+0x1340/0x1340 [ 15.424133][ T12] kthread+0x367/0x460 [ 15.424135][ T12] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 15.424138][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 15.424140][ T12] ret_from_fork+0x474/0x6b0 [ 15.424141][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 15.424143][ T12] ? __switch_to+0x5a3/0xe00 [ 15.424146][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 15.424148][ T12] ret_from_fork_asm+0x11/0x20 [ 15.424151][ T12]