[ 21.070840][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 21.071043][ C0] [ 21.071045][ C0] ======================================================== [ 21.071046][ C0] WARNING: possible irq lock inversion dependency detected [ 21.071048][ C0] 7.2.0-virtme #1 Tainted: G W [ 21.071050][ C0] -------------------------------------------------------- [ 21.071050][ C0] swapper/0/0 just changed the state of lock: [ 21.071052][ C0] ffffffffa3e89760 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 21.071065][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 21.071066][ C0] (fs_reclaim){+.+.}-{0:0} [ 21.071068][ C0] [ 21.071068][ C0] [ 21.071068][ C0] and interrupts could create inverse lock ordering between them. [ 21.071068][ C0] [ 21.071069][ C0] [ 21.071069][ C0] other info that might help us debug this: [ 21.071069][ C0] Possible interrupt unsafe locking scenario: [ 21.071069][ C0] [ 21.071070][ C0] CPU0 CPU1 [ 21.071071][ C0] ---- ---- [ 21.071071][ C0] lock(fs_reclaim); [ 21.071072][ C0] local_irq_disable(); [ 21.071073][ C0] lock(console_owner); [ 21.071074][ C0] lock(fs_reclaim); [ 21.071075][ C0] [ 21.071075][ C0] lock(console_owner); [ 21.071076][ C0] [ 21.071076][ C0] *** DEADLOCK *** [ 21.071076][ C0] [ 21.071077][ C0] locks held by swapper/0/0: 4, last CPU#0: [ 21.071078][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 21.071084][ C0] #1: ffffffffa3ffe9f8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 21.071089][ C0] #2: ffffffffa3f99dc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 21.071092][ C0] #3: ffffffffa3f99e38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 21.071096][ C0] [ 21.071096][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 21.071101][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 21.071104][ C0] HARDIRQ-ON-W at: [ 21.071105][ C0] __lock_acquire+0x388/0xc20 [ 21.071109][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071110][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.071114][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.071117][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.071120][ C0] workqueue_init+0x2a/0x680 [ 21.071124][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.071126][ C0] kernel_init+0x21/0x150 [ 21.071130][ C0] ret_from_fork+0x474/0x6b0 [ 21.071133][ C0] ret_from_fork_asm+0x11/0x20 [ 21.071136][ C0] SOFTIRQ-ON-W at: [ 21.071137][ C0] __lock_acquire+0x388/0xc20 [ 21.071138][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071140][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.071141][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.071143][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.071144][ C0] workqueue_init+0x2a/0x680 [ 21.071146][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.071147][ C0] kernel_init+0x21/0x150 [ 21.071148][ C0] ret_from_fork+0x474/0x6b0 [ 21.071149][ C0] ret_from_fork_asm+0x11/0x20 [ 21.071151][ C0] INITIAL USE at: [ 21.071151][ C0] __lock_acquire+0x388/0xc20 [ 21.071153][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071154][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.071156][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.071157][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.071159][ C0] workqueue_init+0x2a/0x680 [ 21.071160][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.071162][ C0] kernel_init+0x21/0x150 [ 21.071163][ C0] ret_from_fork+0x474/0x6b0 [ 21.071164][ C0] ret_from_fork_asm+0x11/0x20 [ 21.071165][ C0] } [ 21.071165][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 21.071170][ C0] ... acquired at: [ 21.071170][ C0] __lock_acquire+0x518/0xc20 [ 21.071172][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071173][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.071174][ C0] __kmalloc_noprof+0xd3/0x760 [ 21.071176][ C0] alloc_buf.isra.0+0x4b/0x260 [ 21.071180][ C0] put_chars+0x1e1/0x2f0 [ 21.071182][ C0] hvc_console_print+0x292/0x780 [ 21.071184][ C0] console_emit_next_record+0x252/0x4f0 [ 21.071186][ C0] console_flush_one_record+0x46f/0x710 [ 21.071188][ C0] console_unlock+0xee/0x1f0 [ 21.071189][ C0] vprintk_emit+0x37c/0x3e0 [ 21.071191][ C0] _printk+0xc7/0x100 [ 21.071194][ C0] loop_init+0x12a/0x130 [ 21.071196][ C0] do_one_initcall+0x124/0x4f0 [ 21.071198][ C0] kernel_init_freeable+0x596/0x630 [ 21.071199][ C0] kernel_init+0x21/0x150 [ 21.071200][ C0] ret_from_fork+0x474/0x6b0 [ 21.071201][ C0] ret_from_fork_asm+0x11/0x20 [ 21.071202][ C0] [ 21.071203][ C0] -> (console_owner){..-.}-{0:0} { [ 21.071205][ C0] IN-SOFTIRQ-W at: [ 21.071206][ C0] __lock_acquire+0x388/0xc20 [ 21.071207][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071208][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.071210][ C0] console_emit_next_record+0x1f4/0x4f0 [ 21.071212][ C0] console_flush_one_record+0x46f/0x710 [ 21.071213][ C0] console_unlock+0xee/0x1f0 [ 21.071215][ C0] vprintk_emit+0x37c/0x3e0 [ 21.071217][ C0] _printk+0xc7/0x100 [ 21.071218][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.071220][ C0] call_timer_fn+0x160/0x4d0 [ 21.071222][ C0] __run_timers+0x68f/0xaa0 [ 21.071224][ C0] run_timer_softirq+0xf0/0x160 [ 21.071226][ C0] handle_softirqs+0x1d3/0x900 [ 21.071228][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.071229][ C0] irq_exit_rcu+0xe/0x30 [ 21.071231][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.071234][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.071236][ C0] pv_native_safe_halt+0xf/0x10 [ 21.071237][ C0] default_idle+0x9/0x10 [ 21.071239][ C0] default_idle_call+0x6e/0xb0 [ 21.071240][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071243][ C0] do_idle+0xd8/0x190 [ 21.071244][ C0] cpu_startup_entry+0x53/0x70 [ 21.071245][ C0] rest_init+0x279/0x280 [ 21.071246][ C0] start_kernel+0x3af/0x3b0 [ 21.071248][ C0] x86_64_start_reservations+0x24/0x30 [ 21.071250][ C0] x86_64_start_kernel+0x12b/0x130 [ 21.071252][ C0] common_startup_64+0x13e/0x148 [ 21.071255][ C0] INITIAL USE at: [ 21.071255][ C0] } [ 21.071256][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 21.071259][ C0] ... acquired at: [ 21.071260][ C0] mark_lock+0x1d7/0xa00 [ 21.071261][ C0] mark_usage+0x42/0x170 [ 21.071263][ C0] __lock_acquire+0x388/0xc20 [ 21.071264][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071265][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.071267][ C0] console_emit_next_record+0x1f4/0x4f0 [ 21.071268][ C0] console_flush_one_record+0x46f/0x710 [ 21.071270][ C0] console_unlock+0xee/0x1f0 [ 21.071271][ C0] vprintk_emit+0x37c/0x3e0 [ 21.071273][ C0] _printk+0xc7/0x100 [ 21.071275][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.071276][ C0] call_timer_fn+0x160/0x4d0 [ 21.071278][ C0] __run_timers+0x68f/0xaa0 [ 21.071279][ C0] run_timer_softirq+0xf0/0x160 [ 21.071281][ C0] handle_softirqs+0x1d3/0x900 [ 21.071282][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.071283][ C0] irq_exit_rcu+0xe/0x30 [ 21.071284][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.071286][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.071287][ C0] pv_native_safe_halt+0xf/0x10 [ 21.071289][ C0] default_idle+0x9/0x10 [ 21.071290][ C0] default_idle_call+0x6e/0xb0 [ 21.071291][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071293][ C0] do_idle+0xd8/0x190 [ 21.071294][ C0] cpu_startup_entry+0x53/0x70 [ 21.071295][ C0] rest_init+0x279/0x280 [ 21.071296][ C0] start_kernel+0x3af/0x3b0 [ 21.071297][ C0] x86_64_start_reservations+0x24/0x30 [ 21.071299][ C0] x86_64_start_kernel+0x12b/0x130 [ 21.071301][ C0] common_startup_64+0x13e/0x148 [ 21.071302][ C0] [ 21.071303][ C0] [ 21.071303][ C0] stack backtrace: [ 21.071306][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 21.071309][ C0] Tainted: [W]=WARN [ 21.071310][ C0] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 21.071312][ C0] Call Trace: [ 21.071313][ C0] [ 21.071314][ C0] dump_stack_lvl+0x6f/0xa0 [ 21.071318][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 21.071321][ C0] mark_lock_irq+0x989/0x9c0 [ 21.071322][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 21.071326][ C0] mark_lock+0x1d7/0xa00 [ 21.071327][ C0] mark_usage+0x42/0x170 [ 21.071329][ C0] __lock_acquire+0x388/0xc20 [ 21.071331][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.071333][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 21.071335][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071338][ C0] ? lock_acquire+0x13c/0x160 [ 21.071340][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.071342][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 21.071344][ C0] console_emit_next_record+0x1f4/0x4f0 [ 21.071346][ C0] ? devkmsg_read+0x4e0/0x4e0 [ 21.071348][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071350][ C0] ? lock_acquire+0x13c/0x160 [ 21.071352][ C0] console_flush_one_record+0x46f/0x710 [ 21.071354][ C0] ? console_emit_next_record+0x4f0/0x4f0 [ 21.071356][ C0] ? __lock_acquire+0x518/0xc20 [ 21.071358][ C0] console_unlock+0xee/0x1f0 [ 21.071360][ C0] ? console_flush_one_record+0x710/0x710 [ 21.071362][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071364][ C0] ? lock_acquire+0xa0/0x160 [ 21.071366][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 21.071367][ C0] ? vprintk_emit+0x320/0x3e0 [ 21.071369][ C0] vprintk_emit+0x37c/0x3e0 [ 21.071372][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 21.071374][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 21.071376][ C0] _printk+0xc7/0x100 [ 21.071378][ C0] ? snapshot_read.cold+0x21/0x21 [ 21.071380][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 21.071381][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071384][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.071385][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071387][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071389][ C0] call_timer_fn+0x160/0x4d0 [ 21.071391][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 21.071392][ C0] ? debug_object_active_state+0x430/0x430 [ 21.071395][ C0] ? find_held_lock+0x2b/0x80 [ 21.071397][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071399][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071401][ C0] __run_timers+0x68f/0xaa0 [ 21.071403][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071405][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 21.071407][ C0] ? __lock_acquire+0x518/0xc20 [ 21.071410][ C0] ? __rwlock_init+0x150/0x150 [ 21.071413][ C0] run_timer_softirq+0xf0/0x160 [ 21.071415][ C0] ? __run_timers+0xaa0/0xaa0 [ 21.071416][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.071419][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071421][ C0] handle_softirqs+0x1d3/0x900 [ 21.071423][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071425][ C0] ? _local_bh_enable+0xc0/0xc0 [ 21.071427][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.071428][ C0] irq_exit_rcu+0xe/0x30 [ 21.071430][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.071432][ C0] [ 21.071433][ C0] [ 21.071433][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 21.071435][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.071437][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 21.071439][ C0] Code: 48 8b 3d 94 52 73 02 e8 1f 00 00 00 48 2b 05 58 e3 ae 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 76 1e 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 21.071441][ C0] RSP: 0018:ffffffffa3c07cf8 EFLAGS: 00000296 [ 21.071444][ C0] RAX: 0000000000082daf RBX: ffffffffa3c1c600 RCX: ffffffffa03103a7 [ 21.071445][ C0] RDX: ffffffffa3c1c600 RSI: ffffffffa34f7c2a RDI: ffffffffa2e913e0 [ 21.071446][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 21.071447][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff4780fa2 [ 21.071448][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 21.071450][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071452][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 21.071454][ C0] default_idle+0x9/0x10 [ 21.071456][ C0] default_idle_call+0x6e/0xb0 [ 21.071457][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071459][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 21.071461][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 21.071463][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.071465][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071467][ C0] do_idle+0xd8/0x190 [ 21.071468][ C0] cpu_startup_entry+0x53/0x70 [ 21.071470][ C0] rest_init+0x279/0x280 [ 21.071471][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 21.071474][ C0] ? rest_init+0x280/0x280 [ 21.071475][ C0] ? acpi_hw_write_port+0x5c/0xe0 [ 21.071479][ C0] ? acpi_enable+0x112/0x330 [ 21.071481][ C0] start_kernel+0x3af/0x3b0 [ 21.071483][ C0] x86_64_start_reservations+0x24/0x30 [ 21.071485][ C0] x86_64_start_kernel+0x12b/0x130 [ 21.071488][ C0] common_startup_64+0x13e/0x148 [ 21.071491][ C0] [ 21.071494][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 21.071496][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/0 [ 21.071498][ C0] preempt_count: 103, expected: 0 [ 21.071498][ C0] RCU nest depth: 0, expected: 0 [ 21.071499][ C0] INFO: lockdep is turned off. [ 21.071500][ C0] irq event stamp: 536005 [ 21.071500][ C0] hardirqs last enabled at (536004): [] __down_trylock_console_sem+0x86/0xa0 [ 21.071503][ C0] hardirqs last disabled at (536005): [] console_emit_next_record+0x3f8/0x4f0 [ 21.071505][ C0] softirqs last enabled at (535978): [] handle_softirqs+0x67c/0x900 [ 21.071507][ C0] softirqs last disabled at (535985): [] __irq_exit_rcu+0x145/0x1c0 [ 21.071508][ C0] Preemption disabled at: [ 21.071509][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 21.071512][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 21.071514][ C0] Tainted: [W]=WARN [ 21.071514][ C0] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 21.071515][ C0] Call Trace: [ 21.071516][ C0] [ 21.071517][ C0] dump_stack_lvl+0x6f/0xa0 [ 21.071519][ C0] ? schedule_preempt_disabled+0x22/0x30 [ 21.071520][ C0] __might_resched.cold+0x1fe/0x2c1 [ 21.071523][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 21.071526][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071528][ C0] __kmalloc_noprof+0x443/0x760 [ 21.071530][ C0] ? __rwlock_init+0x150/0x150 [ 21.071532][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 21.071534][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 21.071536][ C0] alloc_buf.isra.0+0x4b/0x260 [ 21.071539][ C0] put_chars+0x1e1/0x2f0 [ 21.071541][ C0] ? __send_to_port+0x420/0x420 [ 21.071544][ C0] hvc_console_print+0x292/0x780 [ 21.071546][ C0] ? mark_usage+0x42/0x170 [ 21.071548][ C0] ? __lock_acquire+0x388/0xc20 [ 21.071550][ C0] ? hvc_write+0x3a0/0x3a0 [ 21.071552][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 21.071554][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071556][ C0] ? lock_acquire+0x13c/0x160 [ 21.071558][ C0] console_emit_next_record+0x252/0x4f0 [ 21.071560][ C0] ? devkmsg_read+0x4e0/0x4e0 [ 21.071562][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071564][ C0] ? lock_acquire+0x13c/0x160 [ 21.071566][ C0] console_flush_one_record+0x46f/0x710 [ 21.071568][ C0] ? console_emit_next_record+0x4f0/0x4f0 [ 21.071570][ C0] ? __lock_acquire+0x518/0xc20 [ 21.071572][ C0] console_unlock+0xee/0x1f0 [ 21.071574][ C0] ? console_flush_one_record+0x710/0x710 [ 21.071576][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071578][ C0] ? lock_acquire+0xa0/0x160 [ 21.071580][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 21.071581][ C0] ? vprintk_emit+0x320/0x3e0 [ 21.071583][ C0] vprintk_emit+0x37c/0x3e0 [ 21.071585][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 21.071588][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 21.071590][ C0] _printk+0xc7/0x100 [ 21.071591][ C0] ? snapshot_read.cold+0x21/0x21 [ 21.071593][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 21.071595][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071597][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.071599][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071601][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071602][ C0] call_timer_fn+0x160/0x4d0 [ 21.071604][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 21.071606][ C0] ? debug_object_active_state+0x430/0x430 [ 21.071607][ C0] ? find_held_lock+0x2b/0x80 [ 21.071609][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071611][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071613][ C0] __run_timers+0x68f/0xaa0 [ 21.071615][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.071617][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 21.071619][ C0] ? __lock_acquire+0x518/0xc20 [ 21.071621][ C0] ? __rwlock_init+0x150/0x150 [ 21.071624][ C0] run_timer_softirq+0xf0/0x160 [ 21.071626][ C0] ? __run_timers+0xaa0/0xaa0 [ 21.071628][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.071629][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071631][ C0] handle_softirqs+0x1d3/0x900 [ 21.071633][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.071634][ C0] ? _local_bh_enable+0xc0/0xc0 [ 21.071636][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.071638][ C0] irq_exit_rcu+0xe/0x30 [ 21.071639][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.071641][ C0] [ 21.071642][ C0] [ 21.071642][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 21.071644][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.071645][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 21.071648][ C0] Code: 48 8b 3d 94 52 73 02 e8 1f 00 00 00 48 2b 05 58 e3 ae 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 76 1e 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 21.071649][ C0] RSP: 0018:ffffffffa3c07cf8 EFLAGS: 00000296 [ 21.071650][ C0] RAX: 0000000000082daf RBX: ffffffffa3c1c600 RCX: ffffffffa03103a7 [ 21.071651][ C0] RDX: ffffffffa3c1c600 RSI: ffffffffa34f7c2a RDI: ffffffffa2e913e0 [ 21.071652][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 21.071652][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff4780fa2 [ 21.071653][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 21.071654][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071657][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 21.071659][ C0] default_idle+0x9/0x10 [ 21.071661][ C0] default_idle_call+0x6e/0xb0 [ 21.071662][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 21.071663][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 21.071665][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 21.071666][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.071668][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.071670][ C0] do_idle+0xd8/0x190 [ 21.071671][ C0] cpu_startup_entry+0x53/0x70 [ 21.071673][ C0] rest_init+0x279/0x280 [ 21.071674][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 21.071677][ C0] ? rest_init+0x280/0x280 [ 21.071678][ C0] ? acpi_hw_write_port+0x5c/0xe0 [ 21.071683][ C0] ? acpi_enable+0x112/0x330 [ 21.071685][ C0] start_kernel+0x3af/0x3b0 [ 21.071688][ C0] x86_64_start_reservations+0x24/0x30 [ 21.071690][ C0] x86_64_start_kernel+0x12b/0x130 [ 21.071693][ C0] common_startup_64+0x13e/0x148 [ 21.071696][ C0] [ 33.828466][ T680] Failed to send a RSS delete notification [ 49.189979][ T39] fbnic 0000:01:00.0 enp1s0: Link is Down [ 49.189995][ T39] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 49.189998][ T39] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 39, name: kworker/4:0 [ 49.190000][ T39] preempt_count: 1, expected: 0 [ 49.190001][ T39] RCU nest depth: 0, expected: 0 [ 49.190002][ T39] INFO: lockdep is turned off. [ 49.190003][ T39] irq event stamp: 124 [ 49.190004][ T39] hardirqs last enabled at (123): [] _raw_spin_unlock_irq+0x28/0x50 [ 49.190012][ T39] hardirqs last disabled at (124): [] __schedule+0x1246/0x20e0 [ 49.190024][ T39] softirqs last enabled at (0): [] copy_process+0x1d8f/0x62d0 [ 49.190028][ T39] softirqs last disabled at (0): [<0000000000000000>] 0x0 [ 49.190031][ T39] Preemption disabled at: [ 49.190031][ T39] [] vprintk_emit+0x31b/0x3e0 [ 49.190039][ T39] CPU: 4 UID: 0 PID: 39 Comm: kworker/4:0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 49.190043][ T39] Tainted: [W]=WARN [ 49.190044][ T39] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 49.190046][ T39] Workqueue: events_power_efficient phylink_resolve [ 49.190052][ T39] Call Trace: [ 49.190054][ T39] [ 49.190056][ T39] dump_stack_lvl+0x6f/0xa0 [ 49.190061][ T39] ? vprintk_emit+0x31b/0x3e0 [ 49.190063][ T39] __might_resched.cold+0x1fe/0x2c1 [ 49.190067][ T39] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 49.190070][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190074][ T39] __kmalloc_noprof+0x443/0x760 [ 49.190078][ T39] ? __rwlock_init+0x150/0x150 [ 49.190080][ T39] ? alloc_buf.isra.0+0x4b/0x260 [ 49.190085][ T39] ? do_raw_spin_unlock+0x59/0x250 [ 49.190087][ T39] alloc_buf.isra.0+0x4b/0x260 [ 49.190089][ T39] put_chars+0x1e1/0x2f0 [ 49.190092][ T39] ? __send_to_port+0x420/0x420 [ 49.190094][ T39] ? printk_get_next_message+0x2fe/0x7d0 [ 49.190096][ T39] ? console_prepend_replay+0x20/0x20 [ 49.190098][ T39] ? desc_read+0x219/0x2f0 [ 49.190101][ T39] hvc_console_print+0x292/0x780 [ 49.190105][ T39] ? hvc_write+0x3a0/0x3a0 [ 49.190107][ T39] ? __rwlock_init+0x150/0x150 [ 49.190109][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190110][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190112][ T39] ? lock_acquire+0x13c/0x160 [ 49.190114][ T39] console_emit_next_record+0x252/0x4f0 [ 49.190117][ T39] ? devkmsg_read+0x4e0/0x4e0 [ 49.190120][ T39] ? _prb_read_valid+0x6e0/0x6e0 [ 49.190122][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190125][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190127][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190129][ T39] ? lock_acquire+0x13c/0x160 [ 49.190132][ T39] ? console_flush_one_record+0x111/0x710 [ 49.190135][ T39] console_flush_one_record+0x46f/0x710 [ 49.190138][ T39] ? console_emit_next_record+0x4f0/0x4f0 [ 49.190142][ T39] console_unlock+0xee/0x1f0 [ 49.190144][ T39] ? lock_acquire+0x13c/0x160 [ 49.190147][ T39] ? console_flush_one_record+0x710/0x710 [ 49.190149][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190151][ T39] ? lock_release+0x184/0x1f0 [ 49.190153][ T39] ? lock_acquire+0xa0/0x160 [ 49.190155][ T39] ? sync_exp_reset_tree_hotplug+0x3e0/0x3f0 [ 49.190158][ T39] ? __down_trylock_console_sem+0x5e/0xa0 [ 49.190161][ T39] ? vprintk_emit+0x320/0x3e0 [ 49.190163][ T39] vprintk_emit+0x37c/0x3e0 [ 49.190165][ T39] ? wake_up_klogd_work_func+0x90/0x90 [ 49.190167][ T39] ? wakeup_preempt_fair+0x6cf/0x15d0 [ 49.190170][ T39] dev_vprintk_emit+0x27f/0x2c0 [ 49.190175][ T39] ? device_rename.cold+0xa/0xa [ 49.190177][ T39] ? trace_sched_wakeup+0x9b/0x160 [ 49.190179][ T39] ? _raw_spin_unlock_irq_enable+0x5b/0x90 [ 49.190181][ T39] ? try_to_wake_up+0x153/0x1130 [ 49.190183][ T39] dev_printk_emit+0xb9/0xee [ 49.190185][ T39] ? dev_vprintk_emit+0x2c0/0x2c0 [ 49.190187][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190189][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190191][ T39] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 49.190194][ T39] ? rcu_irq_exit_check_preempt+0x6b/0x290 [ 49.190196][ T39] ? trace_hardirqs_on+0x36/0x40 [ 49.190197][ T39] ? irqentry_exit+0x21c/0x790 [ 49.190201][ T39] __netdev_printk+0x160/0x1d0 [ 49.190205][ T39] netdev_printk+0xdb/0x120 [ 49.190207][ T39] ? __netdev_printk+0x1d0/0x1d0 [ 49.190208][ T39] ? fbnic_rd32+0x39/0x90 [ 49.190211][ T39] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 49.190212][ T39] ? fbnic_mac_link_down_asic+0x75/0x110 [ 49.190215][ T39] ? trace_hardirqs_on+0x36/0x40 [ 49.190217][ T39] ? fbnic_phylink_mac_link_down+0x99/0x120 [ 49.190219][ T39] phylink_resolve+0x5fe/0xde0 [ 49.190220][ T39] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 49.190222][ T39] ? debug_object_deactivate+0x221/0x440 [ 49.190226][ T39] ? phylink_ethtool_ksettings_set+0x1120/0x1120 [ 49.190228][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190229][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190231][ T39] ? lock_acquire+0x13c/0x160 [ 49.190232][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190234][ T39] process_one_work+0xe3e/0x1560 [ 49.190238][ T39] ? __queue_delayed_work+0x470/0x470 [ 49.190240][ T39] ? rcu_is_watching+0x16/0xd0 [ 49.190242][ T39] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 49.190243][ T39] ? do_raw_spin_unlock+0x59/0x250 [ 49.190245][ T39] ? lock_acquire+0x13c/0x160 [ 49.190247][ T39] worker_thread+0x4f1/0xd60 [ 49.190250][ T39] ? rescuer_thread+0x1340/0x1340 [ 49.190252][ T39] kthread+0x367/0x460 [ 49.190255][ T39] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 49.190256][ T39] ? kthread_affine_preferred+0x4c0/0x4c0 [ 49.190258][ T39] ret_from_fork+0x474/0x6b0 [ 49.190261][ T39] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 49.190263][ T39] ? __switch_to+0x5a3/0xe00 [ 49.190266][ T39] ? kthread_affine_preferred+0x4c0/0x4c0 [ 49.190267][ T39] ret_from_fork_asm+0x11/0x20 [ 49.190271][ T39] [ 49.483433][ T1204] fbnic 0000:01:00.0 enp1s0: configuring for inband/100gbase-p link mode [ 49.486202][ T9] fbnic 0000:01:00.0 enp1s0: Link is Up - 100Gbps/Full - flow control rx/tx