virtme: waiting for virtiofsd to start qemu-system-x86_64: warning: hub 0 is not connected to host network [ 1.771900][ T1] loop: module loaded [ 1.771921][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.771921][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.771921][ T1] preempt_count: 1, expected: 0 [ 1.771921][ T1] RCU nest depth: 0, expected: 0 [ 1.771921][ T1] locks held by swapper/0/1: 4, last CPU#3: [ 1.771921][ T1] #0: ffffffffb9599dc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.771921][ T1] #1: ffffffffb9599e38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.771921][ T1] #2: ffffffffb9489760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.771921][ T1] #3: ffffffffb9489660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x202/0x4f0 [ 1.771921][ T1] irq event stamp: 796476 [ 1.771921][ T1] hardirqs last enabled at (796475): [] __down_trylock_console_sem+0x86/0xa0 [ 1.771921][ T1] hardirqs last disabled at (796476): [] console_emit_next_record+0x3f8/0x4f0 [ 1.771921][ T1] softirqs last enabled at (796420): [] bdi_register_va+0x491/0x780 [ 1.771921][ T1] softirqs last disabled at (796418): [] bdi_register_va+0x2ef/0x780 [ 1.771921][ T1] Preemption disabled at: [ 1.771921][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.771921][ T1] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.771921][ T1] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1.771921][ T1] Call Trace: [ 1.771921][ T1] [ 1.771921][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.771921][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.771921][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.771921][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.771921][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.771921][ T1] __kmalloc_noprof+0x443/0x760 [ 1.771921][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.771921][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.771921][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.771921][ T1] put_chars+0x1e1/0x2f0 [ 1.771921][ T1] ? desc_read+0x271/0x2f0 [ 1.771921][ T1] ? __send_to_port+0x420/0x420 [ 1.771921][ T1] hvc_console_print+0x292/0x780 [ 1.771921][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.771921][ T1] ? lock_acquire+0x13c/0x160 [ 1.771921][ T1] console_emit_next_record+0x252/0x4f0 [ 1.771921][ T1] ? devkmsg_read+0x4e0/0x4e0 [ 1.771921][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.771921][ T1] ? lock_acquire+0x13c/0x160 [ 1.771921][ T1] console_flush_one_record+0x46f/0x710 [ 1.771921][ T1] ? console_emit_next_record+0x4f0/0x4f0 [ 1.771921][ T1] ? __lock_acquire+0x518/0xc20 [ 1.771921][ T1] console_unlock+0xee/0x1f0 [ 1.771921][ T1] ? console_flush_one_record+0x710/0x710 [ 1.771921][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.771921][ T1] ? lock_acquire+0xa0/0x160 [ 1.771921][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.771921][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.771921][ T1] vprintk_emit+0x37c/0x3e0 [ 1.771921][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.771921][ T1] ? max_loop_setup+0x30/0x30 [ 1.771921][ T1] _printk+0xc7/0x100 [ 1.771921][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.771921][ T1] ? __mutex_unlock_slowpath+0x14d/0x740 [ 1.771921][ T1] loop_init+0x12a/0x130 [ 1.771921][ T1] do_one_initcall+0x124/0x4f0 [ 1.771921][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.771921][ T1] ? parameq+0x110/0x110 [ 1.771921][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.771921][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.771921][ T1] kernel_init_freeable+0x596/0x630 [ 1.771921][ T1] ? rest_init+0x280/0x280 [ 1.771921][ T1] kernel_init+0x21/0x150 [ 1.771921][ T1] ? rest_init+0x280/0x280 [ 1.771921][ T1] ret_from_fork+0x474/0x6b0 [ 1.771921][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.771921][ T1] ? __switch_to+0x5a3/0xe00 [ 1.771921][ T1] ? rest_init+0x280/0x280 [ 1.771921][ T1] ret_from_fork_asm+0x11/0x20 [ 1.771921][ T1] [ 1.817573][ T1] ACPI: \_SB_.GSIA: Enabled at IRQ 16 [ 1.820306][ T1] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode [ 1.820860][ T1] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 1.821623][ T1] ahci 0000:00:1f.2: flags: 64bit ncq only [ 1.837914][ T1] scsi host0: ahci [ 1.841108][ T1] scsi host1: ahci [ 1.844018][ T1] scsi host2: ahci [ 1.846873][ T1] scsi host3: ahci [ 1.849795][ T1] scsi host4: ahci [ 1.852765][ T1] scsi host5: ahci [ 1.854584][ T1] ata1: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444100 irq 30 lpm-pol 1 [ 1.855166][ T1] ata2: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444180 irq 30 lpm-pol 1 [ 1.855557][ T1] ata3: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444200 irq 30 lpm-pol 1 [ 1.855958][ T1] ata4: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444280 irq 30 lpm-pol 1 [ 1.856348][ T1] ata5: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444300 irq 30 lpm-pol 1 [ 1.856755][ T1] ata6: SATA max UDMA/133 abar m4096@0xfe444000 port 0xfe444380 irq 30 lpm-pol 1 [ 1.871347][ T1] e1000: Intel(R) PRO/1000 Network Driver [ 1.871549][ T1] e1000: Copyright (c) 1999-2006 Intel Corporation. [ 1.872070][ T1] e1000e: Intel(R) PRO/1000 Network Driver [ 1.872278][ T1] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. [ 1.872740][ T1] sky2: driver version 1.30 fbnic-err: bad register access fbnic_mac_read_rxb address 0x80e9 [ 2.009409][ T101] kwatchdog (101) used greatest stack depth: 28672 bytes left [ 2.077456][ T1] Meta(R) Host Network Interface Driver (fbnic) [ 2.078236][ T1] PPP generic driver version 2.4.2 [ 2.079278][ T1] NET: Registered PF_PPPOX protocol family [ 2.080030][ T1] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.082474][ T1] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.083705][ T1] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.087227][ T1] rtc_cmos PNP0B00:00: RTC can wake from S4 [ 2.089244][ T65] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.092675][ T1] rtc_cmos PNP0B00:00: registered as rtc0 [ 2.093095][ T1] rtc_cmos PNP0B00:00: setting system clock to 2026-08-28T08:41:23 UTC (1787906483) [ 2.094043][ T1] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.094912][ T65] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3 [ 2.097387][ T1] i6300ESB timer 0000:00:02.0: initialized. heartbeat=30 sec (nowayout=0) [ 2.098906][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 2.106203][ T1] ipip: IPv4 and MPLS over IPv4 tunneling driver [ 2.109245][ T1] gre: GRE over IPv4 demultiplexer driver [ 2.109422][ T1] ip_gre: GRE over IPv4 tunneling driver [ 2.117676][ T1] Initializing XFRM netlink socket [ 2.118749][ T1] NET: Registered PF_INET6 protocol family [ 2.125537][ T1] Segment Routing with IPv6 [ 2.125955][ T1] In-situ OAM (IOAM) with IPv6 [ 2.126335][ T1] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver [ 2.133084][ T1] ip6_gre: GRE over IPv6 tunneling driver [ 2.136453][ T1] NET: Registered PF_PACKET protocol family [ 2.136777][ T1] 9pnet: Installing 9P2000 support [ 2.137314][ T1] Key type dns_resolver registered [ 2.137951][ T1] NET: Registered PF_VSOCK protocol family [ 2.143987][ T1] IPI shorthand broadcast: enabled [ 2.167433][ T80] ata1: SATA link down (SStatus 0 SControl 300) [ 2.175503][ T82] ata2: SATA link down (SStatus 0 SControl 300) [ 2.176299][ T90] ata6: SATA link down (SStatus 0 SControl 300) [ 2.176828][ T88] ata5: SATA link down (SStatus 0 SControl 300) [ 2.177376][ T86] ata4: SATA link down (SStatus 0 SControl 300) [ 2.177899][ T84] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) [ 2.178403][ T84] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 [ 2.178679][ T84] ata3.00: applying bridge limits [ 2.179124][ T84] ata3.00: configured for UDMA/100 [ 2.181148][ T92] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 [ 2.196584][ T92] scsi 2:0:0:0: Attached scsi generic sg0 type 5 [ 2.244614][ T1] sched_clock: Marking stable (2219002450, 24920246)->(2356058582, -112135886) [ 2.248030][ T1] registered taskstats version 1 [ 2.251681][ T1] Loading compiled-in X.509 certificates [ 2.351763][ T1] Demotion targets for Node 0: null [ 2.352083][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 11277) [ 2.352392][ T1] page_owner is disabled [ 2.361188][ T1] PM: Magic number: 6:98:676 [ 2.363803][ T1] ALSA device list: [ 2.364697][ T1] No soundcards found. [ 2.365350][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 2.368026][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 2.368717][ T1] devtmpfs: mounted [ 2.369000][ T1] VFS: Pivoted into new rootfs [ 2.395786][ T1] Freeing unused kernel image (initmem) memory: 2592K [ 2.396048][ T1] Write protecting the kernel read-only data: 65536k [ 2.396746][ T1] Freeing unused kernel image (text/rodata gap) memory: 1152K [ 2.397204][ T1] Freeing unused kernel image (rodata/data gap) memory: 624K [ 2.397530][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 2.397865][ T1] with arguments: [ 2.398010][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 2.398319][ T1] with environment: [ 2.398455][ T1] HOME=/ [ 2.398633][ T1] TERM=dumb [ 2.398763][ T1] virtme_hostname=vmksft-fbnic-qemu-dbg,debug-threads=on [ 2.399031][ T1] nr_open=2147483584 [ 2.399155][ T1] virtme_link_mods=/srv/vmksft/testing/wt-24/.virtme_mods/lib/modules/0.0.0 [ 2.399502][ T1] virtme_rw_overlay0=/etc [ 2.399715][ T1] virtme_rw_overlay1=/lib [ 2.399887][ T1] virtme_rw_overlay2=/home [ 2.402686][ T1] virtme_rw_overlay3=/opt [ 2.403153][ T1] virtme_rw_overlay4=/srv [ 2.403602][ T1] virtme_rw_overlay5=/usr [ 2.404070][ T1] virtme_rw_overlay6=/var [ 2.404962][ T1] virtme_rw_overlay7=/tmp [ 2.405374][ T1] virtme_console=ttyS0 [ 2.405693][ T1] virtme_chdir=srv/vmksft/testing/wt-24 [ 2.424185][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 2.426525][ T1] virtme-ng-init: Setting hostname to vmksft-fbnic-qemu-dbg,debug-threads=on... [ 2.440056][ T1] overlayfs: failed to set xattr on upper [ 2.440468][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.440894][ T1] overlayfs: ...falling back to uuid=null. [ 2.443860][ T1] overlayfs: failed to set xattr on upper [ 2.444234][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.444612][ T1] overlayfs: ...falling back to uuid=null. [ 2.447260][ T1] overlayfs: failed to set xattr on upper [ 2.447570][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.447951][ T1] overlayfs: ...falling back to uuid=null. [ 2.450620][ T1] overlayfs: failed to set xattr on upper [ 2.450942][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.451310][ T1] overlayfs: ...falling back to uuid=null. [ 2.454127][ T1] overlayfs: failed to set xattr on upper [ 2.454442][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.454813][ T1] overlayfs: ...falling back to uuid=null. [ 2.457312][ T1] overlayfs: failed to set xattr on upper [ 2.457617][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.459207][ T1] overlayfs: ...falling back to uuid=null. [ 2.461804][ T1] overlayfs: failed to set xattr on upper [ 2.463008][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.463389][ T1] overlayfs: ...falling back to uuid=null. [ 2.466041][ T1] overlayfs: failed to set xattr on upper [ 2.466361][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 2.466729][ T1] overlayfs: ...falling back to uuid=null. [ 2.481597][ T1] virtme-ng-init: running systemd-tmpfiles [ 4.340743][ T111] systemd-tmpfile (111) used greatest stack depth: 24928 bytes left [ 4.340760][ T111] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 4.340762][ T111] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 111, name: systemd-tmpfile [ 4.340764][ T111] preempt_count: 2, expected: 0 [ 4.340764][ T111] RCU nest depth: 0, expected: 0 [ 4.340765][ T111] locks held by systemd-tmpfile/111: 5, last CPU#5: [ 4.340767][ T111] #0: ffffffffb94027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 4.340779][ T111] #1: ffffffffb9599dc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 4.340785][ T111] #2: ffffffffb9599e38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 4.340789][ T111] #3: ffffffffb9489760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 4.340792][ T111] #4: ffffffffb9489660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x202/0x4f0 [ 4.340796][ T111] irq event stamp: 2195286 [ 4.340797][ T111] hardirqs last enabled at (2195285): [] __down_trylock_console_sem+0x86/0xa0 [ 4.340799][ T111] hardirqs last disabled at (2195286): [] console_emit_next_record+0x3f8/0x4f0 [ 4.340801][ T111] softirqs last enabled at (2192090): [] handle_softirqs+0x67c/0x900 [ 4.340803][ T111] softirqs last disabled at (2191931): [] __irq_exit_rcu+0x145/0x1c0 [ 4.340805][ T111] Preemption disabled at: [ 4.340806][ T111] [<0000000000000000>] 0x0 [ 4.340812][ T111] CPU: 5 UID: 0 PID: 111 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 4.340816][ T111] Tainted: [W]=WARN [ 4.340816][ T111] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4.340818][ T111] Call Trace: [ 4.340819][ T111] [ 4.340821][ T111] dump_stack_lvl+0x6f/0xa0 [ 4.340827][ T111] __might_resched.cold+0x1fe/0x2c1 [ 4.340832][ T111] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 4.340836][ T111] ? __kmalloc_noprof+0xdb/0x760 [ 4.340841][ T111] __kmalloc_noprof+0x443/0x760 [ 4.340843][ T111] ? alloc_buf.isra.0+0x4b/0x260 [ 4.340849][ T111] ? do_raw_spin_unlock+0x59/0x250 [ 4.340852][ T111] alloc_buf.isra.0+0x4b/0x260 [ 4.340856][ T111] put_chars+0x1e1/0x2f0 [ 4.340859][ T111] ? __send_to_port+0x420/0x420 [ 4.340861][ T111] ? printk_get_next_message+0x2fe/0x7d0 [ 4.340864][ T111] ? rcu_read_lock_any_held+0x3c/0x90 [ 4.340867][ T111] ? validate_chain+0x38b/0xc20 [ 4.340871][ T111] hvc_console_print+0x292/0x780 [ 4.340874][ T111] ? __lock_acquire+0x518/0xc20 [ 4.340876][ T111] ? __lock_acquire+0x518/0xc20 [ 4.340880][ T111] ? hvc_write+0x3a0/0x3a0 [ 4.340883][ T111] ? rcu_is_watching+0x16/0xd0 [ 4.340886][ T111] ? lock_acquire+0x13c/0x160 [ 4.340890][ T111] console_emit_next_record+0x252/0x4f0 [ 4.340893][ T111] ? devkmsg_read+0x4e0/0x4e0 [ 4.340902][ T111] ? rcu_is_watching+0x16/0xd0 [ 4.340904][ T111] ? lock_acquire+0x13c/0x160 [ 4.340908][ T111] console_flush_one_record+0x46f/0x710 [ 4.340912][ T111] ? console_emit_next_record+0x4f0/0x4f0 [ 4.340913][ T111] ? __lock_acquire+0x518/0xc20 [ 4.340920][ T111] console_unlock+0xee/0x1f0 [ 4.340923][ T111] ? console_flush_one_record+0x710/0x710 [ 4.340924][ T111] ? rcu_is_watching+0x16/0xd0 [ 4.340927][ T111] ? lock_acquire+0xa0/0x160 [ 4.340930][ T111] ? __down_trylock_console_sem+0x5e/0xa0 [ 4.340932][ T111] ? vprintk_emit+0x320/0x3e0 [ 4.340935][ T111] vprintk_emit+0x37c/0x3e0 [ 4.340938][ T111] ? wake_up_klogd_work_func+0x90/0x90 [ 4.340942][ T111] ? __lock_acquire+0x518/0xc20 [ 4.340945][ T111] _printk+0xc7/0x100 [ 4.340948][ T111] ? snapshot_read.cold+0x21/0x21 [ 4.340951][ T111] ? do_raw_spin_lock+0x131/0x280 [ 4.340954][ T111] ? __rwlock_init+0x150/0x150 [ 4.340957][ T111] ? do_raw_spin_lock+0x131/0x280 [ 4.340960][ T111] do_exit.cold+0x82/0x9c [ 4.340963][ T111] ? exit_notify+0x890/0x890 [ 4.340965][ T111] ? __lock_release.isra.0+0x69/0x1a0 [ 4.340968][ T111] ? rcu_is_watching+0x16/0xd0 [ 4.340970][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 4.340970][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 4.340970][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 4.340970][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 4.340972][ T111] do_group_exit+0xb8/0x370 [ 4.340975][ T111] __x64_sys_exit_group+0x3c/0x50 [ 4.340977][ T111] x64_sys_call+0x1567/0x1570 [ 4.340980][ T111] do_syscall_64+0xff/0x530 [ 4.340983][ T111] ? exc_page_fault+0xee/0x100 [ 4.340987][ T111] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4.340989][ T111] RIP: 0033:0x7fc8302981b8 [ 4.340991][ T111] Code: Unable to access opcode bytes at 0x7fc83029818e. [ 4.340992][ T111] RSP: 002b:00007fff9cb00ad8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 4.340994][ T111] RAX: ffffffffffffffda RBX: 00007fc8303c8f88 RCX: 00007fc8302981b8 [ 4.340996][ T111] RDX: 00007fc82faf64c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 4.340997][ T111] RBP: 00007fff9cb00b30 R08: 0000000000000000 R09: 0000000000001000 [ 4.340997][ T111] R10: 00007fff9cb008f0 R11: 0000000000000246 R12: 0000000000000001 [ 4.340998][ T111] R13: 0000000000000049 R14: 00007fc8303c7680 R15: 00007fc8303c8fa0 [ 4.341005][ T111] [ 4.359379][ T1] virtme-ng-init: basic initialization done [ 4.393117][ T116] ip (116) used greatest stack depth: 23840 bytes left [ 4.411115][ T112] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 4.411504][ T112] virtme-ng-init: triggering udev coldplug [ 7.235973][ T112] virtme-ng-init: waiting for udev to settle [ 7.235988][ T112] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 7.235990][ T112] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 112, name: virtme-ng-init [ 7.235992][ T112] preempt_count: 1, expected: 0 [ 7.235993][ T112] RCU nest depth: 0, expected: 0 [ 7.235994][ T112] locks held by virtme-ng-init/112: 4, last CPU#2: [ 7.235996][ T112] #0: ffffffffb9599dc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 7.236009][ T112] #1: ffffffffb9599e38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 7.236013][ T112] #2: ffffffffb9489760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 7.236017][ T112] #3: ffffffffb9489660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x202/0x4f0 [ 7.236021][ T112] irq event stamp: 3164 [ 7.236022][ T112] hardirqs last enabled at (3163): [] __down_trylock_console_sem+0x86/0xa0 [ 7.236024][ T112] hardirqs last disabled at (3164): [] console_emit_next_record+0x3f8/0x4f0 [ 7.236026][ T112] softirqs last enabled at (3128): [] handle_softirqs+0x67c/0x900 [ 7.236029][ T112] softirqs last disabled at (3119): [] __irq_exit_rcu+0x145/0x1c0 [ 7.236031][ T112] Preemption disabled at: [ 7.236032][ T112] [] vprintk_emit+0x31b/0x3e0 [ 7.236037][ T112] CPU: 2 UID: 0 PID: 112 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 7.236041][ T112] Tainted: [W]=WARN [ 7.236042][ T112] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7.236043][ T112] Call Trace: [ 7.236045][ T112] [ 7.236046][ T112] dump_stack_lvl+0x6f/0xa0 [ 7.236052][ T112] ? vprintk_emit+0x31b/0x3e0 [ 7.236054][ T112] __might_resched.cold+0x1fe/0x2c1 [ 7.236058][ T112] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 7.236062][ T112] ? __kmalloc_noprof+0xdb/0x760 [ 7.236068][ T112] __kmalloc_noprof+0x443/0x760 [ 7.236070][ T112] ? alloc_buf.isra.0+0x4b/0x260 [ 7.236076][ T112] ? do_raw_spin_unlock+0x59/0x250 [ 7.236079][ T112] alloc_buf.isra.0+0x4b/0x260 [ 7.236083][ T112] put_chars+0x1e1/0x2f0 [ 7.236086][ T112] ? __send_to_port+0x420/0x420 [ 7.236088][ T112] ? printk_get_next_message+0x2fe/0x7d0 [ 7.236092][ T112] ? rcu_read_lock_any_held+0x3c/0x90 [ 7.236094][ T112] ? validate_chain+0x38b/0xc20 [ 7.236098][ T112] hvc_console_print+0x292/0x780 [ 7.236102][ T112] ? __lock_acquire+0x518/0xc20 [ 7.236104][ T112] ? __lock_acquire+0x518/0xc20 [ 7.236108][ T112] ? hvc_write+0x3a0/0x3a0 [ 7.236111][ T112] ? rcu_is_watching+0x16/0xd0 [ 7.236114][ T112] ? lock_acquire+0x13c/0x160 [ 7.236118][ T112] console_emit_next_record+0x252/0x4f0 [ 7.236122][ T112] ? devkmsg_read+0x4e0/0x4e0 [ 7.236126][ T112] ? rcu_is_watching+0x16/0xd0 [ 7.236129][ T112] ? lock_acquire+0x13c/0x160 [ 7.236132][ T112] console_flush_one_record+0x46f/0x710 [ 7.236137][ T112] ? console_emit_next_record+0x4f0/0x4f0 [ 7.236138][ T112] ? __lock_acquire+0x518/0xc20 [ 7.236143][ T112] console_unlock+0xee/0x1f0 [ 7.236146][ T112] ? console_flush_one_record+0x710/0x710 [ 7.236148][ T112] ? rcu_is_watching+0x16/0xd0 [ 7.236150][ T112] ? lock_acquire+0xa0/0x160 [ 7.236154][ T112] ? __down_trylock_console_sem+0x5e/0xa0 [ 7.236155][ T112] ? vprintk_emit+0x320/0x3e0 [ 7.236159][ T112] vprintk_emit+0x37c/0x3e0 [ 7.236162][ T112] ? wake_up_klogd_work_func+0x90/0x90 [ 7.236166][ T112] ? _copy_from_iter+0x1bb/0x1810 [ 7.236171][ T112] devkmsg_emit.constprop.0+0xbc/0xf1 [ 7.236175][ T112] ? vprintk_emit.cold+0x107/0x107 [ 7.236177][ T112] ? simple_strntoull+0x10f/0x140 [ 7.236182][ T112] ? date_str+0x1e0/0x1e0 [ 7.236185][ T112] ? devkmsg_write+0xd1/0x2c0 [ 7.236189][ T112] devkmsg_write.cold+0x5a/0x8b [ 7.236192][ T112] ? vprintk_default+0x20/0x20 [ 7.236197][ T112] ? vprintk_default+0x20/0x20 [ 7.236199][ T112] new_sync_write+0x33e/0x760 [ 7.236203][ T112] ? kasan_quarantine_put+0x102/0x2b0 [ 7.236207][ T112] ? new_sync_read+0x750/0x750 [ 7.236211][ T112] ? __lock_release.isra.0+0x69/0x1a0 [ 7.236216][ T112] ? __fget_files+0x1e3/0x460 [ 7.236220][ T112] vfs_write+0x6a2/0xbd0 [ 7.236224][ T112] ksys_write+0x116/0x250 [ 7.236227][ T112] ? __ia32_sys_read+0xc0/0xc0 [ 7.236229][ T112] ? rcu_is_watching+0x16/0xd0 [ 7.236233][ T112] do_syscall_64+0xff/0x530 [ 7.236235][ T112] ? exc_page_fault+0xee/0x100 [ 7.236239][ T112] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 7.236241][ T112] RIP: 0033:0x7fc3adbd8ed2 [ 7.236245][ T112] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 7.236246][ T112] RSP: 002b:00007fc3adb1fc68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 7.236249][ T112] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007fc3adbd8ed2 [ 7.236250][ T112] RDX: 000000000000002e RSI: 00007fc3a8001090 RDI: 0000000000000003 [ 7.236251][ T112] RBP: 00007fc3adb1fc90 R08: 0000000000000000 R09: 0000000000000000 [ 7.236252][ T112] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fc3adc630a0 [ 7.236253][ T112] R13: 00007fc3adb613e0 R14: 00007fc3a8001090 R15: 00007fc3adb1fda8 [ 7.236259][ T112] [ 7.364642][ T125] virtio_net virtio2 enp0s4: renamed from eth0 [ 7.430615][ T126] fbnic 0000:01:00.0 enp1s0: renamed from eth1 [ 8.042812][ T112] virtme-ng-init: udev is done [ 8.044910][ T1] virtme-ng-init: initialization done [ 9.966647][ T187] fbnic 0000:01:00.0 enp1s0: configuring for inband/100gbase-p link mode [ 9.966667][ T187] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 9.966669][ T187] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 187, name: ip [ 9.966671][ T187] preempt_count: 1, expected: 0 [ 9.966672][ T187] RCU nest depth: 0, expected: 0 [ 9.966673][ T187] locks held by ip/187: 6, last CPU#5: [ 9.966675][ T187] #0: ffffffffb9d5f900 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x9a8/0x11b0 [ 9.966687][ T187] #1: ff110000083c4df0 (&dev->lock){+.+.}-{4:4}, at: do_setlink.isra.0+0x27a/0x2a60 [ 9.966692][ T187] #2: ffffffffb9599dc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 9.966697][ T187] #3: ffffffffb9599e38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 9.966701][ T187] #4: ffffffffb9489760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 9.966704][ T187] #5: ffffffffb9489660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x202/0x4f0 [ 9.966708][ T187] irq event stamp: 79528 [ 9.966709][ T187] hardirqs last enabled at (79527): [] __down_trylock_console_sem+0x86/0xa0 [ 9.966712][ T187] hardirqs last disabled at (79528): [] console_emit_next_record+0x3f8/0x4f0 [ 9.966714][ T187] softirqs last enabled at (79322): [] handle_softirqs+0x67c/0x900 [ 9.966717][ T187] softirqs last disabled at (79231): [] __irq_exit_rcu+0x145/0x1c0 [ 9.966719][ T187] Preemption disabled at: [ 9.966720][ T187] [] vprintk_emit+0x31b/0x3e0 [ 9.966726][ T187] CPU: 5 UID: 0 PID: 187 Comm: ip Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 9.966729][ T187] Tainted: [W]=WARN [ 9.966730][ T187] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9.966732][ T187] Call Trace: [ 9.966734][ T187] [ 9.966736][ T187] dump_stack_lvl+0x6f/0xa0 [ 9.966742][ T187] ? vprintk_emit+0x31b/0x3e0 [ 9.966744][ T187] __might_resched.cold+0x1fe/0x2c1 [ 9.966749][ T187] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 9.966753][ T187] ? __kmalloc_noprof+0xdb/0x760 [ 9.966758][ T187] __kmalloc_noprof+0x443/0x760 [ 9.966760][ T187] ? alloc_buf.isra.0+0x4b/0x260 [ 9.966767][ T187] ? do_raw_spin_unlock+0x59/0x250 [ 9.966770][ T187] alloc_buf.isra.0+0x4b/0x260 [ 9.966774][ T187] put_chars+0x1e1/0x2f0 [ 9.966777][ T187] ? __send_to_port+0x420/0x420 [ 9.966779][ T187] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 9.966784][ T187] ? rcu_read_lock_any_held+0x3c/0x90 [ 9.966786][ T187] ? validate_chain+0x38b/0xc20 [ 9.966791][ T187] hvc_console_print+0x292/0x780 [ 9.966794][ T187] ? __lock_acquire+0x518/0xc20 [ 9.966800][ T187] ? hvc_write+0x3a0/0x3a0 [ 9.966803][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.966808][ T187] console_emit_next_record+0x252/0x4f0 [ 9.966812][ T187] ? devkmsg_read+0x4e0/0x4e0 [ 9.966816][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.966819][ T187] ? lock_acquire+0x13c/0x160 [ 9.966823][ T187] console_flush_one_record+0x46f/0x710 [ 9.966827][ T187] ? console_emit_next_record+0x4f0/0x4f0 [ 9.966828][ T187] ? __lock_acquire+0x518/0xc20 [ 9.966834][ T187] console_unlock+0xee/0x1f0 [ 9.966837][ T187] ? console_flush_one_record+0x710/0x710 [ 9.966839][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.966841][ T187] ? lock_acquire+0xa0/0x160 [ 9.966845][ T187] ? __down_trylock_console_sem+0x5e/0xa0 [ 9.966846][ T187] ? vprintk_emit+0x320/0x3e0 [ 9.966850][ T187] vprintk_emit+0x37c/0x3e0 [ 9.966854][ T187] ? wake_up_klogd_work_func+0x90/0x90 [ 9.966856][ T187] ? __lock_release.isra.0+0x69/0x1a0 [ 9.966858][ T187] ? do_raw_read_unlock+0x70/0x70 [ 9.966862][ T187] dev_vprintk_emit+0x27f/0x2c0 [ 9.966867][ T187] ? device_rename.cold+0xa/0xa [ 9.966872][ T187] ? proc_mkdir+0xf6/0x160 [ 9.966875][ T187] ? __lock_release.isra.0+0x69/0x1a0 [ 9.966877][ T187] ? proc_create_mount_point+0x160/0x160 [ 9.966882][ T187] dev_printk_emit+0xb9/0xee [ 9.966884][ T187] ? dev_vprintk_emit+0x2c0/0x2c0 [ 9.966888][ T187] ? irq_seq_stop+0x120/0x120 [ 9.966890][ T187] ? proc_create_mount_point+0x160/0x160 [ 9.966900][ T187] __netdev_printk+0x160/0x1d0 [ 9.966906][ T187] netdev_printk+0xdb/0x120 [ 9.966909][ T187] ? __netdev_printk+0x1d0/0x1d0 [ 9.966915][ T187] ? fbnic_irq_test+0x1c0/0x1c0 [ 9.966921][ T187] phylink_start.cold+0x74/0x92 [ 9.966924][ T187] ? rtnl_is_locked+0x15/0x20 [ 9.966933][ T187] __fbnic_open+0x153/0x190 [ 9.966936][ T187] fbnic_open+0x47/0x70 [ 9.966939][ T187] __dev_open+0x322/0x7a0 [ 9.966942][ T187] ? netif_state_change+0x3d0/0x3d0 [ 9.966943][ T187] ? __lock_release.isra.0+0x69/0x1a0 [ 9.966946][ T187] ? mark_held_locks+0x40/0x70 [ 9.966950][ T187] __dev_change_flags+0x4a4/0x6d0 [ 9.966953][ T187] ? netif_set_allmulti+0x2c0/0x2c0 [ 9.966956][ T187] ? __kernel_text_address+0x12/0x30 [ 9.966959][ T187] ? write_profile+0xf0/0xf0 [ 9.966964][ T187] netif_change_flags+0x87/0x190 [ 9.966967][ T187] ? do_setlink.isra.0+0x27a/0x2a60 [ 9.966969][ T187] do_setlink.isra.0+0x1d25/0x2a60 [ 9.966972][ T187] ? stack_trace_save+0x93/0xc0 [ 9.966974][ T187] ? rtnl_link_get_size+0x350/0x350 [ 9.966976][ T187] ? rcu_read_lock_any_held+0x66/0x90 [ 9.966978][ T187] ? stack_depot_save_flags+0x38e/0x790 [ 9.966982][ T187] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 9.966985][ T187] ? rcu_read_lock_any_held+0x3c/0x90 [ 9.966987][ T187] ? validate_chain+0x38b/0xc20 [ 9.966989][ T187] ? kasan_save_stack+0x3d/0x50 [ 9.966992][ T187] ? kasan_save_stack+0x2f/0x50 [ 9.966994][ T187] ? kasan_save_track+0x14/0x30 [ 9.966997][ T187] ? __lock_acquire+0x518/0xc20 [ 9.966999][ T187] ? netlink_setsockopt+0x7cd/0x940 [ 9.967002][ T187] ? ___sys_sendmsg+0x80/0x1d0 [ 9.967007][ T187] ? lock_acquire.part.0+0xd4/0x280 [ 9.967008][ T187] ? rtnl_newlink+0x9a8/0x11b0 [ 9.967011][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.967014][ T187] ? lock_acquire+0x13c/0x160 [ 9.967015][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.967017][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.967019][ T187] ? trace_contention_end+0xb3/0x180 [ 9.967023][ T187] ? __mutex_lock+0x1db/0x1ea0 [ 9.967026][ T187] ? __mutex_lock+0x9a3/0x1ea0 [ 9.967028][ T187] ? rtnl_newlink+0x9a8/0x11b0 [ 9.967032][ T187] ? ww_mutex_lock+0x160/0x160 [ 9.967037][ T187] ? __rtnl_newlink+0x3fa/0xa50 [ 9.967043][ T187] rtnl_newlink+0x9f1/0x11b0 [ 9.967049][ T187] ? rtnl_bridge_getlink+0x850/0x850 [ 9.967051][ T187] ? __lock_acquire+0x518/0xc20 [ 9.967056][ T187] ? lock_acquire.part.0+0xd4/0x280 [ 9.967057][ T187] ? find_held_lock+0x2b/0x80 [ 9.967059][ T187] ? rtnl_bridge_getlink+0x850/0x850 [ 9.967061][ T187] ? __lock_release.isra.0+0x69/0x1a0 [ 9.967065][ T187] ? rtnl_bridge_getlink+0x850/0x850 [ 9.967067][ T187] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 9.967071][ T187] ? rtnl_link_fill+0x900/0x900 [ 9.967073][ T187] ? __lock_acquire+0x518/0xc20 [ 9.967077][ T187] ? lock_acquire.part.0+0xd4/0x280 [ 9.967079][ T187] ? find_held_lock+0x2b/0x80 [ 9.967082][ T187] netlink_rcv_skb+0x14e/0x3a0 [ 9.967084][ T187] ? rtnl_link_fill+0x900/0x900 [ 9.967088][ T187] ? netlink_ack+0xcd0/0xcd0 [ 9.967094][ T187] ? netlink_deliver_tap+0xc5/0x330 [ 9.967096][ T187] ? netlink_deliver_tap+0x13c/0x330 [ 9.967101][ T187] netlink_unicast+0x486/0x750 [ 9.967105][ T187] ? netlink_attachskb+0x810/0x810 [ 9.967108][ T187] ? __lock_acquire+0x518/0xc20 [ 9.967112][ T187] netlink_sendmsg+0x735/0xc60 [ 9.967116][ T187] ? netlink_unicast+0x750/0x750 [ 9.967121][ T187] ? __might_fault+0x97/0x140 [ 9.967126][ T187] ____sys_sendmsg+0x415/0x880 [ 9.967129][ T187] ? copy_msghdr_from_user+0x279/0x420 [ 9.967131][ T187] ? get_timestamp.constprop.0+0x3a0/0x3a0 [ 9.967133][ T187] ? move_addr_to_kernel+0x40/0x40 [ 9.967141][ T187] ___sys_sendmsg+0x14e/0x1d0 [ 9.967144][ T187] ? copy_msghdr_from_user+0x420/0x420 [ 9.967159][ T187] __sys_sendmsg+0x12c/0x1d0 [ 9.967162][ T187] ? __sys_sendmsg_sock+0x20/0x20 [ 9.967168][ T187] ? rcu_is_watching+0x16/0xd0 [ 9.967171][ T187] do_syscall_64+0xff/0x530 [ 9.967174][ T187] ? exc_page_fault+0xee/0x100 [ 9.967177][ T187] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 9.967180][ T187] RIP: 0033:0x7fad98d4454e [ 9.967184][ T187] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 9.967186][ T187] RSP: 002b:00007ffeafbe8f60 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 9.967188][ T187] RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00007fad98d4454e [ 9.967190][ T187] RDX: 0000000000000000 RSI: 00007ffeafbe9010 RDI: 0000000000000003 [ 9.967191][ T187] RBP: 00007ffeafbe8f70 R08: 0000000000000000 R09: 0000000000000000 [ 9.967192][ T187] R10: 0000000000000000 R11: 0000000000000202 R12: 000000006a9149bc [ 9.967193][ T187] R13: 00000000004a1620 R14: 0000000000000000 R15: 00007ffeafbe96d0 [ 9.967200][ T187] [ 10.009064][ C0] clocksource: Watchdog remote CPU 5 read timed out [ 10.009092][ C0] [ 10.009094][ C0] ======================================================== [ 10.009095][ C0] WARNING: possible irq lock inversion dependency detected [ 10.009097][ C0] 7.2.0-virtme #1 Tainted: G W [ 10.009098][ C0] -------------------------------------------------------- [ 10.009099][ C0] (udev-worker)/119 just changed the state of lock: [ 10.009100][ C0] ffffffffb9489760 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 10.009112][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 10.009113][ C0] (fs_reclaim){+.+.}-{0:0} [ 10.009115][ C0] [ 10.009115][ C0] [ 10.009115][ C0] and interrupts could create inverse lock ordering between them. [ 10.009115][ C0] [ 10.009116][ C0] [ 10.009116][ C0] other info that might help us debug this: [ 10.009117][ C0] Possible interrupt unsafe locking scenario: [ 10.009117][ C0] [ 10.009117][ C0] CPU0 CPU1 [ 10.009118][ C0] ---- ---- [ 10.009118][ C0] lock(fs_reclaim); [ 10.009119][ C0] local_irq_disable(); [ 10.009120][ C0] lock(console_owner); [ 10.009121][ C0] lock(fs_reclaim); [ 10.009122][ C0] [ 10.009122][ C0] lock(console_owner); [ 10.009123][ C0] [ 10.009123][ C0] *** DEADLOCK *** [ 10.009123][ C0] [ 10.009123][ C0] locks held by (udev-worker)/119: 4, last CPU#0: [ 10.009125][ C0] #0: ff1100000ee7bc30 (&p->lock){+.+.}-{4:4}, at: seq_read_iter+0xc6/0x1250 [ 10.009130][ C0] #1: ffffffffb95b0c00 (rcu_read_lock){....}-{1:3}, at: unwind_next_frame+0x17e/0x1ea0 [ 10.009135][ C0] #2: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 10.009140][ C0] #3: ffffffffb95fe9f8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 10.009144][ C0] [ 10.009144][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 10.009148][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 10.009150][ C0] HARDIRQ-ON-W at: [ 10.009152][ C0] __lock_acquire+0x388/0xc20 [ 10.009156][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009157][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.009160][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.009163][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.009165][ C0] workqueue_init+0x2a/0x680 [ 10.009169][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.009172][ C0] kernel_init+0x21/0x150 [ 10.009175][ C0] ret_from_fork+0x474/0x6b0 [ 10.009178][ C0] ret_from_fork_asm+0x11/0x20 [ 10.009181][ C0] SOFTIRQ-ON-W at: [ 10.009181][ C0] __lock_acquire+0x388/0xc20 [ 10.009183][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009184][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.009185][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.009187][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.009188][ C0] workqueue_init+0x2a/0x680 [ 10.009190][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.009191][ C0] kernel_init+0x21/0x150 [ 10.009192][ C0] ret_from_fork+0x474/0x6b0 [ 10.009193][ C0] ret_from_fork_asm+0x11/0x20 [ 10.009194][ C0] INITIAL USE at: [ 10.009195][ C0] __lock_acquire+0x388/0xc20 [ 10.009196][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009198][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.009199][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.009200][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.009202][ C0] workqueue_init+0x2a/0x680 [ 10.009203][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.009204][ C0] kernel_init+0x21/0x150 [ 10.009206][ C0] ret_from_fork+0x474/0x6b0 [ 10.009207][ C0] ret_from_fork_asm+0x11/0x20 [ 10.009208][ C0] } [ 10.009208][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 10.009213][ C0] ... acquired at: [ 10.009214][ C0] __lock_acquire+0x518/0xc20 [ 10.009215][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009216][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.009218][ C0] __kmalloc_noprof+0xd3/0x760 [ 10.009219][ C0] alloc_buf.isra.0+0x4b/0x260 [ 10.009223][ C0] put_chars+0x1e1/0x2f0 [ 10.009225][ C0] hvc_console_print+0x292/0x780 [ 10.009227][ C0] console_emit_next_record+0x252/0x4f0 [ 10.009229][ C0] console_flush_one_record+0x46f/0x710 [ 10.009230][ C0] console_unlock+0xee/0x1f0 [ 10.009232][ C0] vprintk_emit+0x37c/0x3e0 [ 10.009234][ C0] _printk+0xc7/0x100 [ 10.009237][ C0] loop_init+0x12a/0x130 [ 10.009239][ C0] do_one_initcall+0x124/0x4f0 [ 10.009240][ C0] kernel_init_freeable+0x596/0x630 [ 10.009241][ C0] kernel_init+0x21/0x150 [ 10.009242][ C0] ret_from_fork+0x474/0x6b0 [ 10.009243][ C0] ret_from_fork_asm+0x11/0x20 [ 10.009245][ C0] [ 10.009245][ C0] -> (console_owner){..-.}-{0:0} { [ 10.009247][ C0] IN-SOFTIRQ-W at: [ 10.009248][ C0] __lock_acquire+0x388/0xc20 [ 10.009249][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009250][ C0] console_trylock_spinning+0xb5/0x1e0 [ 10.009252][ C0] vprintk_emit+0x320/0x3e0 [ 10.009254][ C0] _printk+0xc7/0x100 [ 10.009255][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.009257][ C0] call_timer_fn+0x160/0x4d0 [ 10.009259][ C0] __run_timers+0x68f/0xaa0 [ 10.009261][ C0] run_timer_softirq+0xf0/0x160 [ 10.009263][ C0] handle_softirqs+0x1d3/0x900 [ 10.009265][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.009266][ C0] irq_exit_rcu+0xe/0x30 [ 10.009267][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.009270][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.009272][ C0] lock_acquire.part.0+0x112/0x280 [ 10.009273][ C0] unwind_next_frame+0x192/0x1ea0 [ 10.009274][ C0] __unwind_start+0x42e/0x900 [ 10.009275][ C0] arch_stack_walk+0xb3/0x130 [ 10.009278][ C0] stack_trace_save+0x93/0xc0 [ 10.009279][ C0] set_track_prepare+0x62/0x90 [ 10.009280][ C0] ___slab_alloc+0xbf/0x2f0 [ 10.009282][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 10.009284][ C0] seq_read_iter+0x6e3/0x1250 [ 10.009285][ C0] new_sync_read+0x280/0x750 [ 10.009287][ C0] vfs_read+0x3dd/0x7b0 [ 10.009289][ C0] ksys_read+0x116/0x250 [ 10.009290][ C0] do_syscall_64+0xff/0x530 [ 10.009292][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 10.009293][ C0] INITIAL USE at: [ 10.009294][ C0] } [ 10.009295][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 10.009298][ C0] ... acquired at: [ 10.009298][ C0] mark_lock+0x1d7/0xa00 [ 10.009300][ C0] mark_usage+0x42/0x170 [ 10.009301][ C0] __lock_acquire+0x388/0xc20 [ 10.009302][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009303][ C0] console_trylock_spinning+0xb5/0x1e0 [ 10.009305][ C0] vprintk_emit+0x320/0x3e0 [ 10.009306][ C0] _printk+0xc7/0x100 [ 10.009308][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.009309][ C0] call_timer_fn+0x160/0x4d0 [ 10.009311][ C0] __run_timers+0x68f/0xaa0 [ 10.009312][ C0] run_timer_softirq+0xf0/0x160 [ 10.009314][ C0] handle_softirqs+0x1d3/0x900 [ 10.009315][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.009316][ C0] irq_exit_rcu+0xe/0x30 [ 10.009319][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.009320][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.009322][ C0] lock_acquire.part.0+0x112/0x280 [ 10.009323][ C0] unwind_next_frame+0x192/0x1ea0 [ 10.009324][ C0] __unwind_start+0x42e/0x900 [ 10.009325][ C0] arch_stack_walk+0xb3/0x130 [ 10.009326][ C0] stack_trace_save+0x93/0xc0 [ 10.009327][ C0] set_track_prepare+0x62/0x90 [ 10.009329][ C0] ___slab_alloc+0xbf/0x2f0 [ 10.009330][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 10.009332][ C0] seq_read_iter+0x6e3/0x1250 [ 10.009333][ C0] new_sync_read+0x280/0x750 [ 10.009334][ C0] vfs_read+0x3dd/0x7b0 [ 10.009335][ C0] ksys_read+0x116/0x250 [ 10.009336][ C0] do_syscall_64+0xff/0x530 [ 10.009337][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 10.009339][ C0] [ 10.009339][ C0] [ 10.009339][ C0] stack backtrace: [ 10.009342][ C0] CPU: 0 UID: 0 PID: 119 Comm: (udev-worker) Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 10.009345][ C0] Tainted: [W]=WARN [ 10.009346][ C0] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 10.009347][ C0] Call Trace: [ 10.009349][ C0] [ 10.009350][ C0] dump_stack_lvl+0x6f/0xa0 [ 10.009354][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 10.009357][ C0] mark_lock_irq+0x989/0x9c0 [ 10.009358][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 10.009361][ C0] mark_lock+0x1d7/0xa00 [ 10.009363][ C0] mark_usage+0x42/0x170 [ 10.009365][ C0] __lock_acquire+0x388/0xc20 [ 10.009367][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.009368][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 10.009371][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.009374][ C0] ? lock_acquire+0x13c/0x160 [ 10.009375][ C0] console_trylock_spinning+0xb5/0x1e0 [ 10.009377][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 10.009379][ C0] vprintk_emit+0x320/0x3e0 [ 10.009381][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 10.009384][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.009386][ C0] _printk+0xc7/0x100 [ 10.009388][ C0] ? snapshot_read.cold+0x21/0x21 [ 10.009390][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.009391][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.009394][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.009395][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.009397][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.009398][ C0] call_timer_fn+0x160/0x4d0 [ 10.009400][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 10.009402][ C0] ? debug_object_active_state+0x430/0x430 [ 10.009405][ C0] ? find_held_lock+0x2b/0x80 [ 10.009407][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.009409][ C0] ? mark_held_locks+0x40/0x70 [ 10.009411][ C0] __run_timers+0x68f/0xaa0 [ 10.009413][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.009415][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 10.009417][ C0] ? __lock_acquire+0x518/0xc20 [ 10.009419][ C0] ? __rwlock_init+0x150/0x150 [ 10.009422][ C0] run_timer_softirq+0xf0/0x160 [ 10.009424][ C0] ? __run_timers+0xaa0/0xaa0 [ 10.009426][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.009428][ C0] handle_softirqs+0x1d3/0x900 [ 10.009429][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.009431][ C0] ? _local_bh_enable+0xc0/0xc0 [ 10.009433][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.009434][ C0] irq_exit_rcu+0xe/0x30 [ 10.009436][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.009438][ C0] [ 10.009438][ C0] [ 10.009439][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.009441][ C0] RIP: 0010:lock_acquire.part.0+0x112/0x280 [ 10.009444][ C0] Code: ff 65 0f c1 05 3f 4c e7 04 83 f8 01 4c 8b 14 24 0f 85 35 01 00 00 9c 58 f6 c4 02 0f 85 52 01 00 00 4d 85 d2 0f 85 1b 01 00 00 <48> 8b 44 24 30 65 48 2b 05 11 07 e7 04 0f 85 48 01 00 00 48 83 c4 [ 10.009445][ C0] RSP: 0018:ffa0000000a4f7e8 EFLAGS: 00000206 [ 10.009448][ C0] RAX: 0000000000000046 RBX: 0000000000000000 RCX: f1faf757b4e10c57 [ 10.009449][ C0] RDX: 0000000000000000 RSI: ffffffffb8ae0c71 RDI: ffffffffb84913e0 [ 10.009450][ C0] RBP: 0000000000000000 R08: 0000000000000001 R09: ff110000086b5278 [ 10.009451][ C0] R10: 0000000000000200 R11: 0000000000000001 R12: ffffffffb95b0c00 [ 10.009451][ C0] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 [ 10.009454][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.009456][ C0] ? lock_acquire+0x13c/0x160 [ 10.009458][ C0] unwind_next_frame+0x192/0x1ea0 [ 10.009459][ C0] ? unwind_next_frame+0x17e/0x1ea0 [ 10.009460][ C0] ? __lock_acquire+0x518/0xc20 [ 10.009462][ C0] ? __unwind_start+0x357/0x900 [ 10.009463][ C0] ? stack_access_ok+0x1e0/0x1e0 [ 10.009465][ C0] ? find_held_lock+0x2b/0x80 [ 10.009466][ C0] ? get_stack_info_noinstr+0x1a/0x120 [ 10.009468][ C0] __unwind_start+0x42e/0x900 [ 10.009470][ C0] ? write_profile+0xf0/0xf0 [ 10.009471][ C0] arch_stack_walk+0xb3/0x130 [ 10.009474][ C0] ? __unwind_start+0x357/0x900 [ 10.009476][ C0] ? seq_read_iter+0x6e3/0x1250 [ 10.009477][ C0] stack_trace_save+0x93/0xc0 [ 10.009478][ C0] ? filter_irq_stacks+0xd0/0xd0 [ 10.009480][ C0] ? mark_held_locks+0x40/0x70 [ 10.009481][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 10.009483][ C0] set_track_prepare+0x62/0x90 [ 10.009486][ C0] ___slab_alloc+0xbf/0x2f0 [ 10.009488][ C0] ? __pcs_replace_empty_main+0x42f/0x6a0 [ 10.009490][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 10.009492][ C0] ? seq_read_iter+0x6e3/0x1250 [ 10.009494][ C0] seq_read_iter+0x6e3/0x1250 [ 10.009496][ C0] ? kernfs_file_read_iter+0x4c0/0x4c0 [ 10.009499][ C0] new_sync_read+0x280/0x750 [ 10.009501][ C0] ? generic_write_checks_count+0x480/0x480 [ 10.009503][ C0] ? kmem_cache_free+0xf8/0x550 [ 10.009507][ C0] vfs_read+0x3dd/0x7b0 [ 10.009508][ C0] ? fdget_pos+0x1a4/0x310 [ 10.009510][ C0] ksys_read+0x116/0x250 [ 10.009512][ C0] ? __ia32_sys_pwrite64+0x230/0x230 [ 10.009513][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.009515][ C0] do_syscall_64+0xff/0x530 [ 10.009517][ C0] ? common_interrupt+0x5a/0xf0 [ 10.009519][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 10.009520][ C0] RIP: 0033:0x7fdec937054e [ 10.009523][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 10.009524][ C0] RSP: 002b:00007fffb44e1fe0 EFLAGS: 00000202 ORIG_RAX: 0000000000000000 [ 10.009525][ C0] RAX: ffffffffffffffda RBX: 0000556b6ef66b80 RCX: 00007fdec937054e [ 10.009526][ C0] RDX: 0000000000001008 RSI: 0000556b6ef66b80 RDI: 0000000000000013 [ 10.009527][ C0] RBP: 00007fffb44e1ff0 R08: 0000000000000000 R09: 0000000000000000 [ 10.009528][ C0] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000013 [ 10.009529][ C0] R13: 0000000000001008 R14: ffffffffffffffff R15: 0000000000000002 [ 10.009531][ C0] [ 10.018847][ T109] fbnic 0000:01:00.0 enp1s0: Link is Up - 100Gbps/Full - flow control rx/tx [ 10.130220][ T187] ip (187) used greatest stack depth: 22632 bytes left