[ 2006.323928][T29854] pktgen: Packet Generator for packet performance testing. Version: 2.75
[ 2038.274528][ T12] ------------[ cut here ]------------
[ 2038.274859][ T12] conntrack cleanup blocked for 60s
[ 2038.274862][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack], CPU#2: kworker/u16:0/12
[ 2038.275406][ T12] Modules linked in: pktgen(+) xt_conntrack nf_conntrack nf_defrag_ipv4 nf_defrag_ipv6 act_gact cls_flower sch_ingress vxlan ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables
[ 2038.275976][ T12] CPU: 2 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 6.19.0-rc1-virtme #1 PREEMPT(full)
[ 2038.276288][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
[ 2038.276494][ T12] Workqueue: netns cleanup_net
[ 2038.276693][ T12] RIP: 0010:nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 2038.276937][ T12] Code: 00 48 8b 54 24 18 48 8b 05 b3 c8 ab dd 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 9e a0 dc e9 25 fd ff ff 48 8d 3d 46 d6 0c 00 <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df
[ 2038.277426][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010297
[ 2038.277646][ T12] RAX: 00000001001a844f RBX: ffa00000000c7af8 RCX: 0000000000000001
[ 2038.277875][ T12] RDX: 00000001001a844e RSI: 0000000000000004 RDI: ffffffffc0622030
[ 2038.278106][ T12] RBP: 0000000000000001 R08: ffffffffc05547ba R09: ffe21c000159dd9c
[ 2038.278343][ T12] R10: ffe21c000159dd9d R11: 0000000000000001 R12: dffffc0000000000
[ 2038.278586][ T12] R13: ff1100000aceece0 R14: fffffbfff80c5e07 R15: ff11000008d03a00
[ 2038.278817][ T12] FS: 0000000000000000(0000) GS:ff110000cccf3000(0000) knlGS:0000000000000000
[ 2038.279086][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2038.279295][ T12] CR2: 00005570fe6d6538 CR3: 000000005c148004 CR4: 0000000000771ef0
[ 2038.279781][ T12] PKRU: 55555554
[ 2038.279923][ T12] Call Trace:
[ 2038.280067][ T12]
[ 2038.280189][ T12] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2038.280398][ T12] ? kfree+0x119/0x580
[ 2038.280555][ T12] ? lock_acquire+0x10a/0x150
[ 2038.280730][ T12] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2038.280932][ T12] ops_undo_list+0x2d7/0x8f0
[ 2038.281105][ T12] ? netns_install+0x280/0x280
[ 2038.281284][ T12] cleanup_net+0x3bc/0x890
[ 2038.281455][ T12] ? process_one_work+0xd16/0x1390
[ 2038.281642][ T12] ? net_passive_dec+0x190/0x190
[ 2038.281814][ T12] ? rcu_is_watching+0x15/0xd0
[ 2038.281984][ T12] ? process_one_work+0xd16/0x1390
[ 2038.282152][ T12] ? lock_acquire+0x10a/0x150
[ 2038.282330][ T12] ? rcu_is_watching+0x15/0xd0
[ 2038.282501][ T12] process_one_work+0xd57/0x1390
[ 2038.282689][ T12] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2038.282857][ T12] ? lock_acquire.part.0+0xbc/0x260
[ 2038.283033][ T12] ? assign_work+0x152/0x380
[ 2038.283210][ T12] worker_thread+0x4d6/0xd40
[ 2038.283384][ T12] ? process_one_work+0x1390/0x1390
[ 2038.283567][ T12] kthread+0x355/0x5b0
[ 2038.283708][ T12] ? kthread_is_per_cpu+0xe0/0xe0
[ 2038.283877][ T12] ? __lock_release.isra.0+0x59/0x170
[ 2038.284047][ T12] ? rcu_is_watching+0x15/0xd0
[ 2038.284229][ T12] ? kthread_is_per_cpu+0xe0/0xe0
[ 2038.284405][ T12] ret_from_fork+0x3fb/0x510
[ 2038.284591][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2038.284791][ T12] ? __switch_to+0x53c/0xd00
[ 2038.284961][ T12] ? kthread_is_per_cpu+0xe0/0xe0
[ 2038.285131][ T12] ret_from_fork_asm+0x11/0x20
[ 2038.285310][ T12]
[ 2038.285453][ T12] irq event stamp: 12515679
[ 2038.285638][ T12] hardirqs last enabled at (12515691): [] __up_console_sem+0x5a/0x70
[ 2038.285900][ T12] hardirqs last disabled at (12515700): [] __up_console_sem+0x3f/0x70
[ 2038.286156][ T12] softirqs last enabled at (12515214): [] handle_softirqs+0x56f/0x840
[ 2038.286421][ T12] softirqs last disabled at (12515207): [] irq_exit_rcu+0xa2/0xf0
[ 2038.286698][ T12] ---[ end trace 0000000000000000 ]---
[ 2213.299549][ T44] INFO: task modprobe:29854 blocked for more than 122 seconds.
[ 2213.299915][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2213.300114][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2213.300342][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2213.300652][ T44] Call Trace:
[ 2213.300753][ T44]
[ 2213.300829][ T44] __schedule+0xae2/0x1720
[ 2213.300965][ T44] ? io_schedule_timeout+0x130/0x130
[ 2213.301096][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2213.301220][ T44] schedule+0xd4/0x260
[ 2213.301311][ T44] schedule_preempt_disabled+0x18/0x30
[ 2213.301431][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2213.301558][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2213.301682][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.301807][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2213.301930][ T44] ? register_pernet_subsys+0x19/0x40
[ 2213.302054][ T44] ? lock_acquire+0x10a/0x150
[ 2213.302174][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2213.302288][ T44] down_write+0x1c6/0x1f0
[ 2213.302371][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2213.302518][ T44] register_pernet_subsys+0x19/0x40
[ 2213.302629][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2213.302742][ T44] do_one_initcall+0xa3/0x2e0
[ 2213.302857][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2213.302997][ T44] ? kasan_unpoison+0x44/0x70
[ 2213.303112][ T44] do_init_module+0x27b/0x820
[ 2213.303226][ T44] ? free_module+0x450/0x450
[ 2213.303544][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2213.303657][ T44] init_module_from_file+0x15d/0x180
[ 2213.303766][ T44] ? __do_sys_init_module+0x200/0x200
[ 2213.303889][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2213.303998][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2213.304110][ T44] idempotent_init_module+0x226/0x760
[ 2213.304219][ T44] ? init_module_from_file+0x180/0x180
[ 2213.304330][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.304439][ T44] ? cap_capable+0x181/0x3f0
[ 2213.304562][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2213.304670][ T44] do_syscall_64+0xbd/0xfc0
[ 2213.304783][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2213.304920][ T44] RIP: 0033:0x7f9bef99034d
[ 2213.305037][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2213.305203][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2213.305364][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2213.305532][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2213.305697][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2213.305863][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2213.306030][ T44]
[ 2213.306115][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2213.306345][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2213.306612][ T44] Workqueue: netns cleanup_net
[ 2213.306722][ T44] Call Trace:
[ 2213.306817][ T44]
[ 2213.306873][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2213.307013][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.307123][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2213.307230][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2213.307364][ T44] ? lock_acquire+0x10a/0x150
[ 2213.307471][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.307584][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.307693][ T44] ? trace_contention_end+0xd6/0x110
[ 2213.307805][ T44] ? __mutex_lock+0x285/0x1f20
[ 2213.307916][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2213.308051][ T44] ? mark_held_locks+0x40/0x70
[ 2213.308158][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.308270][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2213.308409][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 2213.308583][ T44] ? common_interrupt+0x92/0xf0
[ 2213.308693][ T44] ? asm_common_interrupt+0x26/0x40
[ 2213.308808][ T44] ? trace_contention_end+0x30/0x110
[ 2213.308917][ T44] ? nf_conntrack_cleanup_net_list+0x1aa/0x550 [nf_conntrack]
[ 2213.309077][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2213.309240][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2213.309405][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2213.309545][ T44] ? kfree+0x119/0x580
[ 2213.309627][ T44] ? lock_acquire+0x10a/0x150
[ 2213.309737][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2213.309876][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2213.309985][ T44] ? netns_install+0x280/0x280
[ 2213.310098][ T44] ? cleanup_net+0x3bc/0x890
[ 2213.310206][ T44] ? process_one_work+0xd16/0x1390
[ 2213.310317][ T44] ? net_passive_dec+0x190/0x190
[ 2213.310425][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.310538][ T44] ? process_one_work+0xd16/0x1390
[ 2213.310646][ T44] ? lock_acquire+0x10a/0x150
[ 2213.310754][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.310866][ T44] ? process_one_work+0xd57/0x1390
[ 2213.310979][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2213.311086][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2213.311197][ T44] ? assign_work+0x152/0x380
[ 2213.311306][ T44] ? worker_thread+0x4d6/0xd40
[ 2213.311418][ T44] ? process_one_work+0x1390/0x1390
[ 2213.311532][ T44] ? kthread+0x355/0x5b0
[ 2213.311615][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2213.311725][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2213.311835][ T44] ? rcu_is_watching+0x15/0xd0
[ 2213.311945][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2213.312054][ T44] ? ret_from_fork+0x3fb/0x510
[ 2213.312164][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2213.312298][ T44] ? __switch_to+0x53c/0xd00
[ 2213.312405][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2213.312521][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2213.312633][ T44]
[ 2213.312727][ T44]
[ 2213.312727][ T44] Showing all locks held in the system:
[ 2213.312892][ T44] 5 locks held by kworker/u16:0/12:
[ 2213.313001][ T44] 1 lock held by khungtaskd/44:
[ 2213.313103][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2213.313324][ T44] 1 lock held by modprobe/29854:
[ 2213.313428][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2213.313730][ T44]
[ 2213.313786][ T44] =============================================
[ 2213.313786][ T44]
[ 2336.179544][ T44] INFO: task modprobe:29854 blocked for more than 245 seconds.
[ 2336.179823][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2336.180016][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2336.180242][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2336.180551][ T44] Call Trace:
[ 2336.180646][ T44]
[ 2336.180712][ T44] __schedule+0xae2/0x1720
[ 2336.180849][ T44] ? io_schedule_timeout+0x130/0x130
[ 2336.180978][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2336.181112][ T44] schedule+0xd4/0x260
[ 2336.181205][ T44] schedule_preempt_disabled+0x18/0x30
[ 2336.181329][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2336.181451][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2336.181579][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.181700][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2336.181817][ T44] ? register_pernet_subsys+0x19/0x40
[ 2336.181938][ T44] ? lock_acquire+0x10a/0x150
[ 2336.182058][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2336.182183][ T44] down_write+0x1c6/0x1f0
[ 2336.182275][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2336.182428][ T44] register_pernet_subsys+0x19/0x40
[ 2336.182543][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2336.182655][ T44] do_one_initcall+0xa3/0x2e0
[ 2336.182768][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2336.182910][ T44] ? kasan_unpoison+0x44/0x70
[ 2336.183024][ T44] do_init_module+0x27b/0x820
[ 2336.183139][ T44] ? free_module+0x450/0x450
[ 2336.183249][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2336.183363][ T44] init_module_from_file+0x15d/0x180
[ 2336.183474][ T44] ? __do_sys_init_module+0x200/0x200
[ 2336.183594][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2336.183705][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2336.183815][ T44] idempotent_init_module+0x226/0x760
[ 2336.183925][ T44] ? init_module_from_file+0x180/0x180
[ 2336.184041][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.184154][ T44] ? cap_capable+0x181/0x3f0
[ 2336.184266][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2336.184374][ T44] do_syscall_64+0xbd/0xfc0
[ 2336.184489][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2336.184635][ T44] RIP: 0033:0x7f9bef99034d
[ 2336.184750][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2336.184916][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2336.185076][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2336.185241][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2336.185402][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2336.185573][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2336.185741][ T44]
[ 2336.185824][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2336.186053][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2336.186315][ T44] Workqueue: netns cleanup_net
[ 2336.186428][ T44] Call Trace:
[ 2336.186514][ T44]
[ 2336.186571][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2336.186715][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.186823][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2336.186932][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2336.187068][ T44] ? lock_acquire+0x10a/0x150
[ 2336.187176][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.187284][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.187393][ T44] ? trace_contention_end+0xd6/0x110
[ 2336.187513][ T44] ? __mutex_lock+0x285/0x1f20
[ 2336.187624][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2336.187760][ T44] ? mark_held_locks+0x40/0x70
[ 2336.187869][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.187979][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 2336.188087][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 2336.188249][ T44] ? common_interrupt+0x92/0xf0
[ 2336.188360][ T44] ? report_bug_entry+0xce/0x270
[ 2336.188470][ T44] ? asm_common_interrupt+0x26/0x40
[ 2336.188590][ T44] ? trace_contention_end+0x30/0x110
[ 2336.188698][ T44] ? lock_acquire.part.0+0xfa/0x260
[ 2336.188807][ T44] ? nf_ct_iterate_cleanup+0x8e/0x350 [nf_conntrack]
[ 2336.188943][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2336.189082][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2336.189245][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2336.189411][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2336.189584][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2336.189720][ T44] ? kfree+0x119/0x580
[ 2336.189802][ T44] ? lock_acquire+0x10a/0x150
[ 2336.189916][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2336.190053][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2336.190162][ T44] ? netns_install+0x280/0x280
[ 2336.190274][ T44] ? cleanup_net+0x3bc/0x890
[ 2336.190381][ T44] ? process_one_work+0xd16/0x1390
[ 2336.190493][ T44] ? net_passive_dec+0x190/0x190
[ 2336.190606][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.190715][ T44] ? process_one_work+0xd16/0x1390
[ 2336.190824][ T44] ? lock_acquire+0x10a/0x150
[ 2336.190931][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.191041][ T44] ? process_one_work+0xd57/0x1390
[ 2336.191152][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2336.191261][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2336.191372][ T44] ? assign_work+0x152/0x380
[ 2336.191484][ T44] ? worker_thread+0x4d6/0xd40
[ 2336.191601][ T44] ? process_one_work+0x1390/0x1390
[ 2336.191709][ T44] ? kthread+0x355/0x5b0
[ 2336.191792][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2336.191900][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2336.192009][ T44] ? rcu_is_watching+0x15/0xd0
[ 2336.192118][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2336.192230][ T44] ? ret_from_fork+0x3fb/0x510
[ 2336.192341][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2336.192481][ T44] ? __switch_to+0x53c/0xd00
[ 2336.192598][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2336.192706][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2336.192818][ T44]
[ 2336.192914][ T44]
[ 2336.192914][ T44] Showing all locks held in the system:
[ 2336.193071][ T44] 5 locks held by kworker/u16:0/12:
[ 2336.193180][ T44] 1 lock held by khungtaskd/44:
[ 2336.193284][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2336.193589][ T44] 1 lock held by modprobe/29854:
[ 2336.193692][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2336.193901][ T44]
[ 2336.193953][ T44] =============================================
[ 2336.193953][ T44]
[ 2459.059544][ T44] INFO: task modprobe:29854 blocked for more than 368 seconds.
[ 2459.059815][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2459.060010][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2459.060236][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2459.060550][ T44] Call Trace:
[ 2459.060645][ T44]
[ 2459.060711][ T44] __schedule+0xae2/0x1720
[ 2459.060839][ T44] ? io_schedule_timeout+0x130/0x130
[ 2459.060967][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2459.061096][ T44] schedule+0xd4/0x260
[ 2459.061188][ T44] schedule_preempt_disabled+0x18/0x30
[ 2459.061310][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2459.061435][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2459.061572][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.061699][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2459.061820][ T44] ? register_pernet_subsys+0x19/0x40
[ 2459.061945][ T44] ? lock_acquire+0x10a/0x150
[ 2459.062074][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2459.062197][ T44] down_write+0x1c6/0x1f0
[ 2459.062283][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2459.062448][ T44] register_pernet_subsys+0x19/0x40
[ 2459.062575][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2459.062691][ T44] do_one_initcall+0xa3/0x2e0
[ 2459.062801][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2459.062939][ T44] ? kasan_unpoison+0x44/0x70
[ 2459.063054][ T44] do_init_module+0x27b/0x820
[ 2459.063165][ T44] ? free_module+0x450/0x450
[ 2459.063275][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2459.063390][ T44] init_module_from_file+0x15d/0x180
[ 2459.063499][ T44] ? __do_sys_init_module+0x200/0x200
[ 2459.063619][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2459.063729][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2459.063840][ T44] idempotent_init_module+0x226/0x760
[ 2459.063948][ T44] ? init_module_from_file+0x180/0x180
[ 2459.064062][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.064172][ T44] ? cap_capable+0x181/0x3f0
[ 2459.064282][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2459.064392][ T44] do_syscall_64+0xbd/0xfc0
[ 2459.064501][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2459.064649][ T44] RIP: 0033:0x7f9bef99034d
[ 2459.064763][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2459.064929][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2459.065094][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2459.065255][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2459.065417][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2459.065586][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2459.065760][ T44]
[ 2459.065843][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2459.066074][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2459.066341][ T44] Workqueue: netns cleanup_net
[ 2459.066450][ T44] Call Trace:
[ 2459.066537][ T44]
[ 2459.066593][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2459.066734][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.066842][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2459.066951][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2459.067089][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.067199][ T44] ? trace_contention_end+0xd6/0x110
[ 2459.067309][ T44] ? pick_task_fair+0x7d/0x1e0
[ 2459.067418][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2459.067562][ T44] ? mark_held_locks+0x40/0x70
[ 2459.067670][ T44] ? ww_mutex_lock+0x160/0x160
[ 2459.067778][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2459.067914][ T44] ? common_interrupt+0x92/0xf0
[ 2459.068026][ T44] ? asm_common_interrupt+0x26/0x40
[ 2459.068137][ T44] ? trace_contention_end+0x30/0x110
[ 2459.068246][ T44] ? nf_ct_iterate_cleanup+0x8e/0x350 [nf_conntrack]
[ 2459.068383][ T44] ? nf_conntrack_cleanup_net_list+0x1aa/0x550 [nf_conntrack]
[ 2459.068558][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2459.068721][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2459.068886][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2459.069024][ T44] ? kfree+0x119/0x580
[ 2459.069111][ T44] ? lock_acquire+0x10a/0x150
[ 2459.069225][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2459.069362][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2459.069473][ T44] ? netns_install+0x280/0x280
[ 2459.069592][ T44] ? cleanup_net+0x3bc/0x890
[ 2459.069699][ T44] ? process_one_work+0xd16/0x1390
[ 2459.069808][ T44] ? net_passive_dec+0x190/0x190
[ 2459.069918][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.070026][ T44] ? process_one_work+0xd16/0x1390
[ 2459.070137][ T44] ? lock_acquire+0x10a/0x150
[ 2459.070245][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.070354][ T44] ? process_one_work+0xd57/0x1390
[ 2459.070467][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2459.070579][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2459.070690][ T44] ? assign_work+0x152/0x380
[ 2459.070800][ T44] ? worker_thread+0x4d6/0xd40
[ 2459.070912][ T44] ? process_one_work+0x1390/0x1390
[ 2459.071019][ T44] ? kthread+0x355/0x5b0
[ 2459.071103][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2459.071213][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2459.071321][ T44] ? rcu_is_watching+0x15/0xd0
[ 2459.071430][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2459.071543][ T44] ? ret_from_fork+0x3fb/0x510
[ 2459.071652][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2459.071787][ T44] ? __switch_to+0x53c/0xd00
[ 2459.071894][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2459.072005][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2459.072121][ T44]
[ 2459.072221][ T44]
[ 2459.072221][ T44] Showing all locks held in the system:
[ 2459.072379][ T44] 5 locks held by kworker/u16:0/12:
[ 2459.072486][ T44] 1 lock held by khungtaskd/44:
[ 2459.072678][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2459.072900][ T44] 1 lock held by modprobe/29854:
[ 2459.073008][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2459.073225][ T44]
[ 2459.073278][ T44] =============================================
[ 2459.073278][ T44]
[ 2581.939547][ T44] INFO: task modprobe:29854 blocked for more than 491 seconds.
[ 2581.939825][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2581.940021][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2581.940251][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2581.940592][ T44] Call Trace:
[ 2581.940702][ T44]
[ 2581.940773][ T44] __schedule+0xae2/0x1720
[ 2581.940901][ T44] ? io_schedule_timeout+0x130/0x130
[ 2581.941027][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2581.941149][ T44] schedule+0xd4/0x260
[ 2581.941238][ T44] schedule_preempt_disabled+0x18/0x30
[ 2581.941360][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2581.941482][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2581.941612][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.941734][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2581.941857][ T44] ? register_pernet_subsys+0x19/0x40
[ 2581.941971][ T44] ? lock_acquire+0x10a/0x150
[ 2581.942083][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2581.942196][ T44] down_write+0x1c6/0x1f0
[ 2581.942280][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2581.942419][ T44] register_pernet_subsys+0x19/0x40
[ 2581.942534][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2581.942647][ T44] do_one_initcall+0xa3/0x2e0
[ 2581.942765][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2581.942903][ T44] ? kasan_unpoison+0x44/0x70
[ 2581.943015][ T44] do_init_module+0x27b/0x820
[ 2581.943127][ T44] ? free_module+0x450/0x450
[ 2581.943236][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2581.943348][ T44] init_module_from_file+0x15d/0x180
[ 2581.943457][ T44] ? __do_sys_init_module+0x200/0x200
[ 2581.943574][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2581.943684][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2581.943793][ T44] idempotent_init_module+0x226/0x760
[ 2581.943903][ T44] ? init_module_from_file+0x180/0x180
[ 2581.944016][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.944125][ T44] ? cap_capable+0x181/0x3f0
[ 2581.944236][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2581.944346][ T44] do_syscall_64+0xbd/0xfc0
[ 2581.944455][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2581.944598][ T44] RIP: 0033:0x7f9bef99034d
[ 2581.944717][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2581.944880][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2581.945044][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2581.945205][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2581.945366][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2581.945532][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2581.945705][ T44]
[ 2581.945787][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2581.946014][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2581.946276][ T44] Workqueue: netns cleanup_net
[ 2581.946388][ T44] Call Trace:
[ 2581.946471][ T44]
[ 2581.946533][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2581.946678][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.946789][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2581.946899][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2581.947036][ T44] ? lock_acquire+0x10a/0x150
[ 2581.947144][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.947251][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.947359][ T44] ? trace_contention_end+0xd6/0x110
[ 2581.947467][ T44] ? __mutex_lock+0x285/0x1f20
[ 2581.947582][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2581.947722][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.947828][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.947936][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2581.948075][ T44] ? common_interrupt+0x92/0xf0
[ 2581.948184][ T44] ? asm_common_interrupt+0x26/0x40
[ 2581.948296][ T44] ? trace_contention_end+0x30/0x110
[ 2581.948406][ T44] ? nf_ct_iterate_cleanup+0x81/0x350 [nf_conntrack]
[ 2581.948552][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2581.948691][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2581.948854][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 2581.949017][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2581.949180][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2581.949316][ T44] ? kfree+0x119/0x580
[ 2581.949399][ T44] ? lock_acquire+0x10a/0x150
[ 2581.949515][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2581.949653][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2581.949766][ T44] ? netns_install+0x280/0x280
[ 2581.949875][ T44] ? cleanup_net+0x3bc/0x890
[ 2581.949983][ T44] ? process_one_work+0xd16/0x1390
[ 2581.950092][ T44] ? net_passive_dec+0x190/0x190
[ 2581.950202][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.950309][ T44] ? process_one_work+0xd16/0x1390
[ 2581.950417][ T44] ? lock_acquire+0x10a/0x150
[ 2581.950530][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.950640][ T44] ? process_one_work+0xd57/0x1390
[ 2581.950754][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2581.950863][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2581.950977][ T44] ? assign_work+0x152/0x380
[ 2581.951086][ T44] ? worker_thread+0x4d6/0xd40
[ 2581.951200][ T44] ? process_one_work+0x1390/0x1390
[ 2581.951307][ T44] ? kthread+0x355/0x5b0
[ 2581.951389][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2581.951496][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2581.951610][ T44] ? rcu_is_watching+0x15/0xd0
[ 2581.951722][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2581.951829][ T44] ? ret_from_fork+0x3fb/0x510
[ 2581.951940][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2581.952074][ T44] ? __switch_to+0x53c/0xd00
[ 2581.952183][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2581.952290][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2581.952402][ T44]
[ 2581.952584][ T44]
[ 2581.952584][ T44] Showing all locks held in the system:
[ 2581.952745][ T44] 3 locks held by kworker/u16:0/12:
[ 2581.952857][ T44] 1 lock held by khungtaskd/44:
[ 2581.952959][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2581.953178][ T44] 1 lock held by modprobe/29854:
[ 2581.953280][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2581.953491][ T44]
[ 2581.953549][ T44] =============================================
[ 2581.953549][ T44]
[ 2704.819543][ T44] INFO: task modprobe:29854 blocked for more than 614 seconds.
[ 2704.819809][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2704.820000][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2704.820212][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2704.820521][ T44] Call Trace:
[ 2704.820619][ T44]
[ 2704.820688][ T44] __schedule+0xae2/0x1720
[ 2704.820824][ T44] ? io_schedule_timeout+0x130/0x130
[ 2704.820962][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2704.821086][ T44] schedule+0xd4/0x260
[ 2704.821176][ T44] schedule_preempt_disabled+0x18/0x30
[ 2704.821304][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2704.821428][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2704.821553][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.821672][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2704.821792][ T44] ? register_pernet_subsys+0x19/0x40
[ 2704.821914][ T44] ? lock_acquire+0x10a/0x150
[ 2704.822037][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2704.822154][ T44] down_write+0x1c6/0x1f0
[ 2704.822240][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2704.822384][ T44] register_pernet_subsys+0x19/0x40
[ 2704.822494][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2704.822612][ T44] do_one_initcall+0xa3/0x2e0
[ 2704.822724][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2704.822861][ T44] ? kasan_unpoison+0x44/0x70
[ 2704.822974][ T44] do_init_module+0x27b/0x820
[ 2704.823089][ T44] ? free_module+0x450/0x450
[ 2704.823198][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2704.823315][ T44] init_module_from_file+0x15d/0x180
[ 2704.823424][ T44] ? __do_sys_init_module+0x200/0x200
[ 2704.823544][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2704.823653][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2704.823762][ T44] idempotent_init_module+0x226/0x760
[ 2704.823873][ T44] ? init_module_from_file+0x180/0x180
[ 2704.823985][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.824094][ T44] ? cap_capable+0x181/0x3f0
[ 2704.824205][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2704.824315][ T44] do_syscall_64+0xbd/0xfc0
[ 2704.824463][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2704.824624][ T44] RIP: 0033:0x7f9bef99034d
[ 2704.824746][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2704.824921][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2704.825096][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2704.825271][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2704.825449][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2704.825628][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2704.825808][ T44]
[ 2704.825897][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2704.826142][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2704.826423][ T44] Workqueue: netns cleanup_net
[ 2704.826538][ T44] Call Trace:
[ 2704.826623][ T44]
[ 2704.826683][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2704.826847][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.826963][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2704.827074][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2704.827209][ T44] ? lock_acquire+0x10a/0x150
[ 2704.827319][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.827425][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.827539][ T44] ? trace_contention_end+0xd6/0x110
[ 2704.827649][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.827758][ T44] ? __mutex_lock+0x285/0x1f20
[ 2704.827868][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2704.828009][ T44] ? asm_common_interrupt+0x26/0x40
[ 2704.828116][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.828227][ T44] ? __kasan_check_read+0x4/0x20
[ 2704.828345][ T44] ? common_interrupt+0x92/0xf0
[ 2704.828454][ T44] ? asm_common_interrupt+0x26/0x40
[ 2704.828573][ T44] ? trace_contention_end+0x30/0x110
[ 2704.828683][ T44] ? nf_ct_iterate_cleanup+0x77/0x350 [nf_conntrack]
[ 2704.828820][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2704.828957][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2704.829121][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2704.829287][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2704.829435][ T44] ? kfree+0x119/0x580
[ 2704.829523][ T44] ? lock_acquire+0x10a/0x150
[ 2704.829636][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2704.829773][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2704.829884][ T44] ? netns_install+0x280/0x280
[ 2704.829996][ T44] ? cleanup_net+0x3bc/0x890
[ 2704.830106][ T44] ? process_one_work+0xd16/0x1390
[ 2704.830217][ T44] ? net_passive_dec+0x190/0x190
[ 2704.830329][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.830441][ T44] ? process_one_work+0xd16/0x1390
[ 2704.830554][ T44] ? lock_acquire+0x10a/0x150
[ 2704.830662][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.830772][ T44] ? process_one_work+0xd57/0x1390
[ 2704.830888][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2704.830996][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2704.831108][ T44] ? assign_work+0x152/0x380
[ 2704.831219][ T44] ? worker_thread+0x4d6/0xd40
[ 2704.831336][ T44] ? process_one_work+0x1390/0x1390
[ 2704.831443][ T44] ? kthread+0x355/0x5b0
[ 2704.831532][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2704.831640][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2704.831747][ T44] ? rcu_is_watching+0x15/0xd0
[ 2704.831859][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2704.831967][ T44] ? ret_from_fork+0x3fb/0x510
[ 2704.832081][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2704.832216][ T44] ? __switch_to+0x53c/0xd00
[ 2704.832329][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2704.832438][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2704.832561][ T44]
[ 2704.832668][ T44]
[ 2704.832668][ T44] Showing all locks held in the system:
[ 2704.832828][ T44] 4 locks held by kworker/u16:0/12:
[ 2704.832936][ T44] 1 lock held by khungtaskd/44:
[ 2704.833038][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2704.833256][ T44] 1 lock held by modprobe/29854:
[ 2704.833361][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2704.833672][ T44]
[ 2704.833725][ T44] =============================================
[ 2704.833725][ T44]
[ 2827.699544][ T44] INFO: task modprobe:29854 blocked for more than 737 seconds.
[ 2827.699773][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2827.699948][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2827.700146][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2827.700407][ T44] Call Trace:
[ 2827.700495][ T44]
[ 2827.700574][ T44] __schedule+0xae2/0x1720
[ 2827.700698][ T44] ? io_schedule_timeout+0x130/0x130
[ 2827.700814][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2827.700931][ T44] schedule+0xd4/0x260
[ 2827.701023][ T44] schedule_preempt_disabled+0x18/0x30
[ 2827.701139][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2827.701255][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2827.701376][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.701485][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2827.701602][ T44] ? register_pernet_subsys+0x19/0x40
[ 2827.701710][ T44] ? lock_acquire+0x10a/0x150
[ 2827.701820][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2827.701932][ T44] down_write+0x1c6/0x1f0
[ 2827.702014][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2827.702158][ T44] register_pernet_subsys+0x19/0x40
[ 2827.702266][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2827.702376][ T44] do_one_initcall+0xa3/0x2e0
[ 2827.702490][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2827.702634][ T44] ? kasan_unpoison+0x44/0x70
[ 2827.702749][ T44] do_init_module+0x27b/0x820
[ 2827.702861][ T44] ? free_module+0x450/0x450
[ 2827.702971][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2827.703085][ T44] init_module_from_file+0x15d/0x180
[ 2827.703194][ T44] ? __do_sys_init_module+0x200/0x200
[ 2827.703307][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2827.703415][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2827.703528][ T44] idempotent_init_module+0x226/0x760
[ 2827.703638][ T44] ? init_module_from_file+0x180/0x180
[ 2827.703752][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.703858][ T44] ? cap_capable+0x181/0x3f0
[ 2827.703969][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2827.704077][ T44] do_syscall_64+0xbd/0xfc0
[ 2827.704189][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2827.704321][ T44] RIP: 0033:0x7f9bef99034d
[ 2827.704439][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2827.704616][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2827.704776][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2827.704938][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2827.705102][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2827.705263][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2827.705429][ T44]
[ 2827.705516][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2827.705743][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2827.706004][ T44] Workqueue: netns cleanup_net
[ 2827.706117][ T44] Call Trace:
[ 2827.706203][ T44]
[ 2827.706259][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2827.706406][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.706518][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2827.706626][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2827.706763][ T44] ? lock_acquire+0x10a/0x150
[ 2827.706869][ T44] ? update_curr+0x411/0x670
[ 2827.706977][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.707087][ T44] ? trace_contention_end+0xd6/0x110
[ 2827.707196][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.707302][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2827.707439][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2827.707581][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 2827.707690][ T44] ? irqentry_exit+0xf9/0x4d0
[ 2827.707797][ T44] ? mark_held_locks+0x40/0x70
[ 2827.707904][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.708012][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2827.708152][ T44] ? common_interrupt+0x92/0xf0
[ 2827.708259][ T44] ? nf_conntrack_cleanup_net_list+0x3df/0x550 [nf_conntrack]
[ 2827.708424][ T44] ? asm_common_interrupt+0x26/0x40
[ 2827.708544][ T44] ? handle_bug+0x100/0x2d0
[ 2827.708655][ T44] ? trace_contention_end+0x30/0x110
[ 2827.708765][ T44] ? nf_ct_iterate_cleanup+0x81/0x350 [nf_conntrack]
[ 2827.708901][ T44] ? nf_conntrack_cleanup_net_list+0x1aa/0x550 [nf_conntrack]
[ 2827.709066][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 2827.709231][ T44] ? schedule+0xd4/0x260
[ 2827.709312][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 2827.709475][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2827.709619][ T44] ? kfree+0x119/0x580
[ 2827.709701][ T44] ? lock_acquire+0x10a/0x150
[ 2827.709810][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2827.709949][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2827.710060][ T44] ? netns_install+0x280/0x280
[ 2827.710173][ T44] ? cleanup_net+0x3bc/0x890
[ 2827.710282][ T44] ? process_one_work+0xd16/0x1390
[ 2827.710391][ T44] ? net_passive_dec+0x190/0x190
[ 2827.710500][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.710615][ T44] ? process_one_work+0xd16/0x1390
[ 2827.710726][ T44] ? lock_acquire+0x10a/0x150
[ 2827.710833][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.710942][ T44] ? process_one_work+0xd57/0x1390
[ 2827.711054][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2827.711165][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2827.711276][ T44] ? assign_work+0x152/0x380
[ 2827.711384][ T44] ? worker_thread+0x4d6/0xd40
[ 2827.711499][ T44] ? process_one_work+0x1390/0x1390
[ 2827.711612][ T44] ? kthread+0x355/0x5b0
[ 2827.711696][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2827.711804][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2827.711912][ T44] ? rcu_is_watching+0x15/0xd0
[ 2827.712020][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2827.712134][ T44] ? ret_from_fork+0x3fb/0x510
[ 2827.712244][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2827.712384][ T44] ? __switch_to+0x53c/0xd00
[ 2827.712493][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2827.712610][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2827.712722][ T44]
[ 2827.712833][ T44]
[ 2827.712833][ T44] Showing all locks held in the system:
[ 2827.712990][ T44] 5 locks held by kworker/u16:0/12:
[ 2827.713100][ T44] 1 lock held by khungtaskd/44:
[ 2827.713204][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2827.713422][ T44] 1 lock held by modprobe/29854:
[ 2827.713631][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2827.713847][ T44]
[ 2827.713899][ T44] =============================================
[ 2827.713899][ T44]
[ 2950.579543][ T44] INFO: task modprobe:29854 blocked for more than 860 seconds.
[ 2950.579773][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 2950.579950][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 2950.580145][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 2950.580414][ T44] Call Trace:
[ 2950.580502][ T44]
[ 2950.580581][ T44] __schedule+0xae2/0x1720
[ 2950.580705][ T44] ? io_schedule_timeout+0x130/0x130
[ 2950.580817][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2950.580937][ T44] schedule+0xd4/0x260
[ 2950.581021][ T44] schedule_preempt_disabled+0x18/0x30
[ 2950.581134][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 2950.581248][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 2950.581362][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.581473][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2950.581590][ T44] ? register_pernet_subsys+0x19/0x40
[ 2950.581701][ T44] ? lock_acquire+0x10a/0x150
[ 2950.581812][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 2950.581928][ T44] down_write+0x1c6/0x1f0
[ 2950.582010][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 2950.582148][ T44] register_pernet_subsys+0x19/0x40
[ 2950.582258][ T44] pg_init+0x29/0x1000 [pktgen]
[ 2950.582368][ T44] do_one_initcall+0xa3/0x2e0
[ 2950.582480][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 2950.582623][ T44] ? kasan_unpoison+0x44/0x70
[ 2950.582736][ T44] do_init_module+0x27b/0x820
[ 2950.582849][ T44] ? free_module+0x450/0x450
[ 2950.582960][ T44] ? backing_file_read_iter+0x50e/0x730
[ 2950.583073][ T44] init_module_from_file+0x15d/0x180
[ 2950.583182][ T44] ? __do_sys_init_module+0x200/0x200
[ 2950.583296][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2950.583407][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 2950.583520][ T44] idempotent_init_module+0x226/0x760
[ 2950.583630][ T44] ? init_module_from_file+0x180/0x180
[ 2950.583744][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.583852][ T44] ? cap_capable+0x181/0x3f0
[ 2950.583966][ T44] __x64_sys_finit_module+0xcd/0x160
[ 2950.584075][ T44] do_syscall_64+0xbd/0xfc0
[ 2950.584186][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 2950.584319][ T44] RIP: 0033:0x7f9bef99034d
[ 2950.584435][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 2950.584612][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 2950.584774][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 2950.584942][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 2950.585103][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 2950.585265][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 2950.585432][ T44]
[ 2950.585520][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 2950.585746][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 2950.586011][ T44] Workqueue: netns cleanup_net
[ 2950.586120][ T44] Call Trace:
[ 2950.586202][ T44]
[ 2950.586258][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2950.586399][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.586511][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2950.586619][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2950.586754][ T44] ? lock_acquire+0x10a/0x150
[ 2950.586864][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.586978][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.587087][ T44] ? trace_contention_end+0xd6/0x110
[ 2950.587198][ T44] ? __mutex_lock+0x285/0x1f20
[ 2950.587310][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2950.587446][ T44] ? mark_held_locks+0x40/0x70
[ 2950.587561][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.587669][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 2950.587806][ T44] ? common_interrupt+0x92/0xf0
[ 2950.587920][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 2950.588031][ T44] ? nf_ct_iterate_cleanup+0xa6/0x350 [nf_conntrack]
[ 2950.588166][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 2950.588303][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 2950.588468][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 2950.588614][ T44] ? kfree+0x119/0x580
[ 2950.588698][ T44] ? lock_acquire+0x10a/0x150
[ 2950.588808][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 2950.588948][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 2950.589058][ T44] ? netns_install+0x280/0x280
[ 2950.589168][ T44] ? cleanup_net+0x3bc/0x890
[ 2950.589277][ T44] ? process_one_work+0xd16/0x1390
[ 2950.589386][ T44] ? net_passive_dec+0x190/0x190
[ 2950.589497][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.589617][ T44] ? process_one_work+0xd16/0x1390
[ 2950.589725][ T44] ? lock_acquire+0x10a/0x150
[ 2950.589836][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.589951][ T44] ? process_one_work+0xd57/0x1390
[ 2950.590062][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 2950.590171][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 2950.590283][ T44] ? assign_work+0x152/0x380
[ 2950.590394][ T44] ? worker_thread+0x4d6/0xd40
[ 2950.590512][ T44] ? process_one_work+0x1390/0x1390
[ 2950.590622][ T44] ? kthread+0x355/0x5b0
[ 2950.590704][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2950.590814][ T44] ? __lock_release.isra.0+0x59/0x170
[ 2950.590925][ T44] ? rcu_is_watching+0x15/0xd0
[ 2950.591032][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2950.591144][ T44] ? ret_from_fork+0x3fb/0x510
[ 2950.591257][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 2950.591392][ T44] ? __switch_to+0x53c/0xd00
[ 2950.591500][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 2950.591618][ T44] ? ret_from_fork_asm+0x11/0x20
[ 2950.591731][ T44]
[ 2950.591844][ T44]
[ 2950.591844][ T44] Showing all locks held in the system:
[ 2950.592015][ T44] 5 locks held by kworker/u16:0/12:
[ 2950.592124][ T44] 1 lock held by khungtaskd/44:
[ 2950.592227][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 2950.592450][ T44] 1 lock held by modprobe/29854:
[ 2950.592653][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 2950.592872][ T44]
[ 2950.592930][ T44] =============================================
[ 2950.592930][ T44]
[ 3073.460545][ T44] INFO: task modprobe:29854 blocked for more than 983 seconds.
[ 3073.460778][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 3073.460951][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 3073.461150][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 3073.461420][ T44] Call Trace:
[ 3073.461526][ T44]
[ 3073.461593][ T44] __schedule+0xae2/0x1720
[ 3073.461724][ T44] ? io_schedule_timeout+0x130/0x130
[ 3073.461840][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3073.461954][ T44] schedule+0xd4/0x260
[ 3073.462040][ T44] schedule_preempt_disabled+0x18/0x30
[ 3073.462149][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 3073.462261][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 3073.462376][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.462489][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3073.462607][ T44] ? register_pernet_subsys+0x19/0x40
[ 3073.462721][ T44] ? lock_acquire+0x10a/0x150
[ 3073.462836][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 3073.462952][ T44] down_write+0x1c6/0x1f0
[ 3073.463034][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 3073.463171][ T44] register_pernet_subsys+0x19/0x40
[ 3073.463278][ T44] pg_init+0x29/0x1000 [pktgen]
[ 3073.463388][ T44] do_one_initcall+0xa3/0x2e0
[ 3073.463498][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 3073.463642][ T44] ? kasan_unpoison+0x44/0x70
[ 3073.463756][ T44] do_init_module+0x27b/0x820
[ 3073.463867][ T44] ? free_module+0x450/0x450
[ 3073.463975][ T44] ? backing_file_read_iter+0x50e/0x730
[ 3073.464090][ T44] init_module_from_file+0x15d/0x180
[ 3073.464198][ T44] ? __do_sys_init_module+0x200/0x200
[ 3073.464312][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3073.464424][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 3073.464539][ T44] idempotent_init_module+0x226/0x760
[ 3073.464647][ T44] ? init_module_from_file+0x180/0x180
[ 3073.464761][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.464868][ T44] ? cap_capable+0x181/0x3f0
[ 3073.464978][ T44] __x64_sys_finit_module+0xcd/0x160
[ 3073.465086][ T44] do_syscall_64+0xbd/0xfc0
[ 3073.465199][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 3073.465333][ T44] RIP: 0033:0x7f9bef99034d
[ 3073.465449][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 3073.465618][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 3073.465785][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 3073.465948][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 3073.466110][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 3073.466269][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 3073.466435][ T44]
[ 3073.466521][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 3073.466754][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 3073.467016][ T44] Workqueue: netns cleanup_net
[ 3073.467124][ T44] Call Trace:
[ 3073.467205][ T44]
[ 3073.467260][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3073.467401][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.467513][ T44] ? update_curr+0x411/0x670
[ 3073.467622][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.467736][ T44] ? trace_contention_end+0xd6/0x110
[ 3073.467845][ T44] ? pick_task_fair+0x7d/0x1e0
[ 3073.467958][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3073.468102][ T44] ? mark_held_locks+0x40/0x70
[ 3073.468212][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.468320][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 3073.468454][ T44] ? common_interrupt+0x92/0xf0
[ 3073.468567][ T44] ? __schedule+0xd3e/0x1720
[ 3073.468680][ T44] ? trace_contention_end+0x30/0x110
[ 3073.468795][ T44] ? nf_ct_iterate_cleanup+0x9d/0x350 [nf_conntrack]
[ 3073.468930][ T44] ? nf_conntrack_cleanup_net_list+0x1aa/0x550 [nf_conntrack]
[ 3073.469094][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 3073.469256][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 3073.469423][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 3073.469562][ T44] ? kfree+0x119/0x580
[ 3073.469646][ T44] ? lock_acquire+0x10a/0x150
[ 3073.469760][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 3073.469898][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 3073.470008][ T44] ? netns_install+0x280/0x280
[ 3073.470118][ T44] ? cleanup_net+0x3bc/0x890
[ 3073.470226][ T44] ? process_one_work+0xd16/0x1390
[ 3073.470336][ T44] ? net_passive_dec+0x190/0x190
[ 3073.470444][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.470561][ T44] ? process_one_work+0xd16/0x1390
[ 3073.470671][ T44] ? lock_acquire+0x10a/0x150
[ 3073.470781][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.470889][ T44] ? process_one_work+0xd57/0x1390
[ 3073.471001][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 3073.471109][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 3073.471223][ T44] ? assign_work+0x152/0x380
[ 3073.471332][ T44] ? worker_thread+0x4d6/0xd40
[ 3073.471444][ T44] ? process_one_work+0x1390/0x1390
[ 3073.471557][ T44] ? kthread+0x355/0x5b0
[ 3073.471641][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3073.471753][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3073.471861][ T44] ? rcu_is_watching+0x15/0xd0
[ 3073.471969][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3073.472081][ T44] ? ret_from_fork+0x3fb/0x510
[ 3073.472190][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 3073.472327][ T44] ? __switch_to+0x53c/0xd00
[ 3073.472437][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3073.472551][ T44] ? ret_from_fork_asm+0x11/0x20
[ 3073.472663][ T44]
[ 3073.472776][ T44]
[ 3073.472776][ T44] Showing all locks held in the system:
[ 3073.472934][ T44] 4 locks held by kworker/u16:0/12:
[ 3073.473042][ T44] 1 lock held by khungtaskd/44:
[ 3073.473146][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 3073.473364][ T44] 1 lock held by modprobe/29854:
[ 3073.473465][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 3073.473687][ T44]
[ 3073.473742][ T44] =============================================
[ 3073.473742][ T44]
[ 3196.340546][ T44] INFO: task modprobe:29854 blocked for more than 1105 seconds.
[ 3196.340761][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 3196.340919][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 3196.341098][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 3196.341348][ T44] Call Trace:
[ 3196.341438][ T44]
[ 3196.341498][ T44] __schedule+0xae2/0x1720
[ 3196.341635][ T44] ? io_schedule_timeout+0x130/0x130
[ 3196.341750][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3196.341865][ T44] schedule+0xd4/0x260
[ 3196.341949][ T44] schedule_preempt_disabled+0x18/0x30
[ 3196.342058][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 3196.342169][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 3196.342280][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.342388][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3196.342498][ T44] ? register_pernet_subsys+0x19/0x40
[ 3196.342619][ T44] ? lock_acquire+0x10a/0x150
[ 3196.342731][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 3196.342845][ T44] down_write+0x1c6/0x1f0
[ 3196.342928][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 3196.343067][ T44] register_pernet_subsys+0x19/0x40
[ 3196.343175][ T44] pg_init+0x29/0x1000 [pktgen]
[ 3196.343287][ T44] do_one_initcall+0xa3/0x2e0
[ 3196.343395][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 3196.343541][ T44] ? kasan_unpoison+0x44/0x70
[ 3196.343651][ T44] do_init_module+0x27b/0x820
[ 3196.343764][ T44] ? free_module+0x450/0x450
[ 3196.343871][ T44] ? backing_file_read_iter+0x50e/0x730
[ 3196.343981][ T44] init_module_from_file+0x15d/0x180
[ 3196.344092][ T44] ? __do_sys_init_module+0x200/0x200
[ 3196.344204][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3196.344312][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 3196.344421][ T44] idempotent_init_module+0x226/0x760
[ 3196.344536][ T44] ? init_module_from_file+0x180/0x180
[ 3196.344646][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.344752][ T44] ? cap_capable+0x181/0x3f0
[ 3196.344863][ T44] __x64_sys_finit_module+0xcd/0x160
[ 3196.344973][ T44] do_syscall_64+0xbd/0xfc0
[ 3196.345082][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 3196.345215][ T44] RIP: 0033:0x7f9bef99034d
[ 3196.345329][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 3196.345492][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 3196.345666][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 3196.345825][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 3196.345984][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 3196.346144][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 3196.346311][ T44]
[ 3196.346394][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 3196.346626][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 3196.346886][ T44] Workqueue: netns cleanup_net
[ 3196.346994][ T44] Call Trace:
[ 3196.347077][ T44]
[ 3196.347132][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3196.347273][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.347379][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3196.347487][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3196.347629][ T44] ? update_curr+0x411/0x670
[ 3196.347738][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.347847][ T44] ? trace_contention_end+0xd6/0x110
[ 3196.347955][ T44] ? irqentry_enter+0x2a/0xd0
[ 3196.348065][ T44] ? __mutex_lock+0x285/0x1f20
[ 3196.348177][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3196.348311][ T44] ? mark_held_locks+0x40/0x70
[ 3196.348425][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.348539][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.348652][ T44] ? lockdep_hardirqs_on+0x84/0x130
[ 3196.348762][ T44] ? raw_irqentry_exit_cond_resched+0x1c/0x50
[ 3196.348899][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 3196.349060][ T44] ? common_interrupt+0x92/0xf0
[ 3196.349172][ T44] ? asm_common_interrupt+0x26/0x40
[ 3196.349282][ T44] ? trace_contention_end+0x30/0x110
[ 3196.349391][ T44] ? nf_conntrack_cleanup_net_list+0x1aa/0x550 [nf_conntrack]
[ 3196.349561][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 3196.349721][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 3196.349882][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 3196.350048][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 3196.350182][ T44] ? kfree+0x119/0x580
[ 3196.350265][ T44] ? lock_acquire+0x10a/0x150
[ 3196.350374][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 3196.350518][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 3196.350628][ T44] ? netns_install+0x280/0x280
[ 3196.350737][ T44] ? cleanup_net+0x3bc/0x890
[ 3196.350843][ T44] ? process_one_work+0xd16/0x1390
[ 3196.350951][ T44] ? net_passive_dec+0x190/0x190
[ 3196.351059][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.351166][ T44] ? process_one_work+0xd16/0x1390
[ 3196.351272][ T44] ? lock_acquire+0x10a/0x150
[ 3196.351377][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.351485][ T44] ? process_one_work+0xd57/0x1390
[ 3196.351609][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 3196.351716][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 3196.351826][ T44] ? assign_work+0x152/0x380
[ 3196.351934][ T44] ? worker_thread+0x4d6/0xd40
[ 3196.352045][ T44] ? process_one_work+0x1390/0x1390
[ 3196.352152][ T44] ? kthread+0x355/0x5b0
[ 3196.352235][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3196.352342][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3196.352451][ T44] ? rcu_is_watching+0x15/0xd0
[ 3196.352566][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3196.352675][ T44] ? ret_from_fork+0x3fb/0x510
[ 3196.352784][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 3196.352919][ T44] ? __switch_to+0x53c/0xd00
[ 3196.353030][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3196.353139][ T44] ? ret_from_fork_asm+0x11/0x20
[ 3196.353251][ T44]
[ 3196.353363][ T44]
[ 3196.353363][ T44] Showing all locks held in the system:
[ 3196.353528][ T44] 4 locks held by kworker/u16:0/12:
[ 3196.353637][ T44] 1 lock held by khungtaskd/44:
[ 3196.353740][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 3196.353959][ T44] 1 lock held by modprobe/29854:
[ 3196.354060][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 3196.354282][ T44]
[ 3196.354334][ T44] =============================================
[ 3196.354334][ T44]
[ 3319.220546][ T44] INFO: task modprobe:29854 blocked for more than 1228 seconds.
[ 3319.220777][ T44] Tainted: G W 6.19.0-rc1-virtme #1
[ 3319.220951][ T44] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 3319.221151][ T44] task:modprobe state:D stack:25136 pid:29854 tgid:29854 ppid:1 task_flags:0x400100 flags:0x00080002
[ 3319.221410][ T44] Call Trace:
[ 3319.221519][ T44]
[ 3319.221582][ T44] __schedule+0xae2/0x1720
[ 3319.221707][ T44] ? io_schedule_timeout+0x130/0x130
[ 3319.221830][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3319.221952][ T44] schedule+0xd4/0x260
[ 3319.222043][ T44] schedule_preempt_disabled+0x18/0x30
[ 3319.222158][ T44] rwsem_down_write_slowpath+0x40b/0xc10
[ 3319.222272][ T44] ? rwsem_down_read_slowpath+0xd10/0xd10
[ 3319.222386][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.222500][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3319.222623][ T44] ? register_pernet_subsys+0x19/0x40
[ 3319.222731][ T44] ? lock_acquire+0x10a/0x150
[ 3319.222839][ T44] ? pg_cleanup+0x80/0x80 [pktgen]
[ 3319.222950][ T44] down_write+0x1c6/0x1f0
[ 3319.223033][ T44] ? rwsem_down_write_slowpath+0xc10/0xc10
[ 3319.223173][ T44] register_pernet_subsys+0x19/0x40
[ 3319.223282][ T44] pg_init+0x29/0x1000 [pktgen]
[ 3319.223391][ T44] do_one_initcall+0xa3/0x2e0
[ 3319.223513][ T44] ? trace_event_raw_event_initcall_level+0x1f0/0x1f0
[ 3319.223648][ T44] ? kasan_unpoison+0x44/0x70
[ 3319.223759][ T44] do_init_module+0x27b/0x820
[ 3319.223869][ T44] ? free_module+0x450/0x450
[ 3319.223979][ T44] ? backing_file_read_iter+0x50e/0x730
[ 3319.224090][ T44] init_module_from_file+0x15d/0x180
[ 3319.224197][ T44] ? __do_sys_init_module+0x200/0x200
[ 3319.224313][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3319.224423][ T44] ? do_raw_spin_unlock+0x59/0x250
[ 3319.224537][ T44] idempotent_init_module+0x226/0x760
[ 3319.224648][ T44] ? init_module_from_file+0x180/0x180
[ 3319.224758][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.224867][ T44] ? cap_capable+0x181/0x3f0
[ 3319.224976][ T44] __x64_sys_finit_module+0xcd/0x160
[ 3319.225085][ T44] do_syscall_64+0xbd/0xfc0
[ 3319.225194][ T44] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 3319.225328][ T44] RIP: 0033:0x7f9bef99034d
[ 3319.225448][ T44] RSP: 002b:00007ffe69f5a6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 3319.225619][ T44] RAX: ffffffffffffffda RBX: 00005602e0cf2a00 RCX: 00007f9bef99034d
[ 3319.225780][ T44] RDX: 0000000000000000 RSI: 00005602cc298f2e RDI: 0000000000000005
[ 3319.225938][ T44] RBP: 00007ffe69f5a790 R08: 0000000000000000 R09: 0000000000000000
[ 3319.226098][ T44] R10: 0000000000000000 R11: 0000000000000246 R12: 00005602cc298f2e
[ 3319.226260][ T44] R13: 0000000000040000 R14: 00005602e0cf2b20 R15: 00005602e0cf2460
[ 3319.226428][ T44]
[ 3319.226518][ T44] INFO: task modprobe:29854 blocked on an rw-semaphore likely owned by task kworker/u16:0:12
[ 3319.226746][ T44] task:kworker/u16:0 state:R running task stack:26272 pid:12 tgid:12 ppid:2 task_flags:0x4208060 flags:0x00080000
[ 3319.227007][ T44] Workqueue: netns cleanup_net
[ 3319.227115][ T44] Call Trace:
[ 3319.227197][ T44]
[ 3319.227254][ T44] ? rcu_read_lock_sched_held+0x3c/0x70
[ 3319.227363][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.227473][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3319.227587][ T44] ? update_curr+0x411/0x670
[ 3319.227696][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.227802][ T44] ? trace_contention_end+0xd6/0x110
[ 3319.227911][ T44] ? __mutex_lock+0x285/0x1f20
[ 3319.228018][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 3319.228154][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3319.228293][ T44] ? mark_held_locks+0x40/0x70
[ 3319.228401][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.228517][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.228625][ T44] ? trace_irq_disable.constprop.0+0xce/0x100
[ 3319.228758][ T44] ? common_interrupt+0x92/0xf0
[ 3319.228867][ T44] ? asm_common_interrupt+0x26/0x40
[ 3319.228977][ T44] ? trace_contention_end+0x30/0x110
[ 3319.229084][ T44] ? perf_trace_sched_switch+0x6d0/0x6d0
[ 3319.229193][ T44] ? nf_ct_iterate_cleanup+0x81/0x350 [nf_conntrack]
[ 3319.229331][ T44] ? nf_ct_iterate_cleanup+0x4b/0x350 [nf_conntrack]
[ 3319.229469][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 3319.229634][ T44] ? nf_ct_port_nlattr_to_tuple+0x230/0x230 [nf_conntrack]
[ 3319.229794][ T44] ? nf_conntrack_cleanup_net_list+0x3da/0x550 [nf_conntrack]
[ 3319.229955][ T44] ? nf_conntrack_cleanup_net_list+0x19d/0x550 [nf_conntrack]
[ 3319.230120][ T44] ? nf_conntrack_cleanup_end+0x70/0x70 [nf_conntrack]
[ 3319.230256][ T44] ? kfree+0x119/0x580
[ 3319.230339][ T44] ? lock_acquire+0x10a/0x150
[ 3319.230452][ T44] ? nf_conntrack_pernet_exit+0xa1/0x140 [nf_conntrack]
[ 3319.230593][ T44] ? ops_undo_list+0x2d7/0x8f0
[ 3319.230703][ T44] ? netns_install+0x280/0x280
[ 3319.230815][ T44] ? cleanup_net+0x3bc/0x890
[ 3319.230922][ T44] ? process_one_work+0xd16/0x1390
[ 3319.231031][ T44] ? net_passive_dec+0x190/0x190
[ 3319.231139][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.231249][ T44] ? process_one_work+0xd16/0x1390
[ 3319.231356][ T44] ? lock_acquire+0x10a/0x150
[ 3319.231469][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.231586][ T44] ? process_one_work+0xd57/0x1390
[ 3319.231699][ T44] ? pwq_dec_nr_in_flight+0x700/0x700
[ 3319.231808][ T44] ? lock_acquire.part.0+0xbc/0x260
[ 3319.231918][ T44] ? assign_work+0x152/0x380
[ 3319.232028][ T44] ? worker_thread+0x4d6/0xd40
[ 3319.232139][ T44] ? process_one_work+0x1390/0x1390
[ 3319.232246][ T44] ? kthread+0x355/0x5b0
[ 3319.232331][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3319.232444][ T44] ? __lock_release.isra.0+0x59/0x170
[ 3319.232557][ T44] ? rcu_is_watching+0x15/0xd0
[ 3319.232667][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3319.232776][ T44] ? ret_from_fork+0x3fb/0x510
[ 3319.232886][ T44] ? arch_exit_to_user_mode_prepare.isra.0+0x140/0x140
[ 3319.233021][ T44] ? __switch_to+0x53c/0xd00
[ 3319.233130][ T44] ? kthread_is_per_cpu+0xe0/0xe0
[ 3319.233240][ T44] ? ret_from_fork_asm+0x11/0x20
[ 3319.233352][ T44]
[ 3319.233435][ T44] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
[ 3319.233650][ T44]
[ 3319.233650][ T44] Showing all locks held in the system:
[ 3319.233809][ T44] 5 locks held by kworker/u16:0/12:
[ 3319.233917][ T44] 1 lock held by khungtaskd/44:
[ 3319.234019][ T44] #0: ffffffff9e3850c0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 3319.234238][ T44] 1 lock held by modprobe/29854:
[ 3319.234340][ T44] #0: ffffffff9ea85c50 (pernet_ops_rwsem){++++}-{4:4}, at: register_pernet_subsys+0x19/0x40
[ 3319.234567][ T44]
[ 3319.234620][ T44] =============================================
[ 3319.234620][ T44]
WAIT TIMEOUT stderr
Ctrl-C stderr
Ctrl-C stderr