====================================== | xx__-> [ 1947.382604][ T12] ------------[ cut here ]------------ | [ 1947.383039][ T12] conntrack cleanup blocked for 60s | [ 1947.383042][ T12] WARNING: net/netfilter/nf_conntrack_core.c:2511 at 0x0, CPU#2: kworker/u16:0/12 | [ 1947.383558][ T12] Modules linked in: cls_bpf xt_conntrack nft_compat nf_tables sctp_diag sctp act_mirred cls_u32 ifb openvswitch psample nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nsh act_gact cls_flower sch_ingress vxlan [last unloaded: ila] [ 1947.384588][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1947.384816][ T12] Workqueue: netns cleanup_net [ 1947.385022][ T12] RIP: 0010:nf_conntrack_cleanup_net_list (net/netfilter/nf_conntrack_core.c:2511 (discriminator 16)) nf_conntrack [ 1947.385284][ T12] Code: 00 48 8b 54 24 18 48 8b 05 c3 38 98 e6 48 81 c2 60 ea 00 00 48 39 c2 78 0a e8 42 be 87 e5 e9 25 fd ff ff 48 8d 3d 56 56 ed ff <67> 48 0f b9 3a eb e8 48 8b 5c 24 28 48 b8 00 00 00 00 00 fc ff df All code ======== 0: 00 48 8b add %cl,-0x75(%rax) 3: 54 push %rsp 4: 24 18 and $0x18,%al 6: 48 8b 05 c3 38 98 e6 mov -0x1967c73d(%rip),%rax # 0xffffffffe69838d0 d: 48 81 c2 60 ea 00 00 add $0xea60,%rdx 14: 48 39 c2 cmp %rax,%rdx 17: 78 0a js 0x23 19: e8 42 be 87 e5 call 0xffffffffe587be60 1e: e9 25 fd ff ff jmp 0xfffffffffffffd48 23: 48 8d 3d 56 56 ed ff lea -0x12a9aa(%rip),%rdi # 0xffffffffffed5680 2a:* 67 48 0f b9 3a ud1 (%edx),%rdi <-- trapping instruction 2f: eb e8 jmp 0x19 31: 48 8b 5c 24 28 mov 0x28(%rsp),%rbx 36: 48 b8 00 00 00 00 00 movabs $0xdffffc0000000000,%rax 3d: fc ff df Code starting with the faulting instruction =========================================== 0: 67 48 0f b9 3a ud1 (%edx),%rdi 5: eb e8 jmp 0xffffffffffffffef 7: 48 8b 5c 24 28 mov 0x28(%rsp),%rbx c: 48 b8 00 00 00 00 00 movabs $0xdffffc0000000000,%rax 13: fc ff df [ 1947.385814][ T12] RSP: 0018:ffa00000000c7980 EFLAGS: 00010287 [ 1947.386028][ T12] RAX: 0000000100192150 RBX: ffa00000000c7af8 RCX: 0000000000000001 [ 1947.386272][ T12] RDX: 000000010019214f RSI: 0000000000000004 RDI: ffffffffc0363030 [ 1947.386506][ T12] RBP: 0000000000000001 R08: ffffffffc048d7aa R09: ffe21c00014b10c4 [ 1947.386760][ T12] R10: ffe21c00014b10c5 R11: 0000000000000001 R12: dffffc0000000000 [ 1947.387022][ T12] R13: ff1100000a588620 R14: fffffbfff806e007 R15: ff1100000fa11c00 [ 1947.387261][ T12] FS: 0000000000000000(0000) GS:ff110000c3f0b000(0000) knlGS:0000000000000000 [ 1947.387530][ T12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1947.387755][ T12] CR2: 00007f0e344f9680 CR3: 0000000043b48002 CR4: 0000000000771ef0 [ 1947.387995][ T12] PKRU: 55555554 [ 1947.388139][ T12] Call Trace: [ 1947.388664][ T12] [ 1947.388788][ T12] ? nf_conntrack_cleanup_end (net/netfilter/nf_conntrack_core.c:2488) nf_conntrack [ 1947.388998][ T12] ? kfree (mm/slub.c:6663 (discriminator 3) mm/slub.c:6871 (discriminator 3)) [ 1947.389140][ T12] ? lock_acquire (./include/trace/events/lock.h:24 (discriminator 33) kernel/locking/lockdep.c:5831 (discriminator 33)) [ 1947.389317][ T12] ? nf_conntrack_pernet_exit (net/netfilter/nf_conntrack_standalone.c:1129 (discriminator 4)) nf_conntrack [ 1947.389520][ T12] ops_undo_list (net/core/net_namespace.c:251 (discriminator 4)) [ 1947.389712][ T12] ? netns_install (net/core/net_namespace.c:223) [ 1947.389886][ T12] cleanup_net (net/core/net_namespace.c:698) [ 1947.390057][ T12] ? process_one_work (kernel/workqueue.c:3233 (discriminator 1)) [ 1947.390236][ T12] ? net_passive_dec (net/core/net_namespace.c:660) [ 1947.390409][ T12] ? rcu_is_watching (./include/linux/context_tracking.h:128 (discriminator 1) kernel/rcu/tree.c:751 (discriminator 1)) [ 1947.390596][ T12] ? process_one_work (kernel/workqueue.c:3233 (discriminator 1)) [ 1947.390770][ T12] ? lock_acquire (./include/trace/events/lock.h:24 (discriminator 33) kernel/locking/lockdep.c:5831 (discriminator 33)) [ 1947.390944][ T12] ? rcu_is_watching (./include/linux/context_tracking.h:128 (discriminator 1) kernel/rcu/tree.c:751 (discriminator 1)) [ 1947.391120][ T12] process_one_work (kernel/workqueue.c:3262) [ 1947.391297][ T12] ? pwq_dec_nr_in_flight (kernel/workqueue.c:3159) [ 1947.391469][ T12] ? lock_acquire.part.0 (kernel/locking/lockdep.c:470 kernel/locking/lockdep.c:5870) [ 1947.391660][ T12] ? assign_work (kernel/workqueue.c:1200) [ 1947.391840][ T12] worker_thread (kernel/workqueue.c:3334 (discriminator 2) kernel/workqueue.c:3421 (discriminator 2)) [ 1947.392017][ T12] ? process_one_work (kernel/workqueue.c:3367) [ 1947.392187][ T12] kthread (kernel/kthread.c:463) [ 1947.392335][ T12] ? kthread_is_per_cpu (kernel/kthread.c:412) [ 1947.392506][ T12] ? __lock_release.isra.0 (kernel/locking/lockdep.c:5536) [ 1947.392698][ T12] ? rcu_is_watching (./include/linux/context_tracking.h:128 (discriminator 1) kernel/rcu/tree.c:751 (discriminator 1)) [ 1947.392869][ T12] ? kthread_is_per_cpu (kernel/kthread.c:412) [ 1947.393041][ T12] ret_from_fork (arch/x86/kernel/process.c:164) [ 1947.393218][ T12] ? arch_exit_to_user_mode_prepare.isra.0 (arch/x86/entry/syscall_64.c:37) [ 1947.393421][ T12] ? __switch_to (./include/linux/thread_info.h:140 (discriminator 2) arch/x86/kernel/process.h:16 (discriminator 2) arch/x86/kernel/process_64.c:676 (discriminator 2)) [ 1947.393608][ T12] ? kthread_is_per_cpu (kernel/kthread.c:412) Finger prints: nf_conntrack_cleanup_net_list:ops_undo_list:cleanup_net:process_one_work:worker_thread