crash can analyse the physical machine vmcore generated by kdump: SLES11-40:/dat/bnx2_core # crash vmlinux-2.6.27.19-5-xen vmlinux-2.6.27.19-5-xen.debug vmcore crash 5.0.1 Copyright (C) 2002-2010 Red Hat, Inc. Copyright (C) 2004, 2005, 2006 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. GNU gdb (GDB) 7.0 Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-unknown-linux-gnu"... KERNEL: vmlinux-2.6.27.19-5-xen DEBUG KERNEL: vmlinux-2.6.27.19-5-xen.debug DUMPFILE: vmcore CPUS: 4 DATE: Wed Feb 1 12:05:15 2012 UPTIME: 17:53:39 LOAD AVERAGE: 0.00, 0.00, 0.00 TASKS: 171 NODENAME: dom0-64 RELEASE: 2.6.27.19-5-xen VERSION: #1 SMP 2009-02-28 04:40:21 +0100 MACHINE: x86_64 (2133 Mhz) MEMORY: 31.2 GB PANIC: "Oops: 0000 [1] SMP " (check log for details) PID: 11 COMMAND: "events/0" TASK: ffff8807cb0f0380 [THREAD_INFO: ffff8807cb0f2000] CPU: 0 STATE: TASK_RUNNING (PANIC) crash> q SLES11-40:/dat/xen_vm # xm li Name ID Mem VCPUs State Time(s) Domain-0 0 7416 16 r----- 30181.7 sles10sp3 512 4 0.0 sles11 1 512 4 -b---- 401.8 sles11-1 512 4 0.0 win2008x64 1024 4 0.0 SLES11-40:/dat/xen_vm # xm co 1 sles11:~ # sles11:~ # uname -a Linux sles11 2.6.27.19-5-xen #1 SMP 2009-02-28 04:40:21 +0100 x86_64 x86_64 x86_64 GNU/Linux SLES11-40:/dat/xen_vm # xm dump-core 1 /dat//xen_vm/sles11.dumpcore Crash can't anaylyse ‘xm dump-core' generated core file SLES11-40:/dat/bnx2_core # crash vmlinux-2.6.27.19-5-xen vmlinux-2.6.27.19-5-xen.debug ../xen_vm/sles11.dumpcore crash 5.0.1 Copyright (C) 2002-2010 Red Hat, Inc. Copyright (C) 2004, 2005, 2006 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. GNU gdb (GDB) 7.0 Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-unknown-linux-gnu"... crash: cannot resolve "end_pfn" SLES11-40:/dat/bnx2_core # crash -d14 vmlinux-2.6.27.19-5-xen vmlinux-2.6.27.19-5-xen.debug ../xen_vm/sles11.dumpcore crash 5.0.1 Copyright (C) 2002-2010 Red Hat, Inc. Copyright (C) 2004, 2005, 2006 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. crash: ../xen_vm/sles11.dumpcore: not a netdump ELF dumpfile crash: ../xen_vm/sles11.dumpcore: not a kdump ELF dumpfile Elf64_Ehdr: e_ident: \177ELF e_ident[EI_CLASS]: 2 (ELFCLASS64) e_ident[EI_DATA]: 1 (ELFDATA2LSB) e_ident[EI_VERSION]: 1 (EV_CURRENT) e_ident[EI_OSABI]: 0 (ELFOSABI_SYSV) e_ident[EI_ABIVERSION]: 1 e_type: 4 (ET_CORE) e_machine: 62 (EM_X86_64) e_version: 1 (EV_CURRENT) e_entry: 0 e_phoff: 0 e_shoff: 40 e_flags: 0 e_ehsize: 40 e_phentsize: 38 e_phnum: 0 e_shentsize: 40 e_shnum: 7 e_shstrndx: 1 Elf64_Shdr: sh_name: 0 "" sh_type: 0 (SHT_NULL) sh_flags: 0 sh_addr: 0 sh_offset: 0 sh_size: 0 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 Elf64_Shdr: sh_name: 1 ".shstrtab" sh_type: 3 (SHT_STRTAB) sh_flags: 0 sh_addr: 0 sh_offset: 20207000 sh_size: 48 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 .shstrtab .note.Xen .xen_prstatus .xen_shared_info .xen_pages .xen_p2m Elf64_Shdr: sh_name: b ".note.Xen" sh_type: 7 (SHT_NOTE) sh_flags: 0 sh_addr: 0 sh_offset: 200 sh_size: 568 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 namesz: 4 descz: 0 type: 2000000 (XEN_ELFNOTE_DUMPCORE_NONE) name: Xen (empty) namesz: 4 descz: 32 type: 2000001 (XEN_ELFNOTE_DUMPCORE_HEADER) name: Xen 00000000f00febed 0000000000000004 0000000000020000 0000000000001000 namesz: 4 descz: 1280 type: 2000002 (XEN_ELFNOTE_DUMPCORE_XEN_VERSION) name: Xen 0000000000000004 0000000000000000 31393031325f302e 00322e302d34305f 7372657620636367 2e332e34206e6f69 342d6363675b2034 636e6172622d335f 6973697665722068 3739323531206e6f 4553555328205d33 002978756e694c20 ff00646c69756261 010000000000e008 ffff83022fc87f00 0000000000000292 000000000000020d ffff83022fc87f28 2079614d20756854 34343a3131203032 204354552031343a ffff830030313032 2d302e332d6e6578 782034365f363878 782d302e332d6e65 68207032335f3638 782d302e332d6d76 76682032335f3638 38782d302e332d6d 7668207032335f36 38782d302e332d6d 0000002034365f36 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2d30003139303132 782034365f363878 782d302e332d6e65 68207032335f3638 782d302e332d6d76 76682032335f3638 38782d302e332d6d 7668207032335f36 ffff800000000000 0000000000001000 namesz: 4 descz: 8 type: 2000003 (XEN_ELFNOTE_DUMPCORE_FORMAT_VERSION) name: Xen 0000000000000001 Elf64_Shdr: sh_name: 15 ".xen_prstatus" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 768 sh_size: 50c0 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 1430 Elf64_Shdr: sh_name: 23 ".xen_shared_info" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 5828 sh_size: 1000 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 1000 Elf64_Shdr: sh_name: 34 ".xen_pages" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 7000 sh_size: 20000000 sh_link: 0 sh_info: 0 sh_addralign: 1000 sh_entsize: 1000 Elf64_Shdr: sh_name: 3f ".xen_p2m" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 20007000 sh_size: 200000 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 10 flags: 109 (XENDUMP_LOCAL|XC_CORE_ELF|XC_CORE_P2M_CREATE) xfd: 3 page_size: 4096 ofp: 0 page: ccebf0 panic_pc: 0 panic_sp: 0 accesses: 0 cache_hits: 0 last_pfn: -1 redundant: 0 poc[5000]: ccfc00 (none used) xc_save: nr_pfns: 0 (0x0) vmconfig_size: 0 (0x0) vmconfig_buf: 0 p2m_frame_list: 0 (none) pfns_not: 0 pfns_not_offset: 0 vcpu_ctxt_offset: 0 shared_info_page_offset: 0 region_pfn_type: 0 batch_count: 0 batch_offsets: 0 (none) ia64_version: 0 ia64_page_offsets: 0 (none) xc_core: header: xch_magic: f00febed (XC_CORE_MAGIC) xch_nr_vcpus: 4 xch_nr_pages: 131072 (0x20000) xch_ctxt_offset: 1896 (0x768) xch_index_offset: 536899584 (0x20007000) xch_pages_offset: 28672 (0x7000) elf_class: ELFCLASS64 elf_strtab_offset: 538996736 (0x20207000) format_version: 0000000000000001 shared_info_offset: 22568 (0x5828) elf_index_pfn[128]: 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 0:-1 last_batch: index: 0 (0 - 0) accesses: 0 duplicates: 0 elf32: 0 elf64: cce630 p2m_frames: 0 p2m_frame_index_list: Elf64_Ehdr: e_ident: \177ELF e_ident[EI_CLASS]: 2 (ELFCLASS64) e_ident[EI_DATA]: 1 (ELFDATA2LSB) e_ident[EI_VERSION]: 1 (EV_CURRENT) e_ident[EI_OSABI]: 0 (ELFOSABI_SYSV) e_ident[EI_ABIVERSION]: 1 e_type: 4 (ET_CORE) e_machine: 62 (EM_X86_64) e_version: 1 (EV_CURRENT) e_entry: 0 e_phoff: 0 e_shoff: 40 e_flags: 0 e_ehsize: 40 e_phentsize: 38 e_phnum: 0 e_shentsize: 40 e_shnum: 7 e_shstrndx: 1 Elf64_Shdr: sh_name: 0 "" sh_type: 0 (SHT_NULL) sh_flags: 0 sh_addr: 0 sh_offset: 0 sh_size: 0 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 Elf64_Shdr: sh_name: 1 ".shstrtab" sh_type: 3 (SHT_STRTAB) sh_flags: 0 sh_addr: 0 sh_offset: 20207000 sh_size: 48 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 .shstrtab .note.Xen .xen_prstatus .xen_shared_info .xen_pages .xen_p2m Elf64_Shdr: sh_name: b ".note.Xen" sh_type: 7 (SHT_NOTE) sh_flags: 0 sh_addr: 0 sh_offset: 200 sh_size: 568 sh_link: 0 sh_info: 0 sh_addralign: 0 sh_entsize: 0 namesz: 4 descz: 0 type: 2000000 (XEN_ELFNOTE_DUMPCORE_NONE) name: Xen (empty) namesz: 4 descz: 32 type: 2000001 (XEN_ELFNOTE_DUMPCORE_HEADER) name: Xen 00000000f00febed 0000000000000004 0000000000020000 0000000000001000 namesz: 4 descz: 1280 type: 2000002 (XEN_ELFNOTE_DUMPCORE_XEN_VERSION) name: Xen 0000000000000004 0000000000000000 31393031325f302e 00322e302d34305f 7372657620636367 2e332e34206e6f69 342d6363675b2034 636e6172622d335f 6973697665722068 3739323531206e6f 4553555328205d33 002978756e694c20 ff00646c69756261 010000000000e008 ffff83022fc87f00 0000000000000292 000000000000020d ffff83022fc87f28 2079614d20756854 34343a3131203032 204354552031343a ffff830030313032 2d302e332d6e6578 782034365f363878 782d302e332d6e65 68207032335f3638 782d302e332d6d76 76682032335f3638 38782d302e332d6d 7668207032335f36 38782d302e332d6d 0000002034365f36 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 2d30003139303132 782034365f363878 782d302e332d6e65 68207032335f3638 782d302e332d6d76 76682032335f3638 38782d302e332d6d 7668207032335f36 ffff800000000000 0000000000001000 namesz: 4 descz: 8 type: 2000003 (XEN_ELFNOTE_DUMPCORE_FORMAT_VERSION) name: Xen 0000000000000001 Elf64_Shdr: sh_name: 15 ".xen_prstatus" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 768 sh_size: 50c0 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 1430 Elf64_Shdr: sh_name: 23 ".xen_shared_info" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 5828 sh_size: 1000 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 1000 Elf64_Shdr: sh_name: 34 ".xen_pages" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 7000 sh_size: 20000000 sh_link: 0 sh_info: 0 sh_addralign: 1000 sh_entsize: 1000 Elf64_Shdr: sh_name: 3f ".xen_p2m" sh_type: 1 (SHT_PROGBITS) sh_flags: 0 sh_addr: 0 sh_offset: 20007000 sh_size: 200000 sh_link: 0 sh_info: 0 sh_addralign: 8 sh_entsize: 10 gdb vmlinux-2.6.27.19-5-xen.debug GNU gdb (GDB) 7.0 Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-unknown-linux-gnu"... GETBUF(248 -> 0) GETBUF(1500 -> 1) FREEBUF(1) FREEBUF(0) <readmem: ffffffff8047bec0, KVADDR, "kernel_config_data", 32768, (ROE), 1886ee0> addr: ffffffff8047bec0 paddr: 47bec0 cnt: 320 GETBUF(248 -> 0) FREEBUF(0) MEMBER_OFFSET(vcpu_guest_context, ctrlreg): 4984 ctrlreg[0]: 8005003b ctrlreg[1]: db1d000 ctrlreg[2]: 7fff28c5fde8 ctrlreg[3]: db55000 ctrlreg[4]: 2660 ctrlreg[5]: 0 ctrlreg[6]: 0 ctrlreg[7]: 0 page: found mfn 0xdb55 (56149) at index 125749 contents of PML4 page: 0000000000000000: 0000000000000000 0000000000000000 0000000000000010: 0000000000000000 0000000000000000 0000000000000020: 0000000000000000 0000000000000000 0000000000000030: 0000000000000000 0000000000000000 0000000000000040: 0000000000000000 0000000000000000 0000000000000050: 0000000000000000 0000000000000000 0000000000000060: 0000000000000000 0000000000000000 0000000000000070: 0000000000000000 0000000000000000 0000000000000080: 0000000000000000 0000000000000000 0000000000000090: 0000000000000000 0000000000000000 00000000000000a0: 0000000000000000 0000000000000000 00000000000000b0: 0000000000000000 0000000000000000 00000000000000c0: 0000000000000000 0000000000000000 00000000000000d0: 0000000000000000 0000000000000000 00000000000000e0: 0000000000000000 0000000000000000 00000000000000f0: 0000000000000000 0000000000000000 0000000000000100: 0000000000000000 0000000000000000 0000000000000110: 0000000000000000 0000000000000000 0000000000000120: 0000000000000000 0000000000000000 0000000000000130: 0000000000000000 0000000000000000 0000000000000140: 0000000000000000 0000000000000000 0000000000000150: 0000000000000000 0000000000000000 0000000000000160: 0000000000000000 0000000000000000 0000000000000170: 0000000000000000 0000000000000000 0000000000000180: 0000000000000000 0000000000000000 0000000000000190: 0000000000000000 0000000000000000 00000000000001a0: 0000000000000000 0000000000000000 00000000000001b0: 0000000000000000 0000000000000000 00000000000001c0: 0000000000000000 0000000000000000 00000000000001d0: 0000000000000000 0000000000000000 00000000000001e0: 0000000000000000 0000000000000000 00000000000001f0: 0000000000000000 0000000000000000 0000000000000200: 0000000000000000 0000000000000000 0000000000000210: 0000000000000000 0000000000000000 0000000000000220: 0000000000000000 0000000000000000 0000000000000230: 0000000000000000 0000000000000000 0000000000000240: 0000000000000000 0000000000000000 0000000000000250: 0000000000000000 0000000000000000 0000000000000260: 0000000000000000 0000000000000000 0000000000000270: 0000000000000000 0000000000000000 0000000000000280: 0000000000000000 0000000000000000 0000000000000290: 0000000000000000 0000000000000000 00000000000002a0: 0000000000000000 0000000000000000 00000000000002b0: 0000000000000000 0000000000000000 00000000000002c0: 0000000000000000 0000000000000000 00000000000002d0: 0000000000000000 0000000000000000 00000000000002e0: 0000000000000000 0000000000000000 00000000000002f0: 0000000000000000 0000000000000000 0000000000000300: 0000000000000000 0000000000000000 0000000000000310: 0000000000000000 0000000000000000 0000000000000320: 0000000000000000 0000000000000000 0000000000000330: 0000000000000000 0000000000000000 0000000000000340: 0000000000000000 0000000000000000 0000000000000350: 0000000000000000 0000000000000000 0000000000000360: 0000000000000000 0000000000000000 0000000000000370: 0000000000000000 0000000000000000 0000000000000380: 0000000000000000 0000000000000000 0000000000000390: 0000000000000000 0000000000000000 00000000000003a0: 0000000000000000 0000000000000000 00000000000003b0: 0000000000000000 0000000000000000 00000000000003c0: 0000000000000000 0000000000000000 00000000000003d0: 0000000000000000 0000000000000000 00000000000003e0: 0000000000000000 0000000000000000 00000000000003f0: 0000000000000000 0000000000000000 0000000000000400: 0000000000000000 0000000000000000 0000000000000410: 0000000000000000 0000000000000000 0000000000000420: 0000000000000000 0000000000000000 0000000000000430: 0000000000000000 0000000000000000 0000000000000440: 0000000000000000 0000000000000000 0000000000000450: 0000000000000000 0000000000000000 0000000000000460: 0000000000000000 0000000000000000 0000000000000470: 0000000000000000 0000000000000000 0000000000000480: 0000000000000000 0000000000000000 0000000000000490: 0000000000000000 0000000000000000 00000000000004a0: 0000000000000000 0000000000000000 00000000000004b0: 0000000000000000 0000000000000000 00000000000004c0: 0000000000000000 0000000000000000 00000000000004d0: 0000000000000000 0000000000000000 00000000000004e0: 0000000000000000 0000000000000000 00000000000004f0: 0000000000000000 0000000000000000 0000000000000500: 0000000000000000 0000000000000000 0000000000000510: 0000000000000000 0000000000000000 0000000000000520: 0000000000000000 0000000000000000 0000000000000530: 0000000000000000 0000000000000000 0000000000000540: 0000000000000000 0000000000000000 0000000000000550: 0000000000000000 0000000000000000 0000000000000560: 0000000000000000 0000000000000000 0000000000000570: 0000000000000000 0000000000000000 0000000000000580: 0000000000000000 0000000000000000 0000000000000590: 0000000000000000 0000000000000000 00000000000005a0: 0000000000000000 0000000000000000 00000000000005b0: 0000000000000000 0000000000000000 00000000000005c0: 0000000000000000 0000000000000000 00000000000005d0: 0000000000000000 0000000000000000 00000000000005e0: 0000000000000000 0000000000000000 00000000000005f0: 0000000000000000 0000000000000000 0000000000000600: 0000000000000000 0000000000000000 0000000000000610: 0000000000000000 0000000000000000 0000000000000620: 0000000000000000 0000000000000000 0000000000000630: 0000000000000000 0000000000000000 0000000000000640: 0000000000000000 0000000000000000 0000000000000650: 0000000000000000 0000000000000000 0000000000000660: 0000000000000000 0000000000000000 0000000000000670: 0000000000000000 0000000000000000 0000000000000680: 0000000000000000 0000000000000000 0000000000000690: 0000000000000000 0000000000000000 00000000000006a0: 0000000000000000 0000000000000000 00000000000006b0: 0000000000000000 0000000000000000 00000000000006c0: 0000000000000000 0000000000000000 00000000000006d0: 0000000000000000 0000000000000000 00000000000006e0: 0000000000000000 0000000000000000 00000000000006f0: 0000000000000000 0000000000000000 0000000000000700: 0000000000000000 0000000000000000 0000000000000710: 0000000000000000 0000000000000000 0000000000000720: 0000000000000000 0000000000000000 0000000000000730: 0000000000000000 0000000000000000 0000000000000740: 0000000000000000 0000000000000000 0000000000000750: 0000000000000000 0000000000000000 0000000000000760: 0000000000000000 0000000000000000 0000000000000770: 0000000000000000 0000000000000000 0000000000000780: 0000000000000000 0000000000000000 0000000000000790: 0000000000000000 0000000000000000 00000000000007a0: 0000000000000000 0000000000000000 00000000000007b0: 0000000000000000 0000000000000000 00000000000007c0: 0000000000000000 0000000000000000 00000000000007d0: 0000000000000000 0000000000000000 00000000000007e0: 0000000000000000 0000000000000000 00000000000007f0: 0000000000000000 000000000dda5067 0000000000000800: 000000022fdf6067 000000022fdf1063 0000000000000810: 000000000db55063 0000000000000000 0000000000000820: 000000014cdbb063 00000000cf07a027 0000000000000830: 00000000cf075027 0000000000000000 0000000000000840: 0000000000000000 0000000000000000 0000000000000850: 0000000000000000 0000000000000000 0000000000000860: 0000000000000000 0000000000000000 0000000000000870: 0000000000000000 0000000000000000 0000000000000880: 0000000150139067 0000000000000000 0000000000000890: 0000000000000000 0000000000000000 00000000000008a0: 0000000000000000 0000000000000000 00000000000008b0: 0000000000000000 0000000000000000 00000000000008c0: 0000000000000000 0000000000000000 00000000000008d0: 0000000000000000 0000000000000000 00000000000008e0: 0000000000000000 0000000000000000 00000000000008f0: 0000000000000000 0000000000000000 0000000000000900: 0000000000000000 0000000000000000 0000000000000910: 0000000000000000 0000000000000000 0000000000000920: 0000000000000000 0000000000000000 0000000000000930: 0000000000000000 0000000000000000 0000000000000940: 0000000000000000 0000000000000000 0000000000000950: 0000000000000000 0000000000000000 0000000000000960: 0000000000000000 0000000000000000 0000000000000970: 0000000000000000 0000000000000000 0000000000000980: 0000000000000000 0000000000000000 0000000000000990: 0000000000000000 0000000000000000 00000000000009a0: 0000000000000000 0000000000000000 00000000000009b0: 0000000000000000 0000000000000000 00000000000009c0: 0000000000000000 0000000000000000 00000000000009d0: 0000000000000000 0000000000000000 00000000000009e0: 0000000000000000 0000000000000000 00000000000009f0: 0000000000000000 0000000000000000 0000000000000a00: 0000000000000000 0000000000000000 0000000000000a10: 0000000000000000 0000000000000000 0000000000000a20: 0000000000000000 0000000000000000 0000000000000a30: 0000000000000000 0000000000000000 0000000000000a40: 0000000000000000 0000000000000000 0000000000000a50: 0000000000000000 0000000000000000 0000000000000a60: 0000000000000000 0000000000000000 0000000000000a70: 0000000000000000 0000000000000000 0000000000000a80: 0000000000000000 0000000000000000 0000000000000a90: 0000000000000000 0000000000000000 0000000000000aa0: 0000000000000000 0000000000000000 0000000000000ab0: 0000000000000000 0000000000000000 0000000000000ac0: 0000000000000000 0000000000000000 0000000000000ad0: 0000000000000000 0000000000000000 0000000000000ae0: 0000000000000000 0000000000000000 0000000000000af0: 0000000000000000 0000000000000000 0000000000000b00: 0000000000000000 0000000000000000 0000000000000b10: 0000000000000000 0000000000000000 0000000000000b20: 0000000000000000 0000000000000000 0000000000000b30: 0000000000000000 0000000000000000 0000000000000b40: 0000000000000000 0000000000000000 0000000000000b50: 0000000000000000 0000000000000000 0000000000000b60: 0000000000000000 0000000000000000 0000000000000b70: 0000000000000000 0000000000000000 0000000000000b80: 0000000000000000 0000000000000000 0000000000000b90: 0000000000000000 0000000000000000 0000000000000ba0: 0000000000000000 0000000000000000 0000000000000bb0: 0000000000000000 0000000000000000 0000000000000bc0: 0000000000000000 0000000000000000 0000000000000bd0: 0000000000000000 0000000000000000 0000000000000be0: 0000000000000000 0000000000000000 0000000000000bf0: 0000000000000000 0000000000000000 0000000000000c00: 0000000000000000 0000000000000000 0000000000000c10: 0000000000000000 0000000000000000 0000000000000c20: 000000000ce44067 0000000000000000 0000000000000c30: 0000000000000000 0000000000000000 0000000000000c40: 0000000000000000 0000000000000000 0000000000000c50: 0000000000000000 0000000000000000 0000000000000c60: 0000000000000000 0000000000000000 0000000000000c70: 0000000000000000 0000000000000000 0000000000000c80: 0000000000000000 0000000000000000 0000000000000c90: 0000000000000000 0000000000000000 0000000000000ca0: 0000000000000000 0000000000000000 0000000000000cb0: 0000000000000000 0000000000000000 0000000000000cc0: 0000000000000000 0000000000000000 0000000000000cd0: 0000000000000000 0000000000000000 0000000000000ce0: 0000000000000000 0000000000000000 0000000000000cf0: 0000000000000000 0000000000000000 0000000000000d00: 0000000000000000 0000000000000000 0000000000000d10: 0000000000000000 0000000000000000 0000000000000d20: 0000000000000000 0000000000000000 0000000000000d30: 0000000000000000 0000000000000000 0000000000000d40: 0000000000000000 0000000000000000 0000000000000d50: 0000000000000000 0000000000000000 0000000000000d60: 0000000000000000 0000000000000000 0000000000000d70: 0000000000000000 0000000000000000 0000000000000d80: 0000000000000000 0000000000000000 0000000000000d90: 0000000000000000 0000000000000000 0000000000000da0: 0000000000000000 0000000000000000 0000000000000db0: 0000000000000000 0000000000000000 0000000000000dc0: 0000000000000000 0000000000000000 0000000000000dd0: 0000000000000000 0000000000000000 0000000000000de0: 0000000000000000 0000000000000000 0000000000000df0: 0000000000000000 0000000000000000 0000000000000e00: 0000000000000000 0000000000000000 0000000000000e10: 0000000000000000 0000000000000000 0000000000000e20: 0000000000000000 0000000000000000 0000000000000e30: 0000000000000000 0000000000000000 0000000000000e40: 0000000000000000 0000000000000000 0000000000000e50: 0000000000000000 0000000000000000 0000000000000e60: 0000000000000000 0000000000000000 0000000000000e70: 0000000000000000 0000000000000000 0000000000000e80: 0000000000000000 0000000000000000 0000000000000e90: 0000000000000000 0000000000000000 0000000000000ea0: 0000000000000000 0000000000000000 0000000000000eb0: 0000000000000000 0000000000000000 0000000000000ec0: 0000000000000000 0000000000000000 0000000000000ed0: 0000000000000000 0000000000000000 0000000000000ee0: 0000000000000000 0000000000000000 0000000000000ef0: 0000000000000000 0000000000000000 0000000000000f00: 0000000000000000 0000000000000000 0000000000000f10: 0000000000000000 0000000000000000 0000000000000f20: 0000000000000000 0000000000000000 0000000000000f30: 0000000000000000 0000000000000000 0000000000000f40: 0000000000000000 0000000000000000 0000000000000f50: 0000000000000000 0000000000000000 0000000000000f60: 0000000000000000 0000000000000000 0000000000000f70: 0000000000000000 0000000000000000 0000000000000f80: 0000000000000000 0000000000000000 0000000000000f90: 0000000000000000 0000000000000000 0000000000000fa0: 0000000000000000 0000000000000000 0000000000000fb0: 0000000000000000 0000000000000000 0000000000000fc0: 0000000000000000 0000000000000000 0000000000000fd0: 0000000000000000 0000000000000000 0000000000000fe0: 0000000000000000 0000000000000000 0000000000000ff0: 0000000000000000 0000000130087067 crash: cannot resolve "end_pfn" SLES11-40:/dat/bnx2_core # ls -al ../xen_vm/sles11.dumpcore -rw------- 1 root root 538996808 Mar 4 09:34 ../xen_vm/sles11.dumpcore SLES11-40:/dat/bnx2_core # file ../xen_vm/sles11.dumpcore ../xen_vm/sles11.dumpcore: ELF 64-bit LSB core file x86-64, version 1 SLES11-40:/dat/bnx2_core # gdb vmlinux-2.6.27.19-5-xen ../xen_vm/sles11.dumpcore GNU gdb (GDB) SUSE (7.0-0.4.16) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-suse-linux". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /dat/bnx2_core/vmlinux-2.6.27.19-5-xen...Reading symbols from /dat/bnx2_core/vmlinux-2.6.27.19-5-xen.debug...done. done. "/dat/bnx2_core/../xen_vm/sles11.dumpcore" is not a core dump: File format not recognized (gdb) q SLES11-40:/dat/bnx2_core # the paravituralized vm config: SLES11-40:/etc/xen/vm # cat sles11 name="sles11" description="None" uuid="cf40dbdb-b50d-9c25-7c07-14441d7ae478" memory=512 maxmem=512 vcpus=4 on_poweroff="destroy" on_reboot="restart" on_crash="destroy" localtime=0 keymap="en-us" builder="linux" bootloader="/usr/bin/pygrub" bootargs="" extra=" " disk=[ 'file:/dat/vms/sles11_pv,xvda,w', 'file:/dat/iso/SLES-11-DVD-x86_64-GM-DVD1.iso,xvdb:cdrom,r', ] vif=[ 'mac=00:16:3e:61:b3:96,bridge=br3', ] vfb=['type=vnc,vncunused=1']