1:34 a.m.
Hi, I'm happy to ask developers for help , I'm really confused for my crash
error.
My computer room is running 60 nodes,OS: suse 11 sp1 x86_64
Kernel:2.6.32.12-0.7-default Crash:crash-5.0.1-1.5.5
recently , server often kernel crash, Kdump service dump the vmcore in
/var/crash/happen-date/vmcore,
I installed the kernel-debuginfo so that check out why crash ,but I got
this:
linux:~/bb # crash -d8 vmlinux-2.6.32.12-0.7-default
vmlinux-2.6.32.12-0.7-default.debug vmcore
crash 5.0.1
Copyright (C) 2002-2010 Red Hat, Inc.
Copyright (C) 2004, 2005, 2006 IBM Corporation
Copyright (C) 1999-2006 Hewlett-Packard Co
Copyright (C) 2005, 2006 Fujitsu Limited
Copyright (C) 2006, 2007 VA Linux Systems Japan K.K.
Copyright (C) 2005 NEC Corporation
Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc.
Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc.
This program is free software, covered by the GNU General Public License,
and you are welcome to change it and/or distribute copies of it under
certain conditions. Enter "help copying" to see the conditions.
This program has absolutely no warranty. Enter "help warranty" for details.
compressed kdump: header->utsname.machine:
diskdump_data:
filename: (null)
flags: 6 (KDUMP_CMPRS_LOCAL|ERROR_EXCLUDED)
dfd: 3
ofp: 0
machine_type: 62 (EM_X86_64)
header: ccdfe0
signature: "KDUMP "
header_version: 1
utsname:
sysname:
nodename:
release:
version:
machine:
domainname:
timestamp:
tv_sec: 0
tv_usec: 0
status: 0 ()
block_size: 4096
sub_hdr_size: 1
bitmap_blocks: 400
max_mapnr: 6553600
total_ram_blocks: 0
device_blocks: 0
written_blocks: 0
current_cpu: 0
nr_cpus: 1
tasks[nr_cpus]: 0
sub_header: 0 (n/a)
sub_header_kdump: cceff0
phys_base: 0
dump_level: 0 (0x0)
data_offset: 192000
block_size: 4096
block_shift: 12
bitmap: 7fcca1e01010
bitmap_len: 1638400
dumpable_bitmap: 7fcca1002010
byte: 0
bit: 0
compressed_page: ce3220
curbufptr: 0
page_cache_hdr[0]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd3210
pg_hit_count: 0
page_cache_hdr[1]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd4210
pg_hit_count: 0
page_cache_hdr[2]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd5210
pg_hit_count: 0
page_cache_hdr[3]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd6210
pg_hit_count: 0
page_cache_hdr[4]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd7210
pg_hit_count: 0
page_cache_hdr[5]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd8210
pg_hit_count: 0
page_cache_hdr[6]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cd9210
pg_hit_count: 0
page_cache_hdr[7]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cda210
pg_hit_count: 0
page_cache_hdr[8]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cdb210
pg_hit_count: 0
page_cache_hdr[9]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cdc210
pg_hit_count: 0
page_cache_hdr[10]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cdd210
pg_hit_count: 0
page_cache_hdr[11]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cde210
pg_hit_count: 0
page_cache_hdr[12]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: cdf210
pg_hit_count: 0
page_cache_hdr[13]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: ce0210
pg_hit_count: 0
page_cache_hdr[14]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: ce1210
pg_hit_count: 0
page_cache_hdr[15]:
pg_flags: 0 ()
pg_addr: 0
pg_bufptr: ce2210
pg_hit_count: 0
page_cache_buf: cd3210
evict_index: 0
evictions: 0
accesses: 0
cached_reads: 0
valid_pages: cd0000
crash: pv_init_ops exists: ARCH_PVOPS
compressed kdump: phys_base: 0
gdb vmlinux-2.6.32.12-0.7-default.debug
GNU gdb (GDB) 7.0
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute
it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-unknown-linux-gnu"...
GETBUF(248 -> 0)
GETBUF(1500 -> 1)
FREEBUF(1)
FREEBUF(0)
<readmem: ffffffff8141ae40, KVADDR, "kernel_config_data", 32768, (ROE),
1ab66b0 addr: ffffffff8141ae40 paddr: 141ae40 cnt: 448
crash: seek error: kernel virtual address: ffffffff8141ae40 type:
"kernel_config_data"
WARNING: cannot read kernel_config_data
GETBUF(248 -> 0)
FREEBUF(0)
GETBUF(512 -> 0)
<readmem: ffffffff81413640, KVADDR, "cpu_possible_mask", 8, (FOE),
7fff84995368 addr: ffffffff81413640 paddr:
1413640 cnt: 8
crash: seek error: kernel virtual address: ffffffff81413640 type:
"cpu_possible_mask"
if I use --minimal can got crash> but It limits a lot..
something like crash can't find cpu_possible_mask and cpu_possible_mask in
vmcore I guess,
I Google it and find some email talking about this , read the whitepaper
writed by anderson, but I can't resolve it.
any help I am really *appreciated*. Any other infomation need I provide,
please tell me ,I'll reply as soon as possible.