Hi Jose,
Thanks for reporting the issue. It looks like a known issue which we
are currently dealing with.
On Fri, Aug 2, 2024 at 6:11 PM Jose Fernandez <jose.fernandez(a)linux.dev> wrote:
I'm trying to get crash to work on Arch Linux but I keep running into this error:
crash: seek error: kernel virtual address: ffffffff82b195c0 type:
"page_offset_base"
It looks like some kaslr issue to me, could you please execute the
following cmd and show me the results?
$ nm vmlinux | grep kaslr_regions
If there is no output, aka no such symbol is found, then you hit a
known kaslr issue.
Thanks,
Tao Liu
I've the upstream 6.11RC and the latest CachyOS kernel (6.10.2).
I boot into
the target kernel and then run crash with the respective vmlinux file. I'm
simply trying to load /proc/kcore with this command:
crash /usr/src/debug/linux-cachyos/vmlinux /proc/kcore -d10
Here is the full output:
crash 8.0.5
Copyright (C) 2002-2024 Red Hat, Inc.
Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation
Copyright (C) 1999-2006 Hewlett-Packard Co
Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited
Copyright (C) 2006, 2007 VA Linux Systems Japan K.K.
Copyright (C) 2005, 2011, 2020-2024 NEC Corporation
Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc.
Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc.
Copyright (C) 2015, 2021 VMware, Inc.
This program is free software, covered by the GNU General Public License,
and you are welcome to change it and/or distribute copies of it under
certain conditions. Enter "help copying" to see the conditions.
This program has absolutely no warranty. Enter "help warranty" for details.
get_live_memory_source: /proc/kcore
proc_kcore_data:
flags: 500 (KCORE_LOCAL|KCORE_ELF64)
segments: 28
elf_header: 64e6aab34860
header_size: 11828
notes64: 64e6aab348a0
load64: 64e6aab348d8
notes32: 0
load32: 0
vmcoreinfo: 0
size_vmcoreinfo: 0
Elf64_Phdr:
p_type: 4 (PT_NOTE)
p_flags: 0
p_offset: 698
p_vaddr: 0
p_paddr: 0
p_filesz: 10140
p_memsz: 0
p_align: 0
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 7fffbc403000
p_vaddr: ffffffffbc400000
p_paddr: 915000000
p_filesz: 50528256
p_memsz: 50528256
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 277fc0003000
p_vaddr: ffffa77fc0000000
p_paddr: ffffffffffffffff
p_filesz: 35184372088831
p_memsz: 35184372088831
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 7fffc0003000
p_vaddr: ffffffffc0000000
p_paddr: ffffffffffffffff
p_filesz: 1056964608
p_memsz: 1056964608
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec00004000
p_vaddr: ffff8fec00001000
p_paddr: 1000
p_filesz: 651264
p_memsz: 651264
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 727480003000
p_vaddr: fffff27480000000
p_paddr: ffffffffffffffff
p_filesz: 12288
p_memsz: 12288
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec00103000
p_vaddr: ffff8fec00100000
p_paddr: 100000
p_filesz: 162529280
p_memsz: 162529280
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 727480007000
p_vaddr: fffff27480004000
p_paddr: ffffffffffffffff
p_filesz: 2539520
p_memsz: 2539520
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec09de4000
p_vaddr: ffff8fec09de1000
p_paddr: 9de1000
p_filesz: 1175552
p_memsz: 1175552
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748027a000
p_vaddr: fffff27480277000
p_paddr: ffffffffffffffff
p_filesz: 20480
p_memsz: 20480
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec09f3f000
p_vaddr: ffff8fec09f3c000
p_paddr: 9f3c000
p_filesz: 169684992
p_memsz: 169684992
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748027f000
p_vaddr: fffff2748027c000
p_paddr: ffffffffffffffff
p_filesz: 2658304
p_memsz: 2658304
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec18313000
p_vaddr: ffff8fec18310000
p_paddr: 18310000
p_filesz: 14557184
p_memsz: 14557184
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748060f000
p_vaddr: fffff2748060c000
p_paddr: ffffffffffffffff
p_filesz: 229376
p_memsz: 229376
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec190f6000
p_vaddr: ffff8fec190f3000
p_paddr: 190f3000
p_filesz: 20480
p_memsz: 20480
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec190fc000
p_vaddr: ffff8fec190f9000
p_paddr: 190f9000
p_filesz: 29282304
p_memsz: 29282304
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec1acea000
p_vaddr: ffff8fec1ace7000
p_paddr: 1ace7000
p_filesz: 12288
p_memsz: 12288
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 7274806b6000
p_vaddr: fffff274806b3000
p_paddr: ffffffffffffffff
p_filesz: 4096
p_memsz: 4096
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec1acee000
p_vaddr: ffff8fec1aceb000
p_paddr: 1aceb000
p_filesz: 143360
p_memsz: 143360
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec20e84000
p_vaddr: ffff8fec20e81000
p_paddr: 20e81000
p_filesz: 694374400
p_memsz: 694374400
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748083d000
p_vaddr: fffff2748083a000
p_paddr: ffffffffffffffff
p_filesz: 10850304
p_memsz: 10850304
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec4a6fa000
p_vaddr: ffff8fec4a6f7000
p_paddr: 4a6f7000
p_filesz: 76910592
p_memsz: 76910592
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748129e000
p_vaddr: fffff2748129b000
p_paddr: ffffffffffffffff
p_filesz: 1208320
p_memsz: 1208320
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec4f054000
p_vaddr: ffff8fec4f051000
p_paddr: 4f051000
p_filesz: 71499776
p_memsz: 71499776
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec58201000
p_vaddr: ffff8fec581fe000
p_paddr: 581fe000
p_filesz: 31371264
p_memsz: 31371264
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 72748160a000
p_vaddr: fffff27481607000
p_paddr: ffffffffffffffff
p_filesz: 495616
p_memsz: 495616
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fec59ff0000
p_vaddr: ffff8fec59fed000
p_paddr: 59fed000
p_filesz: 8192
p_memsz: 8192
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: fed00003000
p_vaddr: ffff8fed00000000
p_paddr: 100000000
p_filesz: 66004713472
p_memsz: 66004713472
p_align: 4096
Elf64_Phdr:
p_type: 1 (PT_LOAD)
p_flags: 7
p_offset: 727484003000
p_vaddr: fffff27484000000
p_paddr: ffffffffffffffff
p_filesz: 1031323648
p_memsz: 1031323648
p_align: 4096
Elf64_Nhdr:
n_namesz: 5 ("CORE")
n_descsz: 336
n_type: 1 (NT_PRSTATUS)
Elf64_Nhdr:
n_namesz: 5 ("CORE")
n_descsz: 136
n_type: 3 (NT_PRPSINFO)
Elf64_Nhdr:
n_namesz: 5 ("CORE")
n_descsz: 6360
n_type: 4 (NT_TASKSTRUCT)
Elf64_Nhdr:
n_namesz: 11 ("VMCOREINFO")
n_descsz: 3224
n_type: 0 (unknown)
OSRELEASE=6.10.2-2-cachyos
BUILD-ID=464ddea46107c047dd447fc06ce515bc716030fc
PAGESIZE=4096
SYMBOL(init_uts_ns)=ffffffffbe7c70c0
OFFSET(uts_namespace.name)=0
SYMBOL(node_online_map)=ffffffffbe81bb48
SYMBOL(swapper_pg_dir)=ffffffffbe620000
SYMBOL(_stext)=ffffffffbc400000
NUMBER(VMALLOC_START)=0xffffa77fc0000000
SYMBOL(vmemmap)=fffff27480000000
SYMBOL(mem_section)=ffff8ffc5e2f7000
LENGTH(mem_section)=2048
SIZE(mem_section)=16
OFFSET(mem_section.section_mem_map)=0
NUMBER(SECTION_SIZE_BITS)=27
NUMBER(MAX_PHYSMEM_BITS)=46
SIZE(page)=64
SIZE(pglist_data)=16704
SIZE(zone)=1728
SIZE(free_area)=104
SIZE(list_head)=16
SIZE(nodemask_t)=8
OFFSET(page.flags)=0
OFFSET(page._refcount)=52
OFFSET(page.mapping)=24
OFFSET(page.lru)=8
OFFSET(page._mapcount)=48
OFFSET(page.private)=40
OFFSET(page.compound_head)=8
OFFSET(pglist_data.node_zones)=0
OFFSET(pglist_data.nr_zones)=13792
OFFSET(pglist_data.node_start_pfn)=13800
OFFSET(pglist_data.node_spanned_pages)=13816
OFFSET(pglist_data.node_id)=13824
OFFSET(zone.free_area)=256
OFFSET(zone.vm_stat)=1536
OFFSET(zone.spanned_pages)=152
OFFSET(free_area.free_list)=0
OFFSET(list_head.next)=0
OFFSET(list_head.prev)=8
LENGTH(zone.free_area)=11
SYMBOL(prb)=ffffffffbe65b940
SYMBOL(printk_rb_static)=ffffffffbe65b960
SYMBOL(clear_seq)=ffffffffbf1351a0
SIZE(printk_ringbuffer)=88
OFFSET(printk_ringbuffer.desc_ring)=0
OFFSET(printk_ringbuffer.text_data_ring)=48
OFFSET(printk_ringbuffer.fail)=80
SIZE(prb_desc_ring)=48
OFFSET(prb_desc_ring.count_bits)=0
OFFSET(prb_desc_ring.descs)=8
OFFSET(prb_desc_ring.infos)=16
OFFSET(prb_desc_ring.head_id)=24
OFFSET(prb_desc_ring.tail_id)=32
SIZE(prb_desc)=24
OFFSET(prb_desc.state_var)=0
OFFSET(prb_desc.text_blk_lpos)=8
SIZE(prb_data_blk_lpos)=16
OFFSET(prb_data_blk_lpos.begin)=0
OFFSET(prb_data_blk_lpos.next)=8
SIZE(printk_info)=88
OFFSET(printk_info.seq)=0
OFFSET(printk_info.ts_nsec)=8
OFFSET(printk_info.text_len)=16
OFFSET(printk_info.caller_id)=20
OFFSET(printk_info.dev_info)=24
SIZE(dev_printk_info)=64
OFFSET(dev_printk_info.subsystem)=0
LENGTH(printk_info_subsystem)=16
OFFSET(dev_printk_info.device)=16
LENGTH(printk_info_device)=48
SIZE(prb_data_ring)=32
OFFSET(prb_data_ring.size_bits)=0
OFFSET(prb_data_ring.data)=8
OFFSET(prb_data_ring.head_lpos)=16
OFFSET(prb_data_ring.tail_lpos)=24
SIZE(atomic_long_t)=8
OFFSET(atomic_long_t.counter)=0
SIZE(latched_seq)=24
OFFSET(latched_seq.val)=8
LENGTH(free_area.free_list)=6
NUMBER(NR_FREE_PAGES)=0
NUMBER(PG_lru)=5
NUMBER(PG_private)=14
NUMBER(PG_swapcache)=11
NUMBER(PG_swapbacked)=18
NUMBER(PAGE_SLAB_MAPCOUNT_VALUE)=-4097
NUMBER(PG_hwpoison)=22
NUMBER(PG_head_mask)=64
NUMBER(PAGE_BUDDY_MAPCOUNT_VALUE)=-129
NUMBER(PAGE_HUGETLB_MAPCOUNT_VALUE)=-2049
NUMBER(PAGE_OFFLINE_MAPCOUNT_VALUE)=-257
SYMBOL(kallsyms_names)=ffffffffbda452f8
SYMBOL(kallsyms_num_syms)=ffffffffbda452f0
SYMBOL(kallsyms_token_table)=ffffffffbdc94af8
SYMBOL(kallsyms_token_index)=ffffffffbdc94e98
SYMBOL(kallsyms_offsets)=ffffffffbdc95098
SYMBOL(kallsyms_relative_base)=ffffffffbdd549d8
NUMBER(phys_base)=37996199936
SYMBOL(init_top_pgt)=ffffffffbe620000
NUMBER(pgtable_l5_enabled)=0
SYMBOL(node_data)=ffffffffbe81a620
LENGTH(node_data)=32
KERNELOFFSET=3b400000
NUMBER(KERNEL_IMAGE_SIZE)=1073741824
NUMBER(sme_mask)=0
/proc/version:
Linux version 6.10.2-2-cachyos (linux-cachyos@cachyos) (gcc (GCC) 14.1.1 20240720, GNU ld
(GNU Binutils) 2.42.0) #1 SMP PREEMPT_DYNAMIC Sat, 27 Jul 2024 19:37:59 +0000
/usr/src/debug/linux-cachyos/vmlinux:
Linux version 6.10.2-2-cachyos (linux-cachyos@cachyos) (gcc (GCC) 14.1.1 20240720, GNU ld
(GNU Binutils) 2.42.0) #1 SMP PREEMPT_DYNAMIC Sat, 27 Jul 2024 19:37:59 +0000
readmem: read_proc_kcore() -> /proc/kcore
crash: pv_ops exists: ARCH_PVOPS
VMCOREINFO: NUMBER(phys_base): 37996199936 -> 8d8c00000
gdb /usr/src/debug/linux-cachyos/vmlinux
GNU gdb (GDB) 10.2
Copyright (C) 2021 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <
http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-pc-linux-gnu".
Type "show configuration" for configuration details.
Find the GDB manual and other documentation resources online at:
<
http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
GETBUF(344 -> 0)
GETBUF(1500 -> 1)
FREEBUF(1)
FREEBUF(0)
<readmem: ffffffff82b195c0, KVADDR, "page_offset_base", 8, (FOE|Q),
64e6a75445e8>
<read_proc_kcore: addr: ffffffff82b195c0 paddr: 8db7195c0 cnt: 8>
crash: seek error: kernel virtual address: ffffffff82b195c0 type:
"page_offset_base"
[root@archlinux jose]#
--
Crash-utility mailing list -- devel(a)lists.crash-utility.osci.io
To unsubscribe send an email to devel-leave(a)lists.crash-utility.osci.io
https://${domain_name}/admin/lists/devel.lists.crash-utility.osci.io/
Contribution Guidelines:
https://github.com/crash-utility/crash/wiki