Hi Dave
I have had the time to look closer at the problem with symbols in modules that I reported
some time ago. I now know why the problem occurs and have some idea how to solve it.
However my knowledge in this area is limited so you really have to review my code change.
The module that causes the problem when it is loaded contains a symbol the is
"per_cpu". Its address is higher than any symbol in any module, so the search in
value_search_module in symbols.c is terminated too early.
The test below in the code from value_search_module solves the problem in my example.
* splast will contain the last module symbol encountered.
* Note: "__insmod_"-type symbols will be set in splast only
* when they have unique values.
*/
splast = NULL;
for ( ; sp <= sp_end; sp++) {
if (IN_MODULE_PERCPU(sp->value,lm) &&
!IN_MODULE_PERCPU(value,lm)) continue; // ADDED
if (value == sp->value) {
if (MODULE_END(sp) || MODULE_INIT_END(sp))
break;
Jan
Jan Karlsson
Senior Software Engineer
System Assurance
Sony Mobile Communications
Tel: +46 703 062 174
jan.karlsson(a)sonymobile.com
sonymobile.com
-----Original Message-----
From: crash-utility-bounces(a)redhat.com [mailto:crash-utility-bounces@redhat.com] On Behalf
Of Dave Anderson
Sent: den 12 maj 2015 15:28
To: Discussion list for crash utility usage, maintenance and development
Subject: Re: [Crash-utility] Fix in bt for ARM64
----- Original Message -----
Thanks Dave,
I did not look close enough on this issue and you are quite right that
my fix has no effect. After some more testing I have found that the
problem has to do with one of the modules.
In the core file I investigate the kernel has six modules, where the
wlan module (where the strange names occur) is the last one. If I have
loaded the third module in the mod list, with "mod -s" or "mod -S"
then I get the strange printouts in bt. If that module is not loaded,
independently if other modules are loaded or not, then the bt printout is correct.
I understand fully that this will be very difficult to investigate
without the possibility to run and debug the example. I have tried to
do that but have not found anything useful so far. Any hints what to
look for? I will also try to understand if there is anything specific with the module
itself.
I looked at the data that you sent me offline, but nothing stands out as a smoking gun.
If you take "bt" out of the picture and just run "sym
<wlan-module-address>", you should see the same symptom, where before the third
module is loaded, it finds the correct symbol name of the <wlan-module-address> OK,
but fails to do so after the third module is loaded. cmd_sym() will call value_search(),
which should call value_search_symbol(), and in that function you will be able to see it
cycling through the modules, and at least get an idea as to why the wlan module addresses
are being prematurely found in another module's symbol list.
Dave
I will by the way be out of office up to next Monday mainly due to
national holidays here in Sweden.
Jan Karlsson
Senior Software Engineer
System Assurance
Sony Mobile Communications
Tel: +46 703 062 174
jan.karlsson(a)sonymobile.com
sonymobile.com
-----Original Message-----
From: crash-utility-bounces(a)redhat.com
[mailto:crash-utility-bounces@redhat.com] On Behalf Of Dave Anderson
Sent: den 11 maj 2015 17:49
To: Discussion list for crash utility usage, maintenance and
development
Subject: Re: [Crash-utility] Fix in bt for ARM64
----- Original Message -----
>
>
> Hi Dave
>
>
>
> I found an ARM64 problem for bt when a function belongs to a module.
>
>
>
> Printout before fix given below:
>
> #16 [ffffffc0be96f8d0] __this_module at ffffffbffc15a2f8 [wlan]
> #17 [ffffffc0be96f9b0] __this_module at ffffffbffc161b18 [wlan]
> #18 [ffffffc0be96f9c0] __this_module at ffffffbffc16033c [wlan]
> #19 [ffffffc0be96fa10] __this_module at ffffffbffc1630f8 [wlan]
> #20 [ffffffc0be96fab0] __this_module at ffffffbffc156ff8 [wlan]
> #21 [ffffffc0be96faf0] __this_module at ffffffbffc15aa58 [wlan]
> #22 [ffffffc0be96fb20] __this_module at ffffffbffc15bfc8 [wlan]
> #23 [ffffffc0be96fb60] __this_module at ffffffbffc115fac [wlan]
> #24 [ffffffc0be96fb90] tasklet_action at ffffffc000223738
> #25 [ffffffc0be96fbb0] __do_softirq at ffffffc000222e94
>
>
>
> Printout after fix:
>
> #16 [ffffffc0be96f8d0] dhd_bus_rx_frame at ffffffbffc15a2f8 [wlan]
> #17 [ffffffc0be96f9b0] dhd_update_flow_prio_map at ffffffbffc161b18
> [wlan]
> #18 [ffffffc0be96f9c0] dhd_update_flow_prio_map at ffffffbffc16033c
> [wlan]
> #19 [ffffffc0be96fa10] dhd_prot_process_ctrlbuf at ffffffbffc1630f8
> [wlan]
> #20 [ffffffc0be96fab0] dhd_bus_ringbell at ffffffbffc156ff8 [wlan]
> #21 [ffffffc0be96faf0] dhd_bus_console_in at ffffffbffc15aa58 [wlan]
> #22 [ffffffc0be96fb20] dhd_bus_dpc at ffffffbffc15bfc8 [wlan]
> #23 [ffffffc0be96fb60] dhd_sched_dpc at ffffffbffc115fac [wlan]
> #24 [ffffffc0be96fb90] tasklet_action at ffffffc000223738
> #25 [ffffffc0be96fbb0] __do_softirq at ffffffc000222e94
>
>
>
> From arm64.c:
>
>
>
> static int
>
> arm64_print_stackframe_entry(struct bt_info *bt, int level, struct
> arm64_stackframe *frame)
>
> {
>
> char *name, *name_plus_offset;
> ulong symbol_offset;
> struct syment *sp;
> struct load_module *lm;
> char buf[BUFSIZE];
>
> name = closest_symbol(frame->pc);
> name_plus_offset = NULL;
>
> if (bt->flags & BT_SYMBOL_OFFSET) {
> /*ADDED*/
> if (module_symbol(frame->pc, NULL, &lm, NULL, 0)) sp =
> value_search_module(frame->pc, &symbol_offset); else /*END ADDED*/
> sp = value_search(frame->pc, &symbol_offset);
>
Hi Jan,
I don't dispute that this is something to be fixed, but at the same
time I don't quite understand (1) why it's happening, and (2) how your
fix addresses it?
The value_search() function does this if it's a module address:
struct syment *
value_search(ulong value, ulong *offset) { ...
if (IS_VMALLOC_ADDR(value))
goto check_modules;
...
check_modules:
sp = value_search_module(value, offset);
return sp;
}
And even if IS_VMALLOC_ADDR() above fails, it should just fail to find
it in the base kernel symbols, and fall through to the value_search_module() call.
Does something different happen in your case?
I also note that in all cases "__this_module" is in the "(d)" section
of each module, and typically is the last/highest symbol value of the
module. So I'm confused as to how it's getting picked up as the
closest value to all of the different text addresses in the wlan module?
What does "sym -m wlan" look like?
Thanks,
Dave
>
> You probably also want to prevent calling module_symbol a second
> time later in the function.
>
>
>
> Jan
>
>
>
> Jan Karlsson
>
> Senior Software Engineer
>
> System Assurance
>
>
>
> Sony Mobile Communications
>
> Tel: +46 703 062 174
>
> jan.karlsson(a)sonymobile.com
>
>
>
>
sonymobile.com
>
>
>
>
>
>
>
> --
> Crash-utility mailing list
> Crash-utility(a)redhat.com
>
https://www.redhat.com/mailman/listinfo/crash-utility
--
Crash-utility mailing list
Crash-utility(a)redhat.com
https://www.redhat.com/mailman/listinfo/crash-utility
--
Crash-utility mailing list
Crash-utility(a)redhat.com
https://www.redhat.com/mailman/listinfo/crash-utility
--
Crash-utility mailing list
Crash-utility(a)redhat.com
https://www.redhat.com/mailman/listinfo/crash-utility