2008-03-29 03:12:16 +08:00
|
|
|
/*
|
|
|
|
|
* This file is subject to the terms and conditions of the GNU General Public
|
|
|
|
|
* License. See the file "COPYING" in the main directory of this archive
|
|
|
|
|
* for more details.
|
|
|
|
|
*
|
|
|
|
|
* SGI UV APIC functions (note: not an Intel compatible APIC)
|
|
|
|
|
*
|
2010-10-27 05:27:28 +08:00
|
|
|
* Copyright (C) 2007-2010 Silicon Graphics, Inc. All rights reserved.
|
2008-03-29 03:12:16 +08:00
|
|
|
*/
|
|
|
|
|
#include <linux/cpumask.h>
|
2009-02-26 21:10:10 +08:00
|
|
|
#include <linux/hardirq.h>
|
|
|
|
|
#include <linux/proc_fs.h>
|
|
|
|
|
#include <linux/threads.h>
|
|
|
|
|
#include <linux/kernel.h>
|
|
|
|
|
#include <linux/module.h>
|
2008-03-29 03:12:16 +08:00
|
|
|
#include <linux/string.h>
|
|
|
|
|
#include <linux/ctype.h>
|
|
|
|
|
#include <linux/sched.h>
|
2008-10-25 06:24:29 +08:00
|
|
|
#include <linux/timer.h>
|
include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h
percpu.h is included by sched.h and module.h and thus ends up being
included when building most .c files. percpu.h includes slab.h which
in turn includes gfp.h making everything defined by the two files
universally available and complicating inclusion dependencies.
percpu.h -> slab.h dependency is about to be removed. Prepare for
this change by updating users of gfp and slab facilities include those
headers directly instead of assuming availability. As this conversion
needs to touch large number of source files, the following script is
used as the basis of conversion.
http://userweb.kernel.org/~tj/misc/slabh-sweep.py
The script does the followings.
* Scan files for gfp and slab usages and update includes such that
only the necessary includes are there. ie. if only gfp is used,
gfp.h, if slab is used, slab.h.
* When the script inserts a new include, it looks at the include
blocks and try to put the new include such that its order conforms
to its surrounding. It's put in the include block which contains
core kernel includes, in the same order that the rest are ordered -
alphabetical, Christmas tree, rev-Xmas-tree or at the end if there
doesn't seem to be any matching order.
* If the script can't find a place to put a new include (mostly
because the file doesn't have fitting include block), it prints out
an error message indicating which .h file needs to be added to the
file.
The conversion was done in the following steps.
1. The initial automatic conversion of all .c files updated slightly
over 4000 files, deleting around 700 includes and adding ~480 gfp.h
and ~3000 slab.h inclusions. The script emitted errors for ~400
files.
2. Each error was manually checked. Some didn't need the inclusion,
some needed manual addition while adding it to implementation .h or
embedding .c file was more appropriate for others. This step added
inclusions to around 150 files.
3. The script was run again and the output was compared to the edits
from #2 to make sure no file was left behind.
4. Several build tests were done and a couple of problems were fixed.
e.g. lib/decompress_*.c used malloc/free() wrappers around slab
APIs requiring slab.h to be added manually.
5. The script was run on all .h files but without automatically
editing them as sprinkling gfp.h and slab.h inclusions around .h
files could easily lead to inclusion dependency hell. Most gfp.h
inclusion directives were ignored as stuff from gfp.h was usually
wildly available and often used in preprocessor macros. Each
slab.h inclusion directive was examined and added manually as
necessary.
6. percpu.h was updated not to include slab.h.
7. Build test were done on the following configurations and failures
were fixed. CONFIG_GCOV_KERNEL was turned off for all tests (as my
distributed build env didn't work with gcov compiles) and a few
more options had to be turned off depending on archs to make things
build (like ipr on powerpc/64 which failed due to missing writeq).
* x86 and x86_64 UP and SMP allmodconfig and a custom test config.
* powerpc and powerpc64 SMP allmodconfig
* sparc and sparc64 SMP allmodconfig
* ia64 SMP allmodconfig
* s390 SMP allmodconfig
* alpha SMP allmodconfig
* um on x86_64 SMP allmodconfig
8. percpu.h modifications were reverted so that it could be applied as
a separate patch and serve as bisection point.
Given the fact that I had only a couple of failures from tests on step
6, I'm fairly confident about the coverage of this conversion patch.
If there is a breakage, it's likely to be something in one of the arch
headers which should be easily discoverable easily on most builds of
the specific arch.
Signed-off-by: Tejun Heo <tj@kernel.org>
Guess-its-ok-by: Christoph Lameter <cl@linux-foundation.org>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
2010-03-24 16:04:11 +08:00
|
|
|
#include <linux/slab.h>
|
2009-02-26 21:10:10 +08:00
|
|
|
#include <linux/cpu.h>
|
|
|
|
|
#include <linux/init.h>
|
2009-04-17 22:24:47 +08:00
|
|
|
#include <linux/io.h>
|
2010-02-03 06:38:14 +08:00
|
|
|
#include <linux/pci.h>
|
2010-02-27 00:49:12 +08:00
|
|
|
#include <linux/kdebug.h>
|
2009-02-26 21:10:10 +08:00
|
|
|
|
2008-03-29 03:12:16 +08:00
|
|
|
#include <asm/uv/uv_mmrs.h>
|
|
|
|
|
#include <asm/uv/uv_hub.h>
|
2009-02-26 21:10:10 +08:00
|
|
|
#include <asm/current.h>
|
|
|
|
|
#include <asm/pgtable.h>
|
2008-07-10 04:27:19 +08:00
|
|
|
#include <asm/uv/bios.h>
|
2009-02-26 21:10:10 +08:00
|
|
|
#include <asm/uv/uv.h>
|
|
|
|
|
#include <asm/apic.h>
|
|
|
|
|
#include <asm/ipi.h>
|
|
|
|
|
#include <asm/smp.h>
|
2009-11-20 04:23:41 +08:00
|
|
|
#include <asm/x86_init.h>
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-07-23 04:20:22 +08:00
|
|
|
DEFINE_PER_CPU(int, x2apic_extra_bits);
|
|
|
|
|
|
2010-02-03 06:38:14 +08:00
|
|
|
#define PR_DEVEL(fmt, args...) pr_devel("%s: " fmt, __func__, args)
|
|
|
|
|
|
2008-07-22 13:08:21 +08:00
|
|
|
static enum uv_system_type uv_system_type;
|
2009-11-20 04:23:41 +08:00
|
|
|
static u64 gru_start_paddr, gru_end_paddr;
|
2010-10-27 05:27:28 +08:00
|
|
|
static union uvh_apicid uvh_apicid;
|
2010-01-13 05:09:04 +08:00
|
|
|
int uv_min_hub_revision_id;
|
|
|
|
|
EXPORT_SYMBOL_GPL(uv_min_hub_revision_id);
|
2010-02-27 00:49:12 +08:00
|
|
|
static DEFINE_SPINLOCK(uv_nmi_lock);
|
2009-11-20 04:23:41 +08:00
|
|
|
|
2009-11-24 06:46:07 +08:00
|
|
|
static inline bool is_GRU_range(u64 start, u64 end)
|
2009-11-20 04:23:41 +08:00
|
|
|
{
|
2009-12-01 13:33:51 +08:00
|
|
|
return start >= gru_start_paddr && end <= gru_end_paddr;
|
2009-11-20 04:23:41 +08:00
|
|
|
}
|
|
|
|
|
|
2009-11-24 06:46:07 +08:00
|
|
|
static bool uv_is_untracked_pat_range(u64 start, u64 end)
|
2009-11-20 04:23:41 +08:00
|
|
|
{
|
|
|
|
|
return is_ISA_range(start, end) || is_GRU_range(start, end);
|
|
|
|
|
}
|
2008-07-22 13:08:21 +08:00
|
|
|
|
2009-04-17 22:24:47 +08:00
|
|
|
static int early_get_nodeid(void)
|
|
|
|
|
{
|
|
|
|
|
union uvh_node_id_u node_id;
|
|
|
|
|
unsigned long *mmr;
|
|
|
|
|
|
|
|
|
|
mmr = early_ioremap(UV_LOCAL_MMR_BASE | UVH_NODE_ID, sizeof(*mmr));
|
|
|
|
|
node_id.v = *mmr;
|
|
|
|
|
early_iounmap(mmr, sizeof(*mmr));
|
2010-01-13 05:09:04 +08:00
|
|
|
|
|
|
|
|
/* Currently, all blades have same revision number */
|
|
|
|
|
uv_min_hub_revision_id = node_id.s.revision;
|
|
|
|
|
|
2009-04-17 22:24:47 +08:00
|
|
|
return node_id.s.node_id;
|
|
|
|
|
}
|
|
|
|
|
|
2010-10-29 06:41:32 +08:00
|
|
|
static void __init early_get_apic_pnode_shift(void)
|
2010-10-27 05:27:28 +08:00
|
|
|
{
|
|
|
|
|
unsigned long *mmr;
|
|
|
|
|
|
|
|
|
|
mmr = early_ioremap(UV_LOCAL_MMR_BASE | UVH_APICID, sizeof(*mmr));
|
|
|
|
|
uvh_apicid.v = *mmr;
|
|
|
|
|
early_iounmap(mmr, sizeof(*mmr));
|
|
|
|
|
if (!uvh_apicid.v)
|
|
|
|
|
/*
|
|
|
|
|
* Old bios, use default value
|
|
|
|
|
*/
|
|
|
|
|
uvh_apicid.s.pnode_shift = UV_APIC_PNODE_SHIFT;
|
|
|
|
|
}
|
|
|
|
|
|
x86: Annotate section mismatch warnings in kernel/apic/x2apic_uv_x.c
The function uv_acpi_madt_oem_check() has been marked __init,
the struct apic_x2apic_uv_x has been marked __refdata.
The aim is to address the following section mismatch messages:
WARNING: arch/x86/kernel/apic/built-in.o(.data+0x1368): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
WARNING: arch/x86/kernel/built-in.o(.data+0x68e8): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
WARNING: arch/x86/built-in.o(.text+0x7b36f): Section mismatch in reference from the function uv_acpi_madt_oem_check() to the function .init.text:early_ioremap()
The function uv_acpi_madt_oem_check() references
the function __init early_ioremap().
This is often because uv_acpi_madt_oem_check lacks a __init
annotation or the annotation of early_ioremap is wrong.
WARNING: arch/x86/built-in.o(.text+0x7b38d): Section mismatch in reference from the function uv_acpi_madt_oem_check() to the function .init.text:early_iounmap()
The function uv_acpi_madt_oem_check() references
the function __init early_iounmap().
This is often because uv_acpi_madt_oem_check lacks a __init
annotation or the annotation of early_iounmap is wrong.
WARNING: arch/x86/built-in.o(.data+0x8668): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
Signed-off-by: Leonardo Potenza <lpotenza@inwind.it>
LKML-Reference: <200908161855.48302.lpotenza@inwind.it>
Signed-off-by: Ingo Molnar <mingo@elte.hu>
2009-08-17 00:55:48 +08:00
|
|
|
static int __init uv_acpi_madt_oem_check(char *oem_id, char *oem_table_id)
|
2008-07-22 13:08:21 +08:00
|
|
|
{
|
2010-01-16 02:09:09 +08:00
|
|
|
int nodeid;
|
|
|
|
|
|
2008-07-22 13:08:21 +08:00
|
|
|
if (!strcmp(oem_id, "SGI")) {
|
2010-01-16 02:09:09 +08:00
|
|
|
nodeid = early_get_nodeid();
|
2010-10-29 06:41:32 +08:00
|
|
|
early_get_apic_pnode_shift();
|
2009-11-20 04:23:41 +08:00
|
|
|
x86_platform.is_untracked_pat_range = uv_is_untracked_pat_range;
|
2010-02-27 00:49:12 +08:00
|
|
|
x86_platform.nmi_init = uv_nmi_init;
|
2008-07-22 13:08:21 +08:00
|
|
|
if (!strcmp(oem_table_id, "UVL"))
|
|
|
|
|
uv_system_type = UV_LEGACY_APIC;
|
|
|
|
|
else if (!strcmp(oem_table_id, "UVX"))
|
|
|
|
|
uv_system_type = UV_X2APIC;
|
|
|
|
|
else if (!strcmp(oem_table_id, "UVH")) {
|
2009-04-17 22:24:47 +08:00
|
|
|
__get_cpu_var(x2apic_extra_bits) =
|
2010-10-29 06:41:32 +08:00
|
|
|
nodeid << (uvh_apicid.s.pnode_shift - 1);
|
2008-07-22 13:08:21 +08:00
|
|
|
uv_system_type = UV_NON_UNIQUE_APIC;
|
|
|
|
|
return 1;
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
return 0;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
enum uv_system_type get_uv_system_type(void)
|
|
|
|
|
{
|
|
|
|
|
return uv_system_type;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
int is_uv_system(void)
|
|
|
|
|
{
|
|
|
|
|
return uv_system_type != UV_NONE;
|
|
|
|
|
}
|
2008-08-11 17:19:20 +08:00
|
|
|
EXPORT_SYMBOL_GPL(is_uv_system);
|
2008-07-22 13:08:21 +08:00
|
|
|
|
2008-03-29 03:12:16 +08:00
|
|
|
DEFINE_PER_CPU(struct uv_hub_info_s, __uv_hub_info);
|
|
|
|
|
EXPORT_PER_CPU_SYMBOL_GPL(__uv_hub_info);
|
|
|
|
|
|
|
|
|
|
struct uv_blade_info *uv_blade_info;
|
|
|
|
|
EXPORT_SYMBOL_GPL(uv_blade_info);
|
|
|
|
|
|
|
|
|
|
short *uv_node_to_blade;
|
|
|
|
|
EXPORT_SYMBOL_GPL(uv_node_to_blade);
|
|
|
|
|
|
|
|
|
|
short *uv_cpu_to_blade;
|
|
|
|
|
EXPORT_SYMBOL_GPL(uv_cpu_to_blade);
|
|
|
|
|
|
|
|
|
|
short uv_possible_blades;
|
|
|
|
|
EXPORT_SYMBOL_GPL(uv_possible_blades);
|
|
|
|
|
|
2008-07-10 04:27:19 +08:00
|
|
|
unsigned long sn_rtc_cycles_per_second;
|
|
|
|
|
EXPORT_SYMBOL(sn_rtc_cycles_per_second);
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
static const struct cpumask *uv_target_cpus(void)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2010-03-12 02:43:29 +08:00
|
|
|
return cpu_online_mask;
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
static void uv_vector_allocation_domain(int cpu, struct cpumask *retmask)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2008-12-17 09:33:59 +08:00
|
|
|
cpumask_clear(retmask);
|
|
|
|
|
cpumask_set_cpu(cpu, retmask);
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
2009-04-19 15:43:11 +08:00
|
|
|
static int __cpuinit uv_wakeup_secondary(int phys_apicid, unsigned long start_rip)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2009-02-26 21:10:10 +08:00
|
|
|
#ifdef CONFIG_SMP
|
2008-03-29 03:12:16 +08:00
|
|
|
unsigned long val;
|
2008-05-28 22:51:18 +08:00
|
|
|
int pnode;
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
pnode = uv_apicid_to_pnode(phys_apicid);
|
2008-03-29 03:12:16 +08:00
|
|
|
val = (1UL << UVH_IPI_INT_SEND_SHFT) |
|
|
|
|
|
(phys_apicid << UVH_IPI_INT_APIC_ID_SHFT) |
|
2009-02-26 12:50:49 +08:00
|
|
|
((start_rip << UVH_IPI_INT_VECTOR_SHFT) >> 12) |
|
2008-04-17 00:45:15 +08:00
|
|
|
APIC_DM_INIT;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_write_global_mmr64(pnode, UVH_IPI_INT, val);
|
2008-04-17 00:45:15 +08:00
|
|
|
mdelay(10);
|
|
|
|
|
|
|
|
|
|
val = (1UL << UVH_IPI_INT_SEND_SHFT) |
|
|
|
|
|
(phys_apicid << UVH_IPI_INT_APIC_ID_SHFT) |
|
2009-02-26 12:50:49 +08:00
|
|
|
((start_rip << UVH_IPI_INT_VECTOR_SHFT) >> 12) |
|
2008-04-17 00:45:15 +08:00
|
|
|
APIC_DM_STARTUP;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_write_global_mmr64(pnode, UVH_IPI_INT, val);
|
2009-02-26 12:50:49 +08:00
|
|
|
|
|
|
|
|
atomic_set(&init_deasserted, 1);
|
2009-02-26 21:10:10 +08:00
|
|
|
#endif
|
2008-03-29 03:12:16 +08:00
|
|
|
return 0;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static void uv_send_IPI_one(int cpu, int vector)
|
|
|
|
|
{
|
2009-04-03 07:59:03 +08:00
|
|
|
unsigned long apicid;
|
2008-05-28 22:51:18 +08:00
|
|
|
int pnode;
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-09-29 21:45:29 +08:00
|
|
|
apicid = per_cpu(x86_cpu_to_apicid, cpu);
|
2008-05-28 22:51:18 +08:00
|
|
|
pnode = uv_apicid_to_pnode(apicid);
|
2009-04-03 07:59:03 +08:00
|
|
|
uv_hub_send_ipi(pnode, apicid, vector);
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
static void uv_send_IPI_mask(const struct cpumask *mask, int vector)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
|
|
|
|
unsigned int cpu;
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
for_each_cpu(cpu, mask)
|
2008-12-17 09:33:52 +08:00
|
|
|
uv_send_IPI_one(cpu, vector);
|
|
|
|
|
}
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
static void uv_send_IPI_mask_allbutself(const struct cpumask *mask, int vector)
|
2008-12-17 09:33:52 +08:00
|
|
|
{
|
|
|
|
|
unsigned int this_cpu = smp_processor_id();
|
2009-01-28 22:42:24 +08:00
|
|
|
unsigned int cpu;
|
2008-12-17 09:33:52 +08:00
|
|
|
|
2009-01-28 22:42:24 +08:00
|
|
|
for_each_cpu(cpu, mask) {
|
2008-12-17 09:33:52 +08:00
|
|
|
if (cpu != this_cpu)
|
2008-03-29 03:12:16 +08:00
|
|
|
uv_send_IPI_one(cpu, vector);
|
2009-01-28 22:42:24 +08:00
|
|
|
}
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static void uv_send_IPI_allbutself(int vector)
|
|
|
|
|
{
|
2008-12-17 09:33:52 +08:00
|
|
|
unsigned int this_cpu = smp_processor_id();
|
2009-01-28 22:42:24 +08:00
|
|
|
unsigned int cpu;
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2009-01-28 22:42:24 +08:00
|
|
|
for_each_online_cpu(cpu) {
|
2008-12-17 09:33:52 +08:00
|
|
|
if (cpu != this_cpu)
|
|
|
|
|
uv_send_IPI_one(cpu, vector);
|
2009-01-28 22:42:24 +08:00
|
|
|
}
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static void uv_send_IPI_all(int vector)
|
|
|
|
|
{
|
2008-12-17 09:33:59 +08:00
|
|
|
uv_send_IPI_mask(cpu_online_mask, vector);
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static int uv_apic_id_registered(void)
|
|
|
|
|
{
|
|
|
|
|
return 1;
|
|
|
|
|
}
|
|
|
|
|
|
2008-07-12 04:11:55 +08:00
|
|
|
static void uv_init_apic_ldr(void)
|
2008-07-11 02:16:55 +08:00
|
|
|
{
|
|
|
|
|
}
|
|
|
|
|
|
2008-12-17 09:33:59 +08:00
|
|
|
static unsigned int uv_cpu_mask_to_apicid(const struct cpumask *cpumask)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
|
|
|
|
/*
|
|
|
|
|
* We're using fixed IRQ delivery, can only return one phys APIC ID.
|
|
|
|
|
* May as well be the first.
|
|
|
|
|
*/
|
2009-01-28 22:20:18 +08:00
|
|
|
int cpu = cpumask_first(cpumask);
|
|
|
|
|
|
2008-07-19 09:11:29 +08:00
|
|
|
if ((unsigned)cpu < nr_cpu_ids)
|
2008-03-29 03:12:16 +08:00
|
|
|
return per_cpu(x86_cpu_to_apicid, cpu);
|
|
|
|
|
else
|
|
|
|
|
return BAD_APICID;
|
|
|
|
|
}
|
|
|
|
|
|
2009-01-28 22:20:18 +08:00
|
|
|
static unsigned int
|
|
|
|
|
uv_cpu_mask_to_apicid_and(const struct cpumask *cpumask,
|
|
|
|
|
const struct cpumask *andmask)
|
2008-12-17 09:33:54 +08:00
|
|
|
{
|
|
|
|
|
int cpu;
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* We're using fixed IRQ delivery, can only return one phys APIC ID.
|
|
|
|
|
* May as well be the first.
|
|
|
|
|
*/
|
2009-01-28 22:20:18 +08:00
|
|
|
for_each_cpu_and(cpu, cpumask, andmask) {
|
2008-12-18 07:21:39 +08:00
|
|
|
if (cpumask_test_cpu(cpu, cpu_online_mask))
|
|
|
|
|
break;
|
2009-01-28 22:20:18 +08:00
|
|
|
}
|
2009-12-18 10:29:46 +08:00
|
|
|
return per_cpu(x86_cpu_to_apicid, cpu);
|
2008-12-17 09:33:54 +08:00
|
|
|
}
|
|
|
|
|
|
2009-01-28 21:08:38 +08:00
|
|
|
static unsigned int x2apic_get_apic_id(unsigned long x)
|
2008-07-11 02:16:48 +08:00
|
|
|
{
|
|
|
|
|
unsigned int id;
|
|
|
|
|
|
|
|
|
|
WARN_ON(preemptible() && num_online_cpus() > 1);
|
2008-07-12 16:01:20 +08:00
|
|
|
id = x | __get_cpu_var(x2apic_extra_bits);
|
2008-07-11 02:16:48 +08:00
|
|
|
|
|
|
|
|
return id;
|
|
|
|
|
}
|
|
|
|
|
|
2008-07-22 13:08:21 +08:00
|
|
|
static unsigned long set_apic_id(unsigned int id)
|
2008-07-12 16:01:20 +08:00
|
|
|
{
|
|
|
|
|
unsigned long x;
|
|
|
|
|
|
|
|
|
|
/* maskout x2apic_extra_bits ? */
|
|
|
|
|
x = id;
|
|
|
|
|
return x;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static unsigned int uv_read_apic_id(void)
|
|
|
|
|
{
|
|
|
|
|
|
2009-01-28 21:08:38 +08:00
|
|
|
return x2apic_get_apic_id(apic_read(APIC_ID));
|
2008-07-12 16:01:20 +08:00
|
|
|
}
|
|
|
|
|
|
2009-01-28 20:31:22 +08:00
|
|
|
static int uv_phys_pkg_id(int initial_apicid, int index_msb)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2008-07-11 02:16:48 +08:00
|
|
|
return uv_read_apic_id() >> index_msb;
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static void uv_send_IPI_self(int vector)
|
|
|
|
|
{
|
|
|
|
|
apic_write(APIC_SELF_IPI, vector);
|
|
|
|
|
}
|
|
|
|
|
|
x86: Annotate section mismatch warnings in kernel/apic/x2apic_uv_x.c
The function uv_acpi_madt_oem_check() has been marked __init,
the struct apic_x2apic_uv_x has been marked __refdata.
The aim is to address the following section mismatch messages:
WARNING: arch/x86/kernel/apic/built-in.o(.data+0x1368): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
WARNING: arch/x86/kernel/built-in.o(.data+0x68e8): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
WARNING: arch/x86/built-in.o(.text+0x7b36f): Section mismatch in reference from the function uv_acpi_madt_oem_check() to the function .init.text:early_ioremap()
The function uv_acpi_madt_oem_check() references
the function __init early_ioremap().
This is often because uv_acpi_madt_oem_check lacks a __init
annotation or the annotation of early_ioremap is wrong.
WARNING: arch/x86/built-in.o(.text+0x7b38d): Section mismatch in reference from the function uv_acpi_madt_oem_check() to the function .init.text:early_iounmap()
The function uv_acpi_madt_oem_check() references
the function __init early_iounmap().
This is often because uv_acpi_madt_oem_check lacks a __init
annotation or the annotation of early_iounmap is wrong.
WARNING: arch/x86/built-in.o(.data+0x8668): Section mismatch in reference from the variable apic_x2apic_uv_x to the function .cpuinit.text:uv_wakeup_secondary()
The variable apic_x2apic_uv_x references
the function __cpuinit uv_wakeup_secondary()
If the reference is valid then annotate the
variable with __init* or __refdata (see linux/init.h) or name the variable:
*driver, *_template, *_timer, *_sht, *_ops, *_probe, *_probe_one, *_console,
Signed-off-by: Leonardo Potenza <lpotenza@inwind.it>
LKML-Reference: <200908161855.48302.lpotenza@inwind.it>
Signed-off-by: Ingo Molnar <mingo@elte.hu>
2009-08-17 00:55:48 +08:00
|
|
|
struct apic __refdata apic_x2apic_uv_x = {
|
2009-01-28 09:37:01 +08:00
|
|
|
|
|
|
|
|
.name = "UV large system",
|
|
|
|
|
.probe = NULL,
|
|
|
|
|
.acpi_madt_oem_check = uv_acpi_madt_oem_check,
|
|
|
|
|
.apic_id_registered = uv_apic_id_registered,
|
|
|
|
|
|
2009-01-28 11:02:31 +08:00
|
|
|
.irq_delivery_mode = dest_Fixed,
|
2009-07-27 22:38:56 +08:00
|
|
|
.irq_dest_mode = 0, /* physical */
|
2009-01-28 09:37:01 +08:00
|
|
|
|
|
|
|
|
.target_cpus = uv_target_cpus,
|
2009-01-28 12:08:44 +08:00
|
|
|
.disable_esr = 0,
|
2009-01-28 12:29:25 +08:00
|
|
|
.dest_logical = APIC_DEST_LOGICAL,
|
2009-01-28 09:37:01 +08:00
|
|
|
.check_apicid_used = NULL,
|
|
|
|
|
.check_apicid_present = NULL,
|
|
|
|
|
|
|
|
|
|
.vector_allocation_domain = uv_vector_allocation_domain,
|
|
|
|
|
.init_apic_ldr = uv_init_apic_ldr,
|
|
|
|
|
|
|
|
|
|
.ioapic_phys_id_map = NULL,
|
|
|
|
|
.setup_apic_routing = NULL,
|
|
|
|
|
.multi_timer_check = NULL,
|
|
|
|
|
.apicid_to_node = NULL,
|
|
|
|
|
.cpu_to_logical_apicid = NULL,
|
2009-01-28 13:50:47 +08:00
|
|
|
.cpu_present_to_apicid = default_cpu_present_to_apicid,
|
2009-01-28 09:37:01 +08:00
|
|
|
.apicid_to_cpu_present = NULL,
|
|
|
|
|
.setup_portio_remap = NULL,
|
2009-01-28 19:43:18 +08:00
|
|
|
.check_phys_apicid_present = default_check_phys_apicid_present,
|
2009-01-28 09:37:01 +08:00
|
|
|
.enable_apic_mode = NULL,
|
2009-01-28 20:31:22 +08:00
|
|
|
.phys_pkg_id = uv_phys_pkg_id,
|
2009-01-28 09:37:01 +08:00
|
|
|
.mps_oem_check = NULL,
|
|
|
|
|
|
2009-01-28 21:08:38 +08:00
|
|
|
.get_apic_id = x2apic_get_apic_id,
|
2009-01-28 09:37:01 +08:00
|
|
|
.set_apic_id = set_apic_id,
|
|
|
|
|
.apic_id_mask = 0xFFFFFFFFu,
|
|
|
|
|
|
|
|
|
|
.cpu_mask_to_apicid = uv_cpu_mask_to_apicid,
|
|
|
|
|
.cpu_mask_to_apicid_and = uv_cpu_mask_to_apicid_and,
|
|
|
|
|
|
|
|
|
|
.send_IPI_mask = uv_send_IPI_mask,
|
|
|
|
|
.send_IPI_mask_allbutself = uv_send_IPI_mask_allbutself,
|
|
|
|
|
.send_IPI_allbutself = uv_send_IPI_allbutself,
|
|
|
|
|
.send_IPI_all = uv_send_IPI_all,
|
|
|
|
|
.send_IPI_self = uv_send_IPI_self,
|
|
|
|
|
|
2009-02-26 20:51:40 +08:00
|
|
|
.wakeup_secondary_cpu = uv_wakeup_secondary,
|
2009-01-28 23:15:16 +08:00
|
|
|
.trampoline_phys_low = DEFAULT_TRAMPOLINE_PHYS_LOW,
|
|
|
|
|
.trampoline_phys_high = DEFAULT_TRAMPOLINE_PHYS_HIGH,
|
2009-01-28 09:37:01 +08:00
|
|
|
.wait_for_init_deassert = NULL,
|
|
|
|
|
.smp_callin_clear_local_apic = NULL,
|
|
|
|
|
.inquire_remote_apic = NULL,
|
2009-02-17 15:02:14 +08:00
|
|
|
|
|
|
|
|
.read = native_apic_msr_read,
|
|
|
|
|
.write = native_apic_msr_write,
|
|
|
|
|
.icr_read = native_x2apic_icr_read,
|
|
|
|
|
.icr_write = native_x2apic_icr_write,
|
|
|
|
|
.wait_icr_idle = native_x2apic_wait_icr_idle,
|
|
|
|
|
.safe_wait_icr_idle = native_safe_x2apic_wait_icr_idle,
|
2008-03-29 03:12:16 +08:00
|
|
|
};
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
static __cpuinit void set_x2apic_extra_bits(int pnode)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2008-05-28 22:51:18 +08:00
|
|
|
__get_cpu_var(x2apic_extra_bits) = (pnode << 6);
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* Called on boot cpu.
|
|
|
|
|
*/
|
2008-05-28 22:51:18 +08:00
|
|
|
static __init int boot_pnode_to_blade(int pnode)
|
|
|
|
|
{
|
|
|
|
|
int blade;
|
|
|
|
|
|
|
|
|
|
for (blade = 0; blade < uv_num_possible_blades(); blade++)
|
|
|
|
|
if (pnode == uv_blade_info[blade].pnode)
|
|
|
|
|
return blade;
|
|
|
|
|
BUG();
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
struct redir_addr {
|
|
|
|
|
unsigned long redirect;
|
|
|
|
|
unsigned long alias;
|
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
#define DEST_SHIFT UVH_RH_GAM_ALIAS210_REDIRECT_CONFIG_0_MMR_DEST_BASE_SHFT
|
|
|
|
|
|
|
|
|
|
static __initdata struct redir_addr redir_addrs[] = {
|
2010-11-07 04:41:04 +08:00
|
|
|
{UVH_RH_GAM_ALIAS210_REDIRECT_CONFIG_0_MMR, UVH_RH_GAM_ALIAS210_OVERLAY_CONFIG_0_MMR},
|
|
|
|
|
{UVH_RH_GAM_ALIAS210_REDIRECT_CONFIG_1_MMR, UVH_RH_GAM_ALIAS210_OVERLAY_CONFIG_1_MMR},
|
|
|
|
|
{UVH_RH_GAM_ALIAS210_REDIRECT_CONFIG_2_MMR, UVH_RH_GAM_ALIAS210_OVERLAY_CONFIG_2_MMR},
|
2008-05-28 22:51:18 +08:00
|
|
|
};
|
|
|
|
|
|
|
|
|
|
static __init void get_lowmem_redirect(unsigned long *base, unsigned long *size)
|
|
|
|
|
{
|
2010-11-07 04:41:04 +08:00
|
|
|
union uvh_rh_gam_alias210_overlay_config_2_mmr_u alias;
|
2008-05-28 22:51:18 +08:00
|
|
|
union uvh_rh_gam_alias210_redirect_config_2_mmr_u redirect;
|
|
|
|
|
int i;
|
|
|
|
|
|
|
|
|
|
for (i = 0; i < ARRAY_SIZE(redir_addrs); i++) {
|
|
|
|
|
alias.v = uv_read_local_mmr(redir_addrs[i].alias);
|
2009-10-16 06:40:00 +08:00
|
|
|
if (alias.s.enable && alias.s.base == 0) {
|
2008-05-28 22:51:18 +08:00
|
|
|
*size = (1UL << alias.s.m_alias);
|
|
|
|
|
redirect.v = uv_read_local_mmr(redir_addrs[i].redirect);
|
|
|
|
|
*base = (unsigned long)redirect.s.dest_base << DEST_SHIFT;
|
|
|
|
|
return;
|
|
|
|
|
}
|
|
|
|
|
}
|
2009-10-16 06:40:00 +08:00
|
|
|
*base = *size = 0;
|
2008-05-28 22:51:18 +08:00
|
|
|
}
|
|
|
|
|
|
2008-07-02 03:45:38 +08:00
|
|
|
enum map_type {map_wb, map_uc};
|
|
|
|
|
|
2010-01-09 04:13:54 +08:00
|
|
|
static __init void map_high(char *id, unsigned long base, int pshift,
|
|
|
|
|
int bshift, int max_pnode, enum map_type map_type)
|
2008-07-02 03:45:38 +08:00
|
|
|
{
|
|
|
|
|
unsigned long bytes, paddr;
|
|
|
|
|
|
2010-01-09 04:13:54 +08:00
|
|
|
paddr = base << pshift;
|
|
|
|
|
bytes = (1UL << bshift) * (max_pnode + 1);
|
2008-07-02 03:45:38 +08:00
|
|
|
printk(KERN_INFO "UV: Map %s_HI 0x%lx - 0x%lx\n", id, paddr,
|
2009-02-26 21:10:10 +08:00
|
|
|
paddr + bytes);
|
2008-07-02 03:45:38 +08:00
|
|
|
if (map_type == map_uc)
|
|
|
|
|
init_extra_mapping_uc(paddr, bytes);
|
|
|
|
|
else
|
|
|
|
|
init_extra_mapping_wb(paddr, bytes);
|
|
|
|
|
|
|
|
|
|
}
|
|
|
|
|
static __init void map_gru_high(int max_pnode)
|
|
|
|
|
{
|
|
|
|
|
union uvh_rh_gam_gru_overlay_config_mmr_u gru;
|
|
|
|
|
int shift = UVH_RH_GAM_GRU_OVERLAY_CONFIG_MMR_BASE_SHFT;
|
|
|
|
|
|
|
|
|
|
gru.v = uv_read_local_mmr(UVH_RH_GAM_GRU_OVERLAY_CONFIG_MMR);
|
2009-11-20 04:23:41 +08:00
|
|
|
if (gru.s.enable) {
|
2010-01-09 04:13:54 +08:00
|
|
|
map_high("GRU", gru.s.base, shift, shift, max_pnode, map_wb);
|
2009-11-20 04:23:41 +08:00
|
|
|
gru_start_paddr = ((u64)gru.s.base << shift);
|
|
|
|
|
gru_end_paddr = gru_start_paddr + (1UL << shift) * (max_pnode + 1);
|
|
|
|
|
|
|
|
|
|
}
|
2008-07-02 03:45:38 +08:00
|
|
|
}
|
|
|
|
|
|
2009-09-09 23:43:39 +08:00
|
|
|
static __init void map_mmr_high(int max_pnode)
|
|
|
|
|
{
|
|
|
|
|
union uvh_rh_gam_mmr_overlay_config_mmr_u mmr;
|
|
|
|
|
int shift = UVH_RH_GAM_MMR_OVERLAY_CONFIG_MMR_BASE_SHFT;
|
|
|
|
|
|
|
|
|
|
mmr.v = uv_read_local_mmr(UVH_RH_GAM_MMR_OVERLAY_CONFIG_MMR);
|
|
|
|
|
if (mmr.s.enable)
|
2010-01-09 04:13:54 +08:00
|
|
|
map_high("MMR", mmr.s.base, shift, shift, max_pnode, map_uc);
|
2009-09-09 23:43:39 +08:00
|
|
|
}
|
|
|
|
|
|
2008-07-02 03:45:38 +08:00
|
|
|
static __init void map_mmioh_high(int max_pnode)
|
|
|
|
|
{
|
|
|
|
|
union uvh_rh_gam_mmioh_overlay_config_mmr_u mmioh;
|
|
|
|
|
int shift = UVH_RH_GAM_MMIOH_OVERLAY_CONFIG_MMR_BASE_SHFT;
|
|
|
|
|
|
|
|
|
|
mmioh.v = uv_read_local_mmr(UVH_RH_GAM_MMIOH_OVERLAY_CONFIG_MMR);
|
|
|
|
|
if (mmioh.s.enable)
|
2010-01-09 04:13:54 +08:00
|
|
|
map_high("MMIOH", mmioh.s.base, shift, mmioh.s.m_io,
|
|
|
|
|
max_pnode, map_uc);
|
2008-07-02 03:45:38 +08:00
|
|
|
}
|
|
|
|
|
|
2009-11-26 00:20:19 +08:00
|
|
|
static __init void map_low_mmrs(void)
|
|
|
|
|
{
|
|
|
|
|
init_extra_mapping_uc(UV_GLOBAL_MMR32_BASE, UV_GLOBAL_MMR32_SIZE);
|
|
|
|
|
init_extra_mapping_uc(UV_LOCAL_MMR_BASE, UV_LOCAL_MMR_SIZE);
|
|
|
|
|
}
|
|
|
|
|
|
2008-07-10 04:27:19 +08:00
|
|
|
static __init void uv_rtc_init(void)
|
|
|
|
|
{
|
2008-10-04 00:59:33 +08:00
|
|
|
long status;
|
|
|
|
|
u64 ticks_per_sec;
|
2008-07-10 04:27:19 +08:00
|
|
|
|
2008-10-04 00:59:33 +08:00
|
|
|
status = uv_bios_freq_base(BIOS_FREQ_BASE_REALTIME_CLOCK,
|
|
|
|
|
&ticks_per_sec);
|
|
|
|
|
if (status != BIOS_STATUS_SUCCESS || ticks_per_sec < 100000) {
|
2008-07-10 04:27:19 +08:00
|
|
|
printk(KERN_WARNING
|
|
|
|
|
"unable to determine platform RTC clock frequency, "
|
|
|
|
|
"guessing.\n");
|
|
|
|
|
/* BIOS gives wrong value for clock freq. so guess */
|
|
|
|
|
sn_rtc_cycles_per_second = 1000000000000UL / 30000UL;
|
|
|
|
|
} else
|
|
|
|
|
sn_rtc_cycles_per_second = ticks_per_sec;
|
|
|
|
|
}
|
|
|
|
|
|
2008-10-25 06:24:29 +08:00
|
|
|
/*
|
|
|
|
|
* percpu heartbeat timer
|
|
|
|
|
*/
|
|
|
|
|
static void uv_heartbeat(unsigned long ignored)
|
|
|
|
|
{
|
|
|
|
|
struct timer_list *timer = &uv_hub_info->scir.timer;
|
|
|
|
|
unsigned char bits = uv_hub_info->scir.state;
|
|
|
|
|
|
|
|
|
|
/* flip heartbeat bit */
|
|
|
|
|
bits ^= SCIR_CPU_HEARTBEAT;
|
|
|
|
|
|
2008-10-27 22:51:20 +08:00
|
|
|
/* is this cpu idle? */
|
|
|
|
|
if (idle_cpu(raw_smp_processor_id()))
|
2008-10-25 06:24:29 +08:00
|
|
|
bits &= ~SCIR_CPU_ACTIVITY;
|
|
|
|
|
else
|
|
|
|
|
bits |= SCIR_CPU_ACTIVITY;
|
|
|
|
|
|
|
|
|
|
/* update system controller interface reg */
|
|
|
|
|
uv_set_scir_bits(bits);
|
|
|
|
|
|
|
|
|
|
/* enable next timer period */
|
2009-04-16 14:44:37 +08:00
|
|
|
mod_timer_pinned(timer, jiffies + SCIR_CPU_HB_INTERVAL);
|
2008-10-25 06:24:29 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static void __cpuinit uv_heartbeat_enable(int cpu)
|
|
|
|
|
{
|
2010-01-07 22:35:42 +08:00
|
|
|
while (!uv_cpu_hub_info(cpu)->scir.enabled) {
|
2008-10-25 06:24:29 +08:00
|
|
|
struct timer_list *timer = &uv_cpu_hub_info(cpu)->scir.timer;
|
|
|
|
|
|
|
|
|
|
uv_set_cpu_scir_bits(cpu, SCIR_CPU_HEARTBEAT|SCIR_CPU_ACTIVITY);
|
|
|
|
|
setup_timer(timer, uv_heartbeat, cpu);
|
|
|
|
|
timer->expires = jiffies + SCIR_CPU_HB_INTERVAL;
|
|
|
|
|
add_timer_on(timer, cpu);
|
|
|
|
|
uv_cpu_hub_info(cpu)->scir.enabled = 1;
|
|
|
|
|
|
2010-01-07 22:35:42 +08:00
|
|
|
/* also ensure that boot cpu is enabled */
|
|
|
|
|
cpu = 0;
|
|
|
|
|
}
|
2008-10-25 06:24:29 +08:00
|
|
|
}
|
|
|
|
|
|
2008-11-20 07:05:14 +08:00
|
|
|
#ifdef CONFIG_HOTPLUG_CPU
|
2008-10-25 06:24:29 +08:00
|
|
|
static void __cpuinit uv_heartbeat_disable(int cpu)
|
|
|
|
|
{
|
|
|
|
|
if (uv_cpu_hub_info(cpu)->scir.enabled) {
|
|
|
|
|
uv_cpu_hub_info(cpu)->scir.enabled = 0;
|
|
|
|
|
del_timer(&uv_cpu_hub_info(cpu)->scir.timer);
|
|
|
|
|
}
|
|
|
|
|
uv_set_cpu_scir_bits(cpu, 0xff);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* cpu hotplug notifier
|
|
|
|
|
*/
|
|
|
|
|
static __cpuinit int uv_scir_cpu_notify(struct notifier_block *self,
|
|
|
|
|
unsigned long action, void *hcpu)
|
|
|
|
|
{
|
|
|
|
|
long cpu = (long)hcpu;
|
|
|
|
|
|
|
|
|
|
switch (action) {
|
|
|
|
|
case CPU_ONLINE:
|
|
|
|
|
uv_heartbeat_enable(cpu);
|
|
|
|
|
break;
|
|
|
|
|
case CPU_DOWN_PREPARE:
|
|
|
|
|
uv_heartbeat_disable(cpu);
|
|
|
|
|
break;
|
|
|
|
|
default:
|
|
|
|
|
break;
|
|
|
|
|
}
|
|
|
|
|
return NOTIFY_OK;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __init void uv_scir_register_cpu_notifier(void)
|
|
|
|
|
{
|
|
|
|
|
hotcpu_notifier(uv_scir_cpu_notify, 0);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
#else /* !CONFIG_HOTPLUG_CPU */
|
|
|
|
|
|
|
|
|
|
static __init void uv_scir_register_cpu_notifier(void)
|
|
|
|
|
{
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static __init int uv_init_heartbeat(void)
|
|
|
|
|
{
|
|
|
|
|
int cpu;
|
|
|
|
|
|
|
|
|
|
if (is_uv_system())
|
|
|
|
|
for_each_online_cpu(cpu)
|
|
|
|
|
uv_heartbeat_enable(cpu);
|
|
|
|
|
return 0;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
late_initcall(uv_init_heartbeat);
|
|
|
|
|
|
|
|
|
|
#endif /* !CONFIG_HOTPLUG_CPU */
|
|
|
|
|
|
2010-02-03 06:38:14 +08:00
|
|
|
/* Direct Legacy VGA I/O traffic to designated IOH */
|
|
|
|
|
int uv_set_vga_state(struct pci_dev *pdev, bool decode,
|
|
|
|
|
unsigned int command_bits, bool change_bridge)
|
|
|
|
|
{
|
|
|
|
|
int domain, bus, rc;
|
|
|
|
|
|
|
|
|
|
PR_DEVEL("devfn %x decode %d cmd %x chg_brdg %d\n",
|
|
|
|
|
pdev->devfn, decode, command_bits, change_bridge);
|
|
|
|
|
|
|
|
|
|
if (!change_bridge)
|
|
|
|
|
return 0;
|
|
|
|
|
|
|
|
|
|
if ((command_bits & PCI_COMMAND_IO) == 0)
|
|
|
|
|
return 0;
|
|
|
|
|
|
|
|
|
|
domain = pci_domain_nr(pdev->bus);
|
|
|
|
|
bus = pdev->bus->number;
|
|
|
|
|
|
|
|
|
|
rc = uv_bios_set_legacy_vga_target(decode, domain, bus);
|
|
|
|
|
PR_DEVEL("vga decode %d %x:%x, rc: %d\n", decode, domain, bus, rc);
|
|
|
|
|
|
|
|
|
|
return rc;
|
|
|
|
|
}
|
|
|
|
|
|
2008-09-23 21:42:05 +08:00
|
|
|
/*
|
|
|
|
|
* Called on each cpu to initialize the per_cpu UV data area.
|
2009-02-26 21:10:10 +08:00
|
|
|
* FIXME: hotplug not supported yet
|
2008-09-23 21:42:05 +08:00
|
|
|
*/
|
|
|
|
|
void __cpuinit uv_cpu_init(void)
|
|
|
|
|
{
|
|
|
|
|
/* CPU 0 initilization will be done via uv_system_init. */
|
|
|
|
|
if (!uv_blade_info)
|
|
|
|
|
return;
|
|
|
|
|
|
|
|
|
|
uv_blade_info[uv_numa_blade_id()].nr_online_cpus++;
|
|
|
|
|
|
|
|
|
|
if (get_uv_system_type() == UV_NON_UNIQUE_APIC)
|
|
|
|
|
set_x2apic_extra_bits(uv_hub_info->pnode);
|
|
|
|
|
}
|
|
|
|
|
|
2010-02-27 00:49:12 +08:00
|
|
|
/*
|
|
|
|
|
* When NMI is received, print a stack trace.
|
|
|
|
|
*/
|
|
|
|
|
int uv_handle_nmi(struct notifier_block *self, unsigned long reason, void *data)
|
|
|
|
|
{
|
|
|
|
|
if (reason != DIE_NMI_IPI)
|
|
|
|
|
return NOTIFY_OK;
|
2010-07-21 07:09:05 +08:00
|
|
|
|
|
|
|
|
if (in_crash_kexec)
|
|
|
|
|
/* do nothing if entering the crash kernel */
|
|
|
|
|
return NOTIFY_OK;
|
2010-02-27 00:49:12 +08:00
|
|
|
/*
|
|
|
|
|
* Use a lock so only one cpu prints at a time
|
|
|
|
|
* to prevent intermixed output.
|
|
|
|
|
*/
|
|
|
|
|
spin_lock(&uv_nmi_lock);
|
|
|
|
|
pr_info("NMI stack dump cpu %u:\n", smp_processor_id());
|
|
|
|
|
dump_stack();
|
|
|
|
|
spin_unlock(&uv_nmi_lock);
|
|
|
|
|
|
|
|
|
|
return NOTIFY_STOP;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
static struct notifier_block uv_dump_stack_nmi_nb = {
|
|
|
|
|
.notifier_call = uv_handle_nmi
|
|
|
|
|
};
|
|
|
|
|
|
|
|
|
|
void uv_register_nmi_notifier(void)
|
|
|
|
|
{
|
|
|
|
|
if (register_die_notifier(&uv_dump_stack_nmi_nb))
|
|
|
|
|
printk(KERN_WARNING "UV NMI handler failed to register\n");
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
void uv_nmi_init(void)
|
|
|
|
|
{
|
|
|
|
|
unsigned int value;
|
|
|
|
|
|
|
|
|
|
/*
|
|
|
|
|
* Unmask NMI on all cpus
|
|
|
|
|
*/
|
|
|
|
|
value = apic_read(APIC_LVT1) | APIC_DM_NMI;
|
|
|
|
|
value &= ~APIC_LVT_MASKED;
|
|
|
|
|
apic_write(APIC_LVT1, value);
|
|
|
|
|
}
|
2008-08-22 02:49:05 +08:00
|
|
|
|
|
|
|
|
void __init uv_system_init(void)
|
2008-03-29 03:12:16 +08:00
|
|
|
{
|
2010-11-07 04:41:04 +08:00
|
|
|
union uvh_rh_gam_config_mmr_u m_n_config;
|
2008-05-28 22:51:18 +08:00
|
|
|
union uvh_node_id_u node_id;
|
|
|
|
|
unsigned long gnode_upper, lowmem_redir_base, lowmem_redir_size;
|
|
|
|
|
int bytes, nid, cpu, lcpu, pnode, blade, i, j, m_val, n_val;
|
2009-06-08 23:44:05 +08:00
|
|
|
int gnode_extra, max_pnode = 0;
|
2009-03-30 22:01:11 +08:00
|
|
|
unsigned long mmr_base, present, paddr;
|
|
|
|
|
unsigned short pnode_mask;
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2009-11-26 00:20:19 +08:00
|
|
|
map_low_mmrs();
|
|
|
|
|
|
2010-11-07 04:41:04 +08:00
|
|
|
m_n_config.v = uv_read_local_mmr(UVH_RH_GAM_CONFIG_MMR );
|
2008-05-28 22:51:18 +08:00
|
|
|
m_val = m_n_config.s.m_skt;
|
|
|
|
|
n_val = m_n_config.s.n_skt;
|
2008-03-29 03:12:16 +08:00
|
|
|
mmr_base =
|
|
|
|
|
uv_read_local_mmr(UVH_RH_GAM_MMR_OVERLAY_CONFIG_MMR) &
|
|
|
|
|
~UV_MMR_ENABLE;
|
2009-06-08 23:44:05 +08:00
|
|
|
pnode_mask = (1 << n_val) - 1;
|
|
|
|
|
node_id.v = uv_read_local_mmr(UVH_NODE_ID);
|
|
|
|
|
gnode_extra = (node_id.s.node_id & ~((1 << n_val) - 1)) >> 1;
|
|
|
|
|
gnode_upper = ((unsigned long)gnode_extra << m_val);
|
|
|
|
|
printk(KERN_DEBUG "UV: N %d, M %d, gnode_upper 0x%lx, gnode_extra 0x%x\n",
|
|
|
|
|
n_val, m_val, gnode_upper, gnode_extra);
|
|
|
|
|
|
2008-03-29 03:12:16 +08:00
|
|
|
printk(KERN_DEBUG "UV: global MMR base 0x%lx\n", mmr_base);
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
for(i = 0; i < UVH_NODE_PRESENT_TABLE_DEPTH; i++)
|
|
|
|
|
uv_possible_blades +=
|
|
|
|
|
hweight64(uv_read_local_mmr( UVH_NODE_PRESENT_TABLE + i * 8));
|
2008-03-29 03:12:16 +08:00
|
|
|
printk(KERN_DEBUG "UV: Found %d blades\n", uv_num_possible_blades());
|
|
|
|
|
|
|
|
|
|
bytes = sizeof(struct uv_blade_info) * uv_num_possible_blades();
|
2008-10-24 06:54:05 +08:00
|
|
|
uv_blade_info = kmalloc(bytes, GFP_KERNEL);
|
2009-05-02 04:25:11 +08:00
|
|
|
BUG_ON(!uv_blade_info);
|
2009-07-27 22:35:07 +08:00
|
|
|
for (blade = 0; blade < uv_num_possible_blades(); blade++)
|
|
|
|
|
uv_blade_info[blade].memory_nid = -1;
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
get_lowmem_redirect(&lowmem_redir_base, &lowmem_redir_size);
|
|
|
|
|
|
2008-03-29 03:12:16 +08:00
|
|
|
bytes = sizeof(uv_node_to_blade[0]) * num_possible_nodes();
|
2008-10-24 06:54:05 +08:00
|
|
|
uv_node_to_blade = kmalloc(bytes, GFP_KERNEL);
|
2009-05-02 04:25:11 +08:00
|
|
|
BUG_ON(!uv_node_to_blade);
|
2008-03-29 03:12:16 +08:00
|
|
|
memset(uv_node_to_blade, 255, bytes);
|
|
|
|
|
|
|
|
|
|
bytes = sizeof(uv_cpu_to_blade[0]) * num_possible_cpus();
|
2008-10-24 06:54:05 +08:00
|
|
|
uv_cpu_to_blade = kmalloc(bytes, GFP_KERNEL);
|
2009-05-02 04:25:11 +08:00
|
|
|
BUG_ON(!uv_cpu_to_blade);
|
2008-03-29 03:12:16 +08:00
|
|
|
memset(uv_cpu_to_blade, 255, bytes);
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
blade = 0;
|
|
|
|
|
for (i = 0; i < UVH_NODE_PRESENT_TABLE_DEPTH; i++) {
|
|
|
|
|
present = uv_read_local_mmr(UVH_NODE_PRESENT_TABLE + i * 8);
|
|
|
|
|
for (j = 0; j < 64; j++) {
|
|
|
|
|
if (!test_bit(j, &present))
|
|
|
|
|
continue;
|
2010-09-10 23:08:08 +08:00
|
|
|
pnode = (i * 64 + j);
|
|
|
|
|
uv_blade_info[blade].pnode = pnode;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_blade_info[blade].nr_possible_cpus = 0;
|
2008-03-29 03:12:16 +08:00
|
|
|
uv_blade_info[blade].nr_online_cpus = 0;
|
2010-09-10 23:08:08 +08:00
|
|
|
max_pnode = max(pnode, max_pnode);
|
2008-05-28 22:51:18 +08:00
|
|
|
blade++;
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|
2008-05-28 22:51:18 +08:00
|
|
|
}
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-10-04 00:59:15 +08:00
|
|
|
uv_bios_init();
|
2009-12-18 00:53:25 +08:00
|
|
|
uv_bios_get_sn_info(0, &uv_type, &sn_partition_id, &sn_coherency_id,
|
|
|
|
|
&sn_region_size, &system_serial_number);
|
2008-07-10 04:27:19 +08:00
|
|
|
uv_rtc_init();
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
for_each_present_cpu(cpu) {
|
2009-12-29 05:28:25 +08:00
|
|
|
int apicid = per_cpu(x86_cpu_to_apicid, cpu);
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
nid = cpu_to_node(cpu);
|
2010-10-27 05:27:28 +08:00
|
|
|
/*
|
|
|
|
|
* apic_pnode_shift must be set before calling uv_apicid_to_pnode();
|
|
|
|
|
*/
|
|
|
|
|
uv_cpu_hub_info(cpu)->apic_pnode_shift = uvh_apicid.s.pnode_shift;
|
2009-12-29 05:28:25 +08:00
|
|
|
pnode = uv_apicid_to_pnode(apicid);
|
2008-05-28 22:51:18 +08:00
|
|
|
blade = boot_pnode_to_blade(pnode);
|
|
|
|
|
lcpu = uv_blade_info[blade].nr_possible_cpus;
|
|
|
|
|
uv_blade_info[blade].nr_possible_cpus++;
|
|
|
|
|
|
2009-07-27 22:35:07 +08:00
|
|
|
/* Any node on the blade, else will contain -1. */
|
|
|
|
|
uv_blade_info[blade].memory_nid = nid;
|
|
|
|
|
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_cpu_hub_info(cpu)->lowmem_remap_base = lowmem_redir_base;
|
2008-12-13 04:50:40 +08:00
|
|
|
uv_cpu_hub_info(cpu)->lowmem_remap_top = lowmem_redir_size;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_cpu_hub_info(cpu)->m_val = m_val;
|
2009-10-16 06:40:00 +08:00
|
|
|
uv_cpu_hub_info(cpu)->n_val = n_val;
|
2008-03-29 03:12:16 +08:00
|
|
|
uv_cpu_hub_info(cpu)->numa_blade_id = blade;
|
|
|
|
|
uv_cpu_hub_info(cpu)->blade_processor_id = lcpu;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_cpu_hub_info(cpu)->pnode = pnode;
|
2009-03-30 22:01:11 +08:00
|
|
|
uv_cpu_hub_info(cpu)->pnode_mask = pnode_mask;
|
2009-10-16 06:40:00 +08:00
|
|
|
uv_cpu_hub_info(cpu)->gpa_mask = (1UL << (m_val + n_val)) - 1;
|
2008-05-28 22:51:18 +08:00
|
|
|
uv_cpu_hub_info(cpu)->gnode_upper = gnode_upper;
|
2009-06-08 23:44:05 +08:00
|
|
|
uv_cpu_hub_info(cpu)->gnode_extra = gnode_extra;
|
2008-03-29 03:12:16 +08:00
|
|
|
uv_cpu_hub_info(cpu)->global_mmr_base = mmr_base;
|
2008-10-22 03:09:51 +08:00
|
|
|
uv_cpu_hub_info(cpu)->coherency_domain_number = sn_coherency_id;
|
2009-12-29 05:28:25 +08:00
|
|
|
uv_cpu_hub_info(cpu)->scir.offset = uv_scir_offset(apicid);
|
2008-03-29 03:12:16 +08:00
|
|
|
uv_node_to_blade[nid] = blade;
|
|
|
|
|
uv_cpu_to_blade[cpu] = blade;
|
|
|
|
|
}
|
2008-07-02 03:45:38 +08:00
|
|
|
|
2009-03-30 22:01:11 +08:00
|
|
|
/* Add blade/pnode info for nodes without cpus */
|
|
|
|
|
for_each_online_node(nid) {
|
|
|
|
|
if (uv_node_to_blade[nid] >= 0)
|
|
|
|
|
continue;
|
|
|
|
|
paddr = node_start_pfn(nid) << PAGE_SHIFT;
|
2009-04-20 21:25:31 +08:00
|
|
|
paddr = uv_soc_phys_ram_to_gpa(paddr);
|
2009-03-30 22:01:11 +08:00
|
|
|
pnode = (paddr >> m_val) & pnode_mask;
|
|
|
|
|
blade = boot_pnode_to_blade(pnode);
|
|
|
|
|
uv_node_to_blade[nid] = blade;
|
|
|
|
|
}
|
|
|
|
|
|
2008-07-02 03:45:38 +08:00
|
|
|
map_gru_high(max_pnode);
|
2009-09-09 23:43:39 +08:00
|
|
|
map_mmr_high(max_pnode);
|
2008-07-02 03:45:38 +08:00
|
|
|
map_mmioh_high(max_pnode);
|
2008-03-29 03:12:16 +08:00
|
|
|
|
2008-09-23 21:42:05 +08:00
|
|
|
uv_cpu_init();
|
2008-10-25 06:24:29 +08:00
|
|
|
uv_scir_register_cpu_notifier();
|
2010-02-27 00:49:12 +08:00
|
|
|
uv_register_nmi_notifier();
|
2008-11-11 06:16:31 +08:00
|
|
|
proc_mkdir("sgi_uv", NULL);
|
2010-02-03 06:38:14 +08:00
|
|
|
|
|
|
|
|
/* register Legacy VGA I/O redirection handler */
|
|
|
|
|
pci_register_set_vga_state(uv_set_vga_state);
|
2008-03-29 03:12:16 +08:00
|
|
|
}
|