2006-09-20 21:58:25 +08:00
|
|
|
/*
|
2012-08-28 22:41:50 +08:00
|
|
|
* Copyright IBM Corp. 2006, 2012
|
2006-09-20 21:58:25 +08:00
|
|
|
* Author(s): Cornelia Huck <cornelia.huck@de.ibm.com>
|
|
|
|
* Martin Schwidefsky <schwidefsky@de.ibm.com>
|
|
|
|
* Ralph Wuerthner <rwuerthn@de.ibm.com>
|
2008-12-25 20:38:41 +08:00
|
|
|
* Felix Beck <felix.beck@de.ibm.com>
|
2011-07-24 16:48:25 +08:00
|
|
|
* Holger Dengler <hd@linux.vnet.ibm.com>
|
2006-09-20 21:58:25 +08:00
|
|
|
*
|
|
|
|
* Adjunct processor bus.
|
|
|
|
*
|
|
|
|
* This program is free software; you can redistribute it and/or modify
|
|
|
|
* it under the terms of the GNU General Public License as published by
|
|
|
|
* the Free Software Foundation; either version 2, or (at your option)
|
|
|
|
* any later version.
|
|
|
|
*
|
|
|
|
* This program is distributed in the hope that it will be useful,
|
|
|
|
* but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
|
|
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
|
|
* GNU General Public License for more details.
|
|
|
|
*
|
|
|
|
* You should have received a copy of the GNU General Public License
|
|
|
|
* along with this program; if not, write to the Free Software
|
|
|
|
* Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA.
|
|
|
|
*/
|
|
|
|
|
2008-12-25 20:39:46 +08:00
|
|
|
#define KMSG_COMPONENT "ap"
|
|
|
|
#define pr_fmt(fmt) KMSG_COMPONENT ": " fmt
|
|
|
|
|
2011-01-05 19:47:38 +08:00
|
|
|
#include <linux/kernel_stat.h>
|
2017-02-09 22:48:10 +08:00
|
|
|
#include <linux/moduleparam.h>
|
2006-09-20 21:58:25 +08:00
|
|
|
#include <linux/init.h>
|
|
|
|
#include <linux/delay.h>
|
|
|
|
#include <linux/err.h>
|
|
|
|
#include <linux/interrupt.h>
|
|
|
|
#include <linux/workqueue.h>
|
include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h
percpu.h is included by sched.h and module.h and thus ends up being
included when building most .c files. percpu.h includes slab.h which
in turn includes gfp.h making everything defined by the two files
universally available and complicating inclusion dependencies.
percpu.h -> slab.h dependency is about to be removed. Prepare for
this change by updating users of gfp and slab facilities include those
headers directly instead of assuming availability. As this conversion
needs to touch large number of source files, the following script is
used as the basis of conversion.
http://userweb.kernel.org/~tj/misc/slabh-sweep.py
The script does the followings.
* Scan files for gfp and slab usages and update includes such that
only the necessary includes are there. ie. if only gfp is used,
gfp.h, if slab is used, slab.h.
* When the script inserts a new include, it looks at the include
blocks and try to put the new include such that its order conforms
to its surrounding. It's put in the include block which contains
core kernel includes, in the same order that the rest are ordered -
alphabetical, Christmas tree, rev-Xmas-tree or at the end if there
doesn't seem to be any matching order.
* If the script can't find a place to put a new include (mostly
because the file doesn't have fitting include block), it prints out
an error message indicating which .h file needs to be added to the
file.
The conversion was done in the following steps.
1. The initial automatic conversion of all .c files updated slightly
over 4000 files, deleting around 700 includes and adding ~480 gfp.h
and ~3000 slab.h inclusions. The script emitted errors for ~400
files.
2. Each error was manually checked. Some didn't need the inclusion,
some needed manual addition while adding it to implementation .h or
embedding .c file was more appropriate for others. This step added
inclusions to around 150 files.
3. The script was run again and the output was compared to the edits
from #2 to make sure no file was left behind.
4. Several build tests were done and a couple of problems were fixed.
e.g. lib/decompress_*.c used malloc/free() wrappers around slab
APIs requiring slab.h to be added manually.
5. The script was run on all .h files but without automatically
editing them as sprinkling gfp.h and slab.h inclusions around .h
files could easily lead to inclusion dependency hell. Most gfp.h
inclusion directives were ignored as stuff from gfp.h was usually
wildly available and often used in preprocessor macros. Each
slab.h inclusion directive was examined and added manually as
necessary.
6. percpu.h was updated not to include slab.h.
7. Build test were done on the following configurations and failures
were fixed. CONFIG_GCOV_KERNEL was turned off for all tests (as my
distributed build env didn't work with gcov compiles) and a few
more options had to be turned off depending on archs to make things
build (like ipr on powerpc/64 which failed due to missing writeq).
* x86 and x86_64 UP and SMP allmodconfig and a custom test config.
* powerpc and powerpc64 SMP allmodconfig
* sparc and sparc64 SMP allmodconfig
* ia64 SMP allmodconfig
* s390 SMP allmodconfig
* alpha SMP allmodconfig
* um on x86_64 SMP allmodconfig
8. percpu.h modifications were reverted so that it could be applied as
a separate patch and serve as bisection point.
Given the fact that I had only a couple of failures from tests on step
6, I'm fairly confident about the coverage of this conversion patch.
If there is a breakage, it's likely to be something in one of the arch
headers which should be easily discoverable easily on most builds of
the specific arch.
Signed-off-by: Tejun Heo <tj@kernel.org>
Guess-its-ok-by: Christoph Lameter <cl@linux-foundation.org>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
2010-03-24 16:04:11 +08:00
|
|
|
#include <linux/slab.h>
|
2006-09-20 21:58:25 +08:00
|
|
|
#include <linux/notifier.h>
|
|
|
|
#include <linux/kthread.h>
|
|
|
|
#include <linux/mutex.h>
|
2015-07-17 19:43:18 +08:00
|
|
|
#include <linux/suspend.h>
|
2006-12-08 22:54:07 +08:00
|
|
|
#include <asm/reset.h>
|
2008-12-25 20:38:41 +08:00
|
|
|
#include <asm/airq.h>
|
2011-07-27 07:09:06 +08:00
|
|
|
#include <linux/atomic.h>
|
2008-12-25 20:38:41 +08:00
|
|
|
#include <asm/isc.h>
|
2008-07-14 15:59:08 +08:00
|
|
|
#include <linux/hrtimer.h>
|
|
|
|
#include <linux/ktime.h>
|
2012-03-29 01:30:02 +08:00
|
|
|
#include <asm/facility.h>
|
2014-11-21 09:05:53 +08:00
|
|
|
#include <linux/crypto.h>
|
2016-08-25 17:16:03 +08:00
|
|
|
#include <linux/mod_devicetable.h>
|
2016-11-24 13:45:21 +08:00
|
|
|
#include <linux/debugfs.h>
|
2006-09-20 21:58:25 +08:00
|
|
|
|
|
|
|
#include "ap_bus.h"
|
2016-09-21 18:48:54 +08:00
|
|
|
#include "ap_asm.h"
|
2016-11-24 13:45:21 +08:00
|
|
|
#include "ap_debug.h"
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2017-02-09 22:48:10 +08:00
|
|
|
* Module parameters; note though this file itself isn't modular.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
|
|
|
int ap_domain_index = -1; /* Adjunct Processor Domain Index */
|
2016-08-25 17:11:30 +08:00
|
|
|
static DEFINE_SPINLOCK(ap_domain_lock);
|
2014-04-14 20:28:27 +08:00
|
|
|
module_param_named(domain, ap_domain_index, int, S_IRUSR|S_IRGRP);
|
2006-09-20 21:58:25 +08:00
|
|
|
MODULE_PARM_DESC(domain, "domain index for ap devices");
|
|
|
|
EXPORT_SYMBOL(ap_domain_index);
|
|
|
|
|
2008-02-10 01:24:30 +08:00
|
|
|
static int ap_thread_flag = 0;
|
2014-04-14 20:28:27 +08:00
|
|
|
module_param_named(poll_thread, ap_thread_flag, int, S_IRUSR|S_IRGRP);
|
2008-02-10 01:24:30 +08:00
|
|
|
MODULE_PARM_DESC(poll_thread, "Turn on/off poll thread, default is 0 (off).");
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
static struct device *ap_root_device;
|
|
|
|
|
|
|
|
DEFINE_SPINLOCK(ap_list_lock);
|
|
|
|
LIST_HEAD(ap_card_list);
|
|
|
|
|
2012-08-28 22:41:50 +08:00
|
|
|
static struct ap_config_info *ap_configuration;
|
s390/zcrypt: Fix kernel crash on systems without AP bus support
On systems without AP bus (e.g. KVM) the kernel crashes during init
calls when zcrypt is built-in:
kernel BUG at drivers/base/driver.c:153!
illegal operation: 0001 ilc:1 [#1] SMP
Modules linked in:
CPU: 1 PID: 1 Comm: swapper/0 Not tainted 4.2.0+ #221
task: 0000000010a40000 ti: 0000000010a48000 task.ti:0000000010a48000
Krnl PSW : 0704c00180000000 0000000000592bd6(driver_register+0x106/0x140)
R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 EA:3
0000000000000012 0000000000000000 0000000000c45328 0000000000c44e30
00000000009ef63c 000000000067f598 0000000000cf3c58 0000000000000000
000000000000007b 0000000000cb1030 0000000000000002 0000000000000000
0000000000ca8580 0000000010306700 00000000001001d8 0000000010a4bd88
Krnl Code: 0000000000592bc6: f0b00004ebcf srp 4(12,%r0),3023(%r14),0
0000000000592bcc: f0a0000407f4 srp 4(11,%r0),2036,0
#0000000000592bd2: a7f40001 brc 15,592bd4
>0000000000592bd6: e330d0000004 lg %r3,0(%r13)
0000000000592bdc: c0200021edfd larl %r2,9d07d6
0000000000592be2: c0e500126d8f brasl %r14,7e0700
0000000000592be8: e330d0080004 lg %r3,8(%r13)
0000000000592bee: a7f4ffab brc 15,592b44
Call Trace:
([<00000000001001c8>] do_one_initcall+0x90/0x1d0)
[<0000000000c6dd34>] kernel_init_freeable+0x1e4/0x2a0
[<00000000007db53a>] kernel_init+0x2a/0x120
[<00000000007e8ece>] kernel_thread_starter+0x6/0xc
[<00000000007e8ec8>] kernel_thread_starter+0x0/0xc
Last Breaking-Event-Address:
[<0000000000592bd2>] driver_register+0x102/0x140
When zcrypt is built as a module, the module loader ensures that the
driver modules cannot be loaded if the AP bus module returns an error
during initialisation. But if zcrypt and the driver are built-in, the
driver is getting initialised even if the AP bus initialisation
failed. The driver invokes ap_driver_register() during initialisation,
which then causes operations on uninitialised data structures to be
performed.
Explicitly protect ap_driver_register() by introducing an
"initialised" flag that gets set iff the AP bus initialisation was
successful. When the AP bus initialisation failed,
ap_driver_register() will error out with -ENODEV, causing the driver
initialisation to fail as well.
Test results:
1. Inside KVM (no AP bus), zcrypt built-in
Boots. /sys/bus/ap not present (expected).
2. Inside KVM (no AP bus), zcrypt as module
Boots. Loading zcrypt_cex4 fails because loading ap_bus fails
(expected).
3. On LPAR with CEX5, zcrypt built-in
Boots. /sys/bus/ap/devices/card* present but .../card*/type missing
(i.e. zcrypt_device_register() fails, unrelated issue).
4. On LPAR with CEX5, zcrypt as module
Boots. Loading zcrypt_cex4 successful,
/sys/bus/ap/devices/card*/type present. No further testing
(user-space functionality) was done.
Signed-off-by: Sascha Silbe <silbe@linux.vnet.ibm.com>
Signed-off-by: Martin Schwidefsky <schwidefsky@de.ibm.com>
2015-10-28 01:29:52 +08:00
|
|
|
static bool initialised;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2016-11-24 13:45:21 +08:00
|
|
|
/*
|
|
|
|
* AP bus related debug feature things.
|
|
|
|
*/
|
|
|
|
debug_info_t *ap_dbf_info;
|
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2015-07-27 18:47:40 +08:00
|
|
|
* Workqueue timer for bus rescan.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
|
|
|
static struct timer_list ap_config_timer;
|
|
|
|
static int ap_config_time = AP_CONFIG_TIME;
|
2015-09-14 23:01:23 +08:00
|
|
|
static void ap_scan_bus(struct work_struct *);
|
2015-07-27 18:47:40 +08:00
|
|
|
static DECLARE_WORK(ap_scan_work, ap_scan_bus);
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2008-12-25 20:38:41 +08:00
|
|
|
* Tasklet & timer for AP request polling and interrupts
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
2015-09-14 23:01:23 +08:00
|
|
|
static void ap_tasklet_fn(unsigned long);
|
|
|
|
static DECLARE_TASKLET(ap_tasklet, ap_tasklet_fn, 0);
|
2006-09-20 21:58:25 +08:00
|
|
|
static DECLARE_WAIT_QUEUE_HEAD(ap_poll_wait);
|
|
|
|
static struct task_struct *ap_poll_kthread = NULL;
|
|
|
|
static DEFINE_MUTEX(ap_poll_thread_mutex);
|
2009-12-07 19:52:00 +08:00
|
|
|
static DEFINE_SPINLOCK(ap_poll_timer_lock);
|
2008-07-14 15:59:08 +08:00
|
|
|
static struct hrtimer ap_poll_timer;
|
|
|
|
/* In LPAR poll with 4kHz frequency. Poll every 250000 nanoseconds.
|
|
|
|
* If z/VM change to 1500000 nanoseconds to adjust to z/VM polling.*/
|
|
|
|
static unsigned long long poll_timeout = 250000;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2009-06-22 18:08:16 +08:00
|
|
|
/* Suspend flag */
|
|
|
|
static int ap_suspend_flag;
|
2015-06-26 22:55:35 +08:00
|
|
|
/* Maximum domain id */
|
|
|
|
static int ap_max_domain_id;
|
2009-09-23 04:58:51 +08:00
|
|
|
/* Flag to check if domain was set through module parameter domain=. This is
|
|
|
|
* important when supsend and resume is done in a z/VM environment where the
|
|
|
|
* domain might change. */
|
|
|
|
static int user_set_domain = 0;
|
2009-06-22 18:08:16 +08:00
|
|
|
static struct bus_type ap_bus_type;
|
|
|
|
|
2013-06-24 16:30:41 +08:00
|
|
|
/* Adapter interrupt definitions */
|
2015-09-14 23:01:23 +08:00
|
|
|
static void ap_interrupt_handler(struct airq_struct *airq);
|
|
|
|
|
2013-06-24 16:30:41 +08:00
|
|
|
static int ap_airq_flag;
|
|
|
|
|
|
|
|
static struct airq_struct ap_airq = {
|
|
|
|
.handler = ap_interrupt_handler,
|
|
|
|
.isc = AP_ISC,
|
|
|
|
};
|
|
|
|
|
2008-12-25 20:38:41 +08:00
|
|
|
/**
|
|
|
|
* ap_using_interrupts() - Returns non-zero if interrupt support is
|
|
|
|
* available.
|
|
|
|
*/
|
|
|
|
static inline int ap_using_interrupts(void)
|
|
|
|
{
|
2013-06-24 16:30:41 +08:00
|
|
|
return ap_airq_flag;
|
2008-12-25 20:38:41 +08:00
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
/**
|
|
|
|
* ap_airq_ptr() - Get the address of the adapter interrupt indicator
|
|
|
|
*
|
|
|
|
* Returns the address of the local-summary-indicator of the adapter
|
|
|
|
* interrupt handler for AP, or NULL if adapter interrupts are not
|
|
|
|
* available.
|
|
|
|
*/
|
|
|
|
void *ap_airq_ptr(void)
|
|
|
|
{
|
|
|
|
if (ap_using_interrupts())
|
|
|
|
return ap_airq.lsi_ptr;
|
|
|
|
return NULL;
|
|
|
|
}
|
|
|
|
|
2008-12-25 20:38:41 +08:00
|
|
|
/**
|
|
|
|
* ap_interrupts_available(): Test if AP interrupts are available.
|
|
|
|
*
|
|
|
|
* Returns 1 if AP interrupts are available.
|
|
|
|
*/
|
|
|
|
static int ap_interrupts_available(void)
|
|
|
|
{
|
2015-02-14 18:23:21 +08:00
|
|
|
return test_facility(65);
|
2008-12-25 20:38:41 +08:00
|
|
|
}
|
|
|
|
|
2012-08-28 22:41:50 +08:00
|
|
|
/**
|
|
|
|
* ap_configuration_available(): Test if AP configuration
|
|
|
|
* information is available.
|
|
|
|
*
|
|
|
|
* Returns 1 if AP configuration information is available.
|
|
|
|
*/
|
|
|
|
static int ap_configuration_available(void)
|
|
|
|
{
|
2015-02-14 18:23:21 +08:00
|
|
|
return test_facility(12);
|
2012-08-28 22:41:50 +08:00
|
|
|
}
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_test_queue(): Test adjunct processor queue.
|
|
|
|
* @qid: The AP queue number
|
2015-06-26 21:40:41 +08:00
|
|
|
* @info: Pointer to queue descriptor
|
2006-09-20 21:58:25 +08:00
|
|
|
*
|
2008-04-17 13:46:28 +08:00
|
|
|
* Returns AP queue status structure.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
|
|
|
static inline struct ap_queue_status
|
2015-06-26 21:40:41 +08:00
|
|
|
ap_test_queue(ap_qid_t qid, unsigned long *info)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
2015-06-26 21:40:41 +08:00
|
|
|
if (test_facility(15))
|
2016-06-20 20:00:27 +08:00
|
|
|
qid |= 1UL << 23; /* set APFT T bit*/
|
2016-09-21 18:48:54 +08:00
|
|
|
return ap_tapq(qid, info);
|
2012-08-28 22:41:50 +08:00
|
|
|
}
|
|
|
|
|
2016-06-20 20:00:27 +08:00
|
|
|
static inline int ap_query_configuration(void)
|
|
|
|
{
|
|
|
|
if (!ap_configuration)
|
|
|
|
return -EOPNOTSUPP;
|
2016-09-21 18:48:54 +08:00
|
|
|
return ap_qci(ap_configuration);
|
2016-06-20 20:00:27 +08:00
|
|
|
}
|
|
|
|
|
2015-06-26 22:55:35 +08:00
|
|
|
/**
|
|
|
|
* ap_init_configuration(): Allocate and query configuration array.
|
|
|
|
*/
|
|
|
|
static void ap_init_configuration(void)
|
|
|
|
{
|
|
|
|
if (!ap_configuration_available())
|
|
|
|
return;
|
|
|
|
|
|
|
|
ap_configuration = kzalloc(sizeof(*ap_configuration), GFP_KERNEL);
|
|
|
|
if (!ap_configuration)
|
|
|
|
return;
|
|
|
|
if (ap_query_configuration() != 0) {
|
|
|
|
kfree(ap_configuration);
|
|
|
|
ap_configuration = NULL;
|
|
|
|
return;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
/*
|
|
|
|
* ap_test_config(): helper function to extract the nrth bit
|
|
|
|
* within the unsigned int array field.
|
|
|
|
*/
|
|
|
|
static inline int ap_test_config(unsigned int *field, unsigned int nr)
|
|
|
|
{
|
|
|
|
return ap_test_bit((field + (nr >> 5)), (nr & 0x1f));
|
|
|
|
}
|
|
|
|
|
|
|
|
/*
|
|
|
|
* ap_test_config_card_id(): Test, whether an AP card ID is configured.
|
|
|
|
* @id AP card ID
|
|
|
|
*
|
|
|
|
* Returns 0 if the card is not configured
|
|
|
|
* 1 if the card is configured or
|
|
|
|
* if the configuration information is not available
|
|
|
|
*/
|
|
|
|
static inline int ap_test_config_card_id(unsigned int id)
|
|
|
|
{
|
|
|
|
if (!ap_configuration) /* QCI not supported */
|
|
|
|
return 1;
|
|
|
|
return ap_test_config(ap_configuration->apm, id);
|
|
|
|
}
|
|
|
|
|
|
|
|
/*
|
|
|
|
* ap_test_config_domain(): Test, whether an AP usage domain is configured.
|
|
|
|
* @domain AP usage domain ID
|
|
|
|
*
|
|
|
|
* Returns 0 if the usage domain is not configured
|
|
|
|
* 1 if the usage domain is configured or
|
|
|
|
* if the configuration information is not available
|
|
|
|
*/
|
|
|
|
static inline int ap_test_config_domain(unsigned int domain)
|
|
|
|
{
|
|
|
|
if (!ap_configuration) /* QCI not supported */
|
|
|
|
return domain < 16;
|
|
|
|
return ap_test_config(ap_configuration->aqm, domain);
|
|
|
|
}
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_query_queue(): Check if an AP queue is available.
|
|
|
|
* @qid: The AP queue number
|
|
|
|
* @queue_depth: Pointer to queue depth value
|
|
|
|
* @device_type: Pointer to device type value
|
2015-06-26 21:40:41 +08:00
|
|
|
* @facilities: Pointer to facility indicator
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
2015-06-26 21:40:41 +08:00
|
|
|
static int ap_query_queue(ap_qid_t qid, int *queue_depth, int *device_type,
|
|
|
|
unsigned int *facilities)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
|
|
|
struct ap_queue_status status;
|
2015-06-26 21:40:41 +08:00
|
|
|
unsigned long info;
|
2015-06-26 22:55:35 +08:00
|
|
|
int nd;
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
if (!ap_test_config_card_id(AP_QID_CARD(qid)))
|
2015-06-26 22:55:35 +08:00
|
|
|
return -ENODEV;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2015-06-26 21:40:41 +08:00
|
|
|
status = ap_test_queue(qid, &info);
|
2015-06-17 22:19:15 +08:00
|
|
|
switch (status.response_code) {
|
|
|
|
case AP_RESPONSE_NORMAL:
|
2015-06-26 21:40:41 +08:00
|
|
|
*queue_depth = (int)(info & 0xff);
|
|
|
|
*device_type = (int)((info >> 24) & 0xff);
|
|
|
|
*facilities = (unsigned int)(info >> 32);
|
2015-06-26 22:55:35 +08:00
|
|
|
/* Update maximum domain id */
|
|
|
|
nd = (info >> 16) & 0xff;
|
2016-11-02 17:23:24 +08:00
|
|
|
/* if N bit is available, z13 and newer */
|
2015-06-26 22:55:35 +08:00
|
|
|
if ((info & (1UL << 57)) && nd > 0)
|
|
|
|
ap_max_domain_id = nd;
|
2016-11-02 17:23:24 +08:00
|
|
|
else /* older machine types */
|
|
|
|
ap_max_domain_id = 15;
|
2016-10-27 14:57:39 +08:00
|
|
|
switch (*device_type) {
|
|
|
|
/* For CEX2 and CEX3 the available functions
|
|
|
|
* are not refrected by the facilities bits.
|
|
|
|
* Instead it is coded into the type. So here
|
|
|
|
* modify the function bits based on the type.
|
|
|
|
*/
|
|
|
|
case AP_DEVICE_TYPE_CEX2A:
|
|
|
|
case AP_DEVICE_TYPE_CEX3A:
|
|
|
|
*facilities |= 0x08000000;
|
|
|
|
break;
|
|
|
|
case AP_DEVICE_TYPE_CEX2C:
|
|
|
|
case AP_DEVICE_TYPE_CEX3C:
|
|
|
|
*facilities |= 0x10000000;
|
|
|
|
break;
|
|
|
|
default:
|
|
|
|
break;
|
|
|
|
}
|
2015-06-17 22:19:15 +08:00
|
|
|
return 0;
|
|
|
|
case AP_RESPONSE_Q_NOT_AVAIL:
|
|
|
|
case AP_RESPONSE_DECONFIGURED:
|
|
|
|
case AP_RESPONSE_CHECKSTOPPED:
|
|
|
|
case AP_RESPONSE_INVALID_ADDRESS:
|
|
|
|
return -ENODEV;
|
|
|
|
case AP_RESPONSE_RESET_IN_PROGRESS:
|
|
|
|
case AP_RESPONSE_OTHERWISE_CHANGED:
|
|
|
|
case AP_RESPONSE_BUSY:
|
|
|
|
return -EBUSY;
|
|
|
|
default:
|
|
|
|
BUG();
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
void ap_wait(enum ap_wait wait)
|
2015-09-14 23:01:23 +08:00
|
|
|
{
|
|
|
|
ktime_t hr_time;
|
|
|
|
|
|
|
|
switch (wait) {
|
|
|
|
case AP_WAIT_AGAIN:
|
|
|
|
case AP_WAIT_INTERRUPT:
|
|
|
|
if (ap_using_interrupts())
|
|
|
|
break;
|
|
|
|
if (ap_poll_kthread) {
|
|
|
|
wake_up(&ap_poll_wait);
|
|
|
|
break;
|
|
|
|
}
|
|
|
|
/* Fall through */
|
|
|
|
case AP_WAIT_TIMEOUT:
|
|
|
|
spin_lock_bh(&ap_poll_timer_lock);
|
|
|
|
if (!hrtimer_is_queued(&ap_poll_timer)) {
|
2016-12-25 19:30:41 +08:00
|
|
|
hr_time = poll_timeout;
|
2015-09-14 23:01:23 +08:00
|
|
|
hrtimer_forward_now(&ap_poll_timer, hr_time);
|
|
|
|
hrtimer_restart(&ap_poll_timer);
|
|
|
|
}
|
|
|
|
spin_unlock_bh(&ap_poll_timer_lock);
|
|
|
|
break;
|
|
|
|
case AP_WAIT_NONE:
|
|
|
|
default:
|
|
|
|
break;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* ap_request_timeout(): Handling of request timeouts
|
|
|
|
* @data: Holds the AP device.
|
|
|
|
*
|
|
|
|
* Handles request timeouts.
|
|
|
|
*/
|
2016-08-25 17:16:03 +08:00
|
|
|
void ap_request_timeout(unsigned long data)
|
2015-09-14 23:01:23 +08:00
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
struct ap_queue *aq = (struct ap_queue *) data;
|
2015-09-14 23:01:23 +08:00
|
|
|
|
|
|
|
if (ap_suspend_flag)
|
|
|
|
return;
|
2016-08-25 17:16:03 +08:00
|
|
|
spin_lock_bh(&aq->lock);
|
|
|
|
ap_wait(ap_sm_event(aq, AP_EVENT_TIMEOUT));
|
|
|
|
spin_unlock_bh(&aq->lock);
|
2015-09-14 23:01:23 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* ap_poll_timeout(): AP receive polling for finished AP requests.
|
|
|
|
* @unused: Unused pointer.
|
|
|
|
*
|
|
|
|
* Schedules the AP tasklet using a high resolution timer.
|
|
|
|
*/
|
|
|
|
static enum hrtimer_restart ap_poll_timeout(struct hrtimer *unused)
|
|
|
|
{
|
|
|
|
if (!ap_suspend_flag)
|
|
|
|
tasklet_schedule(&ap_tasklet);
|
|
|
|
return HRTIMER_NORESTART;
|
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* ap_interrupt_handler() - Schedule ap_tasklet on interrupt
|
|
|
|
* @airq: pointer to adapter interrupt descriptor
|
|
|
|
*/
|
|
|
|
static void ap_interrupt_handler(struct airq_struct *airq)
|
|
|
|
{
|
|
|
|
inc_irq_stat(IRQIO_APB);
|
|
|
|
if (!ap_suspend_flag)
|
|
|
|
tasklet_schedule(&ap_tasklet);
|
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* ap_tasklet_fn(): Tasklet to poll all AP devices.
|
|
|
|
* @dummy: Unused variable
|
|
|
|
*
|
|
|
|
* Poll all AP devices on the bus.
|
|
|
|
*/
|
|
|
|
static void ap_tasklet_fn(unsigned long dummy)
|
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
struct ap_card *ac;
|
|
|
|
struct ap_queue *aq;
|
2015-09-14 23:01:23 +08:00
|
|
|
enum ap_wait wait = AP_WAIT_NONE;
|
|
|
|
|
|
|
|
/* Reset the indicator if interrupts are used. Thus new interrupts can
|
|
|
|
* be received. Doing it in the beginning of the tasklet is therefor
|
|
|
|
* important that no requests on any AP get lost.
|
|
|
|
*/
|
|
|
|
if (ap_using_interrupts())
|
|
|
|
xchg(ap_airq.lsi_ptr, 0);
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
spin_lock_bh(&ap_list_lock);
|
|
|
|
for_each_ap_card(ac) {
|
|
|
|
for_each_ap_queue(aq, ac) {
|
|
|
|
spin_lock_bh(&aq->lock);
|
|
|
|
wait = min(wait, ap_sm_event_loop(aq, AP_EVENT_POLL));
|
|
|
|
spin_unlock_bh(&aq->lock);
|
|
|
|
}
|
2015-09-14 23:01:23 +08:00
|
|
|
}
|
2016-08-25 17:16:03 +08:00
|
|
|
spin_unlock_bh(&ap_list_lock);
|
|
|
|
|
|
|
|
ap_wait(wait);
|
2007-07-10 17:24:19 +08:00
|
|
|
}
|
|
|
|
|
2016-09-21 20:12:53 +08:00
|
|
|
static int ap_pending_requests(void)
|
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
struct ap_card *ac;
|
|
|
|
struct ap_queue *aq;
|
|
|
|
|
|
|
|
spin_lock_bh(&ap_list_lock);
|
|
|
|
for_each_ap_card(ac) {
|
|
|
|
for_each_ap_queue(aq, ac) {
|
|
|
|
if (aq->queue_count == 0)
|
|
|
|
continue;
|
|
|
|
spin_unlock_bh(&ap_list_lock);
|
|
|
|
return 1;
|
2016-09-21 20:12:53 +08:00
|
|
|
}
|
|
|
|
}
|
2016-08-25 17:16:03 +08:00
|
|
|
spin_unlock_bh(&ap_list_lock);
|
|
|
|
return 0;
|
2016-09-21 20:12:53 +08:00
|
|
|
}
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
/**
|
|
|
|
* ap_poll_thread(): Thread that polls for finished requests.
|
|
|
|
* @data: Unused pointer
|
|
|
|
*
|
|
|
|
* AP bus poll thread. The purpose of this thread is to poll for
|
|
|
|
* finished requests in a loop if there is a "free" cpu - that is
|
|
|
|
* a cpu that doesn't have anything better to do. The polling stops
|
|
|
|
* as soon as there is another task or if all messages have been
|
|
|
|
* delivered.
|
|
|
|
*/
|
|
|
|
static int ap_poll_thread(void *data)
|
|
|
|
{
|
|
|
|
DECLARE_WAITQUEUE(wait, current);
|
|
|
|
|
|
|
|
set_user_nice(current, MAX_NICE);
|
|
|
|
set_freezable();
|
|
|
|
while (!kthread_should_stop()) {
|
|
|
|
add_wait_queue(&ap_poll_wait, &wait);
|
|
|
|
set_current_state(TASK_INTERRUPTIBLE);
|
2016-09-21 20:12:53 +08:00
|
|
|
if (ap_suspend_flag || !ap_pending_requests()) {
|
2015-07-17 19:43:18 +08:00
|
|
|
schedule();
|
|
|
|
try_to_freeze();
|
|
|
|
}
|
|
|
|
set_current_state(TASK_RUNNING);
|
|
|
|
remove_wait_queue(&ap_poll_wait, &wait);
|
|
|
|
if (need_resched()) {
|
|
|
|
schedule();
|
|
|
|
try_to_freeze();
|
|
|
|
continue;
|
|
|
|
}
|
2015-09-14 23:01:23 +08:00
|
|
|
ap_tasklet_fn(0);
|
2016-09-21 20:12:53 +08:00
|
|
|
}
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static int ap_poll_thread_start(void)
|
|
|
|
{
|
|
|
|
int rc;
|
|
|
|
|
|
|
|
if (ap_using_interrupts() || ap_poll_kthread)
|
|
|
|
return 0;
|
|
|
|
mutex_lock(&ap_poll_thread_mutex);
|
|
|
|
ap_poll_kthread = kthread_run(ap_poll_thread, NULL, "appoll");
|
|
|
|
rc = PTR_RET(ap_poll_kthread);
|
|
|
|
if (rc)
|
|
|
|
ap_poll_kthread = NULL;
|
|
|
|
mutex_unlock(&ap_poll_thread_mutex);
|
|
|
|
return rc;
|
|
|
|
}
|
|
|
|
|
|
|
|
static void ap_poll_thread_stop(void)
|
|
|
|
{
|
|
|
|
if (!ap_poll_kthread)
|
|
|
|
return;
|
|
|
|
mutex_lock(&ap_poll_thread_mutex);
|
|
|
|
kthread_stop(ap_poll_kthread);
|
|
|
|
ap_poll_kthread = NULL;
|
|
|
|
mutex_unlock(&ap_poll_thread_mutex);
|
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
#define is_card_dev(x) ((x)->parent == ap_root_device)
|
|
|
|
#define is_queue_dev(x) ((x)->parent != ap_root_device)
|
2006-09-20 21:58:25 +08:00
|
|
|
|
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_bus_match()
|
|
|
|
* @dev: Pointer to device
|
|
|
|
* @drv: Pointer to device_driver
|
|
|
|
*
|
2006-09-20 21:58:25 +08:00
|
|
|
* AP bus driver registration/unregistration.
|
|
|
|
*/
|
|
|
|
static int ap_bus_match(struct device *dev, struct device_driver *drv)
|
|
|
|
{
|
|
|
|
struct ap_driver *ap_drv = to_ap_drv(drv);
|
|
|
|
struct ap_device_id *id;
|
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2006-09-20 21:58:25 +08:00
|
|
|
* Compare device type of the device with the list of
|
|
|
|
* supported types of the device_driver.
|
|
|
|
*/
|
|
|
|
for (id = ap_drv->ids; id->match_flags; id++) {
|
2016-08-25 17:16:03 +08:00
|
|
|
if (is_card_dev(dev) &&
|
|
|
|
id->match_flags & AP_DEVICE_ID_MATCH_CARD_TYPE &&
|
|
|
|
id->dev_type == to_ap_dev(dev)->device_type)
|
|
|
|
return 1;
|
|
|
|
if (is_queue_dev(dev) &&
|
|
|
|
id->match_flags & AP_DEVICE_ID_MATCH_QUEUE_TYPE &&
|
|
|
|
id->dev_type == to_ap_dev(dev)->device_type)
|
|
|
|
return 1;
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_uevent(): Uevent function for AP devices.
|
|
|
|
* @dev: Pointer to device
|
|
|
|
* @env: Pointer to kobj_uevent_env
|
|
|
|
*
|
|
|
|
* It sets up a single environment variable DEV_TYPE which contains the
|
|
|
|
* hardware device type.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
2007-08-14 21:15:12 +08:00
|
|
|
static int ap_uevent (struct device *dev, struct kobj_uevent_env *env)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
|
|
|
struct ap_device *ap_dev = to_ap_dev(dev);
|
2007-08-14 21:15:12 +08:00
|
|
|
int retval = 0;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
|
|
|
if (!ap_dev)
|
|
|
|
return -ENODEV;
|
|
|
|
|
|
|
|
/* Set up DEV_TYPE environment variable. */
|
2007-08-14 21:15:12 +08:00
|
|
|
retval = add_uevent_var(env, "DEV_TYPE=%04X", ap_dev->device_type);
|
2007-03-31 13:23:12 +08:00
|
|
|
if (retval)
|
|
|
|
return retval;
|
|
|
|
|
2006-12-04 22:40:10 +08:00
|
|
|
/* Add MODALIAS= */
|
2007-08-14 21:15:12 +08:00
|
|
|
retval = add_uevent_var(env, "MODALIAS=ap:t%02X", ap_dev->device_type);
|
2007-03-31 13:23:12 +08:00
|
|
|
|
|
|
|
return retval;
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
|
|
|
|
2016-11-23 05:06:00 +08:00
|
|
|
static int ap_dev_suspend(struct device *dev)
|
2009-06-22 18:08:16 +08:00
|
|
|
{
|
|
|
|
struct ap_device *ap_dev = to_ap_dev(dev);
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
if (ap_dev->drv && ap_dev->drv->suspend)
|
|
|
|
ap_dev->drv->suspend(ap_dev);
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static int ap_dev_resume(struct device *dev)
|
|
|
|
{
|
|
|
|
struct ap_device *ap_dev = to_ap_dev(dev);
|
|
|
|
|
|
|
|
if (ap_dev->drv && ap_dev->drv->resume)
|
|
|
|
ap_dev->drv->resume(ap_dev);
|
2015-07-17 19:43:18 +08:00
|
|
|
return 0;
|
|
|
|
}
|
2009-09-23 04:58:51 +08:00
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
static void ap_bus_suspend(void)
|
|
|
|
{
|
2016-11-24 13:45:21 +08:00
|
|
|
AP_DBF(DBF_DEBUG, "ap_bus_suspend running\n");
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
ap_suspend_flag = 1;
|
|
|
|
/*
|
|
|
|
* Disable scanning for devices, thus we do not want to scan
|
|
|
|
* for them after removing.
|
|
|
|
*/
|
2015-07-27 18:47:40 +08:00
|
|
|
flush_work(&ap_scan_work);
|
2015-07-17 19:43:18 +08:00
|
|
|
tasklet_disable(&ap_tasklet);
|
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
static int __ap_card_devices_unregister(struct device *dev, void *dummy)
|
|
|
|
{
|
|
|
|
if (is_card_dev(dev))
|
|
|
|
device_unregister(dev);
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static int __ap_queue_devices_unregister(struct device *dev, void *dummy)
|
|
|
|
{
|
|
|
|
if (is_queue_dev(dev))
|
|
|
|
device_unregister(dev);
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static int __ap_queue_devices_with_id_unregister(struct device *dev, void *data)
|
2015-07-17 19:43:18 +08:00
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
if (is_queue_dev(dev) &&
|
|
|
|
AP_QID_CARD(to_ap_queue(dev)->qid) == (int)(long) data)
|
|
|
|
device_unregister(dev);
|
2015-07-17 19:43:18 +08:00
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
static void ap_bus_resume(void)
|
2009-06-22 18:08:16 +08:00
|
|
|
{
|
2013-06-24 16:30:41 +08:00
|
|
|
int rc;
|
2009-06-22 18:08:16 +08:00
|
|
|
|
2016-11-24 13:45:21 +08:00
|
|
|
AP_DBF(DBF_DEBUG, "ap_bus_resume running\n");
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
/* remove all queue devices */
|
|
|
|
bus_for_each_dev(&ap_bus_type, NULL, NULL,
|
|
|
|
__ap_queue_devices_unregister);
|
|
|
|
/* remove all card devices */
|
|
|
|
bus_for_each_dev(&ap_bus_type, NULL, NULL,
|
|
|
|
__ap_card_devices_unregister);
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
/* Reset thin interrupt setting */
|
|
|
|
if (ap_interrupts_available() && !ap_using_interrupts()) {
|
|
|
|
rc = register_adapter_interrupt(&ap_airq);
|
|
|
|
ap_airq_flag = (rc == 0);
|
2009-09-23 04:58:51 +08:00
|
|
|
}
|
2015-07-17 19:43:18 +08:00
|
|
|
if (!ap_interrupts_available() && ap_using_interrupts()) {
|
|
|
|
unregister_adapter_interrupt(&ap_airq);
|
|
|
|
ap_airq_flag = 0;
|
|
|
|
}
|
|
|
|
/* Reset domain */
|
|
|
|
if (!user_set_domain)
|
|
|
|
ap_domain_index = -1;
|
|
|
|
/* Get things going again */
|
|
|
|
ap_suspend_flag = 0;
|
|
|
|
if (ap_airq_flag)
|
|
|
|
xchg(ap_airq.lsi_ptr, 0);
|
|
|
|
tasklet_enable(&ap_tasklet);
|
2015-07-27 18:47:40 +08:00
|
|
|
queue_work(system_long_wq, &ap_scan_work);
|
2015-07-17 19:43:18 +08:00
|
|
|
}
|
2009-06-22 18:08:16 +08:00
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
static int ap_power_event(struct notifier_block *this, unsigned long event,
|
|
|
|
void *ptr)
|
|
|
|
{
|
|
|
|
switch (event) {
|
|
|
|
case PM_HIBERNATION_PREPARE:
|
|
|
|
case PM_SUSPEND_PREPARE:
|
|
|
|
ap_bus_suspend();
|
|
|
|
break;
|
|
|
|
case PM_POST_HIBERNATION:
|
|
|
|
case PM_POST_SUSPEND:
|
|
|
|
ap_bus_resume();
|
|
|
|
break;
|
|
|
|
default:
|
|
|
|
break;
|
|
|
|
}
|
|
|
|
return NOTIFY_DONE;
|
2009-06-22 18:08:16 +08:00
|
|
|
}
|
2015-07-17 19:43:18 +08:00
|
|
|
static struct notifier_block ap_power_notifier = {
|
|
|
|
.notifier_call = ap_power_event,
|
|
|
|
};
|
2009-06-22 18:08:16 +08:00
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
static SIMPLE_DEV_PM_OPS(ap_bus_pm_ops, ap_dev_suspend, ap_dev_resume);
|
2016-11-23 05:06:00 +08:00
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
static struct bus_type ap_bus_type = {
|
|
|
|
.name = "ap",
|
|
|
|
.match = &ap_bus_match,
|
|
|
|
.uevent = &ap_uevent,
|
2016-11-23 05:06:00 +08:00
|
|
|
.pm = &ap_bus_pm_ops,
|
2006-09-20 21:58:25 +08:00
|
|
|
};
|
|
|
|
|
|
|
|
static int ap_device_probe(struct device *dev)
|
|
|
|
{
|
|
|
|
struct ap_device *ap_dev = to_ap_dev(dev);
|
2015-09-14 23:01:23 +08:00
|
|
|
struct ap_driver *ap_drv = to_ap_drv(dev->driver);
|
|
|
|
int rc;
|
2014-07-15 01:11:48 +08:00
|
|
|
|
2017-05-24 16:26:29 +08:00
|
|
|
/* Add queue/card to list of active queues/cards */
|
|
|
|
spin_lock_bh(&ap_list_lock);
|
|
|
|
if (is_card_dev(dev))
|
|
|
|
list_add(&to_ap_card(dev)->list, &ap_card_list);
|
|
|
|
else
|
|
|
|
list_add(&to_ap_queue(dev)->list,
|
|
|
|
&to_ap_queue(dev)->card->queues);
|
|
|
|
spin_unlock_bh(&ap_list_lock);
|
|
|
|
|
2015-09-14 23:01:23 +08:00
|
|
|
ap_dev->drv = ap_drv;
|
2006-09-20 21:58:25 +08:00
|
|
|
rc = ap_drv->probe ? ap_drv->probe(ap_dev) : -ENODEV;
|
2017-05-24 16:26:29 +08:00
|
|
|
|
|
|
|
if (rc) {
|
|
|
|
spin_lock_bh(&ap_list_lock);
|
|
|
|
if (is_card_dev(dev))
|
|
|
|
list_del_init(&to_ap_card(dev)->list);
|
|
|
|
else
|
|
|
|
list_del_init(&to_ap_queue(dev)->list);
|
|
|
|
spin_unlock_bh(&ap_list_lock);
|
2015-09-14 23:01:23 +08:00
|
|
|
ap_dev->drv = NULL;
|
2017-05-24 16:26:29 +08:00
|
|
|
}
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
return rc;
|
|
|
|
}
|
|
|
|
|
|
|
|
static int ap_device_remove(struct device *dev)
|
|
|
|
{
|
|
|
|
struct ap_device *ap_dev = to_ap_dev(dev);
|
|
|
|
struct ap_driver *ap_drv = ap_dev->drv;
|
|
|
|
|
2017-05-24 16:26:29 +08:00
|
|
|
if (ap_drv->remove)
|
|
|
|
ap_drv->remove(ap_dev);
|
|
|
|
|
|
|
|
/* Remove queue/card from list of active queues/cards */
|
2016-08-25 17:16:03 +08:00
|
|
|
spin_lock_bh(&ap_list_lock);
|
|
|
|
if (is_card_dev(dev))
|
|
|
|
list_del_init(&to_ap_card(dev)->list);
|
|
|
|
else
|
|
|
|
list_del_init(&to_ap_queue(dev)->list);
|
|
|
|
spin_unlock_bh(&ap_list_lock);
|
2017-05-24 16:26:29 +08:00
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
int ap_driver_register(struct ap_driver *ap_drv, struct module *owner,
|
|
|
|
char *name)
|
|
|
|
{
|
|
|
|
struct device_driver *drv = &ap_drv->driver;
|
|
|
|
|
s390/zcrypt: Fix kernel crash on systems without AP bus support
On systems without AP bus (e.g. KVM) the kernel crashes during init
calls when zcrypt is built-in:
kernel BUG at drivers/base/driver.c:153!
illegal operation: 0001 ilc:1 [#1] SMP
Modules linked in:
CPU: 1 PID: 1 Comm: swapper/0 Not tainted 4.2.0+ #221
task: 0000000010a40000 ti: 0000000010a48000 task.ti:0000000010a48000
Krnl PSW : 0704c00180000000 0000000000592bd6(driver_register+0x106/0x140)
R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 EA:3
0000000000000012 0000000000000000 0000000000c45328 0000000000c44e30
00000000009ef63c 000000000067f598 0000000000cf3c58 0000000000000000
000000000000007b 0000000000cb1030 0000000000000002 0000000000000000
0000000000ca8580 0000000010306700 00000000001001d8 0000000010a4bd88
Krnl Code: 0000000000592bc6: f0b00004ebcf srp 4(12,%r0),3023(%r14),0
0000000000592bcc: f0a0000407f4 srp 4(11,%r0),2036,0
#0000000000592bd2: a7f40001 brc 15,592bd4
>0000000000592bd6: e330d0000004 lg %r3,0(%r13)
0000000000592bdc: c0200021edfd larl %r2,9d07d6
0000000000592be2: c0e500126d8f brasl %r14,7e0700
0000000000592be8: e330d0080004 lg %r3,8(%r13)
0000000000592bee: a7f4ffab brc 15,592b44
Call Trace:
([<00000000001001c8>] do_one_initcall+0x90/0x1d0)
[<0000000000c6dd34>] kernel_init_freeable+0x1e4/0x2a0
[<00000000007db53a>] kernel_init+0x2a/0x120
[<00000000007e8ece>] kernel_thread_starter+0x6/0xc
[<00000000007e8ec8>] kernel_thread_starter+0x0/0xc
Last Breaking-Event-Address:
[<0000000000592bd2>] driver_register+0x102/0x140
When zcrypt is built as a module, the module loader ensures that the
driver modules cannot be loaded if the AP bus module returns an error
during initialisation. But if zcrypt and the driver are built-in, the
driver is getting initialised even if the AP bus initialisation
failed. The driver invokes ap_driver_register() during initialisation,
which then causes operations on uninitialised data structures to be
performed.
Explicitly protect ap_driver_register() by introducing an
"initialised" flag that gets set iff the AP bus initialisation was
successful. When the AP bus initialisation failed,
ap_driver_register() will error out with -ENODEV, causing the driver
initialisation to fail as well.
Test results:
1. Inside KVM (no AP bus), zcrypt built-in
Boots. /sys/bus/ap not present (expected).
2. Inside KVM (no AP bus), zcrypt as module
Boots. Loading zcrypt_cex4 fails because loading ap_bus fails
(expected).
3. On LPAR with CEX5, zcrypt built-in
Boots. /sys/bus/ap/devices/card* present but .../card*/type missing
(i.e. zcrypt_device_register() fails, unrelated issue).
4. On LPAR with CEX5, zcrypt as module
Boots. Loading zcrypt_cex4 successful,
/sys/bus/ap/devices/card*/type present. No further testing
(user-space functionality) was done.
Signed-off-by: Sascha Silbe <silbe@linux.vnet.ibm.com>
Signed-off-by: Martin Schwidefsky <schwidefsky@de.ibm.com>
2015-10-28 01:29:52 +08:00
|
|
|
if (!initialised)
|
|
|
|
return -ENODEV;
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
drv->bus = &ap_bus_type;
|
|
|
|
drv->probe = ap_device_probe;
|
|
|
|
drv->remove = ap_device_remove;
|
|
|
|
drv->owner = owner;
|
|
|
|
drv->name = name;
|
|
|
|
return driver_register(drv);
|
|
|
|
}
|
|
|
|
EXPORT_SYMBOL(ap_driver_register);
|
|
|
|
|
|
|
|
void ap_driver_unregister(struct ap_driver *ap_drv)
|
|
|
|
{
|
|
|
|
driver_unregister(&ap_drv->driver);
|
|
|
|
}
|
|
|
|
EXPORT_SYMBOL(ap_driver_unregister);
|
|
|
|
|
2012-09-11 03:34:26 +08:00
|
|
|
void ap_bus_force_rescan(void)
|
|
|
|
{
|
2015-07-17 19:43:18 +08:00
|
|
|
if (ap_suspend_flag)
|
|
|
|
return;
|
2013-04-12 23:52:08 +08:00
|
|
|
/* processing a asynchronous bus rescan */
|
2015-07-23 16:55:59 +08:00
|
|
|
del_timer(&ap_config_timer);
|
2015-07-27 18:47:40 +08:00
|
|
|
queue_work(system_long_wq, &ap_scan_work);
|
|
|
|
flush_work(&ap_scan_work);
|
2012-09-11 03:34:26 +08:00
|
|
|
}
|
|
|
|
EXPORT_SYMBOL(ap_bus_force_rescan);
|
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2006-09-20 21:58:25 +08:00
|
|
|
* AP bus attributes.
|
|
|
|
*/
|
|
|
|
static ssize_t ap_domain_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%d\n", ap_domain_index);
|
|
|
|
}
|
|
|
|
|
2016-08-25 17:11:30 +08:00
|
|
|
static ssize_t ap_domain_store(struct bus_type *bus,
|
|
|
|
const char *buf, size_t count)
|
|
|
|
{
|
|
|
|
int domain;
|
|
|
|
|
|
|
|
if (sscanf(buf, "%i\n", &domain) != 1 ||
|
|
|
|
domain < 0 || domain > ap_max_domain_id)
|
|
|
|
return -EINVAL;
|
|
|
|
spin_lock_bh(&ap_domain_lock);
|
|
|
|
ap_domain_index = domain;
|
|
|
|
spin_unlock_bh(&ap_domain_lock);
|
2016-11-24 13:45:21 +08:00
|
|
|
|
|
|
|
AP_DBF(DBF_DEBUG, "store new default domain=%d\n", domain);
|
|
|
|
|
2016-08-25 17:11:30 +08:00
|
|
|
return count;
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(ap_domain, 0644, ap_domain_show, ap_domain_store);
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2013-11-20 17:47:13 +08:00
|
|
|
static ssize_t ap_control_domain_mask_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
2015-06-26 22:55:35 +08:00
|
|
|
if (!ap_configuration) /* QCI not supported */
|
|
|
|
return snprintf(buf, PAGE_SIZE, "not supported\n");
|
2016-08-25 17:16:03 +08:00
|
|
|
|
2015-06-26 22:55:35 +08:00
|
|
|
return snprintf(buf, PAGE_SIZE,
|
|
|
|
"0x%08x%08x%08x%08x%08x%08x%08x%08x\n",
|
2013-11-20 17:47:13 +08:00
|
|
|
ap_configuration->adm[0], ap_configuration->adm[1],
|
|
|
|
ap_configuration->adm[2], ap_configuration->adm[3],
|
|
|
|
ap_configuration->adm[4], ap_configuration->adm[5],
|
|
|
|
ap_configuration->adm[6], ap_configuration->adm[7]);
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(ap_control_domain_mask, 0444,
|
|
|
|
ap_control_domain_mask_show, NULL);
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
static ssize_t ap_usage_domain_mask_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
if (!ap_configuration) /* QCI not supported */
|
|
|
|
return snprintf(buf, PAGE_SIZE, "not supported\n");
|
|
|
|
|
|
|
|
return snprintf(buf, PAGE_SIZE,
|
|
|
|
"0x%08x%08x%08x%08x%08x%08x%08x%08x\n",
|
|
|
|
ap_configuration->aqm[0], ap_configuration->aqm[1],
|
|
|
|
ap_configuration->aqm[2], ap_configuration->aqm[3],
|
|
|
|
ap_configuration->aqm[4], ap_configuration->aqm[5],
|
|
|
|
ap_configuration->aqm[6], ap_configuration->aqm[7]);
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(ap_usage_domain_mask, 0444,
|
|
|
|
ap_usage_domain_mask_show, NULL);
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
static ssize_t ap_config_time_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%d\n", ap_config_time);
|
|
|
|
}
|
|
|
|
|
2008-12-25 20:38:41 +08:00
|
|
|
static ssize_t ap_interrupts_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%d\n",
|
|
|
|
ap_using_interrupts() ? 1 : 0);
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(ap_interrupts, 0444, ap_interrupts_show, NULL);
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
static ssize_t ap_config_time_store(struct bus_type *bus,
|
|
|
|
const char *buf, size_t count)
|
|
|
|
{
|
|
|
|
int time;
|
|
|
|
|
|
|
|
if (sscanf(buf, "%d\n", &time) != 1 || time < 5 || time > 120)
|
|
|
|
return -EINVAL;
|
|
|
|
ap_config_time = time;
|
2015-07-23 16:55:59 +08:00
|
|
|
mod_timer(&ap_config_timer, jiffies + ap_config_time * HZ);
|
2006-09-20 21:58:25 +08:00
|
|
|
return count;
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(config_time, 0644, ap_config_time_show, ap_config_time_store);
|
|
|
|
|
|
|
|
static ssize_t ap_poll_thread_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%d\n", ap_poll_kthread ? 1 : 0);
|
|
|
|
}
|
|
|
|
|
|
|
|
static ssize_t ap_poll_thread_store(struct bus_type *bus,
|
|
|
|
const char *buf, size_t count)
|
|
|
|
{
|
|
|
|
int flag, rc;
|
|
|
|
|
|
|
|
if (sscanf(buf, "%d\n", &flag) != 1)
|
|
|
|
return -EINVAL;
|
|
|
|
if (flag) {
|
|
|
|
rc = ap_poll_thread_start();
|
|
|
|
if (rc)
|
2015-07-17 19:43:18 +08:00
|
|
|
count = rc;
|
|
|
|
} else
|
2006-09-20 21:58:25 +08:00
|
|
|
ap_poll_thread_stop();
|
|
|
|
return count;
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(poll_thread, 0644, ap_poll_thread_show, ap_poll_thread_store);
|
|
|
|
|
2008-07-14 15:59:08 +08:00
|
|
|
static ssize_t poll_timeout_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%llu\n", poll_timeout);
|
|
|
|
}
|
|
|
|
|
|
|
|
static ssize_t poll_timeout_store(struct bus_type *bus, const char *buf,
|
|
|
|
size_t count)
|
|
|
|
{
|
|
|
|
unsigned long long time;
|
|
|
|
ktime_t hr_time;
|
|
|
|
|
|
|
|
/* 120 seconds = maximum poll interval */
|
2008-12-25 20:38:41 +08:00
|
|
|
if (sscanf(buf, "%llu\n", &time) != 1 || time < 1 ||
|
|
|
|
time > 120000000000ULL)
|
2008-07-14 15:59:08 +08:00
|
|
|
return -EINVAL;
|
|
|
|
poll_timeout = time;
|
2016-12-25 19:30:41 +08:00
|
|
|
hr_time = poll_timeout;
|
2008-07-14 15:59:08 +08:00
|
|
|
|
2015-04-28 16:31:44 +08:00
|
|
|
spin_lock_bh(&ap_poll_timer_lock);
|
|
|
|
hrtimer_cancel(&ap_poll_timer);
|
|
|
|
hrtimer_set_expires(&ap_poll_timer, hr_time);
|
|
|
|
hrtimer_start_expires(&ap_poll_timer, HRTIMER_MODE_ABS);
|
|
|
|
spin_unlock_bh(&ap_poll_timer_lock);
|
|
|
|
|
2008-07-14 15:59:08 +08:00
|
|
|
return count;
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(poll_timeout, 0644, poll_timeout_show, poll_timeout_store);
|
|
|
|
|
2015-01-23 20:27:04 +08:00
|
|
|
static ssize_t ap_max_domain_id_show(struct bus_type *bus, char *buf)
|
|
|
|
{
|
2015-06-26 22:55:35 +08:00
|
|
|
int max_domain_id;
|
|
|
|
|
|
|
|
if (ap_configuration)
|
|
|
|
max_domain_id = ap_max_domain_id ? : -1;
|
|
|
|
else
|
2015-01-23 20:27:04 +08:00
|
|
|
max_domain_id = 15;
|
|
|
|
return snprintf(buf, PAGE_SIZE, "%d\n", max_domain_id);
|
|
|
|
}
|
|
|
|
|
|
|
|
static BUS_ATTR(ap_max_domain_id, 0444, ap_max_domain_id_show, NULL);
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
static struct bus_attribute *const ap_bus_attrs[] = {
|
|
|
|
&bus_attr_ap_domain,
|
2013-11-20 17:47:13 +08:00
|
|
|
&bus_attr_ap_control_domain_mask,
|
2016-08-25 17:16:03 +08:00
|
|
|
&bus_attr_ap_usage_domain_mask,
|
2006-09-20 21:58:25 +08:00
|
|
|
&bus_attr_config_time,
|
|
|
|
&bus_attr_poll_thread,
|
2008-12-25 20:38:41 +08:00
|
|
|
&bus_attr_ap_interrupts,
|
2008-07-14 15:59:08 +08:00
|
|
|
&bus_attr_poll_timeout,
|
2015-01-23 20:27:04 +08:00
|
|
|
&bus_attr_ap_max_domain_id,
|
2008-07-14 15:59:08 +08:00
|
|
|
NULL,
|
2006-09-20 21:58:25 +08:00
|
|
|
};
|
|
|
|
|
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_select_domain(): Select an AP domain.
|
|
|
|
*
|
|
|
|
* Pick one of the 16 AP domains.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
2007-02-06 04:18:53 +08:00
|
|
|
static int ap_select_domain(void)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
2015-06-26 21:40:41 +08:00
|
|
|
int count, max_count, best_domain;
|
|
|
|
struct ap_queue_status status;
|
|
|
|
int i, j;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/*
|
2006-09-20 21:58:25 +08:00
|
|
|
* We want to use a single domain. Either the one specified with
|
|
|
|
* the "domain=" parameter or the domain with the maximum number
|
|
|
|
* of devices.
|
|
|
|
*/
|
2016-08-25 17:11:30 +08:00
|
|
|
spin_lock_bh(&ap_domain_lock);
|
|
|
|
if (ap_domain_index >= 0) {
|
2006-09-20 21:58:25 +08:00
|
|
|
/* Domain has already been selected. */
|
2016-08-25 17:11:30 +08:00
|
|
|
spin_unlock_bh(&ap_domain_lock);
|
2006-09-20 21:58:25 +08:00
|
|
|
return 0;
|
2016-08-25 17:11:30 +08:00
|
|
|
}
|
2006-09-20 21:58:25 +08:00
|
|
|
best_domain = -1;
|
|
|
|
max_count = 0;
|
|
|
|
for (i = 0; i < AP_DOMAINS; i++) {
|
2012-08-28 22:41:50 +08:00
|
|
|
if (!ap_test_config_domain(i))
|
|
|
|
continue;
|
2006-09-20 21:58:25 +08:00
|
|
|
count = 0;
|
|
|
|
for (j = 0; j < AP_DEVICES; j++) {
|
2012-08-28 22:41:50 +08:00
|
|
|
if (!ap_test_config_card_id(j))
|
|
|
|
continue;
|
2015-06-26 21:40:41 +08:00
|
|
|
status = ap_test_queue(AP_MKQID(j, i), NULL);
|
|
|
|
if (status.response_code != AP_RESPONSE_NORMAL)
|
2006-09-20 21:58:25 +08:00
|
|
|
continue;
|
|
|
|
count++;
|
|
|
|
}
|
|
|
|
if (count > max_count) {
|
|
|
|
max_count = count;
|
|
|
|
best_domain = i;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if (best_domain >= 0){
|
|
|
|
ap_domain_index = best_domain;
|
2016-08-25 17:11:30 +08:00
|
|
|
spin_unlock_bh(&ap_domain_lock);
|
2006-09-20 21:58:25 +08:00
|
|
|
return 0;
|
|
|
|
}
|
2016-08-25 17:11:30 +08:00
|
|
|
spin_unlock_bh(&ap_domain_lock);
|
2006-09-20 21:58:25 +08:00
|
|
|
return -ENODEV;
|
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
/*
|
|
|
|
* helper function to be used with bus_find_dev
|
|
|
|
* matches for the card device with the given id
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
2016-08-25 17:16:03 +08:00
|
|
|
static int __match_card_device_with_id(struct device *dev, void *data)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
return is_card_dev(dev) && to_ap_card(dev)->id == (int)(long) data;
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
/* helper function to be used with bus_find_dev
|
|
|
|
* matches for the queue device with a given qid
|
|
|
|
*/
|
|
|
|
static int __match_queue_device_with_qid(struct device *dev, void *data)
|
|
|
|
{
|
|
|
|
return is_queue_dev(dev) && to_ap_queue(dev)->qid == (int)(long) data;
|
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* ap_scan_bus(): Scan the AP bus for new devices
|
|
|
|
* Runs periodically, workqueue timer (ap_config_time)
|
|
|
|
*/
|
2006-12-07 03:18:20 +08:00
|
|
|
static void ap_scan_bus(struct work_struct *unused)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
2016-08-25 17:16:03 +08:00
|
|
|
struct ap_queue *aq;
|
|
|
|
struct ap_card *ac;
|
2006-09-20 21:58:25 +08:00
|
|
|
struct device *dev;
|
|
|
|
ap_qid_t qid;
|
2016-08-25 17:16:03 +08:00
|
|
|
int depth = 0, type = 0;
|
|
|
|
unsigned int functions = 0;
|
|
|
|
int rc, id, dom, borked, domains;
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2016-11-24 13:45:21 +08:00
|
|
|
AP_DBF(DBF_DEBUG, "ap_scan_bus running\n");
|
|
|
|
|
2012-08-28 22:41:50 +08:00
|
|
|
ap_query_configuration();
|
2015-07-17 19:43:18 +08:00
|
|
|
if (ap_select_domain() != 0)
|
2015-07-23 16:55:59 +08:00
|
|
|
goto out;
|
2015-06-26 22:55:35 +08:00
|
|
|
|
2016-08-25 17:16:03 +08:00
|
|
|
for (id = 0; id < AP_DEVICES; id++) {
|
|
|
|
/* check if device is registered */
|
2006-09-20 21:58:25 +08:00
|
|
|
dev = bus_find_device(&ap_bus_type, NULL,
|
2016-08-25 17:16:03 +08:00
|
|
|
(void *)(long) id,
|
|
|
|
__match_card_device_with_id);
|
|
|
|
ac = dev ? to_ap_card(dev) : NULL;
|
|
|
|
if (!ap_test_config_card_id(id)) {
|
|
|
|
if (dev) {
|
|
|
|
/* Card device has been removed from
|
|
|
|
* configuration, remove the belonging
|
|
|
|
* queue devices.
|
|
|
|
*/
|
|
|
|
bus_for_each_dev(&ap_bus_type, NULL,
|
|
|
|
(void *)(long) id,
|
|
|
|
__ap_queue_devices_with_id_unregister);
|
|
|
|
/* now remove the card device */
|
2015-09-14 23:01:23 +08:00
|
|
|
device_unregister(dev);
|
2016-08-25 17:16:03 +08:00
|
|
|
put_device(dev);
|
|
|
|
}
|
2006-09-20 21:58:25 +08:00
|
|
|
continue;
|
|
|
|
}
|
2016-08-25 17:16:03 +08:00
|
|
|
/* According to the configuration there should be a card
|
|
|
|
* device, so check if there is at least one valid queue
|
|
|
|
* and maybe create queue devices and the card device.
|
|
|
|
*/
|
|
|
|
domains = 0;
|
|
|
|
for (dom = 0; dom < AP_DOMAINS; dom++) {
|
|
|
|
qid = AP_MKQID(id, dom);
|
|
|
|
dev = bus_find_device(&ap_bus_type, NULL,
|
|
|
|
(void *)(long) qid,
|
|
|
|
__match_queue_device_with_qid);
|
|
|
|
aq = dev ? to_ap_queue(dev) : NULL;
|
|
|
|
if (!ap_test_config_domain(dom)) {
|
|
|
|
if (dev) {
|
|
|
|
/* Queue device exists but has been
|
|
|
|
* removed from configuration.
|
|
|
|
*/
|
|
|
|
device_unregister(dev);
|
|
|
|
put_device(dev);
|
|
|
|
}
|
|
|
|
continue;
|
|
|
|
}
|
|
|
|
rc = ap_query_queue(qid, &depth, &type, &functions);
|
|
|
|
if (dev) {
|
|
|
|
spin_lock_bh(&aq->lock);
|
|
|
|
if (rc == -ENODEV ||
|
|
|
|
/* adapter reconfiguration */
|
|
|
|
(ac && ac->functions != functions))
|
|
|
|
aq->state = AP_STATE_BORKED;
|
|
|
|
borked = aq->state == AP_STATE_BORKED;
|
|
|
|
spin_unlock_bh(&aq->lock);
|
|
|
|
if (borked) /* Remove broken device */
|
|
|
|
device_unregister(dev);
|
|
|
|
put_device(dev);
|
|
|
|
if (!borked) {
|
|
|
|
domains++;
|
|
|
|
continue;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if (rc)
|
|
|
|
continue;
|
|
|
|
/* new queue device needed */
|
|
|
|
if (!ac) {
|
|
|
|
/* but first create the card device */
|
|
|
|
ac = ap_card_create(id, depth,
|
|
|
|
type, functions);
|
|
|
|
if (!ac)
|
|
|
|
continue;
|
|
|
|
ac->ap_dev.device.bus = &ap_bus_type;
|
|
|
|
ac->ap_dev.device.parent = ap_root_device;
|
|
|
|
dev_set_name(&ac->ap_dev.device,
|
|
|
|
"card%02x", id);
|
|
|
|
/* Register card with AP bus */
|
|
|
|
rc = device_register(&ac->ap_dev.device);
|
|
|
|
if (rc) {
|
|
|
|
put_device(&ac->ap_dev.device);
|
|
|
|
ac = NULL;
|
|
|
|
break;
|
|
|
|
}
|
|
|
|
/* get it and thus adjust reference counter */
|
|
|
|
get_device(&ac->ap_dev.device);
|
|
|
|
}
|
|
|
|
/* now create the new queue device */
|
|
|
|
aq = ap_queue_create(qid, type);
|
|
|
|
if (!aq)
|
|
|
|
continue;
|
|
|
|
aq->card = ac;
|
|
|
|
aq->ap_dev.device.bus = &ap_bus_type;
|
|
|
|
aq->ap_dev.device.parent = &ac->ap_dev.device;
|
|
|
|
dev_set_name(&aq->ap_dev.device,
|
|
|
|
"%02x.%04x", id, dom);
|
|
|
|
/* Start with a device reset */
|
|
|
|
spin_lock_bh(&aq->lock);
|
|
|
|
ap_wait(ap_sm_event(aq, AP_EVENT_POLL));
|
|
|
|
spin_unlock_bh(&aq->lock);
|
|
|
|
/* Register device */
|
|
|
|
rc = device_register(&aq->ap_dev.device);
|
|
|
|
if (rc) {
|
|
|
|
put_device(&aq->ap_dev.device);
|
|
|
|
continue;
|
|
|
|
}
|
|
|
|
domains++;
|
|
|
|
} /* end domain loop */
|
|
|
|
if (ac) {
|
|
|
|
/* remove card dev if there are no queue devices */
|
|
|
|
if (!domains)
|
|
|
|
device_unregister(&ac->ap_dev.device);
|
|
|
|
put_device(&ac->ap_dev.device);
|
2015-09-14 23:01:23 +08:00
|
|
|
}
|
2016-08-25 17:16:03 +08:00
|
|
|
} /* end device loop */
|
2015-07-23 16:55:59 +08:00
|
|
|
out:
|
|
|
|
mod_timer(&ap_config_timer, jiffies + ap_config_time * HZ);
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
static void ap_config_timeout(unsigned long ptr)
|
2006-09-20 21:58:25 +08:00
|
|
|
{
|
2015-07-17 19:43:18 +08:00
|
|
|
if (ap_suspend_flag)
|
|
|
|
return;
|
2015-07-27 18:47:40 +08:00
|
|
|
queue_work(system_long_wq, &ap_scan_work);
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
2006-12-16 00:18:17 +08:00
|
|
|
|
|
|
|
static void ap_reset_all(void)
|
2006-12-08 22:54:07 +08:00
|
|
|
{
|
|
|
|
int i, j;
|
|
|
|
|
2014-09-08 19:24:13 +08:00
|
|
|
for (i = 0; i < AP_DOMAINS; i++) {
|
|
|
|
if (!ap_test_config_domain(i))
|
|
|
|
continue;
|
|
|
|
for (j = 0; j < AP_DEVICES; j++) {
|
|
|
|
if (!ap_test_config_card_id(j))
|
|
|
|
continue;
|
2016-09-21 18:48:54 +08:00
|
|
|
ap_rapq(AP_MKQID(j, i));
|
2014-09-08 19:24:13 +08:00
|
|
|
}
|
|
|
|
}
|
2006-12-08 22:54:07 +08:00
|
|
|
}
|
|
|
|
|
|
|
|
static struct reset_call ap_reset_call = {
|
2006-12-16 00:18:17 +08:00
|
|
|
.fn = ap_reset_all,
|
2006-12-08 22:54:07 +08:00
|
|
|
};
|
|
|
|
|
2016-11-24 13:45:21 +08:00
|
|
|
int __init ap_debug_init(void)
|
|
|
|
{
|
|
|
|
ap_dbf_info = debug_register("ap", 1, 1,
|
|
|
|
DBF_MAX_SPRINTF_ARGS * sizeof(long));
|
|
|
|
debug_register_view(ap_dbf_info, &debug_sprintf_view);
|
|
|
|
debug_set_level(ap_dbf_info, DBF_ERR);
|
|
|
|
|
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
|
|
|
void ap_debug_exit(void)
|
|
|
|
{
|
|
|
|
debug_unregister(ap_dbf_info);
|
|
|
|
}
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
/**
|
2008-04-17 13:46:28 +08:00
|
|
|
* ap_module_init(): The module initialization code.
|
|
|
|
*
|
|
|
|
* Initializes the module.
|
2006-09-20 21:58:25 +08:00
|
|
|
*/
|
|
|
|
int __init ap_module_init(void)
|
|
|
|
{
|
2015-06-26 22:55:35 +08:00
|
|
|
int max_domain_id;
|
2006-09-20 21:58:25 +08:00
|
|
|
int rc, i;
|
|
|
|
|
2016-11-24 13:45:21 +08:00
|
|
|
rc = ap_debug_init();
|
|
|
|
if (rc)
|
|
|
|
return rc;
|
|
|
|
|
2015-06-26 22:55:35 +08:00
|
|
|
if (ap_instructions_available() != 0) {
|
|
|
|
pr_warn("The hardware system does not support AP instructions\n");
|
|
|
|
return -ENODEV;
|
|
|
|
}
|
|
|
|
|
|
|
|
/* Get AP configuration data if available */
|
|
|
|
ap_init_configuration();
|
|
|
|
|
|
|
|
if (ap_configuration)
|
|
|
|
max_domain_id = ap_max_domain_id ? : (AP_DOMAINS - 1);
|
|
|
|
else
|
|
|
|
max_domain_id = 15;
|
|
|
|
if (ap_domain_index < -1 || ap_domain_index > max_domain_id) {
|
|
|
|
pr_warn("%d is not a valid cryptographic domain\n",
|
|
|
|
ap_domain_index);
|
2016-07-31 17:47:06 +08:00
|
|
|
rc = -EINVAL;
|
|
|
|
goto out_free;
|
2006-09-20 21:58:25 +08:00
|
|
|
}
|
2009-09-23 04:58:51 +08:00
|
|
|
/* In resume callback we need to know if the user had set the domain.
|
|
|
|
* If so, we can not just reset it.
|
|
|
|
*/
|
|
|
|
if (ap_domain_index >= 0)
|
|
|
|
user_set_domain = 1;
|
|
|
|
|
2008-12-25 20:38:41 +08:00
|
|
|
if (ap_interrupts_available()) {
|
2013-06-24 16:30:41 +08:00
|
|
|
rc = register_adapter_interrupt(&ap_airq);
|
|
|
|
ap_airq_flag = (rc == 0);
|
2008-12-25 20:38:41 +08:00
|
|
|
}
|
|
|
|
|
2006-12-08 22:54:07 +08:00
|
|
|
register_reset_call(&ap_reset_call);
|
2006-09-20 21:58:25 +08:00
|
|
|
|
|
|
|
/* Create /sys/bus/ap. */
|
|
|
|
rc = bus_register(&ap_bus_type);
|
|
|
|
if (rc)
|
|
|
|
goto out;
|
|
|
|
for (i = 0; ap_bus_attrs[i]; i++) {
|
|
|
|
rc = bus_create_file(&ap_bus_type, ap_bus_attrs[i]);
|
|
|
|
if (rc)
|
|
|
|
goto out_bus;
|
|
|
|
}
|
|
|
|
|
|
|
|
/* Create /sys/devices/ap. */
|
2008-12-15 20:58:29 +08:00
|
|
|
ap_root_device = root_device_register("ap");
|
2013-06-01 17:51:13 +08:00
|
|
|
rc = PTR_RET(ap_root_device);
|
2006-09-20 21:58:25 +08:00
|
|
|
if (rc)
|
|
|
|
goto out_bus;
|
|
|
|
|
2008-04-17 13:46:28 +08:00
|
|
|
/* Setup the AP bus rescan timer. */
|
2015-07-23 16:55:59 +08:00
|
|
|
setup_timer(&ap_config_timer, ap_config_timeout, 0);
|
2006-09-20 21:58:25 +08:00
|
|
|
|
2015-09-14 23:01:23 +08:00
|
|
|
/*
|
|
|
|
* Setup the high resultion poll timer.
|
2008-07-14 15:59:08 +08:00
|
|
|
* If we are running under z/VM adjust polling to z/VM polling rate.
|
|
|
|
*/
|
|
|
|
if (MACHINE_IS_VM)
|
|
|
|
poll_timeout = 1500000;
|
2009-12-07 19:52:00 +08:00
|
|
|
spin_lock_init(&ap_poll_timer_lock);
|
2008-07-14 15:59:08 +08:00
|
|
|
hrtimer_init(&ap_poll_timer, CLOCK_MONOTONIC, HRTIMER_MODE_ABS);
|
|
|
|
ap_poll_timer.function = ap_poll_timeout;
|
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
/* Start the low priority AP bus poll thread. */
|
|
|
|
if (ap_thread_flag) {
|
|
|
|
rc = ap_poll_thread_start();
|
|
|
|
if (rc)
|
|
|
|
goto out_work;
|
|
|
|
}
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
rc = register_pm_notifier(&ap_power_notifier);
|
|
|
|
if (rc)
|
|
|
|
goto out_pm;
|
|
|
|
|
2015-07-27 18:47:40 +08:00
|
|
|
queue_work(system_long_wq, &ap_scan_work);
|
s390/zcrypt: Fix kernel crash on systems without AP bus support
On systems without AP bus (e.g. KVM) the kernel crashes during init
calls when zcrypt is built-in:
kernel BUG at drivers/base/driver.c:153!
illegal operation: 0001 ilc:1 [#1] SMP
Modules linked in:
CPU: 1 PID: 1 Comm: swapper/0 Not tainted 4.2.0+ #221
task: 0000000010a40000 ti: 0000000010a48000 task.ti:0000000010a48000
Krnl PSW : 0704c00180000000 0000000000592bd6(driver_register+0x106/0x140)
R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 EA:3
0000000000000012 0000000000000000 0000000000c45328 0000000000c44e30
00000000009ef63c 000000000067f598 0000000000cf3c58 0000000000000000
000000000000007b 0000000000cb1030 0000000000000002 0000000000000000
0000000000ca8580 0000000010306700 00000000001001d8 0000000010a4bd88
Krnl Code: 0000000000592bc6: f0b00004ebcf srp 4(12,%r0),3023(%r14),0
0000000000592bcc: f0a0000407f4 srp 4(11,%r0),2036,0
#0000000000592bd2: a7f40001 brc 15,592bd4
>0000000000592bd6: e330d0000004 lg %r3,0(%r13)
0000000000592bdc: c0200021edfd larl %r2,9d07d6
0000000000592be2: c0e500126d8f brasl %r14,7e0700
0000000000592be8: e330d0080004 lg %r3,8(%r13)
0000000000592bee: a7f4ffab brc 15,592b44
Call Trace:
([<00000000001001c8>] do_one_initcall+0x90/0x1d0)
[<0000000000c6dd34>] kernel_init_freeable+0x1e4/0x2a0
[<00000000007db53a>] kernel_init+0x2a/0x120
[<00000000007e8ece>] kernel_thread_starter+0x6/0xc
[<00000000007e8ec8>] kernel_thread_starter+0x0/0xc
Last Breaking-Event-Address:
[<0000000000592bd2>] driver_register+0x102/0x140
When zcrypt is built as a module, the module loader ensures that the
driver modules cannot be loaded if the AP bus module returns an error
during initialisation. But if zcrypt and the driver are built-in, the
driver is getting initialised even if the AP bus initialisation
failed. The driver invokes ap_driver_register() during initialisation,
which then causes operations on uninitialised data structures to be
performed.
Explicitly protect ap_driver_register() by introducing an
"initialised" flag that gets set iff the AP bus initialisation was
successful. When the AP bus initialisation failed,
ap_driver_register() will error out with -ENODEV, causing the driver
initialisation to fail as well.
Test results:
1. Inside KVM (no AP bus), zcrypt built-in
Boots. /sys/bus/ap not present (expected).
2. Inside KVM (no AP bus), zcrypt as module
Boots. Loading zcrypt_cex4 fails because loading ap_bus fails
(expected).
3. On LPAR with CEX5, zcrypt built-in
Boots. /sys/bus/ap/devices/card* present but .../card*/type missing
(i.e. zcrypt_device_register() fails, unrelated issue).
4. On LPAR with CEX5, zcrypt as module
Boots. Loading zcrypt_cex4 successful,
/sys/bus/ap/devices/card*/type present. No further testing
(user-space functionality) was done.
Signed-off-by: Sascha Silbe <silbe@linux.vnet.ibm.com>
Signed-off-by: Martin Schwidefsky <schwidefsky@de.ibm.com>
2015-10-28 01:29:52 +08:00
|
|
|
initialised = true;
|
2015-09-14 23:01:23 +08:00
|
|
|
|
2006-09-20 21:58:25 +08:00
|
|
|
return 0;
|
|
|
|
|
2015-07-17 19:43:18 +08:00
|
|
|
out_pm:
|
|
|
|
ap_poll_thread_stop();
|
2006-09-20 21:58:25 +08:00
|
|
|
out_work:
|
2008-07-14 15:59:08 +08:00
|
|
|
hrtimer_cancel(&ap_poll_timer);
|
2008-12-15 20:58:29 +08:00
|
|
|
root_device_unregister(ap_root_device);
|
2006-09-20 21:58:25 +08:00
|
|
|
out_bus:
|
|
|
|
while (i--)
|
|
|
|
bus_remove_file(&ap_bus_type, ap_bus_attrs[i]);
|
|
|
|
bus_unregister(&ap_bus_type);
|
|
|
|
out:
|
2006-12-08 22:54:07 +08:00
|
|
|
unregister_reset_call(&ap_reset_call);
|
2013-06-24 16:30:41 +08:00
|
|
|
if (ap_using_interrupts())
|
|
|
|
unregister_adapter_interrupt(&ap_airq);
|
2016-07-31 17:47:06 +08:00
|
|
|
out_free:
|
2015-06-26 22:55:35 +08:00
|
|
|
kfree(ap_configuration);
|
2006-09-20 21:58:25 +08:00
|
|
|
return rc;
|
|
|
|
}
|
2017-02-09 22:48:10 +08:00
|
|
|
device_initcall(ap_module_init);
|