linux/kernel/dma
David Rientjes 54adadf9b0 dma-pool: dynamically expanding atomic pools
When an atomic pool becomes fully depleted because it is now relied upon
for all non-blocking allocations through the DMA API, allow background
expansion of each pool by a kworker.

When an atomic pool has less than the default size of memory left, kick
off a kworker to dynamically expand the pool in the background.  The pool
is doubled in size, up to MAX_ORDER-1.  If memory cannot be allocated at
the requested order, smaller allocation(s) are attempted.

This allows the default size to be kept quite low when one or more of the
atomic pools is not used.

Allocations for lowmem should also use GFP_KERNEL for the benefits of
reclaim, so use GFP_KERNEL | GFP_DMA and GFP_KERNEL | GFP_DMA32 for
lowmem allocations.

This also allows __dma_atomic_pool_init() to return a pointer to the pool
to make initialization cleaner.

Also switch over some node ids to the more appropriate NUMA_NO_NODE.

Signed-off-by: David Rientjes <rientjes@google.com>
Signed-off-by: Christoph Hellwig <hch@lst.de>
2020-04-25 13:17:02 +02:00
..
Kconfig dma-remap: separate DMA atomic pools from direct remap code 2020-04-20 12:08:45 +02:00
Makefile dma-remap: separate DMA atomic pools from direct remap code 2020-04-20 12:08:45 +02:00
coherent.c dma-coherent: fix integer overflow in the reserved-memory dma allocation 2020-03-16 10:43:02 +01:00
contiguous.c dma-contiguous: CMA: give precedence to cmdline 2020-01-30 14:41:42 +01:00
debug.c dma-debug: make __dma_entry_alloc_check_leak() static 2020-04-20 12:05:18 +02:00
direct.c dma-pool: add additional coherent pools to map to gfp mask 2020-04-20 12:09:40 +02:00
dummy.c dma-mapping: factor out dummy DMA ops 2018-12-13 21:06:12 +01:00
mapping.c dma-mapping: Fix dma_pgprot() for unencrypted coherent pages 2020-03-17 11:52:58 +01:00
pool.c dma-pool: dynamically expanding atomic pools 2020-04-25 13:17:02 +02:00
remap.c dma-remap: separate DMA atomic pools from direct remap code 2020-04-20 12:08:45 +02:00
swiotlb.c dma-direct: improve swiotlb error reporting 2020-02-05 18:53:05 +01:00
virt.c dma-mapping: zero memory returned from dma_alloc_* 2018-12-20 08:13:52 +01:00