Dave Chinner 16fd536737 xfs: track AGs with reclaimable inodes in per-ag radix tree ... https://bugzilla.kernel.org/show_bug.cgi?id=16348 When the filesystem grows to a large number of allocation groups, the summing of recalimable inodes gets expensive. In many cases, most AGs won't have any reclaimable inodes and so we are wasting CPU time aggregating over these AGs. This is particularly important for the inode shrinker that gets called frequently under memory pressure. To avoid the overhead, track AGs with reclaimable inodes in the per-ag radix tree so that we can find all the AGs with reclaimable inodes via a simple gang tag lookup. This involves setting the tag when the first reclaimable inode is tracked in the AG, and removing the tag when the last reclaimable inode is removed from the tree. Then the summation process becomes a loop walking the radix tree summing AGs with the reclaim tag set. This significantly reduces the overhead of scanning - a 6400 AG filesystea now only uses about 25% of a cpu in kswapd while slab reclaim progresses instead of being permanently stuck at 100% CPU and making little progress. Clean filesystems filesystems will see no overhead and the overhead only increases linearly with the number of dirty AGs. Signed-off-by: Dave Chinner <dchinner@redhat.com> Reviewed-by: Christoph Hellwig <hch@lst.de>		2010-07-20 09:43:39 +10:00
..
linux-2.6	xfs: track AGs with reclaimable inodes in per-ag radix tree	2010-07-20 09:43:39 +10:00
quota	mm: add context argument to shrinker callback	2010-07-19 14:56:17 +10:00
support	xfs: event tracing support	2009-12-14 23:08:16 -06:00
Kconfig	xfs: use generic Posix ACL code	2009-06-10 17:07:47 +02:00
Makefile	xfs: Introduce delayed logging core code	2010-05-24 10:38:03 -05:00
xfs.h	xfs: event tracing support	2009-12-14 23:08:16 -06:00
xfs_acl.h	xfs: constify xattr_handler	2010-05-21 18:31:19 -04:00
xfs_ag.h	xfs: fix access to upper inodes without inode64	2010-05-28 15:19:56 -05:00
xfs_alloc.c	xfs: Improve scalability of busy extent tracking	2010-05-24 10:34:00 -05:00
xfs_alloc.h	xfs: Improve scalability of busy extent tracking	2010-05-24 10:34:00 -05:00
xfs_alloc_btree.c	xfs: Improve scalability of busy extent tracking	2010-05-24 10:34:00 -05:00
xfs_alloc_btree.h	…
xfs_arch.h	xfs: use generic Posix ACL code	2009-06-10 17:07:47 +02:00
xfs_attr.c	xfs: remove duplicate buffer flags	2010-01-21 13:44:36 -06:00
xfs_attr.h	xfs: convert attr to use unsigned names	2010-01-20 10:47:48 +11:00
xfs_attr_leaf.c	xfs: remove duplicate buffer flags	2010-01-21 13:44:36 -06:00
xfs_attr_leaf.h	…
xfs_attr_sf.h	xfs: convert attr to use unsigned names	2010-01-20 10:47:48 +11:00
xfs_bit.c	…
xfs_bit.h	…
xfs_bmap.c	xfs: fix reservation release commit flag in xfs_bmap_add_attrfork()	2010-05-19 09:58:08 -05:00
xfs_bmap.h	xfs: event tracing support	2009-12-14 23:08:16 -06:00
xfs_bmap_btree.c	xfs: make several more functions static	2010-01-15 15:31:38 -06:00
xfs_bmap_btree.h	xfs: make several more functions static	2010-01-15 15:31:38 -06:00
xfs_btree.c	xfs: remove duplicate buffer flags	2010-01-21 13:44:36 -06:00
xfs_btree.h	xfs: add more statics & drop some unused functions	2009-08-31 14:46:20 -05:00
xfs_btree_trace.c	…
xfs_btree_trace.h	xfs: event tracing support	2009-12-14 23:08:16 -06:00
xfs_buf_item.c	xfs: Ensure inode allocation buffers are fully replayed	2010-05-24 10:41:22 -05:00
xfs_buf_item.h	xfs: Ensure inode allocation buffers are fully replayed	2010-05-24 10:41:22 -05:00
xfs_da_btree.c	xfs: convert dirnameops to unsigned char names	2010-01-20 10:47:17 +11:00
xfs_da_btree.h	xfs: convert dirnameops to unsigned char names	2010-01-20 10:47:17 +11:00
xfs_dfrag.c	xfs: prevent swapext from operating on write-only files	2010-06-24 12:07:47 +10:00
xfs_dfrag.h	xfs: clean up inconsistent variable naming in xfs_swap_extent	2010-01-15 15:31:23 -06:00
xfs_dinode.h	…
xfs_dir2.c	xfs: clean up sign warnings in dir2 code	2010-01-20 10:48:05 +11:00
xfs_dir2.h	xfs: make xfs_dir_cilookup_result use unsigned char	2010-01-20 10:47:25 +11:00
xfs_dir2_block.c	xfs: clean up sign warnings in dir2 code	2010-01-20 10:48:05 +11:00
xfs_dir2_block.h	…
xfs_dir2_data.c	…
xfs_dir2_data.h	…
xfs_dir2_leaf.c	xfs: clean up sign warnings in dir2 code	2010-01-20 10:48:05 +11:00
xfs_dir2_leaf.h	…
xfs_dir2_node.c	xfs: make several more functions static	2010-01-15 15:31:38 -06:00
xfs_dir2_node.h	xfs: make several more functions static	2010-01-15 15:31:38 -06:00
xfs_dir2_sf.c	xfs: clean up sign warnings in dir2 code	2010-01-20 10:48:05 +11:00
xfs_dir2_sf.h	…
xfs_dmapi.h	…
xfs_dmops.c	…
xfs_error.c	xfs: clean up log ticket overrun debug output	2010-05-24 10:33:46 -05:00
xfs_error.h	xfs: add const qualifiers to xfs error function args	2010-05-19 09:58:11 -05:00
xfs_extfree_item.c	xfs: remove stale parameter from ->iop_unpin method	2010-05-19 09:58:08 -05:00
xfs_extfree_item.h	…
xfs_filestream.c	xfs: Kill filestreams cache flush	2010-01-15 15:34:22 -06:00
xfs_filestream.h	xfs: Kill filestreams cache flush	2010-01-15 15:34:22 -06:00
xfs_fs.h	xfs: return inode fork offset in bulkstat for fsr	2010-03-05 11:02:07 -06:00
xfs_fsops.c	xfs: Replace per-ag array with a radix tree	2010-01-15 15:33:52 -06:00
xfs_fsops.h	…
xfs_ialloc.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_ialloc.h	xfs: rationalize xfs_inobt_lookup*	2009-09-01 12:45:39 -05:00
xfs_ialloc_btree.c	…
xfs_ialloc_btree.h	…
xfs_iget.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_inode.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_inode.h	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_inode_item.c	xfs: remove stale parameter from ->iop_unpin method	2010-05-19 09:58:08 -05:00
xfs_inode_item.h	xfs: Don't issue buffer IO direct from AIL push V2	2010-02-02 10:13:42 +11:00
xfs_inum.h	xfs: remove XFS_INO64_OFFSET	2009-08-31 14:46:22 -05:00
xfs_iomap.c	xfs: mark xfs_iomap_write_ helpers static	2010-05-19 09:58:20 -05:00
xfs_iomap.h	xfs: mark xfs_iomap_write_ helpers static	2010-05-19 09:58:20 -05:00
xfs_itable.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_itable.h	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_log.c	xfs: forced unmounts need to push the CIL	2010-05-24 10:38:14 -05:00
xfs_log.h	xfs: Ensure inode allocation buffers are fully replayed	2010-05-24 10:41:22 -05:00
xfs_log_cil.c	xfs: Ensure inode allocation buffers are fully replayed	2010-05-24 10:41:22 -05:00
xfs_log_priv.h	xfs: enable background pushing of the CIL	2010-05-24 10:38:20 -05:00
xfs_log_recover.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_log_recover.h	xfs: Clean up XFS_BLI_* flag namespace	2010-05-24 10:33:39 -05:00
xfs_mount.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_mount.h	xfs: convert inode shrinker to per-filesystem contexts	2010-07-20 08:07:02 +10:00
xfs_mru_cache.c	xfs: Kill filestreams cache flush	2010-01-15 15:34:22 -06:00
xfs_mru_cache.h	xfs: Kill filestreams cache flush	2010-01-15 15:34:22 -06:00
xfs_quota.h	xfs: removed unused XFS_QMOPT_ flags	2010-05-19 09:58:15 -05:00
xfs_refcache.h	…
xfs_rename.c	xfs: event tracing support	2009-12-14 23:08:16 -06:00
xfs_rtalloc.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_rtalloc.h	xfs: be more explicit if RT mount fails due to config	2010-05-28 14:58:24 -05:00
xfs_rw.c	xfs: only clear the suid bit once in xfs_write	2010-02-12 13:43:57 -06:00
xfs_rw.h	xfs: only clear the suid bit once in xfs_write	2010-02-12 13:43:57 -06:00
xfs_sb.h	…
xfs_trans.c	xfs: cleanup log reservation calculactions	2010-05-28 14:58:30 -05:00
xfs_trans.h	xfs: cleanup log reservation calculactions	2010-05-28 14:58:30 -05:00
xfs_trans_ail.c	xfs: Don't issue buffer IO direct from AIL push V2	2010-02-02 10:13:42 +11:00
xfs_trans_buf.c	xfs: Ensure inode allocation buffers are fully replayed	2010-05-24 10:41:22 -05:00
xfs_trans_extfree.c	…
xfs_trans_inode.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_trans_item.c	xfs: Introduce delayed logging core code	2010-05-24 10:38:03 -05:00
xfs_trans_priv.h	xfs: Introduce delayed logging core code	2010-05-24 10:38:03 -05:00
xfs_trans_space.h	…
xfs_types.h	xfs: make the log ticket ID available outside the log infrastructure	2010-05-24 10:33:52 -05:00
xfs_utils.c	xfs: kill xfs_qmops	2009-06-08 15:33:32 +02:00
xfs_utils.h	…
xfs_vnodeops.c	xfs: remove block number from inode lookup code	2010-06-24 11:35:17 +10:00
xfs_vnodeops.h	xfs: kill xfs_lrw.h	2010-03-01 16:35:44 -06:00