Hugh Dickins
e504f3fdd6
tmpfs radix_tree: locate_item to speed up swapoff ...
We have already acknowledged that swapoff of a tmpfs file is slower than
it was before conversion to the generic radix_tree: a little slower
there will be acceptable, if the hotter paths are faster.
But it was a shock to find swapoff of a 500MB file 20 times slower on my
laptop, taking 10 minutes; and at that rate it significantly slows down
my testing.
Now, most of that turned out to be overhead from PROVE_LOCKING and
PROVE_RCU: without those it was only 4 times slower than before; and
more realistic tests on other machines don't fare as badly.
I've tried a number of things to improve it, including tagging the swap
entries, then doing lookup by tag: I'd expected that to halve the time,
but in practice it's erratic, and often counter-productive.
The only change I've so far found to make a consistent improvement, is
to short-circuit the way we go back and forth, gang lookup packing
entries into the array supplied, then shmem scanning that array for the
target entry. Scanning in place doubles the speed, so it's now only
twice as slow as before (or three times slower when the PROVEs are on).
So, add radix_tree_locate_item() as an expedient, once-off,
single-caller hack to do the lookup directly in place. #ifdef it on
CONFIG_SHMEM and CONFIG_SWAP, as much to document its limited
applicability as save space in other configurations. And, sadly,
#include sched.h for cond_resched().
Signed-off-by: Hugh Dickins <hughd@google.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2011-08-03 14:25:24 -10:00
lib: add support for LZO-compressed kernels
2010-01-11 09:34:04 -08:00
Move .gitignore from drivers/md to lib/raid6
2010-08-30 17:35:52 +10:00
XZ: Fix missing <linux/kernel.h> include
2011-07-24 10:00:08 -07:00
zlib: slim down zlib_deflate() workspace when possible
2011-03-22 17:44:17 -07:00
inflate_fast: sout is already a short so ptr arith was off by one.
2010-03-12 15:52:44 -08:00
tree-wide: convert open calls to remove spaces to skip_spaces() lib function
2009-12-15 08:53:32 -08:00
atomic: use <linux/atomic.h>
2011-07-26 16:49:47 -07:00
atomic: use <linux/atomic.h>
2011-07-26 16:49:47 -07:00
audit: support the "standard" <asm-generic/unistd.h>
2011-05-04 14:41:28 -04:00
lib: Improve EWMA efficiency by using bitshifts
2010-12-06 15:58:43 -05:00
lib: add shared BCH ECC library
2011-03-11 14:25:50 +00:00
cpusets: randomize node rotor used in cpuset_mem_spread_node()
2011-07-26 16:49:43 -07:00
lib: Add generic binary search function to the kernel.
2011-05-19 16:55:27 +09:30
Fix common misspellings
2011-03-31 11:26:23 -03:00
modules: Fix module_bug_list list corruption race
2010-10-05 11:29:27 -07:00
lib/checksum.c: optimize do_csum a bit
2011-07-07 04:52:24 -07:00
lib: cordic: add library module providing cordic angle calculation
2011-06-03 15:01:07 -04:00
fault-injection: add CPU notifier error injection module
2010-05-27 09:12:48 -07:00
lib: cpu_rmap: CPU affinity reverse-mapping
2011-01-24 14:51:56 -08:00
cpumask: alloc_cpumask_var() use NUMA_NO_NODE
2011-07-26 16:49:44 -07:00
lib: crc8: add new library module providing crc8 algorithm
2011-06-03 15:01:06 -04:00
atomic: use <linux/atomic.h>
2011-07-26 16:49:47 -07:00
ctype: constify read-only _ctype string
2009-12-15 08:53:32 -08:00
Revert "debug_locks: set oops_in_progress if we will log messages."
2010-11-29 15:18:28 -08:00
debugobjects: Fix boot crash when kmemleak and debugobjects enabled
2011-06-20 14:38:43 +02:00
atomic: use <linux/atomic.h>
2011-07-26 16:49:47 -07:00
decompressors: add boot-time XZ support
2011-01-13 08:03:25 -08:00
Decompressors: include <linux/slab.h> in <linux/decompress/mm.h>
2011-01-13 08:03:23 -08:00
decompressors: check input size in decompress_inflate.c
2011-01-13 08:03:25 -08:00
Decompressors: validate match distance in decompress_unlzma.c
2011-01-13 08:03:24 -08:00
Decompressors: fix callback-to-callback mode in decompress_unlzo.c
2011-01-13 08:03:24 -08:00
Fix common misspellings
2011-03-31 11:26:23 -03:00
devres: fix possible use after free
2011-07-25 20:57:14 -07:00
div64_u64(): improve precision on 32bit platforms
2010-10-26 16:52:19 -07:00
dma-debug: print information about leaked entry
2011-04-07 16:31:19 +02:00
dynamic_debug: add #include <linux/sched.h>
2011-02-03 15:59:58 -08:00
fault-injection: add ability to export fault_attr in arbitrary directory
2011-08-03 14:25:20 -10:00
bitops: add #ifndef for each of find bitops
2011-05-26 17:12:38 -07:00
arch: remove CONFIG_GENERIC_FIND_{NEXT_BIT,BIT_LE,LAST_BIT}
2011-05-26 17:12:38 -07:00
flex_array: avoid divisions when accessing elements
2011-05-26 17:12:33 -07:00
crc32: major optimization
2010-05-25 08:07:06 -07:00
lib/genalloc.c: add support for specifying the physical address
2011-05-25 08:39:54 -07:00
include/linux/printk.h lib/hexdump.c: neatening and add CONFIG_PRINTK guard
2011-01-13 08:03:10 -08:00
x86: Add optimized popcnt variants
2010-04-06 15:52:11 -07:00
ida: simplified functions for id allocation
2011-08-03 14:25:20 -10:00
MN10300: Don't try and #include <linux/slab.h> in lib/inflate.c from bootloader
2010-08-12 09:51:35 -07:00
iomap: make IOPORT/PCI mapping functions conditional
2011-07-22 18:46:26 +02:00
iommu: inline iommu_num_pages
2010-08-09 20:45:05 -07:00
ACPI, APEI, Generic Hardware Error Source POLL/IRQ/NMI notification type support
2011-01-12 03:06:19 -05:00
include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h
2010-03-30 22:02:32 +09:00
Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/linville/wireless-next-2.6 into for-davem
2011-06-08 13:44:21 -04:00
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2011-07-22 16:45:02 -07:00
mips,kgdb: kdb low level trap catch and stack trace
2010-05-20 21:04:26 -05:00
Delay struct net freeing while there's a sysfs instance refering to it
2011-06-12 17:45:41 -04:00
kobject_uevent: fix typo in comments
2010-08-23 18:12:46 -07:00
kref: Add a kref_sub function
2010-11-22 13:25:13 +10:00
lib: make _tolower() public
2011-07-25 20:57:16 -07:00
lib/lcm.c: quiet sparse noise
2011-07-25 20:57:15 -07:00
Expand CONFIG_DEBUG_LIST to several other list operations
2011-02-18 11:32:28 -08:00
lib/list_sort: test: check element addresses
2010-10-26 16:52:19 -07:00
rcu: Fix unpaired rcu_irq_enter() from locking selftests
2011-05-26 09:42:19 -07:00
lru_cache: use correct type in sizeof for allocation
2011-05-25 08:39:52 -07:00
Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/linville/wireless-next-2.6 into for-davem
2011-06-08 13:44:21 -04:00
net: fix nla_policy_len to actually _iterate_ over the policy
2011-02-28 12:38:25 -08:00
Fix common misspellings
2011-03-31 11:26:23 -03:00
percpucounter: Optimize __percpu_counter_add a bit through the use of this_cpu() options.
2010-12-17 15:07:18 +01:00
plist: Remove the need to supply locks to plist heads
2011-07-08 14:02:53 +02:00
tmpfs radix_tree: locate_item to speed up swapoff
2011-08-03 14:25:24 -10:00
Merge branch 'master' into for-next
2010-06-16 18:08:13 +02:00
ratelimit: fix the return value when __ratelimit() fails to acquire the lock
2010-04-07 08:38:04 -07:00
lib/rational.c needs module.h
2010-01-11 09:34:05 -08:00
Export the augmented rbtree helper functions
2011-01-28 12:16:59 +10:00
rwsem generic spinlock: use IRQ save/restore spinlocks
2010-04-07 16:15:05 -07:00
rwsem: Remove redundant asmregparm annotation
2011-01-27 12:30:40 +01:00
scatterlist: prevent invalid free when alloc fails
2010-08-30 19:55:09 +02:00
arch, mm: filter disallowed nodes from arch specific show_mem functions
2011-05-25 08:39:03 -07:00
locking: Further name space cleanups
2009-12-14 23:55:33 +01:00
Add a strtobool function matching semantics of existing in kernel equivalents
2011-05-19 16:55:28 +09:30
swiotlb: Export swioltb_nr_tbl and utilize it as appropiate.
2011-06-06 15:41:16 -04:00
kstrtox: fix compile warnings in test
2011-04-14 16:06:54 -07:00
textsearch: doc - fix spelling in lib/textsearch.c.
2011-01-24 23:33:30 -08:00
Fix common misspellings
2011-03-31 11:26:23 -03:00
Unified UUID/GUID definition
2010-05-19 22:40:47 -04:00
Merge 'akpm' patch series
2011-07-25 21:00:19 -07:00
e504f3fdd6