Mel Gorman
dac1d27bc8
mm: use zonelists instead of zones when direct reclaiming pages ...
The following patches replace multiple zonelists per node with two zonelists
that are filtered based on the GFP flags. The patches as a set fix a bug with
regard to the use of MPOL_BIND and ZONE_MOVABLE. With this patchset, the
MPOL_BIND will apply to the two highest zones when the highest zone is
ZONE_MOVABLE. This should be considered as an alternative fix for the
MPOL_BIND+ZONE_MOVABLE in 2.6.23 to the previously discussed hack that filters
only custom zonelists.
The first patch cleans up an inconsistency where direct reclaim uses
zonelist->zones where other places use zonelist.
The second patch introduces a helper function node_zonelist() for looking up
the appropriate zonelist for a GFP mask which simplifies patches later in the
set.
The third patch defines/remembers the "preferred zone" for numa statistics, as
it is no longer always the first zone in a zonelist.
The forth patch replaces multiple zonelists with two zonelists that are
filtered. The two zonelists are due to the fact that the memoryless patchset
introduces a second set of zonelists for __GFP_THISNODE.
The fifth patch introduces helper macros for retrieving the zone and node
indices of entries in a zonelist.
The final patch introduces filtering of the zonelists based on a nodemask.
Two zonelists exist per node, one for normal allocations and one for
__GFP_THISNODE.
Performance results varied depending on the machine configuration. In real
workloads the gain/loss will depend on how much the userspace portion of the
benchmark benefits from having more cache available due to reduced referencing
of zonelists.
These are the range of performance losses/gains when running against
2.6.24-rc4-mm1. The set and these machines are a mix of i386, x86_64 and
ppc64 both NUMA and non-NUMA.
loss to gain
Total CPU time on Kernbench: -0.86% to 1.13%
Elapsed time on Kernbench: -0.79% to 0.76%
page_test from aim9: -4.37% to 0.79%
brk_test from aim9: -0.71% to 4.07%
fork_test from aim9: -1.84% to 4.60%
exec_test from aim9: -0.71% to 1.08%
This patch:
The allocator deals with zonelists which indicate the order in which zones
should be targeted for an allocation. Similarly, direct reclaim of pages
iterates over an array of zones. For consistency, this patch converts direct
reclaim to use a zonelist. No functionality is changed by this patch. This
simplifies zonelist iterators in the next patch.
Signed-off-by: Mel Gorman <mel@csn.ul.ie>
Acked-by: Christoph Lameter <clameter@sgi.com>
Signed-off-by: Lee Schermerhorn <lee.schermerhorn@hp.com>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Cc: Mel Gorman <mel@csn.ul.ie>
Cc: Christoph Lameter <clameter@sgi.com>
Cc: Hugh Dickins <hugh@veritas.com>
Cc: Nick Piggin <nickpiggin@yahoo.com.au>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2008-04-28 08:58:18 -07:00
V4L/DVB (7293): DMX_OUT_TSDEMUX_TAP: record two streams from same mux, resend
2008-04-24 14:07:46 -03:00
ARM: OMAP: I2C: tps65010 driver converts to gpiolib
2008-04-14 09:57:06 -07:00
lockd: unlock lockd locks held for a certain filesystem
2008-04-25 13:00:11 -04:00
[ARM] 4964/1: htc-pasic3: MFD driver for PASIC3 LED control + DS1WM chip
2008-04-19 11:29:08 +01:00
mlx4_core: Add helper to move QP to ready-to-send
2008-04-25 14:52:32 -07:00
[MTD] [MAPS] Extend plat-ram to support a supplied probe type
2008-04-22 20:10:10 +01:00
[NETFILTER]: nf_conntrack: add DCCP protocol support
2008-04-14 11:15:49 +02:00
[NETFILTER]: remove arpt_(un)register_target indirection macros
2008-04-14 11:15:44 +02:00
[NETFILTER]: bridge: add ebt_nflog watcher
2008-04-14 11:15:54 +02:00
nfsd: don't allow setting ctime over v4
2008-04-25 13:00:11 -04:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
Input: ads7846 - simplify support of external vREF (and ads7843)
2008-04-02 00:43:01 -04:00
Merge branch 'master' of master.kernel.org:/pub/scm/linux/kernel/git/torvalds/linux-2.6
2008-04-17 23:56:30 -07:00
Merge git://git.linux-nfs.org/projects/trondmy/nfs-2.6
2008-04-24 11:46:16 -07:00
USB: serial: remove endpoints setting checks from core and header
2008-04-24 21:16:52 -07:00
PCI: #if 0 pci_cleanup_aer_correct_error_status()
2008-04-20 21:47:02 -07:00
drivers/net/arcnet/arcnet.c: use time_* macros
2008-03-28 22:14:15 -04:00
sata_mv: mbus decode window support
2008-03-27 14:51:39 -04:00
[NET]: include/linux/atalk.h - remove duplicate include
2008-03-23 22:04:31 -07:00
SCSI: convert struct class_device to struct device
2008-04-19 19:10:33 -07:00
Audit: Final renamings and cleanup
2008-04-19 09:59:43 +10:00
block: convert bio_copy_user to bio_copy_user_iov
2008-04-21 09:50:08 +02:00
cpumask: add cpumask_scnprintf_len function
2008-04-19 19:44:58 +02:00
x86: optimize find_first_bit for small bitmaps
2008-04-26 19:21:17 +02:00
block: fix memory hotplug and bouncing in block layer
2008-04-21 09:51:05 +02:00
[SCSI] bsg: add release callback support
2008-04-22 15:16:32 -05:00
cdrom: make unregister_cdrom() return void
2008-04-21 09:50:08 +02:00
cgroups: add cgroup support for enabling controllers at boot time
2008-04-04 14:46:26 -07:00
kgdb: clocksource watchdog
2008-04-17 20:05:38 +02:00
compat_sys_wait4() prototype misannotation
2008-03-30 14:20:23 -07:00
generic: make optimized inlining arch-opt-in
2008-04-26 17:44:55 +02:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
cpuidle: fix cpuidle time and usage overflow
2008-03-26 00:45:26 -04:00
x86: convert cpumask_of_cpu macro to allocated array
2008-04-19 19:44:59 +02:00
cpuset: modify cpuset_set_cpus_allowed to use cpumask pointer
2008-04-19 19:44:58 +02:00
[CRYPTO] api: Make the crypto subsystem fully modular
2008-04-21 10:19:23 +08:00
[patch 2/7] vfs: mountinfo: add seq_file_root()
2008-04-23 00:04:38 -04:00
dm table: remove unused dm_create_error_table
2008-04-25 13:27:00 +01:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-2.6
2008-04-21 15:49:58 -07:00
dlm: linux/{dlm,dlm_device}.h: cleanup for userspace
2008-04-21 11:35:39 -05:00
dlm: linux/{dlm,dlm_device}.h: cleanup for userspace
2008-04-21 11:35:39 -05:00
dlm: move plock code from gfs2
2008-04-21 11:22:28 -05:00
dlm: common max length definitions
2008-04-21 11:22:29 -05:00
dm: move include files
2008-04-25 13:26:55 +01:00
dm: move include files
2008-04-25 13:26:55 +01:00
dm: move include files
2008-04-25 13:26:55 +01:00
DMA engine: typo fixes
2008-04-21 22:38:45 +00:00
x86: EFI_PAGE_SHIFT fix
2008-04-19 19:19:54 +02:00
SCSI: convert struct class_device to struct device
2008-04-19 19:10:33 -07:00
[NET]: include <linux/types.h> into linux/ethtool.h for __u* typedef
2008-03-07 11:11:13 -08:00
Use a zero sized array for raw field in struct fid
2008-04-23 16:13:42 -04:00
[PATCH] sanitize unshare_files/reset_files_struct
2008-04-25 09:23:59 -04:00
[SKFILTER]: Add SKF_ADF_NLATTR instruction
2008-04-10 02:02:28 -07:00
firmware: provide stubs for the FW_LOADER=n case
2008-03-10 16:33:33 -07:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs-2.6
2008-04-25 19:05:55 -07:00
phy: Change mii_bus id field to a string
2008-04-16 20:09:35 -04:00
Remove <linux/genhd.h> from user-visible headers.
2008-03-12 12:34:37 -07:00
Remove set_migrateflags()
2008-04-28 08:58:17 -07:00
in_atomic(): document why it is unsuitable for general use
2008-03-28 14:45:21 -07:00
ide: remove broken/dangerous HDIO_[UNREGISTER,SCAN]_HWIF ioctls (take 3)
2008-04-18 00:46:24 +02:00
HID: fix race between open() and disconnect() in usbhid
2008-04-22 11:34:58 +02:00
HID: export headers properly
2008-04-22 11:34:59 +02:00
Convert asm/semaphore.h users to linux/semaphore.h
2008-04-18 22:22:54 -04:00
x86: revert assign IRQs to hpet timer
2008-04-04 18:36:49 +02:00
hrtimers: simplify lockdep handling
2008-04-17 12:22:31 +02:00
PM: Remove destroy_suspended_device()
2008-04-19 19:10:28 -07:00
i2c-algo-pca: Extend for future drivers
2008-04-22 22:16:46 +02:00
V4L/DVB (7620): Adding support for a new i2c bridge type
2008-04-24 14:09:42 -03:00
i2c: Add platform driver on top of the new pca-algorithm
2008-04-22 22:16:46 +02:00
Convert asm/semaphore.h users to linux/semaphore.h
2008-04-18 22:22:54 -04:00
[IPV6]: Fix powerpc allmodconfig build warnings.
2008-03-05 20:58:10 -08:00
ide: remove now unused ide_pci_create_host_proc()
2008-04-27 15:38:34 +02:00
mac80211: update mesh EID values
2008-04-23 21:25:36 -04:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
net: make struct tun_struct private to tun.c
2008-04-12 18:48:58 -07:00
[IPV6] SIT: Add SIOCGETPRL ioctl to get/dump PRL.
2008-04-03 10:06:00 +09:00
[VLAN]: Tag vlan_group_device with net device, not ifindex.
2008-04-16 00:48:04 -07:00
[NET]: include/linux/igmp.h - remove duplicate include
2008-03-23 22:05:44 -07:00
[IPV4]: ipv4_is_lbcast() misannotations
2008-03-17 22:48:46 -07:00
[IPV6]: Define constants for link-local multicast addresses.
2008-04-12 13:43:19 +09:00
[NET] NETNS: Omit net_device->nd_net without CONFIG_NET_NS.
2008-03-26 04:39:53 +09:00
sched: fair-group: de-couple load-balancing from the rb-trees
2008-04-19 19:45:00 +02:00
Input: remove private member from input_dev structure
2008-04-02 00:41:00 -04:00
[S390] genirq/clockevents: move irq affinity prototypes/inlines to interrupt.h
2008-04-17 07:47:05 +02:00
io context: increment task attachment count in ioc_task_link()
2008-04-15 09:25:33 +02:00
PCI: clean up resource alignment management
2008-04-20 21:47:08 -07:00
Merge branch 'master' of master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6
2008-04-14 02:30:23 -07:00
[S390] genirq/clockevents: move irq affinity prototypes/inlines to interrupt.h
2008-04-17 07:47:05 +02:00
x86: pageattr.c fix shadowed variable warning
2008-04-19 19:19:54 +02:00
Firmware: add iSCSI iBFT Support
2008-04-19 19:10:28 -07:00
[ISDN] include/linux/isdn.h: remove dead code
2008-04-15 00:30:16 -07:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/juhl/trivial
2008-04-21 16:36:46 -07:00
remove include/linux/hdsmart.h
2008-04-26 17:36:37 +02:00
driver core: Convert debug functions declared inline __attribute__((format (printf,x,y) to statement expression macros
2008-04-19 19:10:19 -07:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
Input: put ledstate in the keyboard notifier
2008-04-15 01:30:32 -04:00
kgdb: add documentation
2008-04-17 20:05:42 +02:00
time: add ns_to_ktime()
2008-04-19 19:44:57 +02:00
KVM: ppc: Add DCR access information to struct kvm_run
2008-04-27 18:21:37 +03:00
KVM: kill file->f_count abuse in kvm
2008-04-27 18:21:46 +03:00
KVM: MMU: hypercall based pte updates and TLB flushes
2008-04-27 12:00:27 +03:00
KVM: MMU: Don't assume struct page for x86
2008-04-27 12:01:15 +03:00
leds: Document the context brightness_set needs
2008-04-24 23:49:30 +01:00
lguest: comment documentation update.
2008-03-28 11:05:54 +11:00
make sata_print_link_status() static
2008-04-25 00:46:09 -04:00
Fix "$(AS) -traditional" compile breakage caused by asmlinkage_protect
2008-04-11 08:29:13 -07:00
Fix RCU list iterator use of 'rcu_dereference()'
2008-04-21 08:23:35 -07:00
[GFS2] Invalidate cache at correct point
2008-03-31 10:41:44 +01:00
[LMB] Add lmb_alloc_nid()
2008-04-15 21:22:17 +10:00
vfs: fix possible deadlock in ext2, ext3, ext4 when using xattrs
2008-04-15 19:35:41 -07:00
introduce mbus DRAM target info abstraction
2008-03-27 14:51:39 -04:00
driver core: memory: semaphore to mutex
2008-04-19 19:10:19 -07:00
hotplug memory remove: generic __remove_pages() support
2008-04-28 08:58:17 -07:00
memstick: convert struct class_device to struct device
2008-04-19 19:10:29 -07:00
V4L/DVB (7204): remove V4L2_CID_SHARPNESS from meye.h and report private control as DISABLED
2008-04-24 14:07:43 -03:00
PM: Remove destroy_suspended_device()
2008-04-19 19:10:28 -07:00
mm: remove nopage
2008-04-28 08:58:18 -07:00
remove sparse warning for mmzone.h
2008-04-28 08:58:17 -07:00
[patch 6/7] vfs: mountinfo: add /proc/<pid>/mountinfo
2008-04-23 00:05:03 -04:00
[patch 4/7] vfs: mountinfo: add mount peer group ID
2008-04-23 00:04:51 -04:00
[IPV4] MROUTE: Adjust include files for user-space.
2008-04-04 10:44:42 +09:00
[IPV6] MROUTE: Do not call ipv6_find_idev() directly.
2008-04-13 23:21:16 -07:00
[SCSI] st: add option to use SILI in variable block reads
2008-04-07 12:15:39 -05:00
[NET]: NPROTO is redundant; it's equal to AF_MAX/PF_MAX.
2008-03-22 17:18:47 -07:00
[NETNS]: Add netns refcnt debug for network devices.
2008-04-16 02:02:18 -07:00
[NETFILTER]: Add partial checksum validation helper
2008-04-14 11:15:49 +02:00
[NETFILTER]: nf_nat: kill helper and seq_adjust hooks
2008-04-14 11:15:52 +02:00
nfs: remove unnecessary NFS_NEED_* defines
2008-04-23 16:13:37 -04:00
make nfs_automount_list static
2008-04-19 16:55:29 -04:00
NFSv4: Reintroduce machine creds
2008-04-19 16:54:56 -04:00
NFSv4: Only increment the sequence id if the server saw it
2008-04-19 16:53:15 -04:00
nl80211/cfg80211: support for mesh, sta dumping
2008-03-06 15:30:41 -05:00
[POWERPC] Add of_device_is_available function
2008-04-07 13:49:23 +10:00
[POWERPC] OF helpers for the GPIO API
2008-04-17 07:46:11 +10:00
[POWERPC] i2c: OF helpers for the i2c API
2008-04-17 07:46:11 +10:00
Convert asm/semaphore.h users to linux/semaphore.h
2008-04-18 22:22:54 -04:00
PCI: add PCI Express ASPM support
2008-04-20 21:47:03 -07:00
PCI: Expose PCI VPD through sysfs
2008-04-20 21:47:07 -07:00
memstick: add support for JMicron jmb38x MemoryStick host controller
2008-03-10 18:01:19 -07:00
PCI: add PCI Express ASPM support
2008-04-20 21:47:03 -07:00
phylib: Add support for board-level PHY fixups
2008-04-25 02:08:52 -04:00
[IPV4] MROUTE: Adjust include files for user-space.
2008-04-04 10:44:42 +09:00
[PKT_SCHED]: annotate cls_u32
2008-03-17 22:46:46 -07:00
PM: Convert wakeup flag accessors to inline functions
2008-04-19 19:10:26 -07:00
PM: Convert wakeup flag accessors to inline functions
2008-04-19 19:10:26 -07:00
[POWERPC] Fix drivers/macintosh/mediabay.c when !CONFIG_ADB_PMU
2008-03-13 10:09:27 +11:00
pnp: increase number of devices supported per protocol
2008-04-11 08:06:44 -07:00
generic, x86: add prctl commands PR_GET_TSC and PR_SET_TSC
2008-04-19 19:19:55 +02:00
[NET]: Make /proc/net a symlink on /proc/self/net (v3)
2008-03-07 11:08:40 -08:00
Fix quota.h includes
2008-04-17 10:42:14 -04:00
SCSI: convert struct class_device to struct device
2008-04-19 19:10:33 -07:00
rcu: fix misplaced mb() in rcu_enter/exit_nohz()
2008-03-19 18:53:36 -07:00
[RTNETLINK]: Fix bogus ASSERT_RTNL warning
2008-04-23 22:10:48 -07:00
[SCSI] block: add sg buffer copy helper functions
2008-04-07 12:15:45 -05:00
s390: KVM preparation: provide hook to enable pgstes in user pagetable
2008-04-27 12:00:40 +03:00
[PATCH] switch a bunch of LSM hooks from nameidata to path
2008-04-21 23:13:23 -04:00
SELinux: use new audit hooks, remove redundant exports
2008-04-19 09:53:46 +10:00
Improve semaphore documentation
2008-04-17 10:43:01 -04:00
[patch 2/7] vfs: mountinfo: add seq_file_root()
2008-04-23 00:04:38 -04:00
[NETNS]: Do not include net/net_namespace.h from seq_file.h
2008-04-02 00:10:28 -07:00
seqlock: livelock fix
2008-04-25 00:25:08 +02:00
consoles: polling support, kgdboc
2008-04-17 20:05:37 +02:00
Input: add Zhen Hua driver
2008-04-15 13:26:52 -04:00
skbuff: fix missing kernel-doc notation
2008-04-21 15:51:36 -07:00
slab - use angle brackets for include of kmalloc_sizes.h
2008-03-06 16:21:49 -08:00
slub: No need for per node slab counters if !SLUB_DEBUG
2008-04-14 18:53:02 +03:00
smc91x: introduce platform data flags V2
2008-03-17 07:49:27 -04:00
locking: remove unused double_spin_lock()
2008-04-17 12:22:31 +02:00
mm: use zonelists instead of zones when direct reclaiming pages
2008-04-28 08:58:18 -07:00
include: Remove unnecessary inclusions of asm/semaphore.h
2008-04-18 22:16:54 -04:00
cpumask: add show cpu map functions
2008-04-19 19:44:59 +02:00
[SCSI] sysfs: make group is_valid return a mode_t
2008-04-22 15:16:31 -05:00
[TCP]: TCP_DEFER_ACCEPT updates - process as established
2008-03-21 16:33:01 -07:00
acpi thermal trip points increased to 12
2008-04-15 19:35:41 -07:00
hrtimer: add nanosleep specific restart_block member
2008-04-17 12:22:30 +02:00
tifm: fix the MemoryStick host fifo handling code
2008-03-10 18:01:18 -07:00
time: prevent the loop in timespec_add_ns() from being optimised away
2008-03-09 08:42:57 +01:00
time: remove obsolete CLOCK_TICK_ADJUST
2008-03-09 08:42:57 +01:00
cpumask: reduce stack usage in SD_x_INIT initializers
2008-04-19 19:44:59 +02:00
SCSI: convert struct class_device to struct device
2008-04-19 19:10:33 -07:00
consoles: polling support, kgdboc
2008-04-17 20:05:37 +02:00
uaccess: add probe_kernel_write()
2008-04-17 20:05:36 +02:00
udf: move headers out include/linux/
2008-04-17 14:22:23 +02:00
[NET]: include/linux/udp.h - remove duplicate include
2008-03-23 22:06:51 -07:00
wusb: add link wusb-usb device
2008-04-24 21:16:57 -07:00
USB: mass storage: emulation of sat scsi_pass_thru with ATACB
2008-04-24 21:16:42 -07:00
USB: usbfs: export the URB_NO_INTERRUPT flag to userspace
2008-04-24 21:16:54 -07:00
V4L/DVB (7453): v4l2-api: Define a standard control for color killer functionality
2008-04-24 14:07:56 -03:00
virtio: remove overzealous BUG_ON.
2008-04-07 13:14:22 -07:00
WEXT: add mesh interface type
2008-03-06 15:30:40 -05:00
Input: wm97xx-core - support use as a wakeup source
2008-04-17 09:24:58 -04:00
xfrm: alg_key_len & alg_icv_len should be unsigned
2008-04-25 00:29:34 -07:00
dac1d27bc8