Lee Schermerhorn
06808b0827
hugetlb: derive huge pages nodes allowed from task mempolicy ...
This patch derives a "nodes_allowed" node mask from the numa mempolicy of
the task modifying the number of persistent huge pages to control the
allocation, freeing and adjusting of surplus huge pages when the pool page
count is modified via the new sysctl or sysfs attribute
"nr_hugepages_mempolicy". The nodes_allowed mask is derived as follows:
* For "default" [NULL] task mempolicy, a NULL nodemask_t pointer
is produced. This will cause the hugetlb subsystem to use
node_online_map as the "nodes_allowed". This preserves the
behavior before this patch.
* For "preferred" mempolicy, including explicit local allocation,
a nodemask with the single preferred node will be produced.
"local" policy will NOT track any internode migrations of the
task adjusting nr_hugepages.
* For "bind" and "interleave" policy, the mempolicy's nodemask
will be used.
* Other than to inform the construction of the nodes_allowed node
mask, the actual mempolicy mode is ignored. That is, all modes
behave like interleave over the resulting nodes_allowed mask
with no "fallback".
See the updated documentation [next patch] for more information
about the implications of this patch.
Examples:
Starting with:
Node 0 HugePages_Total: 0
Node 1 HugePages_Total: 0
Node 2 HugePages_Total: 0
Node 3 HugePages_Total: 0
Default behavior [with or without this patch] balances persistent
hugepage allocation across nodes [with sufficient contiguous memory]:
sysctl vm.nr_hugepages[_mempolicy]=32
yields:
Node 0 HugePages_Total: 8
Node 1 HugePages_Total: 8
Node 2 HugePages_Total: 8
Node 3 HugePages_Total: 8
Of course, we only have nr_hugepages_mempolicy with the patch,
but with default mempolicy, nr_hugepages_mempolicy behaves the
same as nr_hugepages.
Applying mempolicy--e.g., with numactl [using '-m' a.k.a.
'--membind' because it allows multiple nodes to be specified
and it's easy to type]--we can allocate huge pages on
individual nodes or sets of nodes. So, starting from the
condition above, with 8 huge pages per node, add 8 more to
node 2 using:
numactl -m 2 sysctl vm.nr_hugepages_mempolicy=40
This yields:
Node 0 HugePages_Total: 8
Node 1 HugePages_Total: 8
Node 2 HugePages_Total: 16
Node 3 HugePages_Total: 8
The incremental 8 huge pages were restricted to node 2 by the
specified mempolicy.
Similarly, we can use mempolicy to free persistent huge pages
from specified nodes:
numactl -m 0,1 sysctl vm.nr_hugepages_mempolicy=32
yields:
Node 0 HugePages_Total: 4
Node 1 HugePages_Total: 4
Node 2 HugePages_Total: 16
Node 3 HugePages_Total: 8
The 8 huge pages freed were balanced over nodes 0 and 1.
[rientjes@google.com: accomodate reworked NODEMASK_ALLOC]
Signed-off-by: David Rientjes <rientjes@google.com>
Signed-off-by: Lee Schermerhorn <lee.schermerhorn@hp.com>
Acked-by: Mel Gorman <mel@csn.ul.ie>
Reviewed-by: Andi Kleen <andi@firstfloor.org>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Cc: Randy Dunlap <randy.dunlap@oracle.com>
Cc: Nishanth Aravamudan <nacc@us.ibm.com>
Cc: Adam Litke <agl@us.ibm.com>
Cc: Andy Whitcroft <apw@canonical.com>
Cc: Eric Whitney <eric.whitney@hp.com>
Cc: Christoph Lameter <cl@linux-foundation.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2009-12-15 08:53:12 -08:00
microblaze: Enable GCOV_PROFILE_ALL
2009-09-21 14:29:21 +02:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/jikos/trivial
2009-12-09 19:43:33 -08:00
PM / Runtime: Export the PM runtime workqueue
2009-12-06 16:17:56 +01:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
bsdacct: fix uid/gid misreporting
2009-12-15 08:53:10 -08:00
async: Fix lack of boot-time console due to insufficient synchronization
2009-06-08 12:31:53 -07:00
Audit: send signal info if selinux is disabled
2009-09-24 03:50:26 -04:00
Fix rule eviction order for AUDIT_DIR
2009-06-24 00:02:38 -04:00
Fix rule eviction order for AUDIT_DIR
2009-06-24 00:02:38 -04:00
Audit: reorganize struct audit_watch to save 8 bytes
2009-09-24 03:50:25 -04:00
Audit: clean up all op= output to include string quoting
2009-06-24 00:00:52 -04:00
Audit: rearrange audit_context to save 16 bytes per struct
2009-09-24 03:50:26 -04:00
remove CONFIG_SECURITY_FILE_CAPABILITIES compile option
2009-11-24 15:06:47 +11:00
cgroup: fix strstrip() misuse
2009-10-29 07:39:25 -07:00
cgroups: let ss->can_attach and ss->attach do whole threadgroups at a time
2009-09-24 07:20:58 -07:00
signals: implement sys_rt_tgsigqueueinfo
2009-04-30 19:24:24 +02:00
Merge branch 'sched-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-12 11:34:10 -08:00
sched: Fix balance vs hotplug race
2009-12-06 21:10:56 +01:00
creds_are_invalid() needs to be exported for use by modules:
2009-09-23 11:02:26 -07:00
headers: taskstats_kern.h trim
2009-09-18 09:48:52 -07:00
tty: Move the leader test in disassociate
2009-12-11 15:18:08 -08:00
Merge branch 'for-2.6.33' of git://git.kernel.dk/linux-2.6-block
2009-12-08 08:19:16 -08:00
sched: fix nr_uninterruptible accounting of frozen tasks really
2009-07-18 14:19:53 +02:00
futex: Take mmap_sem for get_user_pages in fault_in_user_writeable
2009-12-08 14:59:36 +01:00
futex: Fix compat_futex to be same as futex for REQUEUE_PI
2009-08-10 15:41:12 +02:00
groups: move code to kernel/groups.c
2009-06-16 19:47:48 -07:00
hrtimer: move timer stats helper functions to hrtimer.c
2009-12-10 13:08:11 +01:00
softlockup: Fix hung_task_check_count sysctl
2009-11-27 06:21:57 +01:00
hw-breakpoints: Modify breakpoints without unregistering them
2009-12-09 09:48:20 +01:00
itimers: Fix racy writes to cpu_itimer fields
2009-11-18 16:32:12 +01:00
hw-breakpoints: Fix broken hw-breakpoint sample module
2009-11-10 11:23:29 +01:00
mutex: Better control mutex adaptive spinning config
2009-12-03 11:50:11 +01:00
kexec: fix omitting offset in extended crashkernel syntax
2009-07-29 19:10:34 -07:00
kfifo: Use "const" definitions
2009-09-19 13:13:17 -07:00
kgdb: Always process the whole breakpoint list on activate or deactivate
2009-12-11 08:43:20 -06:00
security: report the module name to security_module_request
2009-11-10 09:33:46 +11:00
Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-05 15:30:21 -08:00
sched: Fix kthread_bind() by moving the body of kthread_bind() to sched.c
2009-11-03 07:25:00 +01:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
lockdep: BFS cleanup
2009-07-24 10:53:29 +02:00
seq_file: constify seq_operations
2009-09-23 07:39:29 -07:00
Merge branch 'kvm-updates/2.6.33' of git://git.kernel.org/pub/scm/virt/kvm/kvm
2009-12-08 08:02:38 -08:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
headers: remove sched.h from interrupt.h
2009-10-11 11:20:58 -07:00
mutex: Better control mutex adaptive spinning config
2009-12-03 11:50:11 +01:00
kprobes: Fix to add __kprobes to notify_die
2009-08-30 03:08:26 +02:00
cgroups: let ss->can_attach and ss->attach do whole threadgroups at a time
2009-09-24 07:20:58 -07:00
nsproxy: extract create_nsproxy()
2009-06-18 13:03:56 -07:00
Merge branch 'core-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-10-08 12:16:35 -07:00
param: fix setting arrays of bool
2009-10-29 08:56:20 +10:30
Merge branch 'perf-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-11 20:47:30 -08:00
mm: also use alloc_large_system_hash() for the PID hash table
2009-09-22 07:17:38 -07:00
pidns: deny CLONE_PARENT|CLONE_NEWPID combination
2009-09-24 07:21:04 -07:00
pm_qos: clean up racy global "name" variable
2009-10-14 15:31:10 +02:00
posix-cpu-timers: optimize and document timer_create callback
2009-11-18 12:36:05 +01:00
time: Introduce CLOCK_REALTIME_COARSE
2009-08-21 21:43:46 +02:00
Merge branch 'core-printk-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-05 09:50:22 -08:00
kernel/profile.c: Switch /proc/irq/prof_cpu_mask to seq_file
2009-09-20 20:15:40 +02:00
ptrace: __ptrace_detach: do __wake_up_parent() if we reap the tracee
2009-09-24 07:20:59 -07:00
rcu: Re-arrange code to reduce #ifdef pain
2009-11-22 18:58:16 +01:00
rcu: Eliminate unneeded function wrapping
2009-11-22 18:58:16 +01:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
rcu: Add expedited grace-period support for preemptible RCU
2009-12-03 11:35:25 +01:00
rcu: Add expedited grace-period support for preemptible RCU
2009-12-03 11:35:25 +01:00
rcu: Add expedited grace-period support for preemptible RCU
2009-12-03 11:35:25 +01:00
rcu: Add expedited grace-period support for preemptible RCU
2009-12-03 11:35:25 +01:00
const: mark struct vm_struct_operations
2009-09-27 11:39:25 -07:00
memcg: some modification to softlimit under hierarchical memory reclaim.
2009-10-01 16:11:13 -07:00
resources: when allocate_resource() fails, leave resource untouched
2009-11-04 13:06:46 -08:00
rtmutex: Avoid deadlock in rt_mutex_start_proxy_lock()
2009-08-06 05:50:21 +02:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
sched_clock: Fix atomicity/continuity bug by using cmpxchg64()
2009-09-30 22:56:10 +02:00
sched: Add new prio to cpupri before removing old prio
2009-08-02 14:26:09 +02:00
sched: Remove forced2_migrations stats
2009-12-10 20:32:39 +01:00
sched: Update normalized values on user updates via proc
2009-12-09 10:04:02 +01:00
sched: Discard some old bits
2009-12-09 10:03:07 +01:00
sched: Protect sched_rr_get_param() access to task->sched_class
2009-12-09 10:01:07 +01:00
sched: Protect sched_rr_get_param() access to task->sched_class
2009-12-09 10:01:07 +01:00
Merge branch 'perf-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-05 15:30:21 -08:00
SLOW_WORK: Move slow_work's proc file to debugfs
2009-12-01 08:20:31 -08:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/ebiederm/sysctl-2.6
2009-12-08 07:38:50 -08:00
SLOW_WORK: Move slow_work's proc file to debugfs
2009-12-01 08:20:31 -08:00
generic-ipi: Add smp_call_function_any()
2009-11-18 14:52:25 +01:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/percpu
2009-12-14 09:58:24 -08:00
percpu: make percpu symbols under kernel/ and mm/ unique
2009-10-29 22:34:13 +09:00
locking: Reduce ifdefs in kernel/spinlock.c
2009-11-13 20:53:28 +01:00
rcu: Add synchronize_srcu_expedited()
2009-10-26 09:40:30 +01:00
Merge branch 'bkl-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-09 08:07:17 -08:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net-next-2.6
2009-12-08 07:55:01 -08:00
hugetlb: derive huge pages nodes allowed from task mempolicy
2009-12-15 08:53:12 -08:00
sysctl binary: Reorder the tests to process wild card entries first.
2009-11-12 01:42:31 -08:00
ipv4 05/05: add sysctl to accept packets with local source addresses
2009-12-03 12:14:38 -08:00
genetlink: make netns aware
2009-07-12 14:03:27 -07:00
Merge branch 'timers-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-12-08 19:27:08 -08:00
Merge branch 'timers-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip
2009-09-23 09:46:15 -07:00
trivial: fix typo "to to" in multiple files
2009-09-21 15:14:55 +02:00
headers: utsname.h redux
2009-09-23 18:13:10 -07:00
core: Clean up user return notifers use of per_cpu
2009-12-02 10:22:59 +01:00
uids: Prevent tear down race
2009-11-02 16:02:39 +01:00
utsns: extract creeate_uts_ns()
2009-06-18 13:03:55 -07:00
sysctl kernel: Remove binary sysctl logic
2009-11-12 02:04:55 -08:00
locking, sched: Give waitqueue spinlocks their own lockdep classes
2009-08-10 14:43:09 +02:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq
2009-12-10 09:35:44 -08:00
06808b0827