Mel Gorman
21d9ee3eda
mm: remove remaining references to NUMA hinting bits and helpers ...
This patch removes the NUMA PTE bits and associated helpers. As a
side-effect it increases the maximum possible swap space on x86-64.
One potential source of problems is races between the marking of PTEs
PROT_NONE, NUMA hinting faults and migration. It must be guaranteed that
a PTE being protected is not faulted in parallel, seen as a pte_none and
corrupting memory. The base case is safe but transhuge has problems in
the past due to an different migration mechanism and a dependance on page
lock to serialise migrations and warrants a closer look.
task_work hinting update parallel fault
------------------------ --------------
change_pmd_range
change_huge_pmd
__pmd_trans_huge_lock
pmdp_get_and_clear
__handle_mm_fault
pmd_none
do_huge_pmd_anonymous_page
read? pmd_lock blocks until hinting complete, fail !pmd_none test
write? __do_huge_pmd_anonymous_page acquires pmd_lock, checks pmd_none
pmd_modify
set_pmd_at
task_work hinting update parallel migration
------------------------ ------------------
change_pmd_range
change_huge_pmd
__pmd_trans_huge_lock
pmdp_get_and_clear
__handle_mm_fault
do_huge_pmd_numa_page
migrate_misplaced_transhuge_page
pmd_lock waits for updates to complete, recheck pmd_same
pmd_modify
set_pmd_at
Both of those are safe and the case where a transhuge page is inserted
during a protection update is unchanged. The case where two processes try
migrating at the same time is unchanged by this series so should still be
ok. I could not find a case where we are accidentally depending on the
PTE not being cleared and flushed. If one is missed, it'll manifest as
corruption problems that start triggering shortly after this series is
merged and only happen when NUMA balancing is enabled.
Signed-off-by: Mel Gorman <mgorman@suse.de>
Tested-by: Sasha Levin <sasha.levin@oracle.com>
Cc: Aneesh Kumar K.V <aneesh.kumar@linux.vnet.ibm.com>
Cc: Benjamin Herrenschmidt <benh@kernel.crashing.org>
Cc: Dave Jones <davej@redhat.com>
Cc: Hugh Dickins <hughd@google.com>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: Kirill Shutemov <kirill.shutemov@linux.intel.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Paul Mackerras <paulus@samba.org>
Cc: Rik van Riel <riel@redhat.com>
Cc: Mark Brown <broonie@kernel.org>
Cc: Stephen Rothwell <sfr@canb.auug.org.au>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2015-02-12 18:54:08 -08:00
arch: Mass conversion of smp_mb__*()
2014-04-18 14:20:48 +02:00
mm, asm-generic: define PUD_SHIFT in <asm-generic/4level-fixup.h>
2015-02-11 17:06:03 -08:00
locking,arch: Use ACCESS_ONCE() instead of cast to volatile in atomic_read()
2014-10-03 06:06:23 +02:00
locking,arch: Rewrite generic atomic support
2014-08-14 12:48:14 +02:00
audit: Modify a set of system calls in audit class definitions
2014-01-17 17:01:46 -05:00
audit: Modify a set of system calls in audit class definitions
2014-01-17 17:01:46 -05:00
arch: Add lightweight memory barriers dma_rmb() and dma_wmb()
2014-12-11 21:15:06 -05:00
arch: Prepare for smp_mb__{before,after}_atomic()
2014-04-18 11:40:30 +02:00
UAPI: (Scripted) Disintegrate include/asm-generic
2012-10-04 18:20:15 +01:00
bug: Make BUG() always stop the machine
2014-04-07 16:36:10 -07:00
asm-generic headers: Allow yet more arch overrides in checksum.h
2013-02-11 20:00:33 +05:30
asm-generic: COMMON_CLK defines __clk_{get,put}
2014-09-25 18:00:45 -07:00
LLVMLinux: Remove warning about returning an uninitialized variable
2014-04-09 13:44:35 -07:00
asm-generic: move cmpxchg*_local defs to cmpxchg.h
2013-03-13 06:11:05 +01:00
cputime: Generic on-demand virtual cputime accounting
2013-01-27 19:23:27 +01:00
sched, time: Fix build error with 64 bit cputime_t on 32 bit systems
2014-10-03 05:46:55 +02:00
sched, time: Fix build error with 64 bit cputime_t on 32 bit systems
2014-10-03 05:46:55 +02:00
DMA-API: Change dma_declare_coherent_memory() CPU address to phys_addr_t
2014-05-20 16:55:23 -06:00
asm-generic: Add dma-contiguous.h
2014-09-22 13:35:51 +02:00
asm-generic/dma-mapping-broken.h: Provide dma_alloc_attrs()/dma_free_attrs()
2012-12-25 20:14:54 +01:00
Merge branch 'for-v3.18' of git://git.linaro.org/people/mszyprowski/linux-dma-mapping
2014-10-10 16:56:08 -04:00
mm: create generic early_ioremap() support
2014-04-07 16:36:15 -07:00
arm64: fixmap: fix missing sub-page offset for earlyprintk
2014-05-03 22:20:31 +01:00
asm-generic: add generic futex for !CONFIG_SMP
2014-12-08 12:55:48 +08:00
gpio: Increase ARCH_NR_GPIOs to 512
2014-09-23 17:51:39 +02:00
mm: Fix generic hugetlb pte check return type.
2013-10-02 20:02:35 -04:00
UAPI: (Scripted) Disintegrate include/asm-generic
2012-10-04 18:20:15 +01:00
readq/writeq: Add explicit lo_hi_[read|write]_q and hi_lo_[read|write]_q
2014-07-04 13:27:30 +02:00
readq/writeq: Add explicit lo_hi_[read|write]_q and hi_lo_[read|write]_q
2014-07-04 13:27:30 +02:00
Merge branch 'io' of git://git.kernel.org/pub/scm/linux/kernel/git/will/linux into asm-generic
2014-11-11 19:55:45 +01:00
include/asm-generic/ioctl.h: fix _IOC_TYPECHECK sparse error
2014-06-06 16:08:13 -07:00
Kconfig: rename HAS_IOPORT to HAS_IOPORT_MAP
2014-04-07 16:36:11 -07:00
irq_work: Introduce arch_irq_work_has_interrupt()
2014-09-13 18:38:07 +02:00
UAPI: Set up uapi/asm/Kbuild.asm
2012-10-02 18:01:56 +01:00
asm-generic: remove km_type definitions
2012-07-24 15:27:30 +08:00
KVM: add kvm_para_available to asm-generic/kvm_para.h
2013-06-05 13:21:29 +03:00
locking/mcs: Allow architecture specific asm files to be used for contended case
2014-02-09 21:18:52 +01:00
__page_to_pfn: Fix typo in comment
2013-10-14 15:28:29 +02:00
mm: Make arch_unmap()/bprm_mm_init() available to all architectures
2014-11-19 11:54:13 +01:00
asm-generic/mmu.h: Add support for FDPIC
2012-12-09 23:14:14 +01:00
asm-generic: Remove asm-generic arch_bprm_mm_init()
2014-11-22 21:52:08 +01:00
Make most arch asm/module.h files use asm-generic/module.h
2012-09-28 14:31:03 +09:30
asm-generic: Add msi.h
2014-11-23 13:01:47 +01:00
arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not
2013-06-26 12:10:55 +02:00
arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not
2013-06-26 12:10:55 +02:00
arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not
2013-06-26 12:10:55 +02:00
UAPI: (Scripted) Disintegrate include/asm-generic
2012-10-04 18:20:15 +01:00
include: remove __dev* attributes.
2013-01-03 15:57:16 -08:00
pci-dma-compat: add pci_zalloc_consistent helper
2014-08-08 15:57:28 -07:00
percpu: preffity percpu header files
2014-06-17 19:12:40 -04:00
mm: remove remaining references to NUMA hinting bits and helpers
2015-02-12 18:54:08 -08:00
sched: Kill task_preempt_count()
2014-10-28 10:47:56 +01:00
locking/rwlocks: Introduce 'qrwlocks' - fair, queued rwlocks
2014-06-06 07:58:28 +02:00
locking/rwlocks: Introduce 'qrwlocks' - fair, queued rwlocks
2014-06-06 07:58:28 +02:00
asm-generic: remove _STK_LIM_MAX
2014-05-15 00:32:09 +01:00
asm-generic: rwsem: de-PPCify rwsem.h
2014-03-14 18:02:08 +00:00
asm-generic: add generic seccomp.h for secure computing mode 1
2014-11-28 10:24:58 +00:00
nosave: consolidate __nosave_{begin,end} in <asm/sections.h>
2014-10-09 22:26:04 -04:00
constify copy_siginfo_to_user{,32}()
2013-11-09 00:16:29 -05:00
unify default ptrace_signal_deliver
2012-11-29 00:01:23 -05:00
crypto: create generic version of ablk_helper
2013-09-24 06:02:24 +10:00
ARM: 7430/1: sizes.h: move from asm-generic to <linux/sizes.h>
2012-06-28 17:14:34 +01:00
UAPI: (Scripted) Disintegrate include/asm-generic
2012-10-04 18:20:15 +01:00
syscall.h: fix doc text for syscall_get_arch()
2014-09-23 16:20:00 -04:00
burying unused conditionals
2013-02-14 09:21:15 -05:00
UAPI: (Scripted) Disintegrate include/asm-generic
2012-10-04 18:20:15 +01:00
mm: mmu_gather: use tlb->end != 0 only for TLB invalidation
2015-01-13 15:20:40 +13:00
tracing,x86: Add a TSC trace_clock
2012-11-13 15:48:27 -05:00
asm-generic: uaccess: Spelling s/a ny/any/
2014-01-02 10:45:23 +01:00
asm-generic: allow generic unaligned access if the arch supports it
2014-05-08 10:22:23 +02:00
We get rid of the general module prefix confusion with a binary config option,
2013-05-05 10:58:06 -07:00
iommu: provide early initialisation hook for IOMMU drivers
2014-12-01 16:47:46 +00:00
include/asm-generic/vtime.h: avoid zero-length file
2013-09-30 14:31:02 -07:00
word-at-a-time: simplify big-endian zero_bytemask macro
2014-05-01 08:57:44 -07:00
asm-generic: xor: mark static functions as __maybe_unused
2012-10-03 21:21:06 +02:00
21d9ee3eda