Kirill A. Shutemov
f3f0e1d215
khugepaged: add support of collapse for tmpfs/shmem pages ...
This patch extends khugepaged to support collapse of tmpfs/shmem pages.
We share fair amount of infrastructure with anon-THP collapse.
Few design points:
- First we are looking for VMA which can be suitable for mapping huge
page;
- If the VMA maps shmem file, the rest scan/collapse operations
operates on page cache, not on page tables as in anon VMA case.
- khugepaged_scan_shmem() finds a range which is suitable for huge
page. The scan is lockless and shouldn't disturb system too much.
- once the candidate for collapse is found, collapse_shmem() attempts
to create a huge page:
+ scan over radix tree, making the range point to new huge page;
+ new huge page is not-uptodate, locked and freezed (refcount
is 0), so nobody can touch them until we say so.
+ we swap in pages during the scan. khugepaged_scan_shmem()
filters out ranges with more than khugepaged_max_ptes_swap
swapped out pages. It's HPAGE_PMD_NR/8 by default.
+ old pages are isolated, unmapped and put to local list in case
to be restored back if collapse failed.
- if collapse succeed, we retract pte page tables from VMAs where huge
pages mapping is possible. The huge page will be mapped as PMD on
next minor fault into the range.
Link: http://lkml.kernel.org/r/1466021202-61880-35-git-send-email-kirill.shutemov@linux.intel.com
Signed-off-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2016-07-26 16:19:19 -07:00
x86/quirks: Add early quirk to reset Apple AirPort card
2016-07-10 20:13:53 +02:00
libceph: change ceph_osdmap_flag() to take osdc
2016-05-30 23:00:22 +02:00
dmaengine: hsu: Export hsu_dma_get_status()
2016-06-25 14:30:42 -07:00
extcon: adc-jack: add suspend/resume support
2016-07-02 14:31:34 +09:00
iio: st_sensors: harden interrupt handling
2016-07-02 20:40:15 +01:00
irqchip/gicv3-its: Implement two-level(indirect) device table support
2016-06-13 11:53:53 +01:00
mfd: da9053: Fix compiler warning message for uninitialised variable
2016-06-30 07:44:23 +01:00
net/mlx4_en: Avoid unregister_netdev at shutdown flow
2016-06-22 16:38:11 -04:00
net/mlx5: Add timeout handle to commands with callback
2016-07-01 06:12:03 -04:00
MMC core:
2016-05-26 09:36:10 -07:00
phy: Add set_mode callback
2016-07-04 17:19:22 +05:30
hwmon: add support for Sensirion SHT3x sensors
2016-06-27 18:58:03 -07:00
qed*: Don't reset statistics on inner reload
2016-06-19 10:47:32 -07:00
regulator: Silence build warnings from regulator_can_change_voltage()
2016-05-17 18:06:18 +01:00
ARM: SoC driver updates for v4.7
2016-05-18 13:14:02 -07:00
rpc: share one xps between all backchannels
2016-06-15 10:32:25 -04:00
Merge 4.7-rc6 into usb-next
2016-07-04 08:19:21 -07:00
alarmtimer: Fix comments describing structure fields
2016-06-20 12:47:09 -07:00
Merge branch 'for-4.7-zac' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/libata
2016-05-23 17:53:39 -07:00
locking/atomic: Introduce inc/dec variants for the atomic_fetch_$op() API
2016-07-07 09:16:20 +02:00
Merge branch 'stable-4.7' of git://git.infradead.org/users/pcmoore/audit
2016-06-29 15:18:47 -07:00
mm: balloon: use general non-lru movable page feature
2016-07-26 16:19:19 -07:00
coredump: fix dumping through pipes
2016-06-07 22:07:09 -04:00
DAX error handling for 4.7
2016-05-26 19:34:26 -07:00
include/linux: apply __malloc attribute
2016-05-19 19:12:14 -07:00
bpf, perf: delay release of BPF prog after grace period
2016-06-29 05:42:55 -04:00
fs: export __block_write_full_page
2016-06-27 09:58:40 -05:00
clk: Remove CLK_IS_ROOT flag
2016-06-01 14:56:57 -07:00
clk: Add missing clk_get_sys() stub
2016-06-28 10:22:02 +02:00
clocksources: Switch back to the clksrc table
2016-06-28 10:19:35 +02:00
mm: migrate: support non-lru movable page migration
2016-07-26 16:19:19 -07:00
compiler.h: add support for malloc attribute
2016-05-19 19:12:14 -07:00
locking/barriers: Move smp_cond_load_acquire() to asm-generic/barrier.h
2016-06-14 11:55:14 +02:00
tty: vt, remove consw->con_bmove
2016-06-25 09:04:48 -07:00
tty: vt, remove unused vc_deccolm
2016-06-25 09:04:48 -07:00
x86/entry: Avoid interrupt flag save and restore
2016-07-10 13:33:02 +02:00
cpuidle: Do not access cpuidle_devices when !CONFIG_CPU_IDLE
2016-06-02 23:05:27 +02:00
cpuset: use static key better and convert to new API
2016-05-19 19:12:14 -07:00
dax: remote unused fault wrappers
2016-07-26 16:19:19 -07:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
2016-06-20 10:41:51 -07:00
debugobjects.h: fix trivial kernel doc warning
2016-07-26 16:19:19 -07:00
driver core update for 4.7-rc1
2016-05-20 21:26:15 -07:00
devpts: Make each mount of devpts an independent filesystem.
2016-06-05 10:36:01 -07:00
dma-buf: headerdoc fixes
2016-05-31 22:12:43 +05:30
efi: Reorganize the GUID table to make it easier to read
2016-07-08 15:21:37 +02:00
make IS_ERR_VALUE() complain about non-pointer-sized arguments
2016-05-27 16:03:22 -07:00
pnfs: rework LAYOUTGET retry handling
2016-05-17 15:48:12 -04:00
extcon: Fix the wrong description about extcon_set/get_cable_state_()
2016-06-29 19:50:43 +09:00
staging/android: bring struct sync_pt back
2016-06-17 21:17:40 -07:00
rose: limit sk_filter trim to payload
2016-07-13 11:53:40 -07:00
mm, frontswap: convert frontswap_enabled to static key
2016-07-26 16:19:19 -07:00
mm: migrate: support non-lru movable page migration
2016-07-26 16:19:19 -07:00
FS-Cache: make check_consistency callback return int
2016-06-01 10:29:39 +02:00
fsnotify: avoid spurious EMFILE errors from inotify_init()
2016-05-19 19:12:14 -07:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/jikos/livepatching
2016-05-17 17:11:27 -07:00
include/linux/genhd.h: move to use generic UUID library
2016-05-20 17:58:30 -07:00
mm: charge/uncharge kmemcg from generic page allocator paths
2016-07-26 16:19:19 -07:00
printk/nmi: generic solution for safe printk in NMI
2016-05-20 17:58:30 -07:00
<linux/hash.h>: Add support for architecture-specific functions
2016-05-28 15:48:31 -04:00
thp: extract khugepaged from mm/huge_memory.c
2016-07-26 16:19:19 -07:00
include/linux/hugetlb.h: use bool instead of int for hugepage_migration_supported()
2016-05-20 17:58:30 -07:00
include/linux/hugetlb*.h: clean up code
2016-05-20 17:58:30 -07:00
mm/hugetlb: is_vm_hugetlb_page() can return bool
2016-05-19 19:12:14 -07:00
net: diag: add missing declarations
2016-06-10 23:22:55 -07:00
fix up initial thread stack pointer vs thread_info confusion
2016-06-24 17:07:33 -07:00
genirq: Add a helper to spread an affinity mask for MSI/MSI-X vectors
2016-07-04 12:25:14 +02:00
PCI: Identify Enhanced Allocation (EA) BAR Equivalent resources in sysfs
2016-05-16 15:12:02 -05:00
Merge branch 'irq/for-block' into irq/core
2016-07-04 12:26:05 +02:00
Merge branch 'irq/for-block' into irq/core
2016-07-04 12:26:05 +02:00
isa: Dummy isa_register_driver should return error code
2016-06-17 20:47:11 -07:00
locking/static_key: Fix concurrent static_key_slow_inc()
2016-06-24 08:23:16 +02:00
mm/kasan: add API to check memory regions
2016-05-20 17:58:30 -07:00
mm: mempool: kasan: don't poot mempool objects in quarantine
2016-06-24 17:23:52 -07:00
rcu: sysctl: Panic on RCU Stall
2016-06-15 16:00:05 -07:00
driver core update for 4.7-rc1
2016-05-20 21:26:15 -07:00
s390/kexec: consolidate crash_map/unmap_reserved_pages() and arch_kexec_protect(unprotect)_crashkres()
2016-05-23 17:04:14 -07:00
thp: extract khugepaged from mm/huge_memory.c
2016-07-26 16:19:19 -07:00
mm: migrate: support non-lru movable page migration
2016-07-26 16:19:19 -07:00
KVM: Create debugfs dir and stat files for each VM
2016-05-25 16:12:05 +02:00
leds: core: Fix brightness setting upon hardware blinking enabled
2016-06-08 11:47:06 +02:00
hlist: Add hlist_is_singular_node() helper
2016-07-07 10:35:07 +02:00
Merge branches 'for-4.7/core', 'for-4.7/livepatching-doc' and 'for-4.7/livepatching-ppc64' into for-linus
2016-05-17 12:06:35 +02:00
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2016-05-16 14:47:16 -07:00
Merge branch 'next' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2016-05-19 09:21:36 -07:00
include/linux/memblock.h: Clean up code for several trivial details
2016-07-26 16:19:19 -07:00
mm: memcontrol: cleanup kmem charge functions
2016-07-26 16:19:19 -07:00
memory-hotplug: more general validation of zone during online
2016-07-26 16:19:19 -07:00
tmpfs: preliminary minor tidyups
2016-05-19 19:12:14 -07:00
include/linux: apply __malloc attribute
2016-05-19 19:12:14 -07:00
mm: migrate: support non-lru movable page migration
2016-07-26 16:19:19 -07:00
mm: postpone page table allocation until we have page to map
2016-07-26 16:19:19 -07:00
mm: update_lru_size do the __mod_zone_page_state
2016-05-19 19:12:14 -07:00
mm: clean up non-standard page->_mapcount users
2016-07-26 16:19:19 -07:00
include/linux/mmdebug.h: add VM_WARN which maps to WARN()
2016-07-26 16:19:19 -07:00
mm, rmap: account shmem thp pages
2016-07-26 16:19:19 -07:00
staging: fsl-mc: add support for device table matching
2016-06-26 17:14:03 -07:00
genirq/msi: Make use of affinity aware allocations
2016-07-04 12:25:14 +02:00
devpts: Make each mount of devpts an independent filesystem.
2016-06-05 10:36:01 -07:00
net: Don't forget pr_fmt on net_dbg_ratelimited for CONFIG_DYNAMIC_DEBUG
2016-06-15 22:07:57 -07:00
net: define gso types for IPx over IPv4 and IPv6
2016-05-20 18:03:15 -04:00
vlan: use a valid default mtu value for vlan over macsec
2016-07-16 20:15:02 -07:00
pnfs: rework LAYOUTGET retry handling
2016-05-17 15:48:12 -04:00
Merge branch 'work.preadv2' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
2016-05-17 15:05:23 -07:00
NFS: Add COPY nfs operation
2016-05-17 15:47:55 -04:00
NFS client updates for Linux 4.7
2016-05-26 10:33:33 -07:00
nilfs2: fix block comments
2016-05-23 17:04:14 -07:00
Revert "perf/x86/intel, watchdog: Switch NMI watchdog to ref cycles on x86"
2016-07-10 20:58:36 +02:00
include/linux/nodemask.h: create next_node_in() helper
2016-05-19 19:12:14 -07:00
nvmem: Declare nvmem_cell_read() consistently
2016-06-25 07:42:55 -07:00
Merge branch 'clockevents/4.8' of http://git.linaro.org/people/daniel.lezcano/linux into timers/core
2016-07-07 15:41:13 +02:00
drivers: of: Fix of_pci.h header guard
2016-06-08 08:18:06 -05:00
drivers: of: add definition of early_init_dt_alloc_reserved_memory_arch
2016-06-09 14:38:22 -05:00
mm,oom: remove unused argument from oom_scan_process_thread().
2016-07-26 16:19:19 -07:00
kernel/padata.c: removed unused code
2016-05-19 19:12:14 -07:00
page-flags: relax policy for PG_mappedtodisk and PG_reclaim
2016-07-26 16:19:19 -07:00
mm/page_owner: use stackdepot to store stacktrace
2016-07-26 16:19:19 -07:00
mm: check the return value of lookup_page_ext for all call sites
2016-06-03 15:06:22 -07:00
mm/page_owner: introduce split_page_owner and replace manual handling
2016-07-26 16:19:19 -07:00
mm: rename _count, field of the struct page, to _refcount
2016-05-19 19:12:14 -07:00
mm, memcg: use consistent gfp flags during readahead
2016-07-26 16:19:19 -07:00
PCI changes for the v4.7 merge window:
2016-05-19 13:10:54 -07:00
percpu, locking: Revert ("percpu: Replace smp_read_barrier_depends() with lockless_dereference()")
2016-06-03 12:06:11 +02:00
printk/nmi: generic solution for safe printk in NMI
2016-05-20 17:58:30 -07:00
Merge branch 'linus' into perf/core, to refresh the branch
2016-06-08 09:26:46 +02:00
fs: poll/select/recvmmsg: use timespec64 for timeout events
2016-05-19 19:12:14 -07:00
posix_acl: de-union a_refcount and a_rcu
2016-07-11 13:48:02 -04:00
printk: Make the printk*once() variants return a value
2016-07-08 11:33:18 +02:00
pwm: Fix pwm_apply_args()
2016-06-23 18:37:05 +02:00
radix-tree: implement radix_tree_maybe_preload_order()
2016-07-26 16:19:19 -07:00
x86, asm: use bool for bitops and other assembly outputs
2016-06-08 12:41:20 -07:00
rcu: Make call_rcu_tasks() tolerate first call with irqs disabled
2016-06-15 15:45:00 -07:00
reservation: add headerdoc comments
2016-05-31 22:12:43 +05:30
reset: TRIVIAL: Add line break at same place for similar APIs
2016-06-29 21:24:53 +02:00
rmap: support file thp
2016-07-26 16:19:19 -07:00
locking/rwsem: Convert sem->count to 'atomic_long_t'
2016-06-08 15:16:42 +02:00
sched/fair: Fix PELT integrity for new tasks
2016-06-27 12:17:53 +02:00
sctp: sctp_diag should dump sctp socket type
2016-05-31 11:59:06 -07:00
Merge branch 'work.const-path' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
2016-05-17 14:41:03 -07:00
locking/seqcount: Re-fix raw_read_seqcount_latch()
2016-06-03 08:37:25 +02:00
tty/serial/8250: use mctrl_gpio helpers
2016-06-25 14:30:42 -07:00
earlycon: mark earlycon code as __used iif the caller is built-in
2016-06-25 14:31:04 -07:00
x86/sfi: Enable enumeration of SD devices
2016-07-13 09:24:51 +02:00
khugepaged: add support of collapse for tmpfs/shmem pages
2016-07-26 16:19:19 -07:00
signal: move the "sig < SIGRTMIN" check into siginmask(sig)
2016-05-23 17:04:14 -07:00
net_sched: fix mirrored packets checksum
2016-07-01 16:19:34 -04:00
mm: faster kmalloc_array(), kcalloc()
2016-07-26 16:19:19 -07:00
mm: reorganize SLAB freelist randomization
2016-07-26 16:19:19 -07:00
mm: SLUB freelist randomization
2016-07-26 16:19:19 -07:00
sock_diag: do not broadcast raw socket destruction
2016-06-28 09:08:51 -04:00
locking/spinlock, arch: Update and fix spin_unlock_wait() implementations
2016-06-14 11:55:15 +02:00
include/linux: apply __malloc attribute
2016-05-19 19:12:14 -07:00
fs/namei.c: Add hashlen_string() function
2016-05-28 15:42:50 -04:00
mm, oom: rework oom detection
2016-05-20 17:58:30 -07:00
include/linux/syscalls.h: use pid_t instead of int
2016-05-20 17:58:30 -07:00
thermal: add the note for set_trip_temp
2016-06-01 22:25:48 +08:00
time: Add time64_to_tm()
2016-06-20 12:47:15 -07:00
time: remove timespec_add_safe()
2016-05-19 19:12:14 -07:00
time: Make settimeofday error checking work again
2016-06-01 21:13:43 +02:00
timers: Remove set_timer_slack() leftovers
2016-07-07 10:35:09 +02:00
torture: Break online and offline functions out of torture_onoff()
2016-06-14 16:02:16 -07:00
This includes two new updates for the ftrace infrastructure.
2016-05-18 18:55:19 -07:00
TTY and Serial driver update for 4.7-rc1
2016-05-20 20:57:27 -07:00
signal: make oom_flags a bool
2016-05-23 17:04:14 -07:00
mm: introduce fault_env
2016-07-26 16:19:19 -07:00
lib/uuid.c: remove FSF address
2016-05-20 17:58:30 -07:00
thp, vmstats: add counters for huge file pages
2016-07-26 16:19:19 -07:00
Merge branch 'drm-next' of git://people.freedesktop.org/~airlied/linux
2016-05-23 11:48:48 -07:00
mm, page_alloc: inline zone_statistics
2016-05-19 19:12:14 -07:00
tty: vt, ignore PIO_UNIMAPCLR param
2016-06-25 09:04:48 -07:00
sched/cputime: Reorganize vtime native irqtime accounting headers
2016-07-14 10:42:35 +02:00
fs/fs-writeback.c: add a new writeback list for sync
2016-07-26 16:19:19 -07:00
switch ->setxattr() to passing dentry and inode separately
2016-05-27 20:09:16 -04:00
zsmalloc: require GFP in zs_malloc()
2016-05-20 17:58:30 -07:00
