Mel Gorman
d0164adc89
mm, page_alloc: distinguish between being unable to sleep, unwilling to sleep and avoiding waking kswapd ...
__GFP_WAIT has been used to identify atomic context in callers that hold
spinlocks or are in interrupts. They are expected to be high priority and
have access one of two watermarks lower than "min" which can be referred
to as the "atomic reserve". __GFP_HIGH users get access to the first
lower watermark and can be called the "high priority reserve".
Over time, callers had a requirement to not block when fallback options
were available. Some have abused __GFP_WAIT leading to a situation where
an optimisitic allocation with a fallback option can access atomic
reserves.
This patch uses __GFP_ATOMIC to identify callers that are truely atomic,
cannot sleep and have no alternative. High priority users continue to use
__GFP_HIGH. __GFP_DIRECT_RECLAIM identifies callers that can sleep and
are willing to enter direct reclaim. __GFP_KSWAPD_RECLAIM to identify
callers that want to wake kswapd for background reclaim. __GFP_WAIT is
redefined as a caller that is willing to enter direct reclaim and wake
kswapd for background reclaim.
This patch then converts a number of sites
o __GFP_ATOMIC is used by callers that are high priority and have memory
pools for those requests. GFP_ATOMIC uses this flag.
o Callers that have a limited mempool to guarantee forward progress clear
__GFP_DIRECT_RECLAIM but keep __GFP_KSWAPD_RECLAIM. bio allocations fall
into this category where kswapd will still be woken but atomic reserves
are not used as there is a one-entry mempool to guarantee progress.
o Callers that are checking if they are non-blocking should use the
helper gfpflags_allow_blocking() where possible. This is because
checking for __GFP_WAIT as was done historically now can trigger false
positives. Some exceptions like dm-crypt.c exist where the code intent
is clearer if __GFP_DIRECT_RECLAIM is used instead of the helper due to
flag manipulations.
o Callers that built their own GFP flags instead of starting with GFP_KERNEL
and friends now also need to specify __GFP_KSWAPD_RECLAIM.
The first key hazard to watch out for is callers that removed __GFP_WAIT
and was depending on access to atomic reserves for inconspicuous reasons.
In some cases it may be appropriate for them to use __GFP_HIGH.
The second key hazard is callers that assembled their own combination of
GFP flags instead of starting with something like GFP_KERNEL. They may
now wish to specify __GFP_KSWAPD_RECLAIM. It's almost certainly harmless
if it's missed in most cases as other activity will wake kswapd.
Signed-off-by: Mel Gorman <mgorman@techsingularity.net>
Acked-by: Vlastimil Babka <vbabka@suse.cz>
Acked-by: Michal Hocko <mhocko@suse.com>
Acked-by: Johannes Weiner <hannes@cmpxchg.org>
Cc: Christoph Lameter <cl@linux.com>
Cc: David Rientjes <rientjes@google.com>
Cc: Vitaly Wool <vitalywool@gmail.com>
Cc: Rik van Riel <riel@redhat.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2015-11-06 17:50:42 -08:00
ARM: 8446/1: amba: Remove unused callbacks for legacy system PM
2015-10-19 17:08:32 +01:00
brcmfmac: Add support for the BCM4365 and BCM4366 PCIE devices.
2015-09-29 10:56:05 +03:00
net/can: can_dropped_invalid_skb can be boolean
2015-10-09 07:49:01 -07:00
libceph: advertise support for keepalive2
2015-09-17 20:14:27 +03:00
clk: at91: add generated clock driver
2015-10-01 12:48:11 -07:00
dmaengine: hsu: remove platform data
2015-10-17 21:22:08 -07:00
extcon: gpio: Fix minor coding style and remove the unused fields.
2015-09-30 19:22:50 +09:00
add FPGA manager core
2015-10-07 18:08:15 +01:00
powerpc/fsl: Move fsl_guts.h out of arch/powerpc
2015-10-21 18:05:50 -05:00
gpiolib: provide generic request/free implementations
2015-10-16 22:11:16 +02:00
Power management and ACPI updates for v4.4-rc1
2015-11-04 18:10:13 -08:00
- New Device Support
2015-11-06 10:23:50 -08:00
net/mlx4_core: Replace VF zero mac with random mac in mlx4_core
2015-10-14 19:14:44 -07:00
net/mlx5_core: Wait for FW readiness on startup
2015-10-14 19:14:43 -07:00
mmc: mmc: extend the mmc_send_tuning()
2015-10-27 10:38:41 +01:00
net/nfnetlink: lockdep_nfnl_is_held can be boolean
2015-10-09 07:49:00 -07:00
inet netfilter: Remove hook from ip6t_do_table, arp_do_table, ipt_do_table
2015-09-18 21:57:43 +02:00
netfilter: ebtables: Simplify the arguments to ebt_do_table
2015-09-18 21:57:35 +02:00
inet netfilter: Remove hook from ip6t_do_table, arp_do_table, ipt_do_table
2015-09-18 21:57:43 +02:00
inet netfilter: Remove hook from ip6t_do_table, arp_do_table, ipt_do_table
2015-09-18 21:57:43 +02:00
drivers/pinctrl: Add the concept of an "init" state
2015-10-27 11:24:23 +01:00
TTY/Serial driver patches for 4.4-rc1
2015-11-04 21:35:12 -08:00
power: bq27xxx_battery: Add support for additional bq27xxx family devices
2015-09-23 17:15:27 +02:00
qed: Add statistics support
2015-10-27 19:34:54 -07:00
regulator: introduce min_dropout_uV
2015-10-16 17:57:33 +01:00
sched/deadline: Unify dl_time_before() usage
2015-09-23 09:51:25 +02:00
Merge remote-tracking branches 'spi/topic/omap-100k', 'spi/topic/omap-uwire', 'spi/topic/owner', 'spi/topic/pxa' and 'spi/topic/pxa2xx' into spi-next
2015-11-04 11:02:12 +00:00
SUNRPC: Ensure that we wait for connections to complete before retrying
2015-09-17 18:01:28 -04:00
USB patches for 4.4-rc1
2015-11-04 21:26:27 -08:00
Power management and ACPI updates for v4.4-rc1
2015-11-04 18:10:13 -08:00
atomic: remove all traces of READ_ONCE_CTRL() and atomic*_read_ctrl()
2015-11-03 17:22:17 -08:00
audit: audit_string_contains_control can be boolean
2015-11-04 08:23:51 -05:00
writeback: bdi_writeback iteration must not skip dying ones
2015-10-12 10:31:12 -06:00
Merge branch 'for-4.4' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup
2015-11-05 14:51:32 -08:00
blkcg: fix incorrect read/write sync/async stat accounting
2015-10-27 15:04:56 +09:00
block: generic request_queue reference counting
2015-10-21 14:43:41 -06:00
Merge branch 'for-4.4/reservations' of git://git.kernel.dk/linux-block
2015-11-04 21:01:27 -08:00
bpf: add support for persistent maps/progs
2015-11-02 22:48:39 -05:00
net: phy: Broadcom Cygnus internal Etherent PHY driver
2015-10-08 04:45:52 -07:00
cgroup: add cgroup_subsys->free() method and use it to fix pids controller
2015-10-15 16:41:53 -04:00
cgroup: keep zombies associated with their original cgroups
2015-10-15 16:41:53 -04:00
Merge branch 'for-4.3/blkcg' of git://git.kernel.dk/linux-block
2015-09-10 18:56:14 -07:00
clk: Add clk_hw_is_enabled() for use by clk providers
2015-10-26 12:36:55 -07:00
clockevents: Remove unused set_mode() callback
2015-09-14 11:00:55 +02:00
clocksource: cosmetic: Drop OF 'dependency' from symbols
2015-10-01 02:18:39 +02:00
mm: cma: fix incorrect type conversion for size during dma allocation
2015-10-23 17:55:10 +09:00
mm, compaction: distinguish contended status in tracepoints
2015-11-05 19:34:48 -08:00
include/linux/compiler-gcc.h: hide assume_aligned attribute from sparse
2015-11-05 19:34:48 -08:00
compiler.h: add support for function attribute assume_aligned
2015-11-05 19:34:48 -08:00
coresight: fixing typographical error
2015-10-07 17:54:09 +01:00
cpu: Remove try_get_online_cpus()
2015-10-07 16:02:49 -07:00
cpufreq: create cpu/cpufreq/policyX directories
2015-10-28 09:21:12 +01:00
mm, page_alloc: remove unnecessary taking of a seqlock when cpusets are disabled
2015-11-06 17:50:42 -08:00
net/dccp: dccp_list_has_service can be boolean
2015-10-09 07:49:02 -07:00
debugfs: Add debugfs_create_ulong()
2015-10-18 10:14:39 -07:00
PM / devfreq: comments for get_dev_status usage updated
2015-09-11 14:23:29 +09:00
dm: refactor ioctl handling
2015-10-31 19:05:59 -04:00
mm: cma: fix incorrect type conversion for size during dma allocation
2015-10-23 17:55:10 +09:00
iommu: Implement common IOMMU ops for DMA mapping
2015-10-15 16:41:04 +02:00
iommu/vt-d: Implement deferred invalidate for SVM
2015-10-15 13:22:35 +01:00
dma: Add support to program MIC x100 status descriptiors
2015-10-04 12:46:06 +01:00
driver core update for 4.4-rc1
2015-11-04 21:50:37 -08:00
efi: Use correct type for struct efi_memory_map::phys_map
2015-10-28 12:28:06 +01:00
extcon: Modify the id and name of external connector
2015-10-16 08:30:09 +09:00
debugfs: Pass bool pointer to debugfs_create_bool()
2015-10-04 11:36:07 +01:00
fb.h: Provide alternate screen_base pointer
2015-10-13 10:51:30 -07:00
vfs: Fix pathological performance case for __alloc_fd()
2015-10-31 16:12:10 -07:00
bpf: fix cb access in socket filter programs
2015-10-11 04:40:05 -07:00
Merge branch 'akpm' (patches from Andrew)
2015-11-05 23:10:54 -08:00
Power management and ACPI updates for v4.4-rc1
2015-11-04 18:10:13 -08:00
net/netlink: lockdep_genl_is_held can be boolean
2015-10-09 07:48:59 -07:00
block: move blk_integrity to request_queue
2015-10-21 14:43:42 -06:00
mm, page_alloc: distinguish between being unable to sleep, unwilling to sleep and avoiding waking kswapd
2015-11-06 17:50:42 -08:00
mm: hugetlb: proc: add HugetlbPages field to /proc/PID/status
2015-11-05 19:34:48 -08:00
cgroup: replace cgroup_subsys->disabled tests with cgroup_subsys_enabled()
2015-09-18 11:56:28 -04:00
drivers/hv: share Hyper-V SynIC constants with userspace
2015-11-04 16:24:33 +01:00
wireless: add WNM action frame categories
2015-10-13 10:34:46 +02:00
ieee802154: remove unnecessary includes
2015-09-24 20:42:37 +02:00
bridge: define some min/max/default ageing time constants
2015-09-23 14:35:58 -07:00
if_link: Add control trust VF
2015-10-23 05:44:28 -07:00
net/ipv4: Pass proto as u8 instead of u16 in ip_check_mc_rcu
2015-09-29 16:27:47 -07:00
net/inetdevice: bad_mask can be boolean
2015-10-09 07:49:05 -07:00
Merge branch 'for-4.4' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup
2015-11-05 14:51:32 -08:00
iommu/vt-d: Implement SVM_FLAG_PRIVATE_PASID to allocate unique PASIDs
2015-10-15 15:35:32 +01:00
iommu/vt-d: Expose struct svm_dev_ops without CONFIG_INTEL_IOMMU_SVM
2015-10-27 08:36:08 +09:00
genirq: Handle force threading of irqs with primary and thread handler
2015-09-22 12:39:57 +02:00
iommu-common: Fix error code used in iommu_tbl_range_{alloc,free}().
2015-11-04 11:30:57 -08:00
iommu: Add generic_device_group() function
2015-10-22 00:00:49 +02:00
ACPI/PCI: Enhance ACPI core to support sparse IO space
2015-10-16 22:18:51 +02:00
iommu: iova: Move iova cache management to the iova library
2015-10-04 12:46:06 +01:00
ipv6: inet6_sk() should use sk_fullsock()
2015-10-05 02:45:25 -07:00
genirq: Add flag to force mask in disable_irq[_nosync]()
2015-10-11 11:33:42 +02:00
virt: IRQ bypass manager
2015-10-01 15:06:43 +02:00
irqchip / ACPI: Add probing infrastructure for ACPI-based irqchips
2015-10-01 02:18:38 +02:00
genirq: Remove irq argument from irq flow handlers
2015-09-16 15:47:51 +02:00
irqdomain: Documentation updates
2015-10-13 19:01:25 +02:00
genirq: Remove irq argument from irq flow handlers
2015-09-16 15:47:51 +02:00
Document that IRQ_NONE should be returned when IRQ not actually handled
2015-10-30 10:13:26 +01:00
Merge branch 'for-4.4' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup
2015-11-05 14:51:32 -08:00
kexec: split kexec_load syscall from kexec core code
2015-09-10 13:29:01 -07:00
KEYS: Merge the type-specific data with the payload data
2015-10-21 15:18:36 +01:00
KEYS: Merge the type-specific data with the payload data
2015-10-21 15:18:36 +01:00
kmod: use system_unbound_wq instead of khelper
2015-09-10 13:29:01 -07:00
kobject: explain what kobject's sd field is
2015-10-04 11:46:16 +01:00
KVM: x86: move kvm_set_irq_inatomic to legacy device assignment
2015-11-04 16:24:36 +01:00
KVM: eventfd: add irq bypass consumer management
2015-10-01 15:06:46 +02:00
arcnet: com20020-pci: add led trigger support
2015-10-26 09:10:56 +01:00
ata: ahci: find eSATA ports and flag them as removable
2015-09-30 17:37:55 -04:00
lightnvm: refactor phys addrs type to u64
2015-11-03 09:53:24 -07:00
rculist: Use WRITE_ONCE() when deleting from reader-visible list
2015-10-06 11:16:42 -07:00
rculist: Use WRITE_ONCE() when deleting from reader-visible list
2015-10-06 11:16:42 -07:00
rculist: Use WRITE_ONCE() when deleting from reader-visible list
2015-10-06 11:16:42 -07:00
mei: bus: use mei_cldev_ prefix for the API functions
2015-09-20 19:31:10 -07:00
mm/memblock: make memblock_remove_range() static
2015-11-05 19:34:48 -08:00
Merge branch 'akpm' (patches from Andrew)
2015-11-05 23:10:54 -08:00
mm: memory hotplug with an existing resource
2015-10-23 14:19:58 +01:00
misc: mic: Remove COSM functionality from the MIC card driver
2015-10-04 12:46:06 +01:00
mm: introduce VM_LOCKONFAULT
2015-11-05 19:34:48 -08:00
mm: hugetlb: proc: add HugetlbPages field to /proc/PID/status
2015-11-05 19:34:48 -08:00
mm: introduce idle page tracking
2015-09-10 13:29:01 -07:00
mm, page_alloc: use masks and shifts when converting GFP flags to migrate types
2015-11-06 17:50:42 -08:00
mei: bus: add client protocol version to the device alias
2015-09-20 19:30:10 -07:00
lib/mpi: clean unused SHA1_DIGEST_LENGTH
2015-10-20 22:10:45 +08:00
PCI/MSI: Allow the MSI domain to be device-specific
2015-10-16 13:07:16 +01:00
tty: r3964: Replace/remove bogus tty lock use
2015-10-17 21:11:29 -07:00
net: move net_get_random_once to lib
2015-10-08 05:26:35 -07:00
net/core: fix for_each_netdev_feature
2015-11-03 11:29:57 -05:00
Merge branch 'parisc-4.3-2' of git://git.kernel.org/pub/scm/linux/kernel/git/deller/parisc-linux
2015-11-04 11:30:22 -08:00
netfilter: turn NF_HOOK into an inline function
2015-10-16 18:45:36 +02:00
netfilter: Pass net into okfn
2015-09-17 17:18:37 -07:00
netfilter: Store net in nf_hook_state
2015-09-17 17:18:32 -07:00
ipv4: Pass struct net into ip_route_me_harder
2015-09-29 20:21:32 +02:00
ipv6: Pass struct net through ip6_fragment
2015-09-30 01:45:03 -05:00
kernel/watchdog.c: perform all-CPU backtrace in case of hard lockup
2015-11-05 19:34:48 -08:00
nvme: include <linux/types.ĥ> in <linux/nvme.h>
2015-10-09 10:40:37 -06:00
gpiolib: Add and use OF_GPIO_SINGLE_ENDED flag
2015-10-16 22:49:26 +02:00
of/irq: Use the msi-map property to provide device-specific MSI domain
2015-10-16 13:07:15 +01:00
ARM: OMAP1: fix incorrect INT_DMA_LCD
2015-10-28 10:05:58 -07:00
once: make helper generic for calling functions once
2015-10-08 05:26:36 -07:00
mm: optimize PageHighMem() check
2015-11-05 19:34:48 -08:00
mm: page_counter: let page_counter_try_charge() return bool
2015-11-05 19:34:48 -08:00
mm: introduce idle page tracking
2015-09-10 13:29:01 -07:00
mm: introduce idle page tracking
2015-09-10 13:29:01 -07:00
PCI/ACPI: Add interface acpi_pci_root_create()
2015-10-16 22:18:51 +02:00
locking/percpu-rwsem: Make use of the rcu_sync infrastructure
2015-10-06 11:25:31 -07:00
perf/core: Drop PERF_EVENT_TXN
2015-09-13 11:27:30 +02:00
net: phy: Add nested variants of mdiobus read/write
2015-10-23 05:57:43 -07:00
driver-core: platform: Provide helpers for multi-driver modules
2015-10-05 05:02:40 +01:00
PM / PCI / ACPI: Kick devices that might have been reset by firmware
2015-10-14 02:17:34 +02:00
PM / Domains: Merge measurements for PM QoS device latencies
2015-10-28 04:33:04 +01:00
PM / OPP: Prefix exported opp routines with dev_pm_opp_
2015-09-15 02:03:16 +02:00
include/linux/poison.h: remove not-used poison pointer macros
2015-09-10 13:29:01 -07:00
ntp/pps: use y2038 safe types in pps_event_time
2015-10-01 09:59:16 -07:00
block: add an API for Persistent Reservations
2015-10-21 14:46:56 -06:00
sched/core: Kill PREEMPT_ACTIVE
2015-10-06 17:08:19 +02:00
hexdump: do not print debug dumps for !CONFIG_DEBUG
2015-09-10 13:29:01 -07:00
device property: Add fwnode_property_match_string()
2015-09-25 02:00:19 +02:00
pstore: add pstore unregister
2015-10-22 08:59:18 -07:00
ptp: Change ptp_class to a proper bitmask
2015-11-03 11:08:22 -05:00
spi: pxa2xx: Add support for Intel Broxton
2015-10-30 11:18:05 +09:00
random32: add prandom_init_once helper for own rngs
2015-10-08 05:26:38 -07:00
rcu_sync: Cleanup the CONFIG_PROVE_RCU checks
2015-10-06 11:25:45 -07:00
rculist: Make list_entry_rcu() use lockless_dereference()
2015-10-06 11:16:18 -07:00
rcu: Remove deprecated rcu_lockdep_assert()
2015-10-06 11:16:31 -07:00
rcu: Don't disable preemption for Tiny and Tree RCU readers
2015-10-06 11:08:23 -07:00
rcu: Use rcu_callback_t in call_rcu*() and friends
2015-10-06 11:08:05 -07:00
Merge remote-tracking branches 'regmap/topic/atomic', 'regmap/topic/debugfs' and 'regmap/topic/irq-hdr' into regmap-next
2015-10-12 19:25:07 +01:00
net/core: lockdep_rtnl_is_held can be boolean
2015-10-09 07:49:06 -07:00
Merge branch 'akpm' (patches from Andrew)
2015-11-05 23:10:54 -08:00
misc: mic: SCIF RMA header file and IOCTL changes
2015-10-04 12:54:54 +01:00
seccomp, ptrace: add support for dumping seccomp filters
2015-10-27 19:55:13 -07:00
security: fix typo in security_task_prctl
2015-09-20 17:00:26 -07:00
fs/seq_file: convert int seq_vprint/seq_printf/etc... returns to void
2015-09-11 15:21:34 -07:00
mm, page_alloc: distinguish between being unable to sleep, unwilling to sleep and avoiding waking kswapd
2015-11-06 17:50:42 -08:00
slab: convert slab_is_available() to boolean
2015-11-05 19:34:48 -08:00
stop_machine: Kill smp_hotplug_thread->pre_unpark, introduce stop_machine_unpark()
2015-10-20 10:23:55 +02:00
spmi: Auto-populate driver.owner in spmi_driver_register()
2015-09-20 19:32:02 -07:00
rcu: Move preemption disabling out of __srcu_read_lock()
2015-10-06 11:15:43 -07:00
stm class: Introduce an abstraction for System Trace Module devices
2015-10-04 20:28:58 +01:00
stop_machine: Kill smp_hotplug_thread->pre_unpark, introduce stop_machine_unpark()
2015-10-20 10:23:55 +02:00
string: provide strscpy()
2015-09-10 15:36:59 -04:00
lib/string_helpers: rename "esc" arg to "only"
2015-09-10 13:29:01 -07:00
PM / sleep: Add flags to indicate platform firmware involvement
2015-10-14 02:17:33 +02:00
mm: mlock: add new mlock system call
2015-11-05 19:34:48 -08:00
sysfs: added __compat_only_sysfs_link_entry_to_kobj()
2015-10-19 01:01:19 +02:00
block: Consolidate static integrity profile properties
2015-10-21 14:42:38 -06:00
tcp: fastopen: limit max_qlen
2015-10-22 06:22:13 -07:00
thermal: Add a function to get the minimum power
2015-09-14 07:39:46 -07:00
ti-st: use worker instead of calling st_int_write in wake up
2015-09-20 22:52:13 -07:00
ntp/pps: replace getnstime_raw_and_real with 64-bit version
2015-10-01 09:59:01 -07:00
ntp/pps: use timespec64 for hardpps()
2015-10-01 09:57:59 -07:00
tpm: seal/unseal for TPM 2.0
2015-10-19 01:01:21 +02:00
memcg: punt high overage reclaim to return-to-userland path
2015-11-05 19:34:48 -08:00
tty: Abstract tty buffer work
2015-10-17 21:32:21 -07:00
rcu: force alignment on struct callback_head/rcu_head
2015-11-05 19:34:48 -08:00
uaccess: reimplement probe_kernel_address() using probe_kernel_read()
2015-11-05 19:34:48 -08:00
usb: store the new usb 3.1 SuperSpeedPlus device capability descriptor
2015-10-04 10:34:17 +01:00
include/linux/vm_event_item.h: change HIGHMEM_ZONE macro definition
2015-11-05 19:34:48 -08:00
mm: get rid of 'vmalloc_info' from /proc/meminfo
2015-11-01 17:09:15 -08:00
vme: 8-bit status/id takes 256 values, not 255
2015-10-17 22:03:00 -07:00
mm: remove refresh_cpu_vm_stats() definition for !SMP kernel
2015-11-05 19:34:48 -08:00
userfaultfd: revert "userfaultfd: waitqueue: add nr wake parameter to __wake_up_locked_key"
2015-09-22 15:09:53 -07:00
zpool: add zpool_has_pool()
2015-09-10 13:29:01 -07:00
