Repository files (latest commit first)

Filename	Latest commit message	Latest commit date
Jann Horn 48b00ceb54 mm/khugepaged: fix GUP-fast interaction by sending IPI ... commit 2ba99c5e08812494bc57f319fb562f527d9bacd8 upstream. Since commit 70cbc3cc78a99 ("mm: gup: fix the fast GUP race against THP collapse"), the lockless_pages_from_mm() fastpath rechecks the pmd_t to ensure that the page table was not removed by khugepaged in between. However, lockless_pages_from_mm() still requires that the page table is not concurrently freed. Fix it by sending IPIs (if the architecture uses semi-RCU-style page table freeing) before freeing/reusing page tables. Link: https://lkml.kernel.org/r/20221129154730.2274278-2-jannh@google.com Link: https://lkml.kernel.org/r/20221128180252.1684965-2-jannh@google.com Link: https://lkml.kernel.org/r/20221125213714.4115729-2-jannh@google.com Fixes: ba76149f47 ("thp: khugepaged") Signed-off-by: Jann Horn <jannh@google.com> Reviewed-by: Yang Shi <shy828301@gmail.com> Acked-by: David Hildenbrand <david@redhat.com> Cc: John Hubbard <jhubbard@nvidia.com> Cc: Peter Xu <peterx@redhat.com> Cc: <stable@vger.kernel.org> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> [manual backport: two of the three places in khugepaged that can free ptes were refactored into a common helper between 5.15 and 6.0; TLB flushing was refactored between 5.4 and 5.10] Signed-off-by: Jann Horn <jannh@google.com> Signed-off-by: Sasha Levin <sashal@kernel.org>		2022-12-14 11:30:42 +01:00
..
bitops	locking/atomic: Make test_and_*_bit() ordered on failure	2022-08-25 11:18:31 +02:00
vdso
4level-fixup.h
5level-fixup.h
asm-offsets.h
asm-prototypes.h
atomic-instrumented.h
atomic-long.h
atomic.h
atomic64.h
audit_change_attr.h
audit_dir_write.h
audit_read.h
audit_signal.h
audit_write.h
barrier.h
bitops-instrumented.h
bitops.h
bitsperlong.h
bug.h
bugs.h
cache.h
cacheflush.h
checksum.h
cmpxchg-local.h
cmpxchg.h
compat.h
current.h
delay.h
device.h
div64.h
dma-contiguous.h
dma-mapping.h
dma.h
early_ioremap.h
emergency-restart.h
error-injection.h
exec.h
export.h
extable.h
fb.h
fixmap.h
flat.h
ftrace.h
futex.h
getorder.h
gpio.h
hardirq.h
hugetlb.h
hw_irq.h
ide_iops.h
int-ll64.h
io.h
ioctl.h
iomap.h
irq.h
irq_regs.h
irq_work.h
irqflags.h
Kbuild
kdebug.h
kmap_types.h
kprobes.h
kvm_para.h
linkage.h
local.h
local64.h
mcs_spinlock.h
memory_model.h
mm-arch-hooks.h
mm_hooks.h
mmiowb.h	asm-generic/mmiowb: Allow mmiowb_set_pending() when preemptible()	2020-07-29 10:18:40 +02:00
mmiowb_types.h
mmu.h
mmu_context.h
module.h
mshyperv.h	x86/Hyper-V: Report crash data in die() when panic_on_oops is set	2020-04-23 10:36:24 +02:00
msi.h
page.h
param.h
parport.h
pci.h
pci_iomap.h
percpu.h
pgalloc.h
pgtable-nop4d-hack.h
pgtable-nop4d.h
pgtable-nopmd.h
pgtable-nopud.h
pgtable.h	arch: pgtable: define MAX_POSSIBLE_PHYSMEM_BITS where needed	2020-12-02 08:49:50 +01:00
preempt.h
qrwlock.h
qrwlock_types.h
qspinlock.h
qspinlock_types.h
resource.h
seccomp.h
sections.h	asm-generic: sections: refactor memory_intersects	2022-09-05 10:27:43 +02:00
serial.h
set_memory.h
shmparam.h
signal.h
simd.h
spinlock.h
statfs.h
string.h
switch_to.h
syscall.h
syscalls.h
termios-base.h
termios.h
timex.h
tlb.h	mm/khugepaged: fix GUP-fast interaction by sending IPI	2022-12-14 11:30:42 +01:00
tlbflush.h
topology.h	include/asm-generic/topology.h: guard cpumask_of_node() macro argument	2020-06-03 08:21:27 +02:00
trace_clock.h
uaccess.h
unaligned.h
user.h
vga.h
vmlinux.lds.h	vmlinux.lds.h: Fix placement of '.data..decrypted' section	2022-11-25 17:42:09 +01:00
vtime.h
word-at-a-time.h
xor.h