Eric Biggers
db2f42e775
fs-verity: implement readahead of Merkle tree pages ...
When fs-verity verifies data pages, currently it reads each Merkle tree
page synchronously using read_mapping_page().
Therefore, when the Merkle tree pages aren't already cached, fs-verity
causes an extra 4 KiB I/O request for every 512 KiB of data (assuming
that the Merkle tree uses SHA-256 and 4 KiB blocks). This results in
more I/O requests and performance loss than is strictly necessary.
Therefore, implement readahead of the Merkle tree pages.
For simplicity, we take advantage of the fact that the kernel already
does readahead of the file's *data*, just like it does for any other
file. Due to this, we don't really need a separate readahead state
(struct file_ra_state) just for the Merkle tree, but rather we just need
to piggy-back on the existing data readahead requests.
We also only really need to bother with the first level of the Merkle
tree, since the usual fan-out factor is 128, so normally over 99% of
Merkle tree I/O requests are for the first level.
Therefore, make fsverity_verify_bio() enable readahead of the first
Merkle tree level, for up to 1/4 the number of pages in the bio, when it
sees that the REQ_RAHEAD flag is set on the bio. The readahead size is
then passed down to ->read_merkle_tree_page() for the filesystem to
(optionally) implement if it sees that the requested page is uncached.
While we're at it, also make build_merkle_tree_level() set the Merkle
tree readahead size, since it's easy to do there.
However, for now don't set the readahead size in fsverity_verify_page(),
since currently it's only used to verify holes on ext4 and f2fs, and it
would need parameters added to know how much to read ahead.
This patch significantly improves fs-verity sequential read performance.
Some quick benchmarks with 'cat'-ing a 250MB file after dropping caches:
On an ARM64 phone (using sha256-ce):
Before: 217 MB/s
After: 263 MB/s
(compare to sha256sum of non-verity file: 357 MB/s)
In an x86_64 VM (using sha256-avx2):
Before: 173 MB/s
After: 215 MB/s
(compare to sha256sum of non-verity file: 223 MB/s)
Link: https://lore.kernel.org/r/20200106205533.137005-1-ebiggers@kernel.org
Reviewed-by: Theodore Ts'o <tytso@mit.edu>
Signed-off-by: Eric Biggers <ebiggers@google.com>
2020-02-13 15:02:43 -08:00
can: af_can: export can_sock_destruct()
2019-11-13 10:42:33 +01:00
libceph: add function that clears osd client's abort_err
2019-09-16 12:06:23 +02:00
clk: add include guard to clk-conf.h
2019-09-17 10:27:46 -07:00
net: dsa: sja1105: Fix sleeping while atomic in .port_hwtstamp_set
2019-10-02 12:19:53 -04:00
Char/Misc driver patches for 5.4-rc1
2019-09-18 11:14:31 -07:00
gpiolib: Initialize the hardware with a callback
2019-10-15 01:18:46 +02:00
chrome platform changes for v5.4
2019-09-19 14:14:28 -07:00
Merge branch 'next' into for-linus
2019-09-16 09:56:27 -07:00
mailbox: mediatek: cmdq: clear the event in cmdq initial flow
2019-09-17 00:40:05 -05:00
- New Drivers
2019-09-23 19:37:49 -07:00
net/mlx5: Fix flow counter list auto bits struct
2019-10-29 16:27:17 -07:00
dma-mapping updates for 5.4:
2019-09-19 13:27:23 -07:00
This pull-request contains the following changes for MTD:
2019-09-21 10:59:54 -07:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
dmaengine: imx-sdma: fix size check for sdma script_number
2019-10-14 13:33:44 +05:30
RDMA subsystem updates for 5.4
2019-09-21 10:26:24 -07:00
exit/exec: Seperate mm_release()
2019-11-29 10:10:10 +01:00
drm main pull for 5.4-rc1
2019-09-19 16:24:24 -07:00
soundwire: stream: make stream name a const pointer
2019-09-04 14:57:28 +05:30
SUNRPC: Destroy the back channel when we destroy the host transport
2019-10-30 12:04:35 -04:00
USB changes for 5.4-rc1
2019-09-18 10:33:46 -07:00
Merge branch 'next-lockdown' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2019-09-28 08:14:15 -07:00
bitmap.h: fix kernel-doc warning and typo
2019-10-14 15:04:01 -07:00
lib: introduce copy_struct_from_user() helper
2019-10-01 15:45:03 +02:00
block: Delay default elevator initialization
2019-09-05 19:52:34 -06:00
block: add zone open, close and finish operations
2020-01-07 16:02:44 -08:00
block: don't handle bio based drivers in blk_revalidate_disk_zones
2020-01-07 16:02:50 -08:00
bpf: Change size to u64 for bpf_map_{area_alloc, charge_init}()
2019-10-31 21:41:33 +01:00
kprobes: Prohibit probing on BUG() and WARN() address
2019-09-05 10:15:16 +02:00
Merge branches 'clk-init-destroy', 'clk-doc', 'clk-imx' and 'clk-allwinner' into clk-next
2019-09-19 15:31:27 -07:00
We have a small collection of core framework updates this time, mostly around
2019-09-20 15:45:07 -07:00
mm, compaction: raise compaction priority after it withdrawns
2019-09-24 15:54:10 -07:00
futex: Move futex exit handling into futex code
2019-11-29 10:10:08 +01:00
include/linux/compiler.h: fix Oops for Clang-compiled kernels
2019-09-08 14:53:58 +02:00
compiler_attributes.h: Add 'fallthrough' pseudo keyword for switch/case use
2019-10-11 09:26:05 -07:00
Make use of gcc 9's "asm inline()" (Rasmus Villemoes):
2019-09-21 09:47:19 -07:00
driver-core: add include guard to linux/container.h
2019-09-04 13:38:26 +02:00
cpu/speculation: Uninline and export CPU mitigations helpers
2019-11-04 12:22:02 +01:00
cpufreq: Use per-policy frequency QoS
2019-10-21 02:05:21 +02:00
Power management updates for 5.4-rc1
2019-09-17 19:15:14 -07:00
cpumask: nicer for_each_cpumask_and() signature
2019-09-25 17:51:40 -07:00
selinux/stable-5.4 PR 20190917
2019-09-23 11:21:04 -07:00
block: rework zone reporting
2020-01-07 16:02:47 -08:00
USB changes for 5.4-rc1
2019-09-18 10:33:46 -07:00
dma-mapping updates for 5.4:
2019-09-19 13:27:23 -07:00
dynamic_debug: provide dynamic_hex_dump stub
2019-10-22 12:54:44 -07:00
EDAC: Prefer 'unsigned int' to bare use of 'unsigned'
2019-09-03 19:21:19 +02:00
x86, efi: Never relocate kernel below lowest acceptable address
2019-10-31 09:40:19 +01:00
block: Introduce elevator features
2019-09-05 19:52:33 -06:00
symbol namespaces: revert to previous __ksymtab name scheme
2019-10-18 15:32:52 +02:00
f2fs: support data compression
2020-01-28 10:35:38 -08:00
bpf: Fix use after free in subprog's jited symbol removal
2019-10-22 11:26:09 -07:00
Highlights:
2019-09-27 17:00:27 -07:00
fuse update for 5.4
2019-09-25 09:55:59 -07:00
fscrypt: improve format of no-key names
2020-02-13 15:02:43 -08:00
fs-verity: implement readahead of Merkle tree pages
2020-02-13 15:02:43 -08:00
futex: Add mutex around futex exit
2019-11-29 10:10:13 +01:00
net: fix sk_page_frag() recursion from memory reclaim
2019-10-28 16:17:31 -07:00
Linux 5.3-rc7
2019-09-05 11:40:54 +02:00
HID: core: Add printk_once variants to hid_warn() etc
2019-09-18 15:58:13 +02:00
libnvdimm fixes v5.4-rc1
2019-09-29 10:33:41 -07:00
mm: introduce page_size()
2019-09-24 15:54:08 -07:00
hwmon: Fix HWMON_P_MIN_ALARM mask
2019-10-02 06:36:50 -07:00
- First round of vmbus hibernation support from Dexuan Cui.
2019-09-24 12:36:31 -07:00
Merge branch 'i2c/for-5.4' of git://git.kernel.org/pub/scm/linux/kernel/git/wsa/linux
2019-09-24 16:48:02 -07:00
XArray updates for 5.4
2019-11-08 08:46:49 -08:00
net: remove unnecessary variables and callback
2019-10-24 14:53:49 -07:00
team: fix nested locking lockdep warning
2019-10-24 14:53:48 -07:00
net: remove unnecessary variables and callback
2019-10-24 14:53:49 -07:00
Merge branch 'next-lockdown' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2019-09-28 08:14:15 -07:00
iommu/vt-d: Fix QI_DEV_IOTLB_PFSID and QI_DEV_EIOTLB_PFSID macros
2019-11-11 16:10:54 +01:00
Power management updates for 5.4-rc1
2019-09-17 19:15:14 -07:00
augmented rbtree: add new RB_DECLARE_CALLBACKS_MAX macro
2019-09-25 17:51:39 -07:00
iomap: move the iomap_dio_rw ->end_io callback into a structure
2019-09-19 15:32:45 -07:00
jbd2: Fix possible overflow in jbd2_log_space_left()
2019-12-13 08:42:53 +01:00
kernel.h: Add non_block_start/end()
2019-09-07 04:28:05 -03:00
kernfs: fix ino wrap-around detection
2019-12-13 08:42:53 +01:00
Merge branch 'next-lockdown' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2019-09-28 08:14:15 -07:00
kgdb: don't use a notifier to enter kgdb at panic; call directly
2019-09-25 17:51:40 -07:00
khugepaged: enable collapse pmd for pte-mapped THP
2019-09-24 15:54:11 -07:00
Bugfixes: unwinding of KVM_CREATE_VM failure,
2019-11-12 13:19:15 -08:00
leds: core: Fix leds.h structure documentation
2019-10-08 22:05:58 +02:00
Merge branch 'next-lockdown' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2019-09-28 08:14:15 -07:00
include: mdio: Add driver data helpers
2019-09-05 12:32:05 +02:00
mm, memcg: make scan aggression always exclude protection
2019-10-07 15:47:20 -07:00
mm/memory_hotplug: fix try_offline_node()
2019-11-15 18:34:00 -08:00
Revert "Revert "mm, thp: restore node-local hugepage allocations""
2019-09-28 14:05:38 -07:00
libnvdimm fixes v5.4-rc1
2019-09-29 10:33:41 -07:00
net: phy: micrel: Update KSZ87xx PHY name
2019-10-17 16:31:52 -07:00
net: phy: fix write to mii-ctrl1000 register
2019-10-04 18:11:08 -07:00
rfkill: allocate static minor
2019-12-13 08:43:18 +01:00
mm: thp: handle page cache THP correctly in PageTransCompoundMap
2019-11-06 08:28:58 -08:00
mm: thp: handle page cache THP correctly in PageTransCompoundMap
2019-11-06 08:28:58 -08:00
fork: improve error message for corrupted page tables
2019-09-25 17:51:40 -07:00
mm/mmu_notifiers: annotate with might_sleep()
2019-09-07 04:28:04 -03:00
mm: thp: extract split_queue_* into a struct
2019-09-24 15:54:11 -07:00
Merge branch 'next-integrity' of git://git.kernel.org/pub/scm/linux/kernel/git/zohar/linux-integrity
2019-09-27 19:37:27 -07:00
net: remove unnecessary variables and callback
2019-10-24 14:53:49 -07:00
netfilter: remove CONFIG_NETFILTER checks from headers.
2019-09-13 12:47:36 +02:00
netfilter: move nf_bridge_frag_data struct definition to a more appropriate header.
2019-09-13 12:35:33 +02:00
netfilter: move nf_bridge_frag_data struct definition to a more appropriate header.
2019-09-13 12:35:33 +02:00
NFS: Refactor nfs_instantiate() for dentry referencing callers
2019-09-20 15:15:24 -04:00
gpio: of: Make of_gpio_simple_xlate() private
2019-09-11 14:46:02 +01:00
padata: remove cpu_index from the parallel_queue
2019-09-13 21:15:41 +10:00
mm: thp: handle page cache THP correctly in PageTransCompoundMap
2019-11-06 08:28:58 -08:00
mm, page_owner: rename flag indicating that page is allocated
2019-10-14 15:04:00 -07:00
mm: page cache: store only head pages in i_pages
2019-09-24 15:54:08 -07:00
pagewalk: separate function pointers from iterator data
2019-09-07 04:28:04 -03:00
pci-v5.4-changes
2019-09-23 19:16:01 -07:00
pci-v5.4-changes
2019-09-23 19:16:01 -07:00
perf/headers: Fix spelling s/EACCESS/EACCES/, s/privilidge/privilege/
2019-10-28 11:02:01 +01:00
net: phy: extract pause mode
2019-10-04 18:11:08 -07:00
net: fixed_phy: Add forward declaration for struct gpio_desc;
2019-09-05 11:54:14 +02:00
driver core: platform: Add platform_get_irq_byname_optional()
2019-10-07 12:52:44 +02:00
PM: QoS: Drop frequency QoS types from device PM QoS
2019-10-21 02:05:21 +02:00
posix-cpu-timers: Always clear head pointer on dequeue
2019-09-05 21:16:22 +02:00
lib/hexdump: make print_hex_dump_bytes() a nop on !DEBUG builds
2019-09-25 17:51:39 -07:00
pwm: Ensure pwm_apply_state() doesn't modify the state argument
2019-09-21 03:25:10 +02:00
quota: fix wrong condition in is_quota_modification()
2019-09-12 12:09:16 +02:00
radix tree: Remove radix_tree_iter_find
2019-11-01 22:26:34 -04:00
vfs: Convert ramfs, shmem, tmpfs, devtmpfs, rootfs to use the new mount API
2019-09-12 21:05:34 -04:00
augmented rbtree: rework the RB_DECLARE_CALLBACKS macro definition
2019-09-25 17:51:39 -07:00
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2019-09-16 17:25:49 -07:00
tasks, sched/core: With a grace period after finish_task_switch(), remove unnecessary code
2019-09-25 17:42:29 +02:00
reset: fix reset_control_ops kerneldoc comment
2019-10-28 12:18:23 +01:00
reset: fix reset_control_get_exclusive kerneldoc comment
2019-10-24 10:26:33 +02:00
cifs: Add support for root file systems
2019-09-16 11:43:38 -05:00
futex: Add mutex around futex exit
2019-11-29 10:10:13 +01:00
efi/efi_test: Lock down /dev/efi_test and require CAP_SYS_ADMIN
2019-10-31 09:40:21 +01:00
vfs: Convert ramfs, shmem, tmpfs, devtmpfs, rootfs to use the new mount API
2019-09-12 21:05:34 -04:00
mm: shrinker: make shrinker not depend on memcg kmem
2019-09-24 15:54:11 -07:00
udp: drop skb extensions before marking skb stateless
2019-11-22 09:28:46 -08:00
net: skmsg: fix TLS 1.3 crash with full sk_msg
2019-12-04 22:31:01 +01:00
mm, sl[aou]b: guarantee natural alignment for kmalloc(power-of-two)
2019-10-07 15:47:20 -07:00
net: increase SOMAXCONN to 4096
2019-10-31 14:01:40 -07:00
statx: define STATX_ATTR_VERITY
2020-01-08 15:26:59 -08:00
net: stmmac: implement support for passive mode converters via dt
2019-09-11 15:27:09 +01:00
lib/string: Make memzero_explicit() inline instead of external
2019-10-08 13:27:05 +02:00
mm: introduce MADV_PAGEOUT
2019-09-25 17:51:41 -07:00
swiotlb: Split size parameter to map/unmap APIs
2019-09-11 12:34:29 +02:00
ipc: fix sparc64 ipc() wrapper
2019-09-07 21:42:25 +02:00
sysfs: Fixes __BIN_ATTR_WO() macro
2019-10-02 10:06:45 +02:00
block: centralize PI remapping logic to the block layer
2019-09-17 20:03:49 -06:00
tcp: add rcu protection around tp->fastopen_rsk
2019-10-13 10:13:08 -07:00
uaccess: add missing __must_check attributes
2019-09-25 17:51:40 -07:00
Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2019-09-16 17:25:49 -07:00
efi/tpm: Only set 'efi_tpm_final_log_size' after successful event log parsing
2019-10-07 15:24:36 +02:00
uaccess: implement a proper unsafe_copy_to_user() and switch filldir over to it
2019-10-07 12:56:48 -07:00
vsock/virtio: remove unused 'work' field from 'struct virtio_vsock_pkt'
2019-10-28 04:25:04 -04:00
mm/vmalloc: modify struct vmap_area to reduce its size
2019-09-24 15:54:10 -07:00
w1: add 1-wire master driver for IP block found in SGI ASICs
2019-09-04 14:34:31 +02:00
Merge branch 'timers-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2019-09-17 12:35:15 -07:00
workqueue: unconfine alloc/apply/free_workqueue_attrs()
2019-09-13 21:15:39 +10:00
xarray.h: fix kernel-doc warning
2019-10-14 15:04:01 -07:00
zpool: add malloc_support_movable to zpool_driver
2019-09-24 15:54:12 -07:00
