Willem de Bruijn
52900d2228
udp: elide zerocopy operation in hot path ...
With MSG_ZEROCOPY, each skb holds a reference to a struct ubuf_info.
Release of its last reference triggers a completion notification.
The TCP stack in tcp_sendmsg_locked holds an extra ref independent of
the skbs, because it can build, send and free skbs within its loop,
possibly reaching refcount zero and freeing the ubuf_info too soon.
The UDP stack currently also takes this extra ref, but does not need
it as all skbs are sent after return from __ip(6)_append_data.
Avoid the extra refcount_inc and refcount_dec_and_test, and generally
the sock_zerocopy_put in the common path, by passing the initial
reference to the first skb.
This approach is taken instead of initializing the refcount to 0, as
that would generate error "refcount_t: increment on 0" on the
next skb_zcopy_set.
Changes
v3 -> v4
- Move skb_zcopy_set below the only kfree_skb that might cause
a premature uarg destroy before skb_zerocopy_put_abort
- Move the entire skb_shinfo assignment block, to keep that
cacheline access in one place
Signed-off-by: Willem de Bruijn <willemb@google.com>
Acked-by: Paolo Abeni <pabeni@redhat.com>
Signed-off-by: David S. Miller <davem@davemloft.net>
2018-12-03 15:58:32 -08:00
mmc: mmci: Drop support for pdata GPIO numbers
2018-10-08 11:40:43 +02:00
virtchnl: Fix off by one error
2018-11-14 10:56:33 -08:00
can: rx-offload: rename can_rx_offload_irq_queue_err_skb() to can_rx_offload_queue_tail()
2018-11-09 17:33:32 +01:00
libceph: assume argonaut on the server side
2018-11-08 17:51:11 +01:00
Merge branch 'clk-ti' into clk-next
2018-10-18 15:41:21 -07:00
arm64: zynqmp: SoC CLK changes for v4.20
2018-10-10 13:47:06 +02:00
fpga: add devm_fpga_region_create
2018-10-16 11:13:50 +02:00
IOMMU Updates for Linux v4.20
2018-10-26 10:50:10 -07:00
This is the bulk of GPIO changes for the v4.20 series:
2018-10-23 08:45:05 +01:00
KVM updates for v4.20
2018-10-25 17:57:35 -07:00
chrome-platform for v4.20
2018-10-31 16:47:55 -07:00
{net, IB}/mlx4: Initialize CQ buffers in the driver when possible
2018-11-22 11:38:36 -08:00
First merge window pull request
2018-10-26 07:38:19 -07:00
mmc: core: add helper to see if a host is doing a retune
2018-10-08 11:40:43 +02:00
mtd: nand: Fix nanddev_pos_next_page() kernel-doc header
2018-11-06 17:40:31 +01:00
netfilter: nfnetlink_cttimeout: fetch timeouts for udplite and gre, too
2018-11-26 10:25:20 +01:00
arm64: perf: Reject stand-alone CHAIN events for PMUv3
2018-10-12 15:25:17 +01:00
USB/PHY patches for 4.20-rc1
2018-10-26 08:14:13 -07:00
platform-drivers-x86 for v4.20-1
2018-11-01 08:42:21 -07:00
qed: Expose the doorbell overflow recovery mechanism to the protocol drivers
2018-11-30 13:45:13 -08:00
More power management updates for 4.20-rc1
2018-10-30 09:08:07 -07:00
Merge remote-tracking branch 'spi/topic/of' into spi-next
2018-10-21 17:00:17 +01:00
NFS client bugfixes for Linux 4.20
2018-11-04 08:20:09 -08:00
USB: Wait for extra delay time after USB_PORT_FEAT_RESET for quirky hub
2018-11-07 13:23:18 +01:00
pci-v4.20-changes
2018-10-25 06:50:48 -07:00
EDAC, skx: Fix randconfig builds
2018-10-31 19:24:21 +01:00
blkcg: revert blkcg cleanups series
2018-11-01 19:59:53 -06:00
linux/bitmap.h: relax comment on compile-time constant nbits
2018-10-31 08:54:12 -07:00
bitops: protect variables in bit_clear_unless() macro
2018-10-15 15:43:06 +02:00
blkcg: revert blkcg cleanups series
2018-11-01 19:59:53 -06:00
blk-mq: provide helper for setting up an SQ queue and tag set
2018-10-15 20:05:18 -06:00
blkcg: revert blkcg cleanups series
2018-11-01 19:59:53 -06:00
block: Introduce blk_revalidate_disk_zones()
2018-10-25 11:17:40 -06:00
bpf: btf: support proper non-jit func info
2018-11-26 17:57:10 -08:00
bpf: add queue and stack maps
2018-10-19 13:24:31 -07:00
bpf: btf: support proper non-jit func info
2018-11-26 17:57:10 -08:00
net: phy: bcm7xxx: Add entry for BCM7255
2018-11-07 21:50:27 -08:00
bpf: fix a compilation error when CONFIG_BPF_SYSCALL is not defined
2018-11-20 15:21:45 -08:00
psi: cgroup support
2018-10-26 16:26:32 -07:00
for-linus-20181102
2018-11-02 11:25:48 -07:00
Merge branches 'clk-tegra' and 'clk-bulk-get-all' into clk-next
2018-10-18 15:43:38 -07:00
Merge branch 'timers-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2018-10-25 11:14:36 -07:00
Merge branch 'core/urgent' into x86/urgent, to pick up objtool fix
2018-11-03 23:42:16 +01:00
compiler: remove __no_sanitize_address_or_inline again
2018-11-05 08:14:18 -08:00
compiler: remove __no_sanitize_address_or_inline again
2018-11-05 08:14:18 -08:00
Compiler Attributes: improve explanation of header
2018-11-08 11:33:52 +01:00
include/linux/compiler*.h: define asm_volatile_goto
2018-11-06 15:30:16 +01:00
lib: cordic: Move cordic macros and defines to header file
2018-11-29 17:30:48 +02:00
clocksource/drivers/c-sky: Add C-SKY SMP timer
2018-11-02 19:39:54 +01:00
cpuidle: menu: Fix wakeup statistics updates for polling state
2018-10-04 10:23:37 +02:00
kdump, proc/vmcore: Enable kdumping encrypted memory with SME enabled
2018-10-06 12:09:26 +02:00
macintosh: Use common code to access RTC
2018-10-08 22:53:10 +11:00
locking/lockdep: Make global debug_locks* variables read-mostly
2018-10-19 07:53:18 +02:00
delayacct: track delays from thrashing cache pages
2018-10-26 16:26:32 -07:00
- Biggest change this cycle is to remove support for the legacy IO path
2018-10-26 12:57:38 -07:00
Driver core patches for 4.20-rc1
2018-10-26 08:42:25 -07:00
dma-debug: Check for drivers mapping invalid addresses in dma_map_single()
2018-10-08 09:44:17 +02:00
dma-direct: Make DIRECT_MAPPING_ERROR viable for SWIOTLB
2018-11-21 18:47:52 +01:00
dma-mapping: translate __GFP_NOFAIL to DMA_ATTR_NO_WARN
2018-10-09 15:08:26 +02:00
dns: Allow the dns resolver to retrieve a server set
2018-10-04 09:40:52 -07:00
efi/arm: Defer persistent reservations until after paging_init()
2018-11-15 10:04:46 +01:00
net: ethernet: provide nvmem_get_mac_address()
2018-12-03 15:40:30 -08:00
f2fs: guarantee journalled quota data by checkpoint
2018-10-22 17:54:47 -07:00
fanotify: support reporting thread id instead of process id
2018-10-08 13:48:45 +02:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
2018-11-28 22:10:54 -08:00
vfs: rework data cloning infrastructure
2018-11-02 09:33:08 -07:00
fsnotify: generalize handling of extra event flags
2018-10-04 13:28:02 +02:00
mm, thp: consolidate THP gfp handling into alloc_hugepage_direct_gfpmask
2018-11-03 10:09:37 -07:00
Revert "HID: input: Create a utility class for counting scroll events"
2018-11-22 08:57:38 +01:00
mm/hmm: use a structure for update callback parameters
2018-10-31 08:54:12 -07:00
mm/gup: cache dev_pagemap while pinning pages
2018-10-26 16:38:15 -07:00
mm: migration: fix migration of huge PMD shared pages
2018-10-05 16:32:04 -07:00
hwrng: core - document the quality field
2018-10-05 10:16:56 +08:00
hwmon: (core) Add hwmon_in_enable attribute
2018-10-10 20:37:13 -07:00
clockevents/drivers/i8253: Add support for PIT shutdown quirk
2018-11-04 11:04:46 +01:00
ida: Convert to XArray
2018-10-21 10:46:33 -04:00
mac80211: minstrel: Enable STBC and LDPC for VHT Rates
2018-10-11 16:01:00 +02:00
bridge: Allow querying bridge port flags
2018-11-21 17:10:31 -08:00
net/vlan: introduce skb_vlan_tag_get_cfi() helper
2018-11-21 15:41:30 -08:00
ipv4/igmp: fix v1/v2 switchback timeout based on rfc3376, 8.12
2018-10-29 20:26:06 -07:00
LSM: Convert from initcall to struct lsm_info
2018-10-10 20:40:21 -07:00
genirq: Fix grammar s/an /a /
2018-10-09 07:50:41 +02:00
fs/iomap.c: change return type to vm_fault_t
2018-10-26 16:25:18 -07:00
Merge branches 'arm/renesas', 'arm/smmu', 'ppc/pamu', 'x86/vt-d', 'x86/amd' and 'core' into next
2018-10-10 18:09:37 +02:00
KEYS: Provide key type operations for asymmetric key ops [ver #2 ]
2018-10-26 09:30:46 +01:00
KEYS: Provide key type operations for asymmetric key ops [ver #2 ]
2018-10-26 09:30:46 +01:00
leds: core: Introduce LED pattern trigger
2018-10-11 21:55:58 +02:00
lightnvm: pblk: fix mapping issue on failed writes
2018-10-09 08:25:07 -06:00
include/linux/linkage.h: align weak symbols
2018-10-26 16:25:18 -07:00
list: introduce list_bulk_move_tail helper
2018-10-10 15:20:54 -05:00
locking/lockdep: Make class->ops a percpu counter and move it under CONFIG_DEBUG_LOCKDEP=y
2018-10-09 09:56:33 +02:00
Merge branch 'next-general' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2018-10-24 11:49:35 +01:00
mm: don't miss the last page because of round-off error
2018-10-26 16:25:19 -07:00
memblock: stop using implicit alignment to SMP_CACHE_BYTES
2018-10-31 08:54:16 -07:00
mm/memcontrol.c: convert mem_cgroup_id::ref to refcount_t type
2018-10-26 16:26:35 -07:00
mm/memory_hotplug: make add_memory() take the device_hotplug_lock
2018-10-31 08:54:17 -07:00
mm, thp: consolidate THP gfp handling into alloc_hugepage_direct_gfpmask
2018-11-03 10:09:37 -07:00
PCI/P2PDMA: Add PCI p2pmem DMA mappings to adjust the bus offset
2018-10-17 12:18:16 -05:00
net: phy: micrel: add Microchip KSZ9131 initial driver
2018-10-19 17:02:23 -07:00
net: phy: Fixup kerneldoc markup.
2018-11-11 10:10:01 -08:00
s390 updates for 4.20-rc2
2018-11-09 06:30:44 -06:00
Revert "mm, mmu_notifier: annotate mmu notifiers with blockable invalidate callbacks"
2018-10-26 16:25:19 -07:00
mm: remove CONFIG_NO_BOOTMEM
2018-10-31 08:54:14 -07:00
Merge branch 'next-general' of git://git.kernel.org/pub/scm/linux/kernel/git/jmorris/linux-security
2018-10-24 11:49:35 +01:00
net: Plumb support for filtering ipv4 and ipv6 multicast route dumps
2018-10-16 00:13:39 -07:00
UAPI: ndctl: Remove use of PAGE_SIZE
2018-10-17 13:56:58 -07:00
net/dim: Update DIM start sample after each DIM iteration
2018-11-22 11:36:54 -08:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next
2018-11-26 13:08:17 -08:00
netlink: Add answer_flags to netlink_callback
2018-10-16 00:13:12 -07:00
netpoll: allow cleanup to be synchronous
2018-10-19 17:01:43 -07:00
watchdog/core: Add missing prototypes for weak functions
2018-11-06 21:58:00 +01:00
include/linux/notifier.h: SRCU: fix ctags
2018-11-03 10:09:37 -07:00
lib: introduce initial implementation of object aggregation manager
2018-11-15 14:43:43 -08:00
TTY/Serial patches for 4.20-rc1
2018-10-29 10:42:20 -07:00
of: net: kill of_get_nvmem_mac_address()
2018-12-03 15:40:30 -08:00
mm: create non-atomic version of SetPageReserved for init use
2018-10-26 16:26:34 -07:00
page cache: Convert find_get_entries_tag to XArray
2018-10-21 10:46:35 -04:00
pagevec: Use xa_mark_t
2018-10-21 10:46:39 -04:00
PCI: Remove pci_set_dma_max_seg_size()
2018-10-10 15:47:00 -05:00
PCI/P2PDMA: Introduce configfs/sysfs enable attribute helpers
2018-10-17 12:18:17 -05:00
pci-v4.20-changes
2018-10-25 06:50:48 -07:00
PCI: add USR vendor id and use it in r8169 and w6692 driver
2018-11-11 14:00:05 -08:00
percpu: remove PER_CPU_DEF_ATTRIBUTES macro
2018-10-31 08:54:14 -07:00
mm: dax: add comment for PFN_SPECIAL
2018-10-26 16:26:35 -07:00
net: phy: Convert u32 phydev->lp_advertising to linkmode
2018-11-11 10:10:01 -08:00
net: phy: leds: Don't make our own link speed names
2018-11-09 20:13:51 -08:00
PM / Domains: Document flags for genpd
2018-10-18 12:25:10 +02:00
macintosh: Use common code to access RTC
2018-10-08 22:53:10 +11:00
psi: cgroup support
2018-10-26 16:26:32 -07:00
psi: pressure stall information for CPU, memory, and IO
2018-10-26 16:26:32 -07:00
pstore/ram: Clarify resource reservation labels
2018-10-22 07:11:58 -07:00
ptp: deprecate gettime64() in favor of gettimex64()
2018-11-09 19:43:51 -08:00
Merge branch 'siginfo-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/ebiederm/user-namespace
2018-10-24 11:22:39 +01:00
spi: pxa2xx: Add devicetree support
2018-10-11 15:28:04 +01:00
firmware: qcom: scm: Add WLAN VMID for Qualcomm SCM interface
2018-10-13 20:31:37 +03:00
radix tree: Remove multiorder support
2018-10-21 10:46:48 -04:00
lib/rbtree.c: fix typo in comment of rb_insert_augmented()
2018-10-31 08:54:13 -07:00
Merge remote-tracking branches 'regmap/topic/noinc' and 'regmap/topic/single-rw' into regmap-next
2018-10-21 12:07:26 +01:00
remoteproc: Add mechanism for custom dump function assignment
2018-10-19 12:53:55 -07:00
reset: Grammar s/more then once/more than once/
2018-10-04 11:36:07 +02:00
rhashtable: detect when object movement between tables might have invalidated a lookup
2018-12-03 15:31:55 -08:00
New gcc plugin: stackleak
2018-11-01 11:46:27 -07:00
Revert "serial:serial_core: Allow use of CTS for PPS line discipline"
2018-10-04 09:57:45 -07:00
include/linux/signal.h: mark expected switch fall-throughs
2018-10-31 08:54:14 -07:00
udp: elide zerocopy operation in hot path
2018-12-03 15:58:32 -08:00
bpf: sk_msg program helper bpf_msg_push_data
2018-10-20 21:37:11 +02:00
mm, slab/slub: introduce kmalloc-reclaimable caches
2018-10-26 16:26:31 -07:00
smp,cpumask: introduce on_each_cpu_cond_mask
2018-10-09 16:51:11 +02:00
init: add arch_call_rest_init to allow stack switching
2018-10-09 11:20:55 +02:00
lib: Add memcat_p(): paste 2 pointer arrays together
2018-10-11 12:12:55 +02:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/dtor/input
2018-10-12 12:35:02 +02:00
Merge branch 'xarray' of git://git.infradead.org/users/willy/linux-dax
2018-10-28 11:35:40 -07:00
swiotlb: don't dip into swiotlb pool for coherent allocations
2018-10-19 08:48:28 +02:00
TC: Set DMA masks for devices
2018-10-11 09:16:44 -07:00
tcp: defer SACK compression after DupThresh
2018-11-21 15:49:52 -08:00
Merge branch 'timers-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2018-10-25 11:14:36 -07:00
trace_uprobe: support reference counter in fd-based uprobe
2018-10-10 22:14:17 -04:00
tracepoint: Fix tracepoint array element size mismatch
2018-10-17 15:35:29 -04:00
tracepoint: Fix tracepoint array element size mismatch
2018-10-17 15:35:29 -04:00
change semantics of ldisc ->compat_ioctl()
2018-10-13 00:50:53 -04:00
udp: Handle ICMP errors for tunnels with same destination port on both endpoints
2018-11-08 17:13:08 -08:00
iov_iter: Add I/O discard iterator
2018-10-24 00:41:07 +01:00
umh: Add command line to user mode helpers
2018-10-22 19:37:36 -07:00
net/packet: fix packet drop as of virtio gso
2018-10-04 22:23:15 -07:00
scsi: sched/wait: Add wait_event_lock_irq_timeout for TASK_UNINTERRUPTIBLE usage
2018-10-16 00:11:13 -04:00
blkcg: revert blkcg cleanups series
2018-11-01 19:59:53 -06:00
XArray: Fix Documentation
2018-11-05 16:38:10 -05:00
