Yury Norov
0a5ce0831d
lib/bitmap.c: make bitmap_parselist() thread-safe and much faster ...
Current implementation of bitmap_parselist() uses a static variable to
save local state while setting bits in the bitmap. It is obviously wrong
if we assume execution in multiprocessor environment. Fortunately, it's
possible to rewrite this portion of code to avoid using the static
variable.
It is also possible to set bits in the mask per-range with bitmap_set(),
not per-bit, as it is implemented now, with set_bit(); which is way
faster.
The important side effect of this change is that setting bits in this
function from now is not per-bit atomic and less memory-ordered. This is
because set_bit() guarantees the order of memory accesses, while
bitmap_set() does not. I think that it is the advantage of the new
approach, because the bitmap_parselist() is intended to initialise bit
arrays, and user should protect the whole bitmap during initialisation if
needed. So protecting individual bits looks expensive and useless. Also,
other range-oriented functions in lib/bitmap.c don't worry much about
atomicity.
With all that, setting 2k bits in map with the pattern like 0-2047:128/256
becomes ~50 times faster after applying the patch in my testing
environment (arm64 hosted on qemu).
The second patch of the series adds the test for bitmap_parselist(). It's
not intended to cover all tricky cases, just to make sure that I didn't
screw up during rework.
Link: http://lkml.kernel.org/r/20170807225438.16161-1-ynorov@caviumnetworks.com
Signed-off-by: Yury Norov <ynorov@caviumnetworks.com>
Cc: Noam Camus <noamca@mellanox.com>
Cc: Rasmus Villemoes <linux@rasmusvillemoes.dk>
Cc: Matthew Wilcox <mawilcox@microsoft.com>
Cc: Mauro Carvalho Chehab <mchehab@kernel.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2017-09-08 18:26:49 -07:00
lib/fonts/Kconfig: keep non-Sparc fonts listed together
2017-02-27 18:43:46 -08:00
lib/lz4: remove back-compat wrappers
2017-02-24 17:46:57 -08:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
2017-08-22 14:53:32 +08:00
Merge tag 'md/4.14-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/shli/md
2017-09-07 12:41:48 -07:00
lib/zlib_inflate/inftrees.c: fix potential buffer overflow
2017-05-08 17:15:12 -07:00
assoc_array: fix path to assoc_array documentation
2017-08-30 16:40:11 -06:00
lib/atomic64_test.c: add a test that atomic64_inc_not_zero() returns an int
2017-07-14 15:05:13 -07:00
lib/bitmap.c: make bitmap_parselist() thread-safe and much faster
2017-09-08 18:26:49 -07:00
lib/bsearch.c: micro-optimize pivot position calculation
2017-07-10 16:32:35 -07:00
debug: Add _ONCE() logic to report_bug()
2017-03-30 09:37:20 +02:00
lib/cmdline.c: fix get_options() overflow while parsing ranges
2017-06-23 16:15:55 -07:00
sched/fair, cpumask: Export for_each_cpu_wrap()
2017-05-15 10:15:23 +02:00
lib: Add crc4 module
2017-06-09 11:52:07 +02:00
lib: add module support to crc32 tests
2017-02-24 17:46:57 -08:00
lib: add module support to crc32 tests
2017-02-24 17:46:57 -08:00
debugobjects: Make kmemleak ignore debug objects
2017-08-14 16:51:01 +02:00
lib/decompress_unlz4: change module to work with new LZ4 module version
2017-02-24 17:46:57 -08:00
devres: fix devm_ioremap_*() offset parameter kerneldoc description
2017-04-24 13:53:13 -05:00
KEYS: Differentiate uses of rcu_dereference_key() and user_key_payload()
2017-03-02 10:09:00 +11:00
dmaengine updates for 4.12-rc1
2017-05-09 15:40:28 -07:00
dma: Take into account dma_pfn_offset
2017-06-28 06:55:01 -07:00
dma-virt: remove dma_supported and mapping_error methods
2017-06-28 06:54:41 -07:00
sched/headers: Prepare for new header dependencies before moving code to <linux/sched/debug.h>
2017-03-02 08:42:34 +01:00
dynamic_debug: add jump label support
2016-08-04 08:50:07 -04:00
errseq: rename __errseq_set to errseq_set
2017-07-26 12:24:36 -04:00
lib/extable.c: use bsearch() library function in search_extable()
2017-07-10 16:32:35 -07:00
fault-inject: fix wrong should_fail() decision in task context
2017-08-10 15:54:06 -07:00
lib/find_bit.c: micro-optimise find_next_*_bit
2017-02-24 17:46:57 -08:00
percpu_counter: Rename __percpu_counter_add to percpu_counter_add_batch
2017-06-20 15:42:32 -04:00
lib/genalloc.c: start search from start of chunk
2016-10-27 18:43:43 -07:00
lib: add module support to glob tests
2017-02-24 17:46:57 -08:00
lib: add module support to glob tests
2017-02-24 17:46:57 -08:00
lib/hexdump.c: return -EINVAL in case of error in hex2bin()
2017-09-08 18:26:49 -07:00
idr: Add new APIs to support unsigned long
2017-08-30 14:36:44 -07:00
lib/interval_tree: fast overlap detection
2017-09-08 18:26:49 -07:00
lib/iommu-helper: skip to next segment
2016-08-02 19:35:07 -04:00
mm: convert generic code to 5-level paging
2017-03-09 11:48:47 -08:00
Merge branch 'uaccess-work.iov_iter' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs
2017-07-07 20:39:20 -07:00
This adds a new gcc plugin named "latent_entropy". It is designed to
2016-10-15 10:03:15 -07:00
sched/headers: Prepare to move 'init_task' and 'init_thread_union' from <linux/sched.h> to <linux/sched/task.h>
2017-03-02 08:42:38 +01:00
lib/string.c: add testcases for memset16/32/64
2017-09-08 18:26:48 -07:00
lib: add test module for CONFIG_DEBUG_VIRTUAL
2017-09-08 18:26:49 -07:00
mm, kasan: switch SLUB to stackdepot, enable memory quarantine for SLUB
2016-07-28 16:07:41 -07:00
lib: update location of kgdb documentation
2017-05-16 08:44:22 -03:00
Kconfig: lib/Kconfig.ubsan fix reference to ubsan documentation
2016-12-14 16:04:08 -08:00
kobject: Export kobject_get_unless_zero()
2017-03-22 20:11:35 -06:00
Merge branch 'bind_unbind' into driver-core-next
2017-07-22 12:00:15 +02:00
lib/kstrtox.c: use "unsigned int" more
2017-07-10 16:32:34 -07:00
crypto: Work around deallocated stack frame reference gcc bug on sparc.
2017-06-08 17:36:03 +08:00
bug: switch data corruption check to __must_check
2017-02-24 17:46:56 -08:00
lib: add module support to linked list sorting tests
2017-05-08 17:15:10 -07:00
locking/selftest: Add RT-mutex support
2017-06-08 10:35:50 +02:00
locking/lockdep/selftests: Fix mixed read-write ABBA tests
2017-08-29 15:15:17 +02:00
locking/core: Remove cpu_relax_lowlatency() users
2016-11-16 10:15:10 +01:00
lib: add test module for CONFIG_DEBUG_VIRTUAL
2017-09-08 18:26:49 -07:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/pablo/nf-next
2017-09-03 17:08:42 -07:00
printk: Use the main logbuf in NMI when logbuf_lock is available
2017-05-19 14:42:19 +02:00
lib: Introduce priority array area manager
2017-02-03 16:35:42 -05:00
parser: add u64 number parser
2016-12-06 10:17:03 +02:00
percpu-refcount: support synchronous switch to atomic mode.
2017-03-22 19:18:43 -07:00
writeback: rework wb_[dec|inc]_stat family of functions
2017-07-12 16:26:05 -07:00
sched/headers: Prepare to remove the <linux/gfp.h> include from <linux/sched.h>
2017-03-02 08:42:34 +01:00
sched/headers: Prepare for new header dependencies before moving code to <linux/sched/clock.h>
2017-03-02 08:42:27 +01:00
lib/prime_numbers: Suppress warn on kmalloc failure
2017-01-23 09:17:12 +01:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net-next
2017-09-06 14:45:08 -07:00
This adds a new gcc plugin named "latent_entropy". It is designed to
2016-10-15 10:03:15 -07:00
ratelimit: extend to print suppressed messages on release
2016-08-02 19:35:06 -04:00
rbtree: add some additional comments for rebalancing cases
2017-09-08 18:26:48 -07:00
lib/rbtree_test.c: support rb_root_cached
2017-09-08 18:26:48 -07:00
locking/refcount: Create unchecked atomic_t implementation
2017-06-28 18:54:46 +02:00
Add wait_for_random_bytes() and get_random_*_wait() functions so that
2017-07-15 12:44:02 -07:00
sbitmap: add sbitmap_get_shallow() operation
2017-04-14 14:06:52 -06:00
scatterlist: add sg_zero_buffer() helper
2017-06-15 14:30:14 +02:00
lib/show_mem.c: teach show_mem to work with the given nodemask
2017-02-22 16:41:30 -08:00
siphash: implement HalfSipHash1-3 for hash tables
2017-01-09 13:58:57 -05:00
sched/core: Enable might_sleep() and smp_processor_id() checks early
2017-05-23 10:01:38 +02:00
lib: add CONFIG_TEST_SORT to enable self-test of sort()
2017-02-24 17:46:57 -08:00
lib/stackdepot: export save/fetch stack for drivers
2016-11-11 08:12:37 -08:00
lib/string.c: add testcases for memset16/32/64
2017-09-08 18:26:48 -07:00
lib: harden strncpy_from_user
2016-10-11 15:06:30 -07:00
kill strlen_user()
2017-05-15 23:40:22 -04:00
swiotlb: Add warnings for use of bounce buffers with SME
2017-07-18 11:38:03 +02:00
lib/syscall: Clear return values when no stack
2017-03-24 07:43:35 +01:00
bitmap: optimise bitmap_set and bitmap_clear of a single bit
2017-07-10 16:32:34 -07:00
bpf: add BPF_J{LT,LE,SLT,SLE} instructions
2017-08-09 16:53:56 -07:00
lib: add test module for CONFIG_DEBUG_VIRTUAL
2017-09-08 18:26:49 -07:00
test_firmware: add batched firmware tests
2017-08-10 13:58:41 -07:00
lib/test_hash.c: fix warning in preprocessor symbol evaluation
2016-09-01 17:52:01 -07:00
kasan: report only the first error by default
2017-03-31 17:13:30 -07:00
test_kmod: fix small memory leak on filesystem tests
2017-08-10 15:54:06 -07:00
lib: add module support to linked list sorting tests
2017-05-08 17:15:10 -07:00
lib: fix spelling mistake: "actualy" -> "actually"
2017-02-26 11:03:38 -05:00
lib: test_rhashtable: Fix KASAN warning
2017-07-25 12:35:23 -07:00
siphash: implement HalfSipHash1-3 for hash tables
2017-01-09 13:58:57 -05:00
Revert "lib/test_sort.c: make it explicitly non-modular"
2017-05-08 17:15:10 -07:00
test_sysctl: test against int proc_dointvec() array support
2017-07-12 16:26:00 -07:00
lib: remove check for AVR32 arch in test_user_copy
2017-05-01 09:36:30 +02:00
uuid: fix incorrect uuid_equal conversion in test_uuid_test
2017-07-21 09:38:30 +02:00
timerqueue: Use rb_entry_safe() instead of open-coding it
2017-01-20 08:03:42 +01:00
UBSAN: fix typo in format string
2016-08-02 17:31:41 -04:00
lib/ucs2_string: Speed up ucs2_utf8size()
2016-09-09 16:08:46 +01:00
copy_{from,to}_user(): move kasan checks and might_fault() out-of-line
2017-06-29 22:21:20 -04:00
uuid: hoist uuid_is_null() helper from libnvdimm
2017-06-05 16:59:05 +02:00
DeviceTree for 4.13:
2017-07-07 10:37:54 -07:00
lib/win_minmax: windowed min or max estimator
2016-09-21 00:22:59 -04:00
0a5ce0831d