Anna-Maria Gleixner
236968383c
timers: Optimize collect_expired_timers() for NOHZ ...
After a NOHZ idle sleep the timer wheel must be forwarded to current jiffies.
There might be expired timers so the current code loops and checks the expired
buckets for timers. This can take quite some time for long NOHZ idle periods.
The pending bitmask in the timer base allows us to do a quick search for the
next expiring timer and therefore a fast forward of the base time which
prevents pointless long lasting loops.
For a 3 seconds idle sleep this reduces the catchup time from ~1ms to 5us.
Signed-off-by: Anna-Maria Gleixner <anna-maria@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Cc: Arjan van de Ven <arjan@infradead.org>
Cc: Chris Mason <clm@fb.com>
Cc: Eric Dumazet <edumazet@google.com>
Cc: Frederic Weisbecker <fweisbec@gmail.com>
Cc: George Spelvin <linux@sciencehorizons.net>
Cc: Josh Triplett <josh@joshtriplett.org>
Cc: Len Brown <lenb@kernel.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Rik van Riel <riel@redhat.com>
Cc: rt@linutronix.de
Link: http://lkml.kernel.org/r/20160704094342.351296290@linutronix.de
Signed-off-by: Ingo Molnar <mingo@kernel.org>
2016-07-07 10:35:10 +02:00
bpf: fix matching of data/data_end in verifier
2016-06-15 23:37:54 -07:00
mm/init: Add 'rodata=off' boot cmdline parameter to disable read-only kernel mappings
2016-02-22 08:51:37 +01:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
2016-06-29 11:50:42 -07:00
gcov: disable for COMPILE_TEST
2016-05-10 17:12:49 +02:00
irqchip updates for 4.7-rc1:
2016-06-03 15:05:51 +02:00
Merge branches 'for-4.7/core', 'for-4.7/livepatching-doc' and 'for-4.7/livepatching-ppc64' into for-linus
2016-05-17 12:06:35 +02:00
locking: avoid passing around 'thread_info' in mutex debugging code
2016-06-23 12:11:17 -07:00
oom, suspend: fix oom_reaper vs. oom_killer_disable race
2016-06-24 17:23:52 -07:00
printk/nmi: flush NMI messages on the system panic
2016-05-20 17:58:30 -07:00
debugobjects: insulate non-fixup logic related to static obj from fixup callbacks
2016-05-19 19:12:14 -07:00
sched/core: Allow kthreads to fall back to online && !active cpus
2016-06-24 08:26:53 +02:00
timers: Optimize collect_expired_timers() for NOHZ
2016-07-07 10:35:10 +02:00
Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
2016-06-29 11:50:42 -07:00
Merge branch 'stable-4.7' of git://git.infradead.org/users/pcmoore/audit
2016-06-29 15:18:47 -07:00
audit: move audit_get_tty to reduce scope and kabi changes
2016-06-28 15:48:48 -04:00
wrappers for ->i_mutex access
2016-01-22 18:04:28 -05:00
audit: cleanup prune_tree_thread
2016-04-04 09:46:47 -04:00
don't bother with ->d_inode->i_sb - it's always equal to ->d_sb
2016-04-10 17:11:51 -04:00
audit: Fix typo in comment
2016-02-08 11:25:39 -05:00
Merge branch 'stable-4.7' of git://git.infradead.org/users/pcmoore/audit
2016-06-29 15:18:47 -07:00
cgroup: Disable IRQs while holding css_set_lock
2016-06-23 17:23:12 -04:00
cgroup: kill cgrp_ss_priv[CGROUP_CANFORK_COUNT] and friends
2015-12-03 10:24:08 -05:00
cgroup_pids: fix a typo.
2015-12-14 14:54:37 -05:00
context_tracking: Switch to new static_branch API
2015-11-24 09:56:43 +01:00
sched/hotplug: Make activate() the last hotplug step
2016-05-06 14:58:25 +02:00
cpuset: use static key better and convert to new API
2016-05-19 19:12:14 -07:00
kmemcg: account certain kmem allocations to memcg
2016-01-14 16:00:49 -08:00
kmemcg: account certain kmem allocations to memcg
2016-01-14 16:00:49 -08:00
wait: allow sys_waitid() to accept __WNOTHREAD/__WCLONE/__WALL
2016-05-23 17:04:14 -07:00
Fix build break in fork.c when THREAD_SIZE < PAGE_SIZE
2016-06-25 06:01:28 -07:00
futex: Calculate the futex key based on a tail page for file-based futexes
2016-06-08 19:23:54 +02:00
ptrace: use fsuid, fsgid, effective creds for fs access checks
2016-01-20 17:09:18 -08:00
kernel/hung_task.c: use timeout diff when timeout is updated
2016-03-22 15:36:02 -07:00
treewide: Remove old email address
2015-11-23 09:44:58 +01:00
locking/static_key: Fix concurrent static_key_slow_inc()
2016-06-24 08:23:16 +02:00
kallsyms: add support for relative offsets in kallsyms address table
2016-03-15 16:55:16 -07:00
ptrace: use fsuid, fsgid, effective creds for fs access checks
2016-01-20 17:09:18 -08:00
kernel/kcov: unproxify debugfs file's fops
2016-06-15 04:56:35 -07:00
s390/kexec: consolidate crash_map/unmap_reserved_pages() and arch_kexec_protect(unprotect)_crashkres()
2016-05-23 17:04:14 -07:00
s390/kexec: consolidate crash_map/unmap_reserved_pages() and arch_kexec_protect(unprotect)_crashkres()
2016-05-23 17:04:14 -07:00
kexec: introduce a protection mechanism for the crashkernel reserved memory
2016-05-23 17:04:14 -07:00
kexec: move some memembers and definitions within the scope of CONFIG_KEXEC_FILE
2016-01-20 17:09:18 -08:00
rcu: Remove TINY_RCU bloat from pointless boot parameters
2015-12-07 16:59:37 -08:00
sched/debug: Make schedstats a runtime tunable that is disabled by default
2016-02-09 11:54:23 +01:00
ELF/MIPS build fix
2016-05-23 17:04:14 -07:00
memremap: add arch specific hook for MEMREMAP_WB mappings
2016-04-04 10:26:41 +02:00
module: preserve Elf information for livepatch modules
2016-04-01 15:00:10 +02:00
KEYS: Move the point of trust determination to __key_link()
2016-04-11 22:43:43 +01:00
cgroup: introduce cgroup namespaces
2016-02-16 13:04:58 -05:00
kernel/padata.c: hide unused functions
2016-05-19 19:12:14 -07:00
printk/nmi: flush NMI messages on the system panic
2016-05-20 17:58:30 -07:00
remove lots of IS_ERR_VALUE abuses
2016-05-27 15:26:11 -07:00
profile: hide unused functions when !CONFIG_PROC_FS
2016-03-22 15:36:02 -07:00
ptrace: change __ptrace_unlink() to clear ->ptrace under ->siglock
2016-03-22 15:36:02 -07:00
kernel/relay.c: fix potential memory leak
2016-06-09 14:23:11 -07:00
/proc/iomem: only expose physical resource addresses to privileged users
2016-04-14 12:56:09 -07:00
Merge branch 'upstream' of git://git.linux-mips.org/pub/scm/ralf/upstream-linus
2016-05-19 10:02:26 -07:00
signals: Use hrtimer for sigtimedwait()
2016-07-07 10:35:07 +02:00
Merge branch 'smp-hotplug-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2016-03-15 13:50:29 -07:00
cpu/hotplug: Unpark smpboot threads from the state machine
2016-03-01 20:36:56 +01:00
cpu/hotplug: Create hotplug threads
2016-03-01 20:36:56 +01:00
arch, ftrace: for KASAN put hard/soft IRQ entries into separate sections
2016-03-25 16:37:42 -07:00
kernel/stop_machine.c: remove CONFIG_SMP dependencies
2016-01-16 11:17:24 -08:00
prctl: make PR_SET_THP_DISABLE wait for mmap_sem killable
2016-05-23 17:04:14 -07:00
vfs: add copy_file_range syscall and vfs helper
2015-12-01 14:00:53 -05:00
Merge branch 'perf-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
2016-05-25 17:05:40 -07:00
kernel/sysctl_binary.c: use generic UUID library
2016-05-20 17:58:30 -07:00
taskstats: use the libnl API to align nlattr on 64-bit
2016-04-23 20:13:25 -04:00
rcutorture: Dump trace buffer upon shutdown
2016-04-21 13:47:04 -07:00
kernel/...: convert pr_warning to pr_warn
2016-03-22 15:36:02 -07:00
time, acct: Drop irq save & restore from __acct_update_integrals()
2016-02-29 09:53:09 +01:00
kernel/*: switch to memdup_user_nul()
2016-01-04 10:27:55 -05:00
watchdog: don't run proc_watchdog_update if new value is same as old
2016-03-17 15:09:34 -07:00
debugobjects: insulate non-fixup logic related to static obj from fixup callbacks
2016-05-19 19:12:14 -07:00
sched/core: Get rid of 'cpu' argument in wq_worker_sleeping()
2016-03-02 10:28:47 -05:00
236968383c