Martin Schwidefsky
ef6edc9746
[PATCH] Directed yield: cpu_relax variants for spinlocks and rw-locks
...
On systems running with virtual cpus there is optimization potential in
regard to spinlocks and rw-locks. If the virtual cpu that has taken a lock
is known to a cpu that wants to acquire the same lock it is beneficial to
yield the timeslice of the virtual cpu in favour of the cpu that has the
lock (directed yield).
With CONFIG_PREEMPT="n" this can be implemented by the architecture without
common code changes. Powerpc already does this.
With CONFIG_PREEMPT="y" the lock loops are coded with _raw_spin_trylock,
_raw_read_trylock and _raw_write_trylock in kernel/spinlock.c. If the lock
could not be taken cpu_relax is called. A directed yield is not possible
because cpu_relax doesn't know anything about the lock. To be able to
yield the lock in favour of the current lock holder variants of cpu_relax
for spinlocks and rw-locks are needed. The new _raw_spin_relax,
_raw_read_relax and _raw_write_relax primitives differ from cpu_relax
insofar that they have an argument: a pointer to the lock structure.
Signed-off-by: Martin Schwidefsky <schwidefsky@de.ibm.com>
Cc: Ingo Molnar <mingo@elte.hu>
Cc: Paul Mackerras <paulus@samba.org>
Cc: Haavard Skinnemoen <hskinnemoen@atmel.com>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2006-10-01 00:39:21 -07:00
..
mach-bigsmp
mach-default
[PATCH] simplify update_times (avoid jiffies/jiffies_64 aliasing problem)
2006-09-29 09:18:15 -07:00
mach-es7000
[PATCH] i386: Allow to use GENERICARCH for UP kernels
2006-09-26 10:52:26 +02:00
mach-generic
mach-numaq
mach-summit
[PATCH] convert i386 Summit subarch to use SRAT info for apicid_to_node calls
2006-09-29 09:18:03 -07:00
mach-visws
[PATCH] simplify update_times (avoid jiffies/jiffies_64 aliasing problem)
2006-09-29 09:18:15 -07:00
mach-voyager
[PATCH] simplify update_times (avoid jiffies/jiffies_64 aliasing problem)
2006-09-29 09:18:15 -07:00
8253pit.h
a.out.h
acpi.h
[PATCH] i386: Replace i386 open-coded cmdline parsing with
2006-09-26 10:52:32 +02:00
agp.h
alternative-asm.i
[PATCH] i386: add alternative-asm.h to allow LOCK_PREFIX replacement in .S files
2006-09-26 10:52:29 +02:00
alternative.h
[PATCH] i386: Remove alternative_smp
2006-08-30 16:05:15 -07:00
apic.h
[PATCH] i386: Make enable_local_apic static
2006-09-26 10:52:35 +02:00
apicdef.h
x86_64: Remove stale lapic definition from apicdef.h
2006-04-01 22:50:03 -05:00
arch_hooks.h
[PATCH] x86: early printk handling fixes
2006-03-23 07:38:05 -08:00
atomic.h
i386: improve and correct inline asm memory constraints
2006-07-08 15:24:18 -07:00
auxvec.h
bitops.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
boot.h
bug.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
bugs.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
byteorder.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
cache.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
cacheflush.h
checksum.h
cpu.h
[PATCH] Register sysfs file for hotplugged new node
2006-06-27 17:32:36 -07:00
cpufeature.h
[PATCH] x86_64: i386/x86-64 Add nmi watchdog support for new Intel CPUs
2006-06-26 10:48:22 -07:00
cputime.h
current.h
debugreg.h
delay.h
[PATCH] Time: i386 Conversion - part 3: Enable Generic Timekeeping
2006-06-26 09:58:21 -07:00
desc.h
[PATCH] i386: Fix pack_descriptor()
2006-09-26 10:52:40 +02:00
div64.h
dma-mapping.h
[PATCH] Use valid_dma_direction() in include/asm-i386/dma-mapping.h
2006-09-29 09:18:10 -07:00
dma.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
dmi.h
[PATCH] x86_64: Implement early DMI scanning
2006-03-25 09:10:55 -08:00
dwarf2.h
[PATCH] i386/x86-64: Work around gcc bug with noreturn functions in unwinder
2006-09-26 10:52:41 +02:00
e820.h
[PATCH] x86: Remove incorrect comment about ACPI e820 entries
2006-09-26 10:52:38 +02:00
edac.h
elf.h
[PATCH] headers_check: move kernel-only #includes within <asm-i386/elf.h>
2006-09-13 07:32:15 -07:00
emergency-restart.h
errno.h
fcntl.h
fixmap.h
[PATCH] x86: make __FIXADDR_TOP variable to allow it to make space for a hypervisor
2006-09-26 08:48:55 -07:00
floppy.h
[PATCH] irq-flags: i386: Use the new IRQF_ constants
2006-07-02 13:58:47 -07:00
frame.i
[PATCH] i386: Redo semaphore and rwlock assembly helpers
2006-09-26 10:52:29 +02:00
futex.h
i386: improve and correct inline asm memory constraints
2006-07-08 15:24:18 -07:00
genapic.h
[PATCH] i386: Allow to use GENERICARCH for UP kernels
2006-09-26 10:52:26 +02:00
hardirq.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
highmem.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
hpet.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
hw_irq.h
[PATCH] genirq: add ->retrigger() irq op to consolidate hw_irq_resend()
2006-06-29 10:26:23 -07:00
i387.h
[PATCH] i386: fix broken FP exception handling
2006-04-29 14:13:16 -07:00
i8253.h
i8259.h
ide.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
intel_arch_perfmon.h
[PATCH] x86: i386/x86-64 Add nmi watchdog support for new Intel CPUs
2006-09-26 10:52:27 +02:00
io.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
io_apic.h
[PATCH] i386: Replace i386 open-coded cmdline parsing with
2006-09-26 10:52:32 +02:00
ioctl.h
ioctls.h
ipc.h
ipcbuf.h
irq.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
irqflags.h
[PATCH] lockdep: irqtrace cleanup of include/asm-i386/irqflags.h
2006-07-03 15:27:03 -07:00
ist.h
k8.h
[PATCH] x86_64: Clean and enhance up K8 northbridge access code
2006-06-26 10:48:15 -07:00
Kbuild
[PATCH] Split i386 and x86_64 ptrace.h
2006-09-26 08:49:10 -07:00
kdebug.h
[PATCH] Notify page fault call chain for i386
2006-06-26 09:58:22 -07:00
kexec.h
[PATCH] i386: Avoid overwriting the current pgd (V4, i386)
2006-09-26 10:52:38 +02:00
kmap_types.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
kprobes.h
[PATCH] IA64: kprobe invalidate icache of jump buffer
2006-07-31 13:28:38 -07:00
ldt.h
linkage.h
local.h
i386: improve and correct inline asm memory constraints
2006-07-08 15:24:18 -07:00
math_emu.h
mc146818rtc.h
mca.h
mca_dma.h
mce.h
[PATCH] Don't trigger full rebuild via CONFIG_X86_MCE
2006-06-23 07:42:56 -07:00
mman.h
[PATCH] add asm-generic/mman.h
2006-02-15 15:32:22 -08:00
mmu.h
[PATCH] vdso: randomize the i386 vDSO by moving it into a vma
2006-06-27 17:32:38 -07:00
mmu_context.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
mmx.h
mmzone.h
[PATCH] convert i386 NUMA KVA space to bootmem
2006-09-26 08:48:45 -07:00
module.h
mpspec.h
[PATCH] mptspec: remove duplicate #include
2006-04-11 06:18:34 -07:00
mpspec_def.h
msgbuf.h
msi.h
[PATCH] PCI: cleanup unused variable about msi driver
2006-06-21 12:00:00 -07:00
msr.h
mtrr.h
[PATCH] Don't trigger full rebuild via CONFIG_MTRR
2006-06-23 07:42:56 -07:00
mutex.h
[PATCH] i386: Remove lock section support in mutex.h
2006-09-26 10:52:31 +02:00
namei.h
nmi.h
[PATCH] x86: Clean up x86 NMI sysctls
2006-09-30 01:47:55 +02:00
numa.h
numaq.h
page.h
[PATCH] vdso: randomize the i386 vDSO by moving it into a vma
2006-06-27 17:32:38 -07:00
param.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
parport.h
pci-direct.h
pci.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
percpu.h
pgalloc.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
pgtable-2level-defs.h
pgtable-2level.h
[PATCH] x86: trivial move of __HAVE macros in i386 pagetable headers
2006-09-26 08:48:56 -07:00
pgtable-3level-defs.h
pgtable-3level.h
[PATCH] x86: trivial move of __HAVE macros in i386 pagetable headers
2006-09-26 08:48:56 -07:00
pgtable.h
Merge branch 'for-linus' of git://one.firstfloor.org/home/andi/git/linux-2.6
2006-09-26 13:07:55 -07:00
poll.h
[PATCH] POLLRDHUP/EPOLLRDHUP handling for half-closed devices notifications
2006-03-25 08:22:56 -08:00
posix_types.h
i386: improve and correct inline asm memory constraints
2006-07-08 15:24:18 -07:00
processor.h
[PATCH] x86: roll all the cpuid asm into one __cpuid call
2006-09-26 08:48:55 -07:00
ptrace-abi.h
[PATCH] Split i386 and x86_64 ptrace.h
2006-09-26 08:49:10 -07:00
ptrace.h
Merge branch 'for-linus' of git://one.firstfloor.org/home/andi/git/linux-2.6
2006-09-26 13:07:55 -07:00
resource.h
rtc.h
rwlock.h
[PATCH] i386: Clean up spin/rwlocks
2006-09-26 10:52:32 +02:00
rwsem.h
[PATCH] i386: Remove lock section support in rwsem.h
2006-09-26 10:52:31 +02:00
scatterlist.h
seccomp.h
sections.h
segment.h
[PATCH] i386: Allow a kernel not to be in ring 0
2006-09-26 10:52:39 +02:00
semaphore.h
[PATCH] i386: Use early clobbers for semaphores now
2006-09-27 14:39:51 -07:00
sembuf.h
serial.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
setup.h
[PATCH] headers_check: don't expose PFN stuff to userspace in <asm-i386/setup.h>
2006-09-13 07:32:16 -07:00
shmbuf.h
shmparam.h
sigcontext.h
siginfo.h
signal.h
[PATCH] headers_check: move inclusion of <linux/linkage.h> in <asm-i386/signal.h>
2006-09-13 07:32:15 -07:00
smp.h
[PATCH] convert i386 Summit subarch to use SRAT info for apicid_to_node calls
2006-09-29 09:18:03 -07:00
socket.h
[AF_UNIX]: Datagram getpeersec
2006-06-29 16:58:06 -07:00
sockios.h
sparsemem.h
spinlock.h
[PATCH] Directed yield: cpu_relax variants for spinlocks and rw-locks
2006-10-01 00:39:21 -07:00
spinlock_types.h
srat.h
stacktrace.h
[PATCH] i386: Do stacktracer conversion too
2006-09-26 10:52:34 +02:00
stat.h
[PATCH] 2TB files: st_blocks is invalid when calling stat64
2006-03-26 08:57:00 -08:00
statfs.h
string.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
suspend.h
sync_bitops.h
[PATCH] x86: implement always-locked bit ops, for memory shared with an SMP hypervisor
2006-09-26 08:48:55 -07:00
system.h
[PATCH] x86: implement always-locked bit ops, for memory shared with an SMP hypervisor
2006-09-26 08:48:55 -07:00
termbits.h
termios.h
therm_throt.h
[PATCH] x86: Add a cumulative thermal throttle event counter.
2006-09-26 10:52:42 +02:00
thread_info.h
[PATCH] i386: use thread_info flags for debug regs and IO bitmaps
2006-07-09 18:47:12 -07:00
timer.h
[PATCH] Time: i386 Conversion - part 3: Enable Generic Timekeeping
2006-06-26 09:58:21 -07:00
timex.h
[PATCH] Time: i386 Conversion - part 2: Rework TSC Support
2006-06-26 09:58:21 -07:00
tlb.h
tlbflush.h
[PATCH] i386: Minor fixes & cleanup to tlb flush
2006-09-26 10:52:29 +02:00
topology.h
[PATCH] sched: mc/smt power savings sched policy
2006-06-27 17:32:45 -07:00
tsc.h
[PATCH] x86: remove config.h includes from asm-i386 & asm-x86_64
2006-09-26 10:52:36 +02:00
types.h
Don't include linux/config.h from anywhere else in include/
2006-04-26 12:56:16 +01:00
uaccess.h
[PATCH] Make copy_from_user_inatomic NOT zero the tail on i386
2006-06-25 10:01:09 -07:00
ucontext.h
unaligned.h
unistd.h
[PATCH] consistently use MAX_ERRNO in __syscall_return
2006-09-27 08:26:18 -07:00
unwind.h
[PATCH] i386/x86-64: Work around gcc bug with noreturn functions in unwinder
2006-09-26 10:52:41 +02:00
user.h
vga.h
[PATCH] vgacon: make VGA_MAP_MEM take size, remove extra use
2006-06-22 15:05:58 -07:00
vic.h
vm86.h
voyager.h
xor.h