Christoph Lameter
8f6aac419b
Generic Virtual Memmap support for SPARSEMEM ...
SPARSEMEM is a pretty nice framework that unifies quite a bit of code over all
the arches. It would be great if it could be the default so that we can get
rid of various forms of DISCONTIG and other variations on memory maps. So far
what has hindered this are the additional lookups that SPARSEMEM introduces
for virt_to_page and page_address. This goes so far that the code to do this
has to be kept in a separate function and cannot be used inline.
This patch introduces a virtual memmap mode for SPARSEMEM, in which the memmap
is mapped into a virtually contigious area, only the active sections are
physically backed. This allows virt_to_page page_address and cohorts become
simple shift/add operations. No page flag fields, no table lookups, nothing
involving memory is required.
The two key operations pfn_to_page and page_to_page become:
#define __pfn_to_page(pfn) (vmemmap + (pfn))
#define __page_to_pfn(page) ((page) - vmemmap)
By having a virtual mapping for the memmap we allow simple access without
wasting physical memory. As kernel memory is typically already mapped 1:1
this introduces no additional overhead. The virtual mapping must be big
enough to allow a struct page to be allocated and mapped for all valid
physical pages. This vill make a virtual memmap difficult to use on 32 bit
platforms that support 36 address bits.
However, if there is enough virtual space available and the arch already maps
its 1-1 kernel space using TLBs (f.e. true of IA64 and x86_64) then this
technique makes SPARSEMEM lookups even more efficient than CONFIG_FLATMEM.
FLATMEM needs to read the contents of the mem_map variable to get the start of
the memmap and then add the offset to the required entry. vmemmap is a
constant to which we can simply add the offset.
This patch has the potential to allow us to make SPARSMEM the default (and
even the only) option for most systems. It should be optimal on UP, SMP and
NUMA on most platforms. Then we may even be able to remove the other memory
models: FLATMEM, DISCONTIG etc.
[apw@shadowen.org: config cleanups, resplit code etc]
[kamezawa.hiroyu@jp.fujitsu.com: Fix sparsemem_vmemmap init]
[apw@shadowen.org: vmemmap: remove excess debugging]
[apw@shadowen.org: simplify initialisation code and reduce duplication]
[apw@shadowen.org: pull out the vmemmap code into its own file]
Signed-off-by: Christoph Lameter <clameter@sgi.com>
Signed-off-by: Andy Whitcroft <apw@shadowen.org>
Acked-by: Mel Gorman <mel@csn.ul.ie>
Cc: "Luck, Tony" <tony.luck@intel.com>
Cc: Andi Kleen <ak@suse.de>
Cc: "David S. Miller" <davem@davemloft.net>
Cc: Paul Mackerras <paulus@samba.org>
Cc: Benjamin Herrenschmidt <benh@kernel.crashing.org>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Signed-off-by: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2007-10-16 09:42:51 -07:00
IB/mlx4: Implement FMRs
2007-10-09 19:59:16 -07:00
mmc: add led trigger
2007-09-24 07:15:48 +02:00
[MTD] [NOR] fix ctrl-alt-del can't reboot for intel flash bug
2007-10-13 14:36:18 +01:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
knfsd: 64 bit ino support for NFS server
2007-10-09 18:31:57 -04:00
mmc_spi host driver
2007-09-23 22:17:27 +02:00
[SSB]: add Sonics Silicon Backplane bus support
2007-10-10 16:51:36 -07:00
Merge git://git.linux-nfs.org/pub/linux/nfs-2.6
2007-10-15 10:47:35 -07:00
[PKT_SCHED]: Add stateless NAT
2007-10-10 16:53:11 -07:00
docbook: fix usb content
2007-10-15 17:56:36 -07:00
long vs. unsigned long - low-hanging fruits in drivers
2007-10-14 12:41:51 -07:00
arcnet endianness annotations
2007-10-10 16:51:59 -07:00
libata: add human-readable error value decoding
2007-10-12 14:55:45 -04:00
[XFRM]: xfrm audit calls
2007-10-10 16:49:02 -07:00
backlight: Convert corgi backlight driver into a more generic driver
2007-10-11 22:24:13 +01:00
Drop 'size' argument from bio_endio and bi_end_io
2007-10-10 09:25:57 +02:00
[BLOCK] Move sector_div() from blkdev.h to kernel.h
2007-10-12 12:40:38 +02:00
[BLOCK] Better fix for do_blk_trace_setup() for !CONFIG_BLOCK
2007-10-12 12:50:07 +02:00
clockevents: introduce force broadcast notifier
2007-10-14 22:57:45 +02:00
[NET]: make netlink user -> kernel interface synchronious
2007-10-10 21:15:29 -07:00
[CPUFREQ] implement !CONFIG_CPU_FREQ stub for cpufreq_unregister_notifier()
2007-10-04 18:40:57 -04:00
[CRYPTO] api: Fixed crypto_*_reqsize return type
2007-10-10 16:55:42 -07:00
[DCCP]: Tidy-up -- minisock initialisation
2007-10-10 16:54:36 -07:00
debugfs: helper for decimal challenged
2007-10-12 14:51:03 -07:00
Driver core: change add_uevent_var to use a struct
2007-10-12 14:51:01 -07:00
introduce DMA_MASK_NONE as a signal for unable to do DMA
2007-10-16 09:42:50 -07:00
drivers/firmware: const-ify DMI API and internals
2007-10-09 20:22:20 -04:00
ax88796: add 93cx6 eeprom support
2007-10-10 16:53:56 -07:00
[NET]: Move hardware header operations out of netdevice.
2007-10-10 16:52:52 -07:00
[ETHTOOL]: Introduce ->{get,set}_priv_flags, ETHTOOL_[GS]PFLAGS
2007-10-10 16:48:08 -07:00
Merge branch 'locks' of git://linux-nfs.org/~bfields/linux
2007-10-15 16:07:40 -07:00
fs_enet: Be an of_platform device when CONFIG_PPC_CPM_NEW_BINDING is set.
2007-10-10 16:54:03 -07:00
[GFS2] Fix quota do_list operation hang
2007-10-10 08:55:27 +01:00
Input: gpio-keys - add suspend/resume support
2007-09-26 00:01:17 -04:00
long vs. unsigned long - low-hanging fruits in drivers
2007-10-14 12:41:51 -07:00
HID: fix HIDIOCGRDESC memory access in hidraw
2007-10-15 08:12:00 -07:00
HID: fix HIDIOCGRDESC memory access in hidraw
2007-10-15 08:12:00 -07:00
hwmon: Convert from class_device to device
2007-10-09 22:56:30 -04:00
i2c: Move i2c-dev interfaces to i2c-dev.h
2007-10-13 23:56:32 +02:00
V4L/DVB (6149): Add I2C_HW_B_CX23885 for Conexant 23885/23887 PCIe bridge
2007-10-09 22:07:51 -03:00
i2c: Rename the PEC functionality bit
2007-10-13 23:56:33 +02:00
ide: move ide_config_drive_speed() calls to upper layers (take 2)
2007-10-13 17:47:51 +02:00
[PATCH] wireless networking: move frame inline functions to generic header
2007-10-10 16:52:59 -07:00
arcnet endianness annotations
2007-10-10 16:51:59 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NET] drivers/net: statistics cleanup #1 -- save memory and shrink code
2007-10-10 16:51:16 -07:00
[NET]: Move hardware header operations out of netdevice.
2007-10-10 16:52:52 -07:00
[NET]: netlink support for moving devices between network namespaces.
2007-10-10 16:49:13 -07:00
pppoe: endianness
2007-10-10 16:52:04 -07:00
[NET]: Move hardware header operations out of netdevice.
2007-10-10 16:52:52 -07:00
[NET] drivers/net: statistics cleanup #1 -- save memory and shrink code
2007-10-10 16:51:16 -07:00
[NET]: Make the device list and device lookups per namespace.
2007-10-10 16:49:10 -07:00
fix endianness bug in inet_lro
2007-10-14 12:41:52 -07:00
Add assembler equivalents to __init{,date}_refok
2007-10-16 09:42:49 -07:00
[NETNS]: Fix allnoconfig compilation error.
2007-10-10 16:49:21 -07:00
Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/dtor/input
2007-10-15 13:41:39 -07:00
provide stubs for enable_irq_wake() and disable_irq_wake()
2007-10-16 09:42:50 -07:00
[IPSEC]: Get rid of ipv6_{auth,esp,comp}_hdr
2007-10-10 16:55:55 -07:00
[ISDN]: Remove local copy of device name to make sure renames work.
2007-10-15 12:26:37 -07:00
V4L/DVB (6123): ivtv: move ivtv.h public header to include/linux
2007-10-09 22:07:28 -03:00
V4L/DVB (6119): ivtvfb: renamed ivtv-fb to ivtvfb, move header to include/linux
2007-10-09 22:07:23 -03:00
docbook: fix filesystems content
2007-10-15 17:56:36 -07:00
slow down printk during boot
2007-10-16 09:42:49 -07:00
[BLOCK] Move sector_div() from blkdev.h to kernel.h
2007-10-12 12:40:38 +02:00
sched: guest CPU accounting: add guest-CPU /proc/stat field
2007-10-15 17:00:19 +02:00
Merge master.kernel.org:/pub/scm/linux/kernel/git/torvalds/linux-2.6
2007-10-12 21:27:47 -04:00
kobject: update the copyrights
2007-10-12 14:51:12 -07:00
[KTIME]: Introduce ktime_sub_ns and ktime_sub_us
2007-10-10 16:48:12 -07:00
KVM: Replace enum by #define
2007-10-13 10:18:29 +02:00
[libata] struct pci_dev related cleanups
2007-10-12 14:55:47 -04:00
[NETNS]: Cleanup list walking in setup_net and cleanup_net
2007-10-10 16:51:35 -07:00
lockdep: annotate rcu_read_{,un}lock{,_bh}
2007-10-11 22:11:12 +02:00
Generic bitbanged MDIO library
2007-10-10 16:54:03 -07:00
Generic Virtual Memmap support for SPARSEMEM
2007-10-16 09:42:51 -07:00
sparsemem: record when a section has a valid mem_map
2007-10-16 09:42:51 -07:00
i2c: Kill struct i2c_device_id
2007-10-13 23:56:29 +02:00
lockdep: fixup mutex annotations
2007-10-11 22:11:12 +02:00
[NET]: Make socket creation namespace safe.
2007-10-10 16:49:07 -07:00
net core: fix kernel-doc for new function parameters
2007-10-13 09:52:26 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NETFILTER]: Replace sk_buff ** with sk_buff *
2007-10-15 12:26:29 -07:00
[NET]: make netlink user -> kernel interface synchronious
2007-10-10 21:15:29 -07:00
[NET] netconsole: Support dynamic reconfiguration using configfs
2007-10-10 16:48:06 -07:00
NFS: Add a boot parameter to disable 64 bit inode numbers
2007-10-09 17:20:52 -04:00
NFS: Clean up write code...
2007-10-09 17:15:11 -04:00
NFS: Fake up 'wcc' attributes to prevent cache invalidation after write
2007-10-09 17:19:15 -04:00
[NL80211]: add netlink interface to cfg80211
2007-10-10 16:52:14 -07:00
[NET]: Add a network namespace parameter to tasks
2007-10-10 16:49:04 -07:00
PCI: Add 'nodomains' boot option, and pci_domains_supported global
2007-10-12 15:03:18 -07:00
8250_pci: Autodetect mainpine cards
2007-10-16 09:42:50 -07:00
PCI: modify PCI bridge control ISA flag for clarity
2007-10-12 15:03:18 -07:00
PHYLIB: IRQ event workqueue handling fixes
2007-10-10 16:53:55 -07:00
PHY fixed driver: rework release path and update phy_id notation
2007-10-10 16:53:50 -07:00
[NET_SCHED]: Making rate table lookups more flexible.
2007-10-10 16:49:20 -07:00
Driver core: Make platform_device.id an int
2007-10-12 14:51:07 -07:00
[NET]: Fix race when opening a proc file while a network namespace is exiting.
2007-10-10 16:49:22 -07:00
lockdep: annotate rcu_read_{,un}lock{,_bh}
2007-10-11 22:11:12 +02:00
more low-hanging fruits - kernel, fs, lib signedness
2007-10-14 12:41:52 -07:00
[RFKILL]: Add support for hardware-only rfkill buttons
2007-10-10 16:54:11 -07:00
[IPv6]: Export userland ND options through netlink (RDNSS support)
2007-10-10 21:22:05 -07:00
sched: guest CPU accounting: maintain stats in account_system_time()
2007-10-15 17:00:19 +02:00
[SCTP]: protocol definitions for SCTP-AUTH implementation
2007-10-10 16:51:28 -07:00
long vs. unsigned long - low-hanging fruits in drivers
2007-10-14 12:41:51 -07:00
[FS] seq_file: Introduce the seq_open_private()
2007-10-10 16:55:33 -07:00
wake up from a serial port
2007-10-16 09:42:50 -07:00
Merge branch 'master' of master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6
2007-10-15 14:06:58 -07:00
[TCP] MIB: Count FRTO's successfully detected spurious RTOs
2007-10-10 16:52:39 -07:00
long vs. unsigned long - low-hanging fruits in drivers
2007-10-14 12:41:51 -07:00
Drop 'size' argument from bio_endio and bi_end_io
2007-10-10 09:25:57 +02:00
sysfs: add copyrights
2007-10-12 14:51:12 -07:00
[TCP]: Make snd_cwnd_cnt 32-bit
2007-10-15 12:59:43 -07:00
sched: enable wake-idle on CONFIG_SCHED_MC=y
2007-10-15 17:00:19 +02:00
PTY: add kernel parameter to overwrite legacy pty count
2007-10-12 14:51:09 -07:00
USB: skip autosuspended devices during system resume
2007-10-12 14:55:34 -07:00
Convert from class_device to device for drivers/video
2007-10-12 14:51:04 -07:00
V4L/DVB (6108): videodev2.h: add new pixel formats for the cx23415 OSD
2007-10-09 22:07:04 -03:00
Merge git://git.linux-nfs.org/pub/linux/nfs-2.6
2007-10-15 10:47:35 -07:00
[POWERPC] XilinxFB: Allow fixed framebuffer base address
2007-10-12 14:05:17 +10:00
[ZLIB]: Move bnx2 driver gzip unpacker into zlib.
2007-10-10 16:53:57 -07:00
