kevin/linux
1
Fork 0
Code
8c8def26bf
linux/arch/powerpc/include/asm
History
Anton Blanchard b6dcde5c74 powerpc: Fix hypervisor TLB batching 
Profiling of a page fault scalability microbenchmark shows flush_hash_range
is not calling the batch hpte invalidate hcall (H_BULK_REMOVE).

It turns out we have a duplicate firmware feature for hcall-bulk and the
current setup code stops after finding the first match. This meant we never
batch and always do individual invalidates.

The patch below removes the duplicate and shifts FW_FEATURE_CMO to close
the gap. With the patch applied the single threaded page fault rate improves
from 217169 to 238755 per second on a POWER5 test box, a 10% improvement.

Signed-off-by: Anton Blanchard <anton@samba.org>
Signed-off-by: Benjamin Herrenschmidt <benh@kernel.crashing.org>
2009-10-14 16:58:37 +11:00
..
iseries powerpc/iseries: Fix pci breakage due to bad dma_data initialization 2009-05-15 16:43:41 +10:00
8xx_immap.h
8253pit.h time: move PIT_TICK_RATE to linux/timex.h 2009-06-16 19:47:27 -07:00
abs_addr.h
agp.h agp: kill phys_to_gart() and gart_to_phys() 2009-08-03 09:05:00 +01:00
asm-compat.h
atomic.h powerpc: Use generic atomic64_t implementation on 32-bit processors 2009-06-15 13:27:38 +10:00
auxvec.h
backlight.h
bitops.h powerpc: expose the multi-bit ops that underlie single-bit ops. 2009-08-20 10:12:23 +10:00
bitsperlong.h asm-generic: introduce asm/bitsperlong.h 2009-06-11 21:02:14 +02:00
bootx.h powerpc: Fix warnings from make headers_check 2009-02-23 10:48:57 +11:00
btext.h
bug.h powerpc: Fix asm EMIT_BUG_ENTRY with !CONFIG_BUG 2008-12-16 15:53:23 +11:00
bugs.h
byteorder.h byteorder: make swab.h include asm/swab.h like a regular header 2009-01-14 19:56:50 -08:00
cache.h
cacheflush.h
cell-pmu.h powerpc/oprofile: IBM CELL: add SPU event profiling support 2009-01-08 15:51:55 +01:00
cell-regs.h powerpc/cell: Move CBE_IOPTE_* to <asm/cell-regs.h> 2009-08-20 10:29:26 +10:00
checksum.h
clk_interface.h
code-patching.h powerpc: Unify opcode definitions and support 2009-02-23 10:48:56 +11:00
compat.h x86-64: seccomp: fix 32/64 syscall hole 2009-03-02 15:41:30 -08:00
cpm1.h powerpc/cpm1: Remove IMAP_ADDR 2009-06-23 08:09:54 -05:00
cpm2.h powerpc/cpm: Remove some cruft code and defines 2009-05-19 00:47:19 -05:00
cpm.h
cputable.h Merge commit 'origin/master' into next 2009-03-24 13:38:30 +11:00
cputhreads.h powerpc/mm: Add HW threads support to no_hash TLB management 2009-08-20 10:12:37 +10:00
cputime.h cputime: Optimize jiffies_to_cputime(1) 2009-08-03 14:48:36 +02:00
current.h
dbdma.h
dbell.h powerpc: Add support for using doorbells for SMP IPI 2009-02-23 15:53:03 +11:00
dcr-generic.h
dcr-mmio.h
dcr-native.h powerpc/4xx: Extended DCR support v2 2008-12-21 14:21:15 +11:00
dcr-regs.h ibm_newemac: Fix EMAC soft reset on 460EX/GT 2008-10-08 15:27:14 -07:00
dcr.h powerpc: Const-qualify Device Node Argument to DCR Resource Extent API 2008-12-21 14:21:16 +11:00
delay.h powerpc: Fix spin_event_timeout() to be robust over context switches 2009-07-08 13:50:24 +10:00
device.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
disassemble.h ppc: Create disassemble.h to extract instruction fields 2008-12-31 16:52:21 +02:00
div64.h
dma-mapping.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
dma.h
edac.h
eeh_event.h
eeh.h powerpc/pci: Split pcibios_fixup_bus() into bus setup and device setup 2008-11-06 09:22:37 +11:00
elf.h powerpc: Fix up elf_read_implies_exec() usage 2009-05-21 15:44:21 +10:00
emergency-restart.h
emulated_ops.h powerpc: Keep track of emulated instructions 2009-05-21 15:44:26 +10:00
errno.h
exception-64e.h powerpc/book3e-64: Add helper function to setup IVORs 2009-08-28 14:24:13 +10:00
exception-64s.h powerpc: Remove use of a second scratch SPRG in STAB code 2009-08-20 10:12:28 +10:00
fb.h
fcntl.h
feature-fixups.h powerpc: Enable MMU feature sections for inline asm 2009-05-21 15:44:21 +10:00
firmware.h powerpc: Fix hypervisor TLB batching 2009-10-14 16:58:37 +11:00
fixmap.h powerpc: Minor cleanups of kernel virt address space definitions 2009-05-27 16:32:50 +10:00
floppy.h
fs_pd.h
fsl_gtm.h
fsl_lbc.h powerpc/fsl: Increase the number of possible localbus banks 2009-06-15 21:45:32 -05:00
fsldma.h fsldma: Add DMA_SLAVE support 2009-09-08 17:53:04 -07:00
ftrace.h powerpc32, ftrace: save and restore mcount regs with macro 2009-02-23 10:48:54 +11:00
futex.h powerpc: Fix data-corrupting bug in __futex_atomic_op 2009-04-15 15:23:53 +10:00
gpio.h
grackle.h
hardirq.h powerpc: Switch to asm-generic/hardirq.h 2009-08-20 10:29:27 +10:00
heathrow.h
highmem.h powerpc/mm: Make k(un)map_atomic out of line 2009-06-26 14:37:25 +10:00
hugetlb.h mm: report the MMU pagesize in /proc/pid/smaps 2009-01-06 15:58:58 -08:00
hvcall.h powerpc: Make CMO paging space pool ID and page size available 2008-08-18 14:22:34 +10:00
hvconsole.h
hvcserver.h
hw_irq.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
hydra.h
i8259.h
ibmebus.h
ide.h cleanup powerpc/include/asm/ide.h 2008-08-18 21:40:03 +02:00
immap_86xx.h
immap_cpm2.h powerpc: Update QE/CPM2 usb_ctlr structures for USB support 2008-11-08 12:39:02 -06:00
immap_qe.h powerpc: Update QE/CPM2 usb_ctlr structures for USB support 2008-11-08 12:39:02 -06:00
io-defs.h
io.h powerpc: Wire up /proc/vmallocinfo to our ioremap() 2009-03-11 17:10:14 +11:00
ioctl.h
ioctls.h powerpc: Add ioctls for RS485 mode control of serial drivers 2009-01-08 16:25:12 +11:00
iommu.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
ipcbuf.h
ipic.h
irq_regs.h
irq.h powerpc/irq: Improve nanodoc 2009-09-11 11:27:57 +10:00
irqflags.h powerpc: Fix lockdep IRQ tracing bug 2008-08-18 14:22:34 +10:00
Kbuild byteorder: make swab.h include asm/swab.h like a regular header 2009-01-14 19:56:50 -08:00
kdebug.h
kdump.h powerpc/32: Wire up the trampoline code for kdump 2008-12-23 15:13:29 +11:00
kexec.h powerpc/kdump: Use ppc_save_regs() in crash_setup_regs() 2009-01-08 16:25:17 +11:00
keylargo.h
kgdb.h
kmap_types.h
kprobes.h
kvm_44x.h KVM: ppc: move struct kvmppc_44x_tlbe into 44x-specific header 2009-03-24 11:02:55 +02:00
kvm_asm.h KVM: ppc: Add extra E500 exceptions 2009-03-24 11:02:59 +02:00
kvm_e500.h KVM: ppc: E500 core-specific code 2009-03-24 11:02:58 +02:00
kvm_host.h KVM: Prepare memslot data structures for multiple hugepage sizes 2009-09-10 08:33:02 +03:00
kvm_para.h
kvm_ppc.h KVM: ppc: remove debug support broken by KVM debug rewrite 2009-03-24 11:03:01 +02:00
kvm.h Merge branch 'header-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/linux-2.6-tip 2009-03-26 16:11:41 -07:00
libata-portmap.h
linkage.h
lmb.h
local.h powerpc: Tell gcc when we clobber the carry in inline asm 2008-11-19 16:04:28 +11:00
lppaca.h powerpc: Shield code specific to 64-bit server processors 2009-06-09 16:47:38 +10:00
lv1call.h
machdep.h powerpc/pci: Pull ppc32 PCI features into common 2009-08-28 14:24:15 +10:00
macio.h
mc146818rtc.h
mediabay.h
mman.h mm: add MAP_HUGETLB for mmaping pseudo-anonymous huge page regions 2009-09-22 07:17:41 -07:00
mmu_context.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-8xx.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-40x.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-44x.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-book3e.h powerpc/booke: Move MMUCSR definition into mmu-book3e.h 2009-08-24 20:48:05 -05:00
mmu-hash32.h powerpc: Name xpn & x fields in HW Hash PTE format 2009-08-28 14:24:12 +10:00
mmu-hash64.h powerpc/pseries: Fix to handle slb resize across migration 2009-09-02 16:19:01 +10:00
mmu.h powerpc/mm: Add MMU features for TLB reservation & Paired MAS registers 2009-08-28 14:24:12 +10:00
mmzone.h numa, cpumask: move numa_node_id default implementation to topology.h, fix 2009-03-19 12:51:25 +01:00
module.h powerpc/ppc32: ftrace, dynamic ftrace to handle modules 2008-11-20 10:52:53 -08:00
mpc5xxx.h powerpc/5xxx: Add common mpc5xxx_get_bus_frequency() function 2009-06-17 00:30:22 -06:00
mpc6xx.h
mpc8xx.h
mpc52xx_psc.h ASoC: Add a few more mpc5200 PSC defines 2009-05-24 19:31:04 +01:00
mpc52xx.h powerpc/5xxx: Add common mpc5xxx_get_bus_frequency() function 2009-06-17 00:30:22 -06:00
mpc8260.h
mpic.h powerpc: Add support for CoreInt delivery of interrupts on MPIC 2009-04-06 09:09:14 -05:00
msgbuf.h
msi_bitmap.h powerpc: Split-out common MSI bitmap logic into msi_bitmap.c 2008-08-20 16:34:57 +10:00
mutex.h powerpc: Optimise mutex 2008-11-19 16:04:58 +11:00
nvram.h powerpc/nvram: Enable use Generic NVRAM driver for different size chips 2009-09-11 16:02:11 +10:00
of_device.h powerpc: Remove include of linux/of_device.h from asm/of_device.h 2008-08-20 16:34:59 +10:00
of_platform.h of: make of_(un)register_platform_driver common code 2009-05-02 15:36:10 -07:00
ohare.h
oprofile_impl.h powerpc/oprofile: IBM CELL: add SPU event profiling support 2009-01-08 15:51:55 +01:00
paca.h perf: Tidy up after the big rename 2009-09-21 14:34:11 +02:00
page_32.h asm-generic: rename page.h and uaccess.h 2009-06-11 21:02:17 +02:00
page_64.h powerpc: Add memory management headers for new 64-bit BookE 2009-08-20 10:25:06 +10:00
page.h powerpc: Add memory management headers for new 64-bit BookE 2009-08-20 10:25:06 +10:00
param.h
parport.h parport_pc: Fix build failure drivers/parport/parport_pc.c for powerpc 2009-04-14 08:48:50 -07:00
pasemi_dma.h
pci-bridge.h powerpc/pci: Pull ppc32 PCI features into common 2009-08-28 14:24:15 +10:00
pci.h Merge branch 'linux-next' of git://git.kernel.org/pub/scm/linux/kernel/git/jbarnes/pci-2.6 2009-09-16 07:49:54 -07:00
percpu.h
perf_event.h perf_event, powerpc: Fix compilation after big perf_counter rename 2009-09-22 09:30:40 +02:00
pgalloc-32.h mm: Pass virtual address to [__]p{te,ud,md}_free_tlb() 2009-07-27 12:10:38 -07:00
pgalloc-64.h mm: Pass virtual address to [__]p{te,ud,md}_free_tlb() 2009-07-27 12:10:38 -07:00
pgalloc.h powerpc/mm: Fix encoding of page table cache numbers 2009-08-20 10:25:12 +10:00
pgtable-ppc32.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pgtable-ppc64-4k.h powerpc/mm: Split the various pgtable-* headers based on MMU type 2009-03-20 15:56:57 +11:00
pgtable-ppc64-64k.h powerpc/mm: Fix misplaced #endif in pgtable-ppc64-64k.h 2009-08-20 10:12:35 +10:00
pgtable-ppc64.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pgtable.h powerpc/32: Always order writes to halves of 64-bit PTEs 2009-08-18 14:48:39 +10:00
phyp_dump.h
pmac_feature.h
pmac_low_i2c.h
pmac_pfunc.h
pmc.h powerpc/pmc: Don't access lppaca on Book3E 2009-09-24 15:31:39 +10:00
pmi.h
poll.h
posix_types.h
ppc4xx.h
ppc_asm.h powerpc: Adjust base and index registers in Altivec macros 2009-08-28 14:24:12 +10:00
ppc-opcode.h powerpc/mm: Add opcode definitions for tlbivax and tlbsrx. 2009-08-20 10:12:38 +10:00
ppc-pci.h powerpc/pci: Merge ppc32 and ppc64 versions of phb_scan() 2009-09-02 15:45:53 +10:00
processor.h powerpc: Sanitize stack pointer in signal handling code 2009-03-27 16:58:24 +11:00
prom.h powerpc: Add of_find_next_cache_node() 2008-12-21 14:21:14 +11:00
ps3.h ps3: Replace direct file operations by callback 2009-06-15 16:47:26 +10:00
ps3av.h powerpc/ps3: Make ps3av_set_video_mode mode ID signed 2009-03-11 17:10:17 +11:00
ps3fb.h powerpc: Remove duplicated #include's 2009-04-07 15:18:58 +10:00
ps3gpu.h ps3fb: Tear down FB setup during cleanup 2009-06-15 13:26:21 +10:00
ps3stor.h
pSeries_reconfig.h
pte-8xx.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-40x.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-44x.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pte-book3e.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pte-common.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-fsl-booke.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pte-hash32.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pte-hash64-4k.h powerpc/mm: Tweak PTE bit combination definitions 2009-03-24 13:47:33 +11:00
pte-hash64-64k.h powerpc/mm: Fix potential access to freed pages when using hugetlbfs 2009-06-26 16:55:36 +10:00
pte-hash64.h powerpc/mm: Add option for non-atomic PTE updates to ppc64 2009-03-24 13:47:34 +11:00
ptrace.h powerpc: Add PTRACE_SINGLEBLOCK support 2009-06-09 13:29:25 +10:00
qe_ic.h powerpc/qe: Fix few build errors with CONFIG_QUICC_ENGINE=n 2008-12-30 11:14:06 -06:00
qe.h powerpc/qe: Implement qe_alive_during_sleep() helper function 2009-08-30 21:51:33 -07:00
reg_8xx.h
reg_booke.h powerpc/book3e-64: Add support to initial_tlb_book3e for non-HES TLB 2009-08-28 14:24:14 +10:00
reg_fsl_emb.h
reg.h powerpc: Add definitions used by exception handling on 64-bit Book3E 2009-08-20 10:25:07 +10:00
resource.h
rheap.h
rio.h
rtas.h powerpc: Use one common impl. of RTAS timebase sync and use raw spinlock 2009-06-26 16:55:25 +10:00
rtc.h
rwsem.h
scatterlist.h powerpc: Use sg->dma_length in sg_dma_len() macro on 32-bit 2009-05-21 15:44:25 +10:00
seccomp.h x86-64: seccomp: fix 32/64 syscall hole 2009-03-02 15:41:30 -08:00
sections.h Merge commit 'origin' 2008-10-15 11:31:54 +11:00
sembuf.h
serial.h
setjmp.h
setup.h powerpc: derive COMMAND_LINE_SIZE from asm-generic 2009-08-28 14:24:16 +10:00
sfp-machine.h powerpc/math-emu: Change types to work on ppc64 2009-04-02 16:17:36 -05:00
shmbuf.h
shmparam.h
sigcontext.h
siginfo.h signals: demultiplexing SIGTRAP signal 2008-09-23 13:26:52 +02:00
signal.h asm-generic: rename termios.h, signal.h and mman.h 2009-06-11 21:01:52 +02:00
smp.h cpumask: remove arch_send_call_function_ipi 2009-09-24 09:34:47 +09:30
smu.h
socket.h net: implement a SO_DOMAIN getsockoption 2009-08-05 13:02:57 -07:00
sockios.h
sparsemem.h
spinlock_types.h
spinlock.h locking, powerpc: Rename __spin_try_lock() and friends 2009-08-31 18:08:48 +02:00
spu_csa.h
spu_info.h powerpc: Fix warnings from make headers_check 2009-02-23 10:48:57 +11:00
spu_priv1.h
spu.h powerpc/cell: Bitops work on unsigned longs 2009-01-08 16:25:12 +11:00
sstep.h
stat.h
statfs.h PowerPC: Use <asm-generic/statfs.h> 2008-09-06 19:30:15 +01:00
string.h
suspend.h pm: cleanup includes 2009-04-01 08:59:16 -07:00
swab.h powerpc: Fix warnings from make headers_check 2009-02-23 10:48:57 +11:00
swiotlb.h powerpc: use dma_map_ops struct 2009-08-28 14:24:10 +10:00
synch.h powerpc: Optimise smp_wmb 2008-11-19 16:04:55 +11:00
syscall.h
syscalls.h
systbl.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
system.h powerpc: Set init_bootmem_done on NUMA platforms as well 2009-06-09 16:43:04 +10:00
tce.h
termbits.h
termios.h asm-generic: rename termios.h, signal.h and mman.h 2009-06-11 21:01:52 +02:00
thread_info.h sched: INIT_PREEMPT_COUNT 2009-07-10 14:24:05 -07:00
time.h powerpc: Eliminate unused do_gtod variable 2008-11-06 09:49:28 +11:00
timex.h
tlb.h powerpc/mm: Rework & cleanup page table freeing code path 2009-08-20 10:24:56 +10:00
tlbflush.h powerpc/mm: Make low level TLB flush ops on BookE take additional args 2009-08-20 10:12:41 +10:00
topology.h cpumask: remove obsolete topology_core_siblings and topology_thread_siblings: powerpc 2009-09-24 09:34:42 +09:30
tsi108_irq.h
tsi108_pci.h
tsi108.h
types.h asm-generic: introduce asm/bitsperlong.h 2009-06-11 21:02:14 +02:00
uaccess.h
ucc_fast.h
ucc_slow.h
ucc.h
ucontext.h
udbg.h powerpc/udbg: Fix lost byte during console handover; change LFCR to CRLF 2009-03-11 17:11:34 +11:00
uic.h
unaligned.h
uninorth.h
unistd.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
user.h
vdso_datapage.h powerpc: Improve resolution of VDSO clock_gettime 2008-11-06 09:49:22 +11:00
vdso.h powerpc: Move 64bit VDSO to improve context switch performance 2009-08-20 10:12:24 +10:00
vga.h
vio.h
xilinx_intc.h
xilinx_pci.h powerpc/virtex: Add support for Xilinx PCI host bridge 2009-06-06 10:14:22 -06:00
xmon.h
xor.h