powerpc64le: Optimize memcpy for POWER10
commite941e0ae80626b7661c1db8953a673cafd3b8b19
authorTulio Magno Quites Machado Filho <tuliom@linux.ibm.com>
Fri, 30 Apr 2021 21:12:08 +0000 (30 18:12 -0300)
committerTulio Magno Quites Machado Filho <tuliom@linux.ibm.com>
Fri, 30 Apr 2021 21:12:08 +0000 (30 18:12 -0300)
tree42b3dcccfce69af0f7ffb0fa4ed2ed75734b82a2
parentdd59655e9371af86043b97e38953f43bd9496699
powerpc64le: Optimize memcpy for POWER10

This implementation is based on __memcpy_power8_cached and integrates
suggestions from Anton Blanchard.
It benefits from loads and stores with length for short lengths and for
tail code, simplifying the code.

All unaligned memory accesses use instructions that do not generate
alignment interrupts on POWER10, making it safe to use on
caching-inhibited memory.

The main loop has also been modified in order to increase instruction
throughput by reducing the dependency on updates from previous iterations.

On average, this implementation provides around 30% improvement when
compared to __memcpy_power7 and 10% improvement in comparison to
__memcpy_power8_cached.
sysdeps/powerpc/powerpc64/le/power10/memcpy.S [new file with mode: 0644]
sysdeps/powerpc/powerpc64/multiarch/Makefile
sysdeps/powerpc/powerpc64/multiarch/ifunc-impl-list.c
sysdeps/powerpc/powerpc64/multiarch/memcpy-power10.S [new file with mode: 0644]
sysdeps/powerpc/powerpc64/multiarch/memcpy.c