Use __builtin_prefetch to Manually Prefetch Memory

Software Prefetch Hides Latency

__builtin_prefetch (GCC/Clang) and _mm_prefetch (Intel intrinsics) hint that the CPU should load a cache line before the load instruction executes. Compilers use this in hand-tuned memcpy and graph traversals when access patterns are predictable but not contiguous enough for hardware stride prefetchers.

How Far Ahead to Prefetch

Prefetch roughly 64/128 iterations ahead for memory-bound loops. Too early evicts useful lines; too late misses RAM latency hiding.

cCopy
Loading…

• Prefetch does nothing if the address is already resident
• Use locality hint 0 (no temporal locality) for streaming scans
• Measure: prefetch helps only when the loop is memory-bound
• Hardware prefetchers often beat manual hints on pure sequential access

Working Through the Exercise

Keep the relevant documentation open while you implement. When your output disagrees with the reference, trace one failing case by hand before changing random lines.

• Trace first: walk one failing input step by step
• Read the manual: skim the official doc for the mechanism named in this task
• Compare baselines: save measurements from the prior step so speedups are honest

Why for this exercise

You will add __builtin_prefetch to a memory-bound loop and compare timings with and without hints. This exercise asks you to find the prefetch distance that helps without polluting cache.