- GPU kernels are specialized functions launched across the GPU, with threads grouped into wavefronts and thread blocks, and their performance depends on threads, data, and hardware architecture.
- The HipKittens paper introduces an eight-wave ping-pong schedule on AMD hardware that overlaps computation with memory movement, where paired waves alternate roles between computing and prefetching data.
- Parallel programming requires a balance between independence and dependence among threads; complete independence prevents unified results, while total dependence leads to waiting.
- The author draws a parallel between the alternating roles of GPU waves and Suzuki's 'Posture' concept, emphasizing that roles are real but temporary, and posture is about relationships during change.