Cross-Layer Attention

Concept

A technique that shares KV caches across layers, reducing memory usage and improving performance.

Mentioned in 1 video

Videos Mentioning Cross-Layer Attention

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 10: Inference

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 10: Inference

Stanford Online

A technique that shares KV caches across layers, reducing memory usage and improving performance.