Alibi
Concept
Alibi is mentioned as a complex positional embedding used by LLaMA, which George Hotz contrasts with simpler methods or the potential abolishment of positional embeddings.
Mentioned in 2 videos
Save the 2 videos on Alibi to your own pod.
Sign up free to keep building your knowledge base on Alibi as more episodes are added.
Videos Mentioning Alibi
Ep 18: Petaflops to the People — with George Hotz of tinycorp
Latent Space
Alibi is mentioned as a complex positional embedding used by LLaMA, which George Hotz contrasts with simpler methods or the potential abolishment of positional embeddings.
Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 2 - Large Language Models
Stanford Online
طريقة لإضافة انحياز خطي إلى طبقة الانتباه يعتمد على المسافة بين الرموز.