transformer network
Concept
The underlying architecture for large language models and the embedding network used, which processes tokens through attention layers.
Mentioned in 2 videos
Videos Mentioning transformer network
Max Tegmark: The Case for Halting AI Development | Lex Fridman Podcast #371
Lex Fridman
A simple computational system used in large language models like GPT-4, which has proven surprisingly effective for advanced AI despite its 'feed forward' architecture.
Vector Search with LLMs- Computerphile
Computerphile
The underlying architecture for large language models and the embedding network used, which processes tokens through attention layers.