Matryoshka Embeddings

Concept

A technique allowing for the reduction of embedding dimensions, significantly saving storage space and compute with a minimal performance drop. OpenAI was the first to acknowledge its relevance.

Mentioned in 1 video

Videos Mentioning Matryoshka Embeddings

[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx

[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx

Latent Space

A technique allowing for the reduction of embedding dimensions, significantly saving storage space and compute with a minimal performance drop. OpenAI was the first to acknowledge its relevance.