Contextual Embeddings

Concept

A technique involving a two-stage adaptation process: first conditioning the model on a corpus and then using it for embeddings, notably improving efficiency even with smaller models.

Mentioned in 1 video

Videos Mentioning Contextual Embeddings

[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx

[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx

Latent Space

A technique involving a two-stage adaptation process: first conditioning the model on a corpus and then using it for embeddings, notably improving efficiency even with smaller models.