fixed length bottleneck

Concept

A limitation in early sequence-to-sequence models where the encoder compressed input into a single fixed-size vector, struggling to capture long or complex sentence meanings.

Mentioned in 1 video

Videos Mentioning fixed length bottleneck

Transformers Explained: The Discovery That Changed AI Forever

Y Combinator

A limitation in early sequence-to-sequence models where the encoder compressed input into a single fixed-size vector, struggling to capture long or complex sentence meanings.