Redux Tree

Concept

A unified semantic token idea tree used by SGLang for efficient cache matching and memory management, contrasting with separate memory pools.

Mentioned in 1 video

Videos Mentioning Redux Tree

Why Inference Matters 12x More Than Training | YC Paper Club

Why Inference Matters 12x More Than Training | YC Paper Club

Y Combinator

A unified semantic token idea tree used by SGLang for efficient cache matching and memory management, contrasting with separate memory pools.