Orca

Software / App

An early system that introduced the concept of continuous batching for dynamic workloads in inference.

Mentioned in 1 video

Videos Mentioning Orca

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 10: Inference

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 10: Inference

Stanford Online

An early system that introduced the concept of continuous batching for dynamic workloads in inference.