IBGDA

Software / App

Integrated Buffer Access or similar hardware feature enabling efficient communication between GPUs and CPUs for tasks like dispatching in Expert Parallelism.

Mentioned in 1 video

Videos Mentioning IBGDA

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford Online

Integrated Buffer Access or similar hardware feature enabling efficient communication between GPUs and CPUs for tasks like dispatching in Expert Parallelism.