Soma

What If We Stopped Using GPUs? | YC Paper Club

Y Combinator

A proposed model architecture described as a 'sparse mixture of experts' that leverages data aggregation and distributed training.