Lottery Ticket Hypothesis

[Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)

Latent Space

A hypothesis suggesting that dense neural networks contain smaller subnetworks that, when trained in isolation, can reach the same accuracy as the original dense network. Cerebras leverages this idea for parameter pruning.