LLaMA CPP
Software / App
A framework enabling on-device inference for small models.
Mentioned in 3 videos
Videos Mentioning LLaMA CPP
![Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]](https://i.ytimg.com/vi/AjmdDy7Rzx0/maxresdefault.jpg)
Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]
Latent Space
A framework enabling on-device inference for small models.
Building AGI with OpenAI's Structured Outputs API
Latent Space
A project where constrained grammar mechanisms, like using Backus-Naur form, were first observed, influencing discussions around grammar in LLMs.
Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
Latent Space
A C++ implementation of Meta's LLaMA models, enabling efficient local execution on consumer hardware, mentioned as a key tool for local LLMs.