MMLU
Software / App
A benchmark mentioned as an example of 'PhD++ problems' in AI, which current models are surpassing, in contrast to the ARC benchmarks that normal people can solve.
Mentioned in 2 videos
Save the 2 videos on MMLU to your own pod.
Sign up free to keep building your knowledge base on MMLU as more episodes are added.
Videos Mentioning MMLU
How Intelligent Is AI, Really?
Y Combinator
A benchmark mentioned as an example of 'PhD++ problems' in AI, which current models are surpassing, in contrast to the ARC benchmarks that normal people can solve.
How To Read AI Research Papers Effectively
DeepLearningAI
A benchmark used to evaluate how well LLMs can multitask across various subjects.