MMLU (Massive Multitask Language Understanding)

Study / Research

A benchmark used by the speaker to test the performance of GPT-4 and Smart GPT across various tasks. High scores on MMLU are considered indicative of advanced AI capabilities.

Mentioned in 1 video

Videos Mentioning MMLU (Massive Multitask Language Understanding)

GPT 4 is Smarter than You Think: Introducing SmartGPT

GPT 4 is Smarter than You Think: Introducing SmartGPT

AI Explained

A benchmark used by the speaker to test the performance of GPT-4 and Smart GPT across various tasks. High scores on MMLU are considered indicative of advanced AI capabilities.