Next Sentence Prediction

Concept

A pre-training task for BERT where the model predicts whether two sentences follow each other sequentially.

Mentioned in 1 video