BERT (language model) - Wikipedia Next sentence prediction (NSP): In this task, BERT is trained to predict whether one sentence logically follows another For example, given two sentences, "The cat sat on the mat" and "It was a sunny day", BERT has to decide if the second sentence is a valid continuation of the first one
什么是BERT？一文读懂谷歌推出的预训练语言模型 | AI铺子 2018年，谷歌推出的BERT（Bidirectional Encoder Representations from Transformers）模型，以双向语境理解能力和大规模无监督预训练为核心，彻底改变了NLP的技术范式。
BERT模型介绍-腾讯云开发者社区-腾讯云 BERT（Bidirectional Encoder Representations from Transformers）是Google在2018年提出的一种预训练语言模型，它在自然语言处理（NLP）领域引起了广泛的关注和应用。