为了使 BERT 能处理大量卑鄙任务,它的输入可以明确表示单一句子或句子对,例如<标题,答案>。
To make BERT handle a variety of down-stream tasks, our input representation is able to unambiguously represent both a single sentence and a pair of sentences (e.g., h Question, Answeri) in one token sequence
因此 BERT 的 Embedding 分为三个部门: