Causal Language Model
A model that predicts the next token based only on preceding tokens, never looking ahead. This left-to-right constraint makes it natural for text generation. All modern GPT-style models are causal language models.
A model that predicts the next token based only on preceding tokens, never looking ahead. This left-to-right constraint makes it natural for text generation. All modern GPT-style models are causal language models.