Token

The basic unit of text that language models process. A token can be a word, part of a word, or a punctuation mark. For example, 'unhappiness' might be split into 'un', 'happiness'. Most AI APIs price usage per token, with typical costs measured per 1,000 or 1 million tokens.