Why Are Companies Seeing Higher Costs with Larger AI Models? Many companies are finding higher costs due to increased token costs on larger models. In simple terms, a 'token' is a piece of text—like a word or part of a word—that an AI model processes. Larger models, such as GPT-4 or Claude 3, use mo...