Module 1: Generative AI foundations
Tokens, context, and prediction
Language models divide input into tokens and predict likely next tokens. The context window limits how much information can be considered at one time, so clear, relevant context usually improves an answer.
Practice exercise
Compare the token length of a short question and a detailed prompt.