MAX’S NOTES
How generative AI creates an answer: a simple guide
A language model can build an answer piece by piece: use the prompt and the text already generated, select the next token, and repeat. Here is an everyday example of that process.

How an answer takes shape In common autoregressive generation, the model receives a text context and estimates possible next tokens; the system selects a continuation. That new piece then becomes part of the context for the next step. This is a simplified explanation of text generation, not a description of every kind of AI.
What happens step by step - Before your prompt, the model undergoes training. During training, its internal numerical parameters change. - Generation uses the prompt and the continuation already produced. - The system selects the next token from possible options. - Generation continues until a stopping condition, such as a special end token or a length limit.
You do not need to memorize how parameters work to use this explanation. It is more useful to distinguish training a model from generating a particular answer: they are different stages.
An everyday breakfast example Consider the sentence “For breakfast, I usually eat…”. For this teaching example, “porridge” and “eggs” are possible endings. Add “I want some hot porridge” and the context changes. These are not measured probabilities; the example illustrates how extra detail connects a continuation to the task.
Why the wording can vary Choosing a continuation can involve random sampling, and generation settings affect that choice. Repeating a prompt therefore does not guarantee exactly the same text. Variation is not inevitable either: some settings select a continuation without random sampling.
I would start by specifying the intended reader and the result you want. In the example above, that means the recipient and length rather than a request to “write it better.”
What this explanation does not promise Models can produce plausible errors. A convincing style does not by itself establish that a statement is correct. For an important fact, ask for a source and compare the answer with it.
Sources
- Google — Introduction to Large Language Models
- Hugging Face — Text generation
- Google — LLMs: What's a large language model?