In their own words.
Our plain version above is ours. This is the official or expert wording we based it on.
“In machine learning, AI inference is the act of using a trained AI model to make predictions on new data.”
Related words.
Context window
How much text (counted in tokens) a model can take in at once, including your question, any documents you give it and the conversation so far. Anything beyond it is not seen.
Hallucination
When an AI model states something false or made up as if it were true, such as an invented quote, fact or court case.
Prompt
The text (or image, or file) you give an AI model to tell it what you want.
Chain of thought
Step-by-step working that a model writes out before giving its answer. Reasoning models do this by default.
AI agent
An AI system that does not just answer but takes actions for you, such as browsing websites, running code or filling in forms, over several steps.
Token
The small chunk of text (often part of a word) that a model reads and writes. Prices, limits and context windows are counted in tokens.