In their own words.
Our plain version above is ours. This is the official or expert wording we based it on.
“A Prompt Injection Vulnerability occurs when user prompts alter the LLM's behavior or output in unintended ways.”
“Indirect prompt injections occur when an LLM accepts input from external sources, such as websites or files.”
Related words.
Benchmark
A fixed test, such as a set of exam questions or coding tasks, used to score and compare AI models. Scores can mislead if models were trained on the answers or the test is too easy.
Deepfake
Fake but realistic video, audio or images of real people, places or events, made or altered with AI.
Alignment
Work to make AI systems pursue the goals and values their makers and users intend, and not harmful or unintended ones.
Red-teaming
Deliberately attacking or trying to misuse an AI system before release, to find dangerous or embarrassing failures so they can be fixed.
Jailbreak
A prompt crafted to trick a model into ignoring its safety rules, for example to get instructions it is meant to refuse.
System card (model card)
A report a lab publishes with a model, describing what it can do, how it was tested, safety results and known limits. The idea comes from 'model cards'.