Module 01 · 20 minutes
Capability and Reliability
Understand how tokens, context, ambiguity, and reliability limits affect a model's response.
Written and edited by Cahyanto Arie Wibowo. Last reviewed · version 1.2.
When is the idea of “Capability and Reliability” most useful?
Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible. Instead of memorizing Capability and Reliability, compare one clear example with another that looks similar but works differently. You will leave with a simple way to explain Capability and Reliability and one question that tests its limits.
After this lesson
- Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible.
- Use the idea of “Capability and Reliability” to interpret one realistic situation.
- Explain the limits of the concept and the information that still needs to be checked.
Start with the situation
Understand the situation first. The label can come later.
The instruction 'make it better' does not define the audience, goal, quality bar, or output format. This lesson uses the idea of “Capability and Reliability” to examine that situation without treating a single term as the answer to every problem.
Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible. Understand how tokens, context, ambiguity, and reliability limits affect a model's response. Connect the term to a decision someone genuinely needs to make.
Do not rush the choice
Two ways to look at Capability and Reliability
Useful when
- Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible.
- Use the idea of “Capability and Reliability” to interpret one realistic situation.
- Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible. Understand how tokens, context, ambiguity, and reliability limits affect a model's response. Connect the term to a decision someone genuinely needs to make.
Pause and check
- A model cannot know organizational context that you do not provide. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
- Explain the limits of the concept and the information that still needs to be checked.
The stronger choice is the one whose evidence, owner, and limits can be explained, not simply the more sophisticated option.
Visual model
Map the parts before choosing what to do.
Read the diagram as a map of Capability and Reliability: begin with the context, follow the connections, and inspect the highlighted point before making a decision.
Let’s see how it works
Reading the situation in practice
Instead of memorizing Capability and Reliability, compare one clear example with another that looks similar but works differently. Begin with what can be observed, then separate facts, assumptions, and open questions.
The instruction 'make it better' does not define the audience, goal, quality bar, or output format. Identify the part of the situation most closely connected to the idea of “Capability and Reliability”. Use the case as a thinking tool, not as proof that one solution fits every context.
Pause for a moment
What evidence could change this decision?
Answer before opening the discussion. Name one fact and one assumption.
Open the discussion
Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible. Instead of memorizing Capability and Reliability, compare one clear example with another that looks similar but works differently. You will leave with a simple way to explain Capability and Reliability and one question that tests its limits.
A tempting shortcut
A familiar term can still lead us to the wrong decision.
Why this can seem reasonable
A model cannot know organizational context that you do not provide. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
How to check it
Instead of memorizing Capability and Reliability, compare one clear example with another that looks similar but works differently. Begin with what can be observed, then separate facts, assumptions, and open questions.
Try it on your work
Try it with one small piece of real work.
- Choose one real situation related to Capability and Reliability.
- Separate what you can observe from what you are assuming.
- Write one decision, its owner, and the evidence needed to review it.
- Name the signal that would make you stop or change direction.
Make one small decision with the idea of “Capability and Reliability”. Record your reasoning, the limits, and the signal that would make you change course. The larger module activity is: Diagnose three prompts that look clear but remain ambiguous. Keep the first version small enough for another person to review in a few minutes.
Quick practice
Make one small decision with the idea of “Capability and Reliability”. Record your reasoning, the limits, and the signal that would make you change course. The larger module activity is: Diagnose three prompts that look clear but remain ambiguous.
Summary
- Within Prompting, the point of Capability and Reliability is clearer when its benefit, owner, and limits are visible.
- Use examples and evidence to test your understanding.
- Record the limits, risks, and conditions that should trigger another review.
Continue from here
- Ambiguity: Continue the idea from How Models Read Instructions with a closely related example.
- When Not to Use AI: Connect this lesson to Applied AI and test the idea in another context.
- Data Distribution: See how the same decision changes when viewed through Data Literacy.
Sources and further reading
- Prompt engineering: OpenAI · official-documentation. Primary reference for the definition, evidence, or limits discussed in “Capability and Reliability”.
- Machine Learning Glossary: Google for Developers · official-documentation. Further evidence and context for checking the explanation in “Capability and Reliability”.
- Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile: NIST · official-framework. Further evidence and context for checking the explanation in “Capability and Reliability”.