Module 02 · 20 minutes
Updating with Evidence
Use distributions, base rates, and conditional probability to update a decision when new evidence arrives.
Written and edited by Cahyanto Arie Wibowo. Last reviewed · version 1.2.
When is the idea of “Updating with Evidence” most useful?
Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice. Separate facts from assumptions before applying Updating with Evidence. This keeps a sophisticated label from covering up a poorly understood problem. Use the lesson to decide when Updating with Evidence is useful and when a simpler approach is enough.
After this lesson
- Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice.
- Use the idea of “Updating with Evidence” to interpret one realistic situation.
- Explain the limits of the concept and the information that still needs to be checked.
Start with the situation
Understand the situation first. The label can come later.
Read a positive signal alongside how often the event occurs and how many positive results are false. This lesson uses the idea of “Updating with Evidence” to examine that situation without treating a single term as the answer to every problem.
Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice. Use distributions, base rates, and conditional probability to update a decision when new evidence arrives. Connect the term to a decision someone genuinely needs to make.
Do not rush the choice
Two ways to look at Updating with Evidence
Useful when
- Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice.
- Use the idea of “Updating with Evidence” to interpret one realistic situation.
- Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice. Use distributions, base rates, and conditional probability to update a decision when new evidence arrives. Connect the term to a decision someone genuinely needs to make.
Pause and check
- The probability of X given Y is not the same as the probability of Y given X. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
- Explain the limits of the concept and the information that still needs to be checked.
The stronger choice is the one whose evidence, owner, and limits can be explained, not simply the more sophisticated option.
Visual model
Map the parts before choosing what to do.
Read the diagram as a map of Updating with Evidence: begin with the context, follow the connections, and inspect the highlighted point before making a decision.
Let’s see how it works
Reading the situation in practice
Separate facts from assumptions before applying Updating with Evidence. This keeps a sophisticated label from covering up a poorly understood problem. Begin with what can be observed, then separate facts, assumptions, and open questions.
Read a positive signal alongside how often the event occurs and how many positive results are false. Identify the part of the situation most closely connected to the idea of “Updating with Evidence”. Use the case as a thinking tool, not as proof that one solution fits every context.
Pause for a moment
What evidence could change this decision?
Answer before opening the discussion. Name one fact and one assumption.
Open the discussion
Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice. Separate facts from assumptions before applying Updating with Evidence. This keeps a sophisticated label from covering up a poorly understood problem. Use the lesson to decide when Updating with Evidence is useful and when a simpler approach is enough.
A tempting shortcut
A familiar term can still lead us to the wrong decision.
Why this can seem reasonable
The probability of X given Y is not the same as the probability of Y given X. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
How to check it
Separate facts from assumptions before applying Updating with Evidence. This keeps a sophisticated label from covering up a poorly understood problem. Begin with what can be observed, then separate facts, assumptions, and open questions.
Try it on your work
Try it with one small piece of real work.
- Choose one real situation related to Updating with Evidence.
- Separate what you can observe from what you are assuming.
- Write one decision, its owner, and the evidence needed to review it.
- Name the signal that would make you stop or change direction.
Make one small decision with the idea of “Updating with Evidence”. Record your reasoning, the limits, and the signal that would make you change course. The larger module activity is: Update one decision after receiving new evidence. Keep the first version small enough for another person to review in a few minutes.
Quick practice
Make one small decision with the idea of “Updating with Evidence”. Record your reasoning, the limits, and the signal that would make you change course. The larger module activity is: Update one decision after receiving new evidence.
Summary
- Data Literacy places Updating with Evidence inside a realistic situation and follows the consequences of the choice.
- Use examples and evidence to test your understanding.
- Record the limits, risks, and conditions that should trigger another review.
Continue from here
- Base Rates: Continue the idea from Probability for Decisions with a closely related example.
- Humans Set the Goal: Connect this lesson to AI for Everyone and test the idea in another context.
- Data Readiness: See how the same decision changes when viewed through Product Thinking.
Sources and further reading
- Introductory Statistics 2e: Probability Topics: OpenStax · open-textbook. Primary reference for the definition, evidence, or limits discussed in “Updating with Evidence”.
- NIST/SEMATECH e-Handbook of Statistical Methods: NIST · official-handbook. Further evidence and context for checking the explanation in “Updating with Evidence”.
- Classification: Accuracy, recall, precision, and related metrics: Google for Developers · official-course. Further evidence and context for checking the explanation in “Updating with Evidence”.