Module 01 · 16 minutes
Unit of Analysis
Turn a broad question into a precise data question, then define the unit, quality, and source of the data.
Written and edited by Cahyanto Arie Wibowo. Last reviewed · version 1.2.
How does the idea of “Unit of Analysis” change the decision we make?
Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking. Look at Unit of Analysis through a decision: what information is available, who owns the result, and what happens if the assumptions are wrong. The goal is to use Unit of Analysis to clarify a decision, not simply add another term to remember.
After this lesson
- Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking.
- Use the idea of “Unit of Analysis” to interpret one realistic situation.
- Explain the limits of the concept and the information that still needs to be checked.
Start with the situation
Understand the situation first. The label can come later.
Clicks can rise while the user's underlying need remains unresolved. This lesson uses the idea of “Unit of Analysis” to examine that situation without treating a single term as the answer to every problem.
Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking. Turn a broad question into a precise data question, then define the unit, quality, and source of the data. Connect the term to a decision someone genuinely needs to make.
Visual model
Map the parts before choosing what to do.
Read the diagram as a map of Unit of Analysis: begin with the context, follow the connections, and inspect the highlighted point before making a decision.
Let’s see how it works
Reading the situation in practice
Look at Unit of Analysis through a decision: what information is available, who owns the result, and what happens if the assumptions are wrong. Begin with what can be observed, then separate facts, assumptions, and open questions.
Clicks can rise while the user's underlying need remains unresolved. Identify the part of the situation most closely connected to the idea of “Unit of Analysis”. Use the case as a thinking tool, not as proof that one solution fits every context.
Working definition
What it means, and when to be careful with it.
Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking. Turn a broad question into a precise data question, then define the unit, quality, and source of the data. Connect the term to a decision someone genuinely needs to make.
- Unit of Analysis
- Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking. Look at Unit of Analysis through a decision: what information is available, who owns the result, and what happens if the assumptions are wrong. The goal is to use Unit of Analysis to clarify a decision, not simply add another term to remember.
- Boundary to check
- A metric represents part of reality. It is not reality itself. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
Pause for a moment
What evidence could change this decision?
Answer before opening the discussion. Name one fact and one assumption.
Open the discussion
Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking. Look at Unit of Analysis through a decision: what information is available, who owns the result, and what happens if the assumptions are wrong. The goal is to use Unit of Analysis to clarify a decision, not simply add another term to remember.
Try it on your work
Try it with one small piece of real work.
- Choose one real situation related to Unit of Analysis.
- Separate what you can observe from what you are assuming.
- Write one decision, its owner, and the evidence needed to review it.
- Name the signal that would make you stop or change direction.
Choose a task you know. List what is known, what is still an assumption, and what must be tested before using the idea of “Unit of Analysis”. The larger module activity is: Audit a small dataset and write down its limits. Keep the first version small enough for another person to review in a few minutes.
A tempting shortcut
A familiar term can still lead us to the wrong decision.
Why this can seem reasonable
A metric represents part of reality. It is not reality itself. This mistake often appears when a label is used before the problem is understood. Write down your assumptions so another person can review them.
How to check it
Look at Unit of Analysis through a decision: what information is available, who owns the result, and what happens if the assumptions are wrong. Begin with what can be observed, then separate facts, assumptions, and open questions.
Quick practice
Choose a task you know. List what is known, what is still an assumption, and what must be tested before using the idea of “Unit of Analysis”. The larger module activity is: Audit a small dataset and write down its limits.
Summary
- Use Unit of Analysis to inspect evidence in Data Literacy; identify who owns Unit of Analysis, then note what still needs checking.
- Use examples and evidence to test your understanding.
- Record the limits, risks, and conditions that should trigger another review.
Continue from here
- Quality and Provenance: Continue the idea from Asking Questions with Data with a closely related example.
- Predictive and Generative AI: Connect this lesson to AI for Everyone and test the idea in another context.
- Outcomes: See how the same decision changes when viewed through Product Thinking.
Sources and further reading
- Data on the Web Best Practices: W3C · web-standard. Primary reference for the definition, evidence, or limits discussed in “Unit of Analysis”.
- Machine Learning Crash Course: Google for Developers · official-course. Further evidence and context for checking the explanation in “Unit of Analysis”.
- NIST/SEMATECH e-Handbook of Statistical Methods: NIST · official-handbook. Further evidence and context for checking the explanation in “Unit of Analysis”.