Is all evidence created equal?
"My cousin said..." vs "Studies with 10,000 people showed..." Both are evidence, but one is WAY stronger! Not all evidence is equal. Learning to judge evidence quality is like having a superpower for thinking clearly!
WEAKEST → STRONGEST:
• Personal anecdote ("My friend said...")
• Expert opinion (better, but still opinion)
• Single study (could be fluke!)
• Multiple studies showing same thing
• Systematic reviews (analyzing ALL studies)
Size, replication, and method matter!
Evaluate evidence by asking:
• Who says? Expert in the field or random person?
• How many? One person or thousands?
• How tested? Controlled experiment or just observation?
• Replicated? Multiple studies or just one?
• Conflicts? Who funded it? Bias?
BE SKEPTICAL when you see:
• "I heard that..." (hearsay)
• Tiny sample size (10 people proved...)
• Cherry-picked data (ignoring contradicting evidence)
• Conflicts of interest (tobacco company funding health study)
• Can't be verified (secret study, unnamed sources)
BEST EVIDENCE = Randomized Controlled Trials (RCTs) with large samples, replicated multiple times, published in peer-reviewed journals, with no conflicts of interest.
But even these aren't perfect! Science is about weighing evidence, not absolute proof.
Not all evidence is equal - we must judge quality, not just existence!
Evidence quality ladder (weak → strong):
1. Anecdotes: "My uncle smoked and lived to 90!" (weakest)
2. Expert opinion: Better, but still just opinion
3. Observational studies: Notice patterns, can't prove cause
4. Single experiment: Could be fluke or error
5. Multiple replicated studies: Much stronger!
6. Meta-analyses: Combining all research (strongest)
Critical questions:
• Sample size: 10 people or 10,000?
• Method: Controlled experiment or just asking people?
• Replication: One study or many?
• Source: Expert or random person?
• Bias: Who funded it? What do they gain?
Remember: Quantity of evidence ≠ quality of evidence! One good study beats 100 anecdotes!
🤔 Which thinking lens(es) did you use?
Select all the lenses you used:
🌱 A Small Everyday Story
"My friend said this works!"
"How does she know?"
"She tried it once."
"One person, one time?"
"...That's not much, is it?"
The anecdote met the evidence ladder.
See more guidance →
🧠 Thinking habits this builds:
- Evaluating source credibility
- Distinguishing anecdote from data
- Looking for replication
- Checking for conflicts of interest
🌿 Behaviors you may notice (and reinforce):
- Asking "How do they know?"
- Looking for sample sizes
- Questioning single stories
- Seeking multiple sources
How to reinforce: "You asked about the sample size! That's exactly how scientists evaluate evidence."
🔄 When ideas are still forming:
Children might dismiss all evidence as "just someone's opinion." Help them see the spectrum - some evidence IS stronger.
Helpful response: "All evidence isn't equal - one person's story is different from a study of thousands. Both are evidence, but one is much stronger!"
🔬 If you want to go deeper:
- Find a news claim - what evidence supports it?
- Why do we trust replicated studies more?
- How can conflicts of interest affect research?
Key concepts (for adults): Evidence hierarchy, sample size, replication, peer review, conflicts of interest.