"A lie can travel around the world while the truth is still putting on its shoes."

Often attributed to Mark Twain — who almost certainly never said it.
Which is kind of the whole point.

Why We're Talking About This

Misinformation is fast. It fits in a tweet, a screenshot, a 15-second clip. It confirms what you already believe and asks nothing of you in return.

Truth is usually slow. It lives in long-form research, careful data, and context that doesn't fit in a caption. It often asks you to sit with discomfort, change your mind, or accept that the answer is complicated.

That's not a fair fight — and it's not supposed to be. The people spreading misinformation are counting on you not doing the work.

Tonight we're going to build a toolkit — a set of habits of mind — so that when someone throws a number, a stat, or a claim at you, your instinct isn't to accept or reject it. Your instinct is to get curious.

Part 1 - Statistical Thinking Part 2 - Cognitive Biases Part 3 - Logical Fallacies
Part 1 — Statistical Thinking

Habits of Mind

How to smell out misinformation
in a world drowning in numbers and claims

The Core Lesson

"True but Misleading"

Statistics don't lie — but the people choosing which statistics to show you are making a decision about what you should feel, not just what you should know.

Two completely opposite claims can both be true about the same data. The question is always: what was left out?

Scenario

The Tax Bill Debate

"The average American family will save $4,000 under this plan."
— Politician A
"This bill only benefits the wealthy. Working families see almost nothing."
— Politician B

Both of these statements are true about the same bill. How is that possible?

The Critical Lens

Mean vs. Median

Imagine 10 people affected by the tax bill:

PersonTax Savings
Persons 1–9$100 each
Person 10$40,000
$4,090
Mean (Average)
$100
Median (Typical)
Always ask: When someone says "average," do they mean the mean or the median? If a few extreme values can pull the number, the mean is misleading about what's typical.
Scenario

The Scary Headline

"New study finds that eating processed meat daily DOUBLES your risk of Disease X!"

Sounds terrifying. Should you panic?

This kind of headline drives clicks, shares, and fear — often intentionally.

The Critical Lens

Relative vs. Absolute Risk

What "doubles your risk" actually looked like:

1 in
100,000
Base Risk
2 in
100,000
New Risk
+100%
Relative Increase
+0.001%
Absolute Increase
Always ask: If someone gives you a percentage, ask "percentage of what?" If they give you a raw number, ask "out of how many?"
Scenario

The Positive Test Result

Your school announces mandatory drug testing. The test they're using is 99% accurate — if someone uses drugs, it catches them 99% of the time, and if someone is clean, it correctly clears them 99% of the time.

Your friend tests positive. The principal says the test is 99% accurate.

"The test is virtually foolproof. A 99% accuracy rate speaks for itself."
— School administrator, very confident

So there's a 99% chance your friend is guilty... right?

The Critical Lens

Base Rate Neglect

Let's walk through the actual math. Say your school has 1,000 students, and the real drug-use rate is 1% — so 10 students actually use drugs.

GroupStudentsTest ResultCount
Actual users 10 Positive (correctly) ~10
Clean students 990 Positive (falsely) ~10
~20
Total Positive Results
~10
Are Actually False

A "99% accurate" test produced results where roughly half of all positive results are wrong. Your friend has about a 50% chance of being innocent — not 1%. The missing ingredient is the base rate: because drug use is rare, the small error rate applied to the huge clean population generates as many false alarms as real catches.

This isn't hypothetical. It affects real medical screening, criminal forensics, airport security, and content moderation algorithms. Anywhere a rare event meets a large population, "highly accurate" can still mean "mostly wrong."

Always ask: How common is this thing in the first place? A test or prediction is only as useful as the base rate it's working against. "99% accurate" means almost nothing until you know how rare the thing you're testing for actually is.
Scenario

The Economy Debate

"Unemployment has dropped 4 points since I took office — the greatest jobs recovery in history!"
— President, Year 3
"Unemployment is still higher than it was four years ago. This administration has failed."
— Opposition Leader

Both are using real data. Neither is lying. So what's going on?

The Critical Lens

Cherry-Picked Timeframes

Imagine unemployment over 5 years:

Year 0
4%
← Opposition starts here
Year 1 (crisis)
12%
← President starts here
Year 2
9%
Year 3
8%
← Both end here
Always ask: Why did they pick this start date? What does the full picture look like? You can make any trend look good or terrible by choosing your window.
Scenario

The Discrimination Lawsuit

In the 1970s, UC Berkeley was accused of gender discrimination in admissions. The numbers seemed damning:

44%
Male Admit Rate
35%
Female Admit Rate

Open and shut case of discrimination... right?

The Critical Lens

Simpson's Paradox

When researchers looked at individual departments:

DepartmentMale RateFemale RateWho applied more?
Dept A (easy admit)62%82%Mostly men
Dept B (easy admit)63%68%Mostly men
Dept C (hard admit)37%34%Mostly women
Dept D (hard admit)33%35%Mostly women

Women were admitted at equal or higher rates within most departments. But they applied to the most competitive ones.

Always ask: What happens when I break this down by group, category, or subpopulation? The story of the whole can be the opposite of the story of the parts.
Scenario

The Doctor's Office

Your doctor describes a surgery two different ways:

"This surgery has a 95% survival rate."
"Out of every 100 people who have this surgery, 5 will die."

These are the exact same statistic. Do they feel the same?

The Critical Lens

Framing & Anchoring

The same number feels completely different depending on how it's presented. This isn't a math trick — it's a psychology trick.

"We removed 99% of harmful content"
Sounds great — until you realize 1% of a billion posts is still 10 million.
"9 out of 10 dentists recommend..."
What did the 10th dentist say? How were they selected? How was the question worded?
Always ask: What would this same number feel like if it were framed differently? If someone chose this framing, what feeling were they trying to create?
Scenario

Correlation ≠ Causation

Consider these two real statistical relationships:

"Ice cream sales and shark attacks rise and fall together almost perfectly. Should we ban ice cream to prevent shark attacks?"
"States that spend more on education have higher crime rates. Clearly, education spending is making crime worse — we should cut school funding!"
— Hypothetical political argument

Both correlations are real — the numbers check out. But something important is hiding behind them.

The Critical Lens

Confounding Variables

A confounding variable is a hidden factor that drives both things you're looking at:

🍦 Ice Cream Sales ☀️ Hot Weather 🦈 Shark Attacks
📚 Education Spending 🏙️ Population Density 📈 Crime Rates

Dense urban states have bigger budgets and more crime — not because one causes the other, but because population density drives both. Politicians who leave out the confounding variable can make you believe anything causes anything.

Always ask: Is there a third thing that could explain both of these? Just because two things move together doesn't mean one is causing the other.
Scenario

The Dropout Success Story

"Bill Gates dropped out of Harvard. Steve Jobs dropped out of Reed. Mark Zuckerberg dropped out of Harvard. College is clearly a waste of time and money — the most successful people in the world didn't even finish!"
— Viral social media post, 2.4M likes

You've also seen this pattern with:

"This influencer built a 7-figure business with no experience — you can too!"
"My grandpa ate bacon every day and lived to 96."
"I never studied and got an A — studying is overrated."

What do all of these arguments have in common?

The Critical Lens

Survivorship Bias

You only hear from the winners. The losers don't get interviews, followers, or documentaries.

Famous dropouts
3
All dropouts (US/yr)
~1,200,000
Avg. earnings gap
Degree holders earn ~$30k more/year

Social media is a survivorship bias machine. Algorithms promote the extraordinary outcomes — the 1-in-a-million success, the viral business, the impossible physique. The millions of people who tried the same thing and failed never show up in your feed.

Always ask: Am I only seeing the survivors? What happened to everyone else who did the same thing? The cemetery of failed attempts is invisible — but it's enormous.
Scenario

The Power of One Story

"My cousin got the flu vaccine last year and was sick for an entire week afterward. I'm never getting one — those shots literally make you sick."
— Your friend, very confidently
"I switched to this supplement and my skin cleared up in two weeks. It totally works — look at me!"
— Influencer, #ad, 800K views

These stories feel persuasive. One person, a clear before-and-after, told with total confidence. Why are they so convincing — and so dangerous?

The Critical Lens

One Story Is Not Data

An anecdote is a sample size of one — the smallest, least reliable sample possible.

SourceSampleReliability
"My cousin got sick" n = 1 Nearly zero
Online poll: "Did the vaccine work?" n = 200 (self-selected) Low — biased sample
Clinical trial, randomized n = 40,000 High

Your cousin's bad week could be coincidence, a different illness, or a normal immune response. You'd need to compare thousands of vaccinated people to thousands of unvaccinated people to know if the vaccine actually caused it. That's exactly what clinical trials do — and they found it doesn't.

The supplement influencer? They also changed their sleep, stress, diet, and skincare routine. A sample of one person with dozens of changing variables tells you nothing about which change mattered.

Always ask: How many people is this based on? Was it a controlled comparison, or just one person's experience? The more confident someone sounds telling a single story, the more skeptical you should be.

Your Toolkit

Three questions to ask whenever someone throws a number at you

"Compared to what?"
A number without context is just a number. $4,000 in savings means something very different for someone earning $40k vs. $400k. Always demand the baseline.
"Who chose this number, and what didn't they show me?"
Every statistic is a selection. Someone decided to show you this one. What they left out is often more revealing than what they included.
"What does this look like broken down differently?"
By group. By timeframe. By region. Disaggregation is where the real story often lives — and where misleading summaries fall apart.

The Goal

Not to become cynical about numbers —
but to become curious about the choices behind them.

"That's interesting — tell me more"
is always better than
"All statistics are garbage."

Part 2 — Cognitive Biases

Your Brain Is Lying to You

And it's really, really good at it

What Is a Cognitive Bias?

Your brain processes roughly 11 million bits of information every second. But you can only consciously handle about 50. To bridge that gap, your brain takes shortcuts — fast, automatic patterns that help you make decisions without thinking through every detail.

Most of the time, these shortcuts are useful. They keep you from standing in the cereal aisle for three hours. They help you read a room, dodge a ball, sense danger.

But sometimes the shortcuts are wrong — and you don't realize it, because the whole point of a shortcut is that it happens before you think.

A cognitive bias is a predictable pattern in the way your brain gets things wrong. Not randomly wrong — wrong in the same direction, every time. And once you learn to spot them, you'll see them everywhere — starting with yourself.

Scenario

The Algorithm Knows You

Two classmates both search "is creatine safe for teens?"

Student A already takes creatine and loves it. Their results page fills with fitness influencers, bodybuilding forums, and articles titled "Why Creatine Is the Safest Supplement on the Market."
They think: "See? I knew it was fine."
Student B thinks supplements are sketchy. Their results show health warnings, concerned doctors, and articles titled "What Parents Need to Know About Teen Supplement Use."
They think: "See? I knew it was dangerous."

Same question. Opposite conclusions. Both feel confirmed.

The Critical Lens

Confirmation Bias

Your brain doesn't search for the truth. It searches for agreement. You instinctively:

Seek information that supports what you already believe
Interpret ambiguous evidence in your favor
Remember the hits and forget the misses
Dismiss contradicting evidence as flawed, biased, or "not the full story"

Algorithms make this worse — they feed you what you engage with, which is usually what you already agree with. But confirmation bias existed long before the internet. It's the reason people can watch the same presidential debate and both sides declare their candidate won.

The hardest habit to build: When you find evidence that supports your view, that's when you should be most skeptical. Actively search for the strongest argument against your position. If your belief survives that, it's earned.
Scenario

The Confident Beginner

Your friend watches three YouTube videos about investing and starts giving everyone stock tips at lunch. "It's easy — just buy low, sell high. I don't know why people pay financial advisors."
— Two weeks into learning about the stock market
Meanwhile, your aunt has been a financial analyst for 15 years. When you ask her what stock to buy, she says: "Honestly, it's really complicated. There are so many factors. I'd need to know a lot more about your situation before I'd feel comfortable saying anything."
— 15 years of professional experience

Why is the person who knows the least the most confident?

The Critical Lens

The Dunning-Kruger Effect

When you're new to a subject, you don't know enough to know what you don't know.

Confidence 📈 Beginner 📉 Intermediate 📈 Experienced
Peak of "Mount Stupid" — You've learned just enough to think you get it. Everything seems simple.
Valley of Despair — You've learned enough to realize how much you don't know. Confidence crashes.
Slope of Enlightenment — Real knowledge rebuilds confidence slowly, paired with humility about what remains uncertain.
Watch for this in yourself: If a complex topic feels simple and obvious to you, ask: "Have I actually studied this — or have I just started?" The most dangerous moment in learning is when you first feel confident.
Scenario

The Logical Trap

Read these two arguments and quickly decide: is the logic valid?

Argument A:
All dogs are animals. All animals have four legs. Therefore, all dogs have four legs.
Argument B:
All flowers need water. All roses need water. Therefore, all roses are flowers.

Most people accept both. But only one of them is actually logically valid. Which one?

The Critical Lens

Belief Bias

Argument A has valid logic — but a false premise. (Not all animals have four legs.) We tend to accept it because the conclusion sounds right.

Argument B has a true conclusion — roses are flowers — but the logic is broken. "All X need water, all Y need water, therefore Y is X" doesn't follow. Cats need water too. That doesn't make them flowers.

We accept bad logic
when the conclusion
feels right
We reject good logic
when the conclusion
feels wrong

This is how propaganda works. If someone builds an argument toward a conclusion you already agree with, you won't check their reasoning. And if someone makes a flawless argument toward an uncomfortable conclusion, your brain will hunt for reasons to reject it.

Always ask: Am I accepting this because the reasoning is sound — or because I like the conclusion? Try to evaluate the argument as if you had no opinion on the outcome.
Scenario

The Double Standard

A player on your team makes a hard foul in a basketball game.
"That's just playing tough. Good, hard-nosed basketball."
A player on the other team makes the exact same foul.
"That's dirty. He could've hurt someone. Should be ejected."

Now scale this up:

When our political party does it → "It's complicated. There's context you're missing."
When their party does it → "This is corruption, plain and simple."
When our country does it → "Necessary for security."
When their country does it → "A violation of human rights."
The Critical Lens

In-Group Bias

Your brain automatically divides the world into "us" and "them" — and then applies completely different rules to each.

When "we" do something bad:
It's an isolated incident. They had good reasons. The situation was complicated. Don't judge the whole group.
When "they" do something bad:
It reveals who they really are. It's a pattern. This is what that group is like. They're all the same.

The groups can be anything — political parties, schools, religions, nationalities, fandoms, even which gaming platform you use. The bias is the same: we give our group the benefit of the doubt we refuse to give others.

The consistency test: Before judging an action, mentally swap the group. If the other side did exactly the same thing, would you feel the same way? If not, your group loyalty is doing your thinking for you.
Scenario

The Fear Factor

Quick — which of these is more dangerous?

🦈
Shark Attacks
🐄
Cow Encounters

Most people say sharks — and it isn't close. But cows kill roughly 20x more people per year in the US than sharks do.

Now a harder one:

After a week of news coverage about a school shooting, a poll finds that 67% of parents believe schools are "less safe than ever." But statistically, school violence has been declining for two decades.
The Critical Lens

The Availability Heuristic

Your brain estimates how likely something is based on how easily you can think of an example — not on actual data.

Easy to picture:
Plane crashes, shark attacks, terrorism, kidnappings
→ We overestimate these risks
Hard to picture:
Heart disease, car accidents, antibiotic resistance, falling
→ We underestimate these risks

News media and social media both exploit this. Dramatic, rare events get massive coverage. Slow, common killers don't. After consuming a week of coverage about a plane crash, your brain genuinely believes flying is more dangerous — even though you drove to the airport without a second thought, which was statistically the riskier part of your trip.

Always ask: Am I afraid of this because it's actually likely — or because I can vividly picture it? If your evidence is "I saw it on the news," remember: news is a highlight reel of the dramatic, not a representative sample of reality.

The Uncomfortable Truth

These biases aren't flaws in other people's thinking.
They're flaws in all human thinking — including yours, including mine.

You can't eliminate them. But you can learn to notice them —
and noticing is where intellectual honesty begins.

Part 3 — Logical Fallacies

The Art of Being Wrong
While Sounding Completely Right

Biases vs. Fallacies

Last time we talked about cognitive biases — the invisible shortcuts your own brain takes without asking your permission. Those happen inside your head, often before you even realize you're thinking.

Tonight is different. Logical fallacies happen in arguments — in the space between people. They're patterns of reasoning that look logical, sound persuasive, but are structurally broken.

Here's what makes them dangerous: a fallacy can lead to a true conclusion. The conclusion of a bad argument might be completely correct. But if the reasoning is broken, you've arrived at the right answer by accident — and you'll have no way to tell when the same pattern of reasoning leads you somewhere wrong.

The goal tonight isn't to win arguments. It's to recognize when an argument is asking you to skip a step — whether it comes from someone else, or from yourself.

Scenario

The Argument You Never Made

Imagine this exchange between two students in a class debate:

Student A: "I think we should have some limits on how late students can use their phones on school nights. Sleep research is pretty clear that screens before bed hurt academic performance."
Student B: "So you want to ban all technology and go back to the Dark Ages? What's next, getting rid of the internet? That's ridiculous."

The room laughs. Student A is on the defensive. But wait — did Student A say any of that?

The Critical Lens

The Strawman Fallacy

Instead of responding to the actual argument, you rebuild it as a weaker, more extreme version — then knock that down instead.

What was actually said:
"Some limits on phone use at bedtime might help students sleep better."
What was attacked:
"You want to ban all technology and return to the Dark Ages."

You'll see this constantly in political debates. "We should reform the immigration system" becomes "They want open borders." "We should support the police" becomes "They don't care about civil rights." The strawman works because it's easier to defeat an extreme position than to engage with a nuanced one.

Always ask: Is this person responding to what was actually said — or to a distorted, extreme version of it? And check yourself: when you disagree with someone, are you attacking their real position, or the dumbest version of it?
Scenario

The Expert Said So

A Nobel Prize-winning physicist goes on a podcast and says the education system is broken and kids should stop going to college. The clip gets 12 million views. Comment sections fill with: "He's literally a genius — I think he knows what he's talking about."
— Every social media platform, constantly
A celebrity with no medical background posts a documentary about a miracle diet that "cured" their chronic illness. They interview one doctor who agrees with them.
— "Do your own research" crowd shares it 4 million times

Should you trust these claims? They come from a Nobel laureate and a published doctor. Doesn't that settle it?

The Critical Lens

Appeal to Authority

Expertise is real and valuable — but it's not a blank check. The fallacy happens when:

Domain mismatch — A brilliant physicist speaking about education policy has no more authority than anyone else. Genius doesn't transfer across fields.
Cherry-picked experts — Finding one doctor who agrees doesn't mean the medical community agrees. You can find a credentialed expert to support almost anything.
Authority replaces evidence — "Because Dr. X said so" is not evidence. The question is always: what's the data behind the claim?

This doesn't mean ignore experts — it means check what makes them expert. A climate scientist speaking about climate? That's earned authority. That same scientist giving stock tips? That's just a person with an opinion.

Always ask: Is this person an expert in the specific thing they're claiming? Do other experts in that field agree? And are they showing me evidence, or asking me to trust their title?
Scenario

The Convenient Exception

A friend tells you their horoscope app is scarily accurate. You check it for a week and it's wrong every day. When you tell them, they say:

"Well, you have to understand — it only works if you're truly open to it. You were probably approaching it with negative energy. Also, Mercury was in retrograde last week, so that doesn't count."
— Moving the goalposts in real time
A political commentator claims their economic policy always leads to growth. When you point to a country where it failed, they say:

"That doesn't count — they had corruption issues. And the global economy was bad. And they didn't implement it exactly right."
— Every failure is a special case

Notice the pattern: every time the evidence doesn't cooperate, there's a reason it doesn't count.

The Critical Lens

Special Pleading

Special pleading is when someone applies rules and standards except when the result is inconvenient for their argument — then suddenly there's a special exception.

When evidence supports the claim:

"See? It works!"
When evidence contradicts the claim:

"That case is different because..."

The key question is: could this claim ever be proven wrong? If every piece of contrary evidence gets explained away with a new exception, the belief isn't based on evidence at all — it's been made unfalsifiable. It's wearing the costume of a testable claim, but it never allows itself to be tested.

Always ask: What evidence would it take to change this person's mind? If the answer is "nothing" — if every failure has a built-in excuse — then you're not dealing with a real argument. You're dealing with a belief that refuses to be questioned.
Scenario

Prove Me Wrong

"There's an invisible dragon living in my garage."

"Uh... I don't think there is."

"Can you prove there isn't?"
— Carl Sagan's famous thought experiment
In real life, this sounds like:

"This supplement boosts your immune system."
"Where's the evidence for that?"
"Where's the evidence that it doesn't?"

Suddenly you're on the defensive — but wait. Who made the claim here?

The Critical Lens

Burden of Proof Shifting

A foundational rule of honest reasoning: the person making the claim carries the burden of proving it.

Someone makes a claim They provide evidence You evaluate it
Someone makes a claim "Prove me wrong" Now you carry their burden

You can't prove a negative. You can't prove there's no invisible dragon, no hidden conspiracy, no undetectable effect. And that's exactly why burden-shifting works — it sets you an impossible task, then treats your inability to complete it as evidence that the original claim is true.

Always ask: Who made the claim, and have they supported it? "You can't prove it's not true" is never evidence that something is true. The obligation always belongs to the person making the assertion.
Scenario

The Amazing Prediction

After a major earthquake, a social media account goes viral because they posted "I feel like something big is about to happen" three days before the quake. Followers call them a prophet. News outlets run the story.
— Nobody checks their 4,000 previous posts
A wellness influencer posts a chart showing that autism diagnoses and organic food sales have risen on almost identical curves over the past 20 years. "Exposed. Do your research."
— 300K shares, mostly uncritical

In both cases, someone found a pattern. But did the pattern exist before they went looking?

The Critical Lens

The Texas Sharpshooter Fallacy

The name comes from a joke: a Texan fires randomly at the side of a barn, then paints a bullseye around the tightest cluster of bullet holes. Perfect aim — after the fact.

Honest reasoning:
Prediction → Test → Results
"I think X will happen. Let's watch and see."
Texas Sharpshooter:
Results → Find pattern → Claim prediction
"Look — X happened and I said something vague that fits!"

The "prophet" posted thousands of vague feelings — eventually one coincided with an event. The autism-organic food chart is real, but both just rose alongside hundreds of other things (smartphones, streaming subscriptions, yoga studios). With enough data, you will always find coincidental patterns. Always.

Always ask: Was this pattern identified before looking at the data, or discovered after? How many other patterns were possible? If someone searched through enough data to find this one match, they were painting the bullseye around the bullet hole.
Scenario

The Purity Test

Person A: "No one in our community would ever do something like that."

Person B: "But what about [specific member] who did exactly that?"

Person A: "Well, they were never a real member of our community. A true member would never do that."

You'll hear this pattern everywhere:

"No real patriot would question our military."
"A true fan wouldn't criticize the team."
"If you were a real Christian/Muslim/progressive/conservative, you would..."
"Any serious scientist would agree with us."

What's actually happening in this argument?

The Critical Lens

No True Scotsman

The fallacy works in three steps:

1 A broad claim is made about a group: "No one in our group does X."
2 A counterexample is presented: "But this person in your group did X."
3 Instead of accepting the counterexample, the group is redefined: "They weren't a real member."

The definition of the group shifts after the fact to exclude anything inconvenient. It makes the original claim unfalsifiable — no evidence can ever disprove it, because any counterexample automatically disqualifies itself. It's special pleading's cousin: instead of making the evidence a special case, you make the person a special case.

This is especially powerful in ideological communities. It silences dissent — if questioning the group means you aren't a real member, then no one can question the group from the inside.

Always ask: Is the definition of this group being adjusted to protect a claim? If the only people who count as "real" members are the ones who support the argument, then the argument is circular — and designed to prevent challenges, not invite them.

The Pattern Beneath the Patterns

If you look at every fallacy we covered tonight, they all share something in common: they're shortcuts to winning an argument without doing the work of understanding one.

Strawman — skip engaging with the real argument
Appeal to Authority — skip evaluating the evidence
Special Pleading — skip accepting uncomfortable results
Burden Shifting — skip supporting your own claim
Texas Sharpshooter — skip honest pattern-finding
No True Scotsman — skip accepting counterevidence

Every fallacy is a way of skipping a step that honest reasoning requires.

The Real Skill

Spotting fallacies in other people's arguments is easy.
It feels good. It makes you feel smart.

The real skill — the one that actually changes how you think — is catching these patterns in yourself.

The question is never "How do I win this argument?"
The question is "What if I'm the one who's wrong?"

That's the habit of mind that changes everything.