Read The Numbers Honestly — Uncertainty, Base Rates, And Noise
34 tasks
The soundness of a decision process — accurately representing knowledge, weighing alternatives and probabilities — judged independently of the realized outcome. (Building robustness into a worldview.)
Sign in to review and change this plan before creating a private project.
Source details
Derivation tier: T1
statistical-literacy · 811d3172498cc1c972c338d7fb39dae77c20caac0ed2ac6670a1706c17b156d5
Authorship and review status are not recorded here.
Template tasks (34)
Review tasks and choose or change owners before creating your project. Assigning an agent does not start it.
Tasks begin as To Do in your project.
- #1Data Quality & Critical InquiryHigh
Teaches you to interrogate where a number came from before you trust it, and to estimate how much of a dataset is genuine signal versus noise.
Completion check
The data quality & critical inquiry work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 0 days after project start · Planned duration: 14 days
- #2Cognitive Biases & HeuristicsHigh
Catalogs the predictable ways your judgment deviates from the numbers — availability, anchoring, confirmation, representativeness, motivated reasoning — and how to counter them.
Completion check
The cognitive biases & heuristics work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 14 days after project start · Planned duration: 14 days
- #3Dual-Process Cognition (System 1 / System 2)Medium
The interplay of fast intuitive judgment and slow deliberate reasoning, and when to trust each with numbers.
Completion check
The dual-process cognition (system 1 / system 2) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 28 days after project start · Planned duration: 7 days
- #4Narrative Fallacy & Illusory CausalityMedium
Warns you about the mind's compulsion to build tidy causal stories over messy or random facts, manufacturing an illusion of understanding.
Completion check
The narrative fallacy & illusory causality work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 35 days after project start · Planned duration: 7 days
- #5Distorted Risk Perception & MiscalibrationHigh
Maps the systematic gap between how dangerous something feels and how dangerous it statistically is. You learn where your gut reliably over- and under-shoots.
Completion check
The distorted risk perception & miscalibration work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 42 days after project start · Planned duration: 14 days
- #6Fear Promotion & Risk Information FramingMedium
Exposes how hazards are packaged to maximize emotional impact and trigger fast, heuristic judgment. You learn to detect the framing before it moves you.
Completion check
The fear promotion & risk information framing work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 56 days after project start · Planned duration: 7 days
- #7Emotional Regulation & DistanceMedium
Address the transient emotions — tilt, fear, urgency — that hijack decisions, and the distancing techniques that restore alignment with your long-term interests. You learn to buy time between feeling and acting.
Completion check
The emotional regulation & distance work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 63 days after project start · Planned duration: 7 days
- #8Statistical Literacy & ThinkingHigh
Define the central capacity the whole guide serves: building an accurate mental model of a probabilistic situation and reasoning correctly within it. You get the distinction between memorized formulas and genuine statistical insight.
Completion check
The statistical literacy & thinking work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 70 days after project start · Planned duration: 14 days
- #9Sample Size & Statistical PowerHigh
How the count of independent observations sets the width of your uncertainty and your ability to detect real effects — before and after you run anything.
Completion check
The sample size & statistical power work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 84 days after project start · Planned duration: 14 days
- #10Effect Size vs. Statistical SignificanceHigh
Reorients you from asking whether an effect exists to asking whether it is large enough to matter for a decision.
Completion check
The effect size vs. statistical significance work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 98 days after project start · Planned duration: 14 days
- #11Base Rates & the Outside ViewMedium
Anchor a forecast on how similar cases have actually turned out before adjusting for the specifics of yours.
Completion check
The base rates & the outside view work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 112 days after project start · Planned duration: 7 days
- #12Overconfidence & Epistemic ArroganceHigh
Targets the gap between how sure you feel about a number or forecast and how accurate it actually is. You learn to measure that gap and shrink it through calibration rather than willpower.
Completion check
The overconfidence & epistemic arrogance work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 119 days after project start · Planned duration: 14 days
- #13Epistemic Humility & Skeptical MindsetHigh
Builds the habit of holding beliefs provisionally — questioning sources, claims, and your own reactions — so you can revise when evidence warrants.
Completion check
The epistemic humility & skeptical mindset work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 133 days after project start · Planned duration: 14 days
- #14Survivorship Bias & Silent EvidenceMedium
Makes visible the missing data — the failures, dropouts, and casualties you never see — that quietly inflate every success story you do.
Completion check
The survivorship bias & silent evidence work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 147 days after project start · Planned duration: 7 days
- #15Misinformation, Bullshit & Deception DetectionHigh
Focus on a working toolkit for spotting misleading quantitative claims — cherry-picked stats, false precision, and unfalsifiable numbers. You learn to refute them without a statistics degree.
Completion check
The misinformation, bullshit & deception detection work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 154 days after project start · Planned duration: 14 days
- #16Sound Research & Study DesignHigh
Lock down the inferential quality of a study before a single data point is collected — where hypotheses, sampling, measurement, and power get decided.
Completion check
The sound research & study design work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 168 days after project start · Planned duration: 14 days
- #17Validity & Reliability of InferenceHigh
Define what makes a conclusion trustworthy — robustness, replicability, generalizability, and freedom from both false alarms and misses — and how the upstream design choices converge on it.
Completion check
The validity & reliability of inference work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 182 days after project start · Planned duration: 14 days
- #18Uncertainty Quantification & Probabilistic RepresentationHigh
Teaches you to carry uncertainty forward as a range or distribution instead of collapsing it into a single deceptively confident number.
Completion check
The uncertainty quantification & probabilistic representation work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 196 days after project start · Planned duration: 14 days
- #19System Noise (Random Judgment Variability)High
Separates random scatter in repeated judgments from consistent directional bias, and shows why noise is the error you cannot see by looking at averages. You get the diagnostic lens to detect variability that should not exist.
Completion check
The system noise (random judgment variability) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 210 days after project start · Planned duration: 14 days
- #20Luck vs. Skill & Randomness DomainHigh
Gauge how much of an outcome is chance versus skill, and whether you're in a mild (Mediocristan) or wild (Extremistan) randomness regime.
Completion check
The luck vs. skill & randomness domain work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 224 days after project start · Planned duration: 14 days
- #21Model Limitations & OverfittingMedium
Keeps you honest about what your models leave out — the difference between the map ('Model Land') and the territory. You learn to use outputs without mistaking them for reality.
Completion check
The model limitations & overfitting work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 238 days after project start · Planned duration: 7 days
- #22Probabilistic / Betting Decision FramingHigh
Reframes decisions as bets on uncertain futures and teaches you to state beliefs as probabilities and scenario ranges instead of yes/no certainties. You get a language for thinking under uncertainty.
Completion check
The probabilistic / betting decision framing work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 245 days after project start · Planned duration: 14 days
- #23Outcome vs. Process (Resulting) & FieldingMedium
Separates the quality of a decision from the quality of its outcome, so a bad break doesn't get blamed on good judgment. You learn to field results by attributing them to skill versus luck.
Completion check
The outcome vs. process (resulting) & fielding work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 259 days after project start · Planned duration: 7 days
- #24Structured Decision Process & Debiasing LeversHigh
Use the levers that architect judgment: decomposition, checklists, relative scales, information sequencing, and reality-testing. You learn to build error out of the process rather than out of yourself.
Completion check
The structured decision process & debiasing levers work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 266 days after project start · Planned duration: 14 days
- #25Aggregation & Truth-Seeking GroupsMedium
Shows how combining independent judgments and building dissent-friendly groups cancels individual error. You learn what makes a crowd wise rather than a herd.
Completion check
The aggregation & truth-seeking groups work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 280 days after project start · Planned duration: 7 days
- #26Escalation of Commitment & Sunk CostMedium
Names why you throw good resources after bad — sunk cost, loss aversion, endowment, status-quo bias — and how to quit a failing course on time. You learn to treat quitting as a decision, not a defeat.
Completion check
The escalation of commitment & sunk cost work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 287 days after project start · Planned duration: 7 days
- #27Black Swans, Fragility & RobustnessHigh
Stop forecasting rare catastrophes and instead engineer your exposures so shocks help rather than harm you. You get the barbell and antifragility as concrete design tools.
Completion check
The black swans, fragility & robustness work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 294 days after project start · Planned duration: 14 days
- #28Objective Ignorance & Irreducible UncertaintyMedium
Apply a working sense of the hard floor on prediction — the portion of the future no method, model, or expert can recover — and how to tell it apart from your own sloppiness.
Completion check
The objective ignorance & irreducible uncertainty work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 308 days after project start · Planned duration: 7 days
- #29Experience-Based Intuition & SensemakingMedium
Legitimizes expert intuition — recognitional pattern-matching and mental simulation — as a real decision engine under time pressure. You learn when to trust the gut and when it's an imposter.
Completion check
The experience-based intuition & sensemaking work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 315 days after project start · Planned duration: 7 days
- #30Decision QualityHigh
Define a decision's quality by its process and evidentiary grounding at the moment it was made — not by how it turned out — and gives you a way to evaluate choices under uncertainty fairly.
Completion check
The decision quality work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 322 days after project start · Planned duration: 14 days
- #31Accurate Worldview & Belief AccuracyHigh
Build a picture of the world that tracks what the data actually says, not what the vivid story implies. You learn to weight thousands of quiet cases over one loud one.
Completion check
The accurate worldview & belief accuracy work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 336 days after project start · Planned duration: 14 days
- #32Well-Being & Psychological ResilienceMedium
Connect sound probabilistic thinking to how you feel after a decision goes wrong. It gives you a way to evaluate choices by their process rather than punishing yourself for unlucky outcomes.
Completion check
The well-being & psychological resilience work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 350 days after project start · Planned duration: 7 days
- #33Societal Resource (Mis)allocation & TrustMedium
Examine what happens when miscalibrated risk perception scales up to public budgets, media attention, and institutional trust. You see how statistical errors become societal misallocations.
Completion check
The societal resource (mis)allocation & trust work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 357 days after project start · Planned duration: 7 days
- #34Organizational Context, Culture & Catastrophic FailureMedium
Address how the organization around a decision-maker shapes — and often degrades — judgment quality. You learn to spot the structural conditions that turn individual errors into catastrophic failures.
Completion check
The organizational context, culture & catastrophic failure work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 364 days after project start · Planned duration: 7 days
Sign in to review and change this plan before creating a private project.
Template usage
- Recorded uses: 0
- Projects marked complete: 0 (self-declared)
- Independent completion results are not available.