← Templates

Measure What Matters

22 tasks

The extent to which a measure captures the intended construct for a specified purpose; the overall strength of relationship between observed variable and latent concept. (Measure only what changes the decision.)

Start this plan

Sign in to review and change this plan before creating a private project.

Derived from guideMeasure What Matters
Source details

Derivation tier: T1

measurement · 6d8ae583e5b211701b7304e88a36e45d17f9e16384a4ad4e226956ea515e4b8a

Authorship and review status are not recorded here.

Template tasks (22)

Review tasks and choose or change owners before creating your project. Assigning an agent does not start it.

Tasks begin as To Do in your project.

  • #1Construct Definition & Decision ClarityHigh

    Pin down exactly what you intend to measure and tie that definition to the decision it must inform, before you write a single item.

    Completion check

    The construct definition & decision clarity work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 0 days after project start · Planned duration: 14 days

  • #2Item / Question Design QualityHigh

    Word, structure, and format individual items so respondents interpret them as you intend and can answer accurately.

    Completion check

    The item / question design quality work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 14 days after project start · Planned duration: 14 days

  • #3Scale / Measurement Level ChoiceMedium

    Tells you how to fix the measurement level — nominal, ordinal, interval, or ratio — for each thing you count, and which arithmetic that level actually licenses.

    Completion check

    The scale / measurement level choice work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 28 days after project start · Planned duration: 7 days

  • #4Content Sampling & Indicator AdequacyMedium

    Choose a set of indicators that covers the whole content domain of your construct without padding it with irrelevant or redundant items.

    Completion check

    The content sampling & indicator adequacy work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 35 days after project start · Planned duration: 7 days

  • #5Sample Adequacy & RepresentativenessMedium

    How large and how representative your development sample must be for factor structures, reliability estimates, and item statistics to be stable rather than accidents of your particular respondents.

    Completion check

    The sample adequacy & representativeness work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 42 days after project start · Planned duration: 7 days

  • #6Mode & Contextual ConditionsMedium

    Address the administration conditions you inherit rather than design—mode, medium, question sensitivity, continuous-testing pressure—and how they reshape how respondents answer.

    Completion check

    The mode & contextual conditions work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 49 days after project start · Planned duration: 7 days

  • #7Respondent Cognitive Response ProcessHigh

    Unpacks the four mental steps—comprehension, retrieval, judgment, response mapping—every respondent runs to answer a question, and where each step breaks.

    Completion check

    The respondent cognitive response process work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 56 days after project start · Planned duration: 14 days

  • #8Respondent Ability, Willingness & MotivationMedium

    Separates the two distinct reasons a respondent gives a poor answer—they can't (ability) or they won't (willingness)—and what each requires.

    Completion check

    The respondent ability, willingness & motivation work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 70 days after project start · Planned duration: 7 days

  • #9Response Rate & Data CompletenessMedium

    How much of your intended sample actually delivered usable data, and why the missing part matters more than the count that responded.

    Completion check

    The response rate & data completeness work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 77 days after project start · Planned duration: 7 days

  • #10Probability Sampling DesignLow

    How the probabilistic mechanism you use to select respondents — stratifying, clustering, sampling in stages — governs the precision and bias of any population estimate your measure feeds into.

    Completion check

    The probability sampling design work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 84 days after project start · Planned duration: 3 days

  • #11Sampling Frame QualityLow

    Audit the list you actually sample from—before it silently distorts every estimate downstream.

    Completion check

    The sampling frame quality work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 87 days after project start · Planned duration: 3 days

  • #12Data Screening & Analytic Procedure RigorMedium

    The pre-analysis and modeling decisions—cleaning, extraction, retention, rotation, estimation—that determine whether your factor structure reflects the data or your defaults.

    Completion check

    The data screening & analytic procedure rigor work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 90 days after project start · Planned duration: 7 days

  • #13Random Measurement ErrorHigh

    The noise floor of any measurement—the inconsistent scatter that shows up when you measure the same thing twice.

    Completion check

    The random measurement error work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 97 days after project start · Planned duration: 14 days

  • #14Systematic Error & BiasHigh

    Address the persistent offsets that make a metric consistently point at the wrong target—biases that repetition will not average away.

    Completion check

    The systematic error & bias work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 111 days after project start · Planned duration: 14 days

  • #15ReliabilityHigh

    Define how consistently your instrument reproduces results and how to quantify that consistency as a ratio of true signal to observed variation.

    Completion check

    The reliability work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 125 days after project start · Planned duration: 14 days

  • #16Validity & Total Measurement QualityHigh

    Whether your measure actually captures the concept you care about for the decision at hand—the overall verdict on measurement quality.

    Completion check

    The validity & total measurement quality work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 139 days after project start · Planned duration: 14 days

  • #17Dimensionality & Factor StructureMedium

    Check whether the items you are combining actually reflect one underlying thing—or several—before you sum them into a score.

    Completion check

    The dimensionality & factor structure work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 153 days after project start · Planned duration: 7 days

  • #18Comparability, Equating & Test SecurityMedium

    Address whether scores from different forms, times, languages, or channels mean the same thing—and how to protect the instrument so they keep meaning the same.

    Completion check

    The comparability, equating & test security work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 160 days after project start · Planned duration: 7 days

  • #19Calibrated JudgmentLow

    The trainable skill of expressing uncertainty so that your stated probabilities and intervals match reality—your 90% confidence bounds should contain the truth 90% of the time.

    Completion check

    The calibrated judgment work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 167 days after project start · Planned duration: 3 days

  • #20Value of InformationHigh

    Use the economic lens for deciding whether a measurement is worth taking at all, and how much precision to buy.

    Completion check

    The value of information work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 170 days after project start · Planned duration: 14 days

  • #21Reporting Transparency & ReplicabilityLow

    Documenting your analytic choices and results completely enough that someone else could reproduce them and judge their meaning.

    Completion check

    The reporting transparency & replicability work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 184 days after project start · Planned duration: 3 days

  • #22Quality of Inference & DecisionsHigh

    The ultimate payoff: whether the conclusions and decisions your measurement supports are actually trustworthy and profitable.

    Completion check

    The quality of inference & decisions work is complete: key decisions are recorded and outputs are ready for the next phase.

    Choose or change the owner during setup.

    Starts 187 days after project start · Planned duration: 14 days

Start this plan

Sign in to review and change this plan before creating a private project.

Template usage
  • Recorded uses: 0
  • Projects marked complete: 0 (self-declared)
  • Independent completion results are not available.