Measure What Matters
22 tasks
The extent to which a measure captures the intended construct for a specified purpose; the overall strength of relationship between observed variable and latent concept. (Measure only what changes the decision.)
Sign in to review and change this plan before creating a private project.
Source details
Derivation tier: T1
measurement · 6d8ae583e5b211701b7304e88a36e45d17f9e16384a4ad4e226956ea515e4b8a
Authorship and review status are not recorded here.
Template tasks (22)
Review tasks and choose or change owners before creating your project. Assigning an agent does not start it.
Tasks begin as To Do in your project.
- #1Construct Definition & Decision ClarityHigh
Pin down exactly what you intend to measure and tie that definition to the decision it must inform, before you write a single item.
Completion check
The construct definition & decision clarity work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 0 days after project start · Planned duration: 14 days
- #2Item / Question Design QualityHigh
Word, structure, and format individual items so respondents interpret them as you intend and can answer accurately.
Completion check
The item / question design quality work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 14 days after project start · Planned duration: 14 days
- #3Scale / Measurement Level ChoiceMedium
Tells you how to fix the measurement level — nominal, ordinal, interval, or ratio — for each thing you count, and which arithmetic that level actually licenses.
Completion check
The scale / measurement level choice work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 28 days after project start · Planned duration: 7 days
- #4Content Sampling & Indicator AdequacyMedium
Choose a set of indicators that covers the whole content domain of your construct without padding it with irrelevant or redundant items.
Completion check
The content sampling & indicator adequacy work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 35 days after project start · Planned duration: 7 days
- #5Sample Adequacy & RepresentativenessMedium
How large and how representative your development sample must be for factor structures, reliability estimates, and item statistics to be stable rather than accidents of your particular respondents.
Completion check
The sample adequacy & representativeness work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 42 days after project start · Planned duration: 7 days
- #6Mode & Contextual ConditionsMedium
Address the administration conditions you inherit rather than design—mode, medium, question sensitivity, continuous-testing pressure—and how they reshape how respondents answer.
Completion check
The mode & contextual conditions work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 49 days after project start · Planned duration: 7 days
- #7Respondent Cognitive Response ProcessHigh
Unpacks the four mental steps—comprehension, retrieval, judgment, response mapping—every respondent runs to answer a question, and where each step breaks.
Completion check
The respondent cognitive response process work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 56 days after project start · Planned duration: 14 days
- #8Respondent Ability, Willingness & MotivationMedium
Separates the two distinct reasons a respondent gives a poor answer—they can't (ability) or they won't (willingness)—and what each requires.
Completion check
The respondent ability, willingness & motivation work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 70 days after project start · Planned duration: 7 days
- #9Response Rate & Data CompletenessMedium
How much of your intended sample actually delivered usable data, and why the missing part matters more than the count that responded.
Completion check
The response rate & data completeness work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 77 days after project start · Planned duration: 7 days
- #10Probability Sampling DesignLow
How the probabilistic mechanism you use to select respondents — stratifying, clustering, sampling in stages — governs the precision and bias of any population estimate your measure feeds into.
Completion check
The probability sampling design work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 84 days after project start · Planned duration: 3 days
- #11Sampling Frame QualityLow
Audit the list you actually sample from—before it silently distorts every estimate downstream.
Completion check
The sampling frame quality work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 87 days after project start · Planned duration: 3 days
- #12Data Screening & Analytic Procedure RigorMedium
The pre-analysis and modeling decisions—cleaning, extraction, retention, rotation, estimation—that determine whether your factor structure reflects the data or your defaults.
Completion check
The data screening & analytic procedure rigor work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 90 days after project start · Planned duration: 7 days
- #13Random Measurement ErrorHigh
The noise floor of any measurement—the inconsistent scatter that shows up when you measure the same thing twice.
Completion check
The random measurement error work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 97 days after project start · Planned duration: 14 days
- #14Systematic Error & BiasHigh
Address the persistent offsets that make a metric consistently point at the wrong target—biases that repetition will not average away.
Completion check
The systematic error & bias work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 111 days after project start · Planned duration: 14 days
- #15ReliabilityHigh
Define how consistently your instrument reproduces results and how to quantify that consistency as a ratio of true signal to observed variation.
Completion check
The reliability work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 125 days after project start · Planned duration: 14 days
- #16Validity & Total Measurement QualityHigh
Whether your measure actually captures the concept you care about for the decision at hand—the overall verdict on measurement quality.
Completion check
The validity & total measurement quality work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 139 days after project start · Planned duration: 14 days
- #17Dimensionality & Factor StructureMedium
Check whether the items you are combining actually reflect one underlying thing—or several—before you sum them into a score.
Completion check
The dimensionality & factor structure work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 153 days after project start · Planned duration: 7 days
- #18Comparability, Equating & Test SecurityMedium
Address whether scores from different forms, times, languages, or channels mean the same thing—and how to protect the instrument so they keep meaning the same.
Completion check
The comparability, equating & test security work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 160 days after project start · Planned duration: 7 days
- #19Calibrated JudgmentLow
The trainable skill of expressing uncertainty so that your stated probabilities and intervals match reality—your 90% confidence bounds should contain the truth 90% of the time.
Completion check
The calibrated judgment work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 167 days after project start · Planned duration: 3 days
- #20Value of InformationHigh
Use the economic lens for deciding whether a measurement is worth taking at all, and how much precision to buy.
Completion check
The value of information work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 170 days after project start · Planned duration: 14 days
- #21Reporting Transparency & ReplicabilityLow
Documenting your analytic choices and results completely enough that someone else could reproduce them and judge their meaning.
Completion check
The reporting transparency & replicability work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 184 days after project start · Planned duration: 3 days
- #22Quality of Inference & DecisionsHigh
The ultimate payoff: whether the conclusions and decisions your measurement supports are actually trustworthy and profitable.
Completion check
The quality of inference & decisions work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 187 days after project start · Planned duration: 14 days
Sign in to review and change this plan before creating a private project.
Template usage
- Recorded uses: 0
- Projects marked complete: 0 (self-declared)
- Independent completion results are not available.