Where The Evidence Comes From — Meta-Analysis And The Research Substrate
16 tasks
The distribution of correlations or d-values as reported across a research literature prior to artifact correction — its observed mean and observed variance — confounding true and artifactual components and appearing to show conflicting findings. (Building trustworthy cumulative knowledge that moves the world.)
Sign in to review and change this plan before creating a private project.
Source details
Derivation tier: T1
research-substrate · e789750d5022f1a78c58243017ce416537e60bd55fa29e17795c266cc3691a16
Authorship and review status are not recorded here.
Template tasks (16)
Review tasks and choose or change owners before creating your project. Assigning an agent does not start it.
Tasks begin as To Do in your project.
- #1Observed Effect Size Distribution (Mean and Variance)High
Describes what you actually confront in the raw literature: a distribution of correlations or d-values that mixes true effect, sampling error, and artifacts into an apparently contradictory mess. You learn to read it as a confounded signal, not a verdict.
Completion check
The observed effect size distribution (mean and variance) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 0 days after project start · Planned duration: 14 days
- #2Substantive Domain Antecedents (Person/Context/Leadership)Low
Identifies the driver variables — person, context, and leadership characteristics — that a meta-analysis treats as the causal starting point, and shows why their construct definitions govern what you can legitimately pool.
Completion check
The substantive domain antecedents (person/context/leadership) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 14 days after project start · Planned duration: 3 days
- #3Substantive Mediating MechanismsLow
The psychological and relational variables — satisfaction, commitment, trust, LMX, strategy use — that carry effects from antecedents to outcomes, and how meta-analysis reconstructs those pathways from primary correlations.
Completion check
The substantive mediating mechanisms work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 17 days after project start · Planned duration: 3 days
- #4Substantive Domain OutcomesLow
Address the dependent variables a meta-analysis ultimately estimates — performance, engagement, strain, citizenship behavior — and how outcome definition and measurement source shape the pooled effect.
Completion check
The substantive domain outcomes work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 20 days after project start · Planned duration: 3 days
- #5True Effect Size Distribution (Mean and Variance)High
Define the target every meta-analysis aims at: the real distribution of effects that would emerge from flawless, infinite-sample studies. You learn to think of an effect not as a single number but as a mean with genuine spread.
Completion check
The true effect size distribution (mean and variance) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 23 days after project start · Planned duration: 14 days
- #6Study Design ArtifactsHigh
Catalogs the specific imperfections in primary studies — unreliable measures, restricted ranges, dichotomized variables, finite samples — that systematically distort what any single study reports. You learn to see each observed correlation as already corrupted before you touch it.
Completion check
The study design artifacts work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 37 days after project start · Planned duration: 14 days
- #7Sampling ErrorHigh
Isolates the single largest source of apparent disagreement across studies: the random scatter introduced by finite samples. You learn why small-sample studies bounce around a true value without any real effect differing between them.
Completion check
The sampling error work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 51 days after project start · Planned duration: 14 days
- #8Systematic Attenuation / Underestimation of True RelationshipMedium
The directional bias — always downward — that measurement error, dichotomization, and range restriction impose on the average observed effect. You learn why the literature systematically understates how strong relationships really are.
Completion check
The systematic attenuation / underestimation of true relationship work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 65 days after project start · Planned duration: 7 days
- #9Artifactual / Spurious VarianceMedium
Address the fraction of between-study variance that comes from artifacts rather than real heterogeneity. You learn to decompose total observed variance and ask how much is left once the artifacts are removed.
Completion check
The artifactual / spurious variance work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 72 days after project start · Planned duration: 7 days
- #10Artifact Correction Procedure (Meta-Analysis)Medium
The analytic engine of psychometric meta-analysis: the procedures that strip artifactual distortion from observed statistics to recover true parameters. You learn what the corrections do and what they require of your data.
Completion check
The artifact correction procedure (meta-analysis) work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 79 days after project start · Planned duration: 7 days
- #11Valid Moderator DetectionLow
Focus on about finding the real variables — populations, settings, treatments — that make an effect genuinely differ, and separating them from statistical mirages. You learn when a moderator search is warranted and how to conduct it honestly.
Completion check
The valid moderator detection work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 86 days after project start · Planned duration: 3 days
- #12Capitalization on ChanceLow
Names the specific statistical trap that undermines moderator analysis: testing many study-characteristic hypotheses against few studies inflates the odds of spurious 'findings.' You learn to recognize and quantify the risk.
Completion check
The capitalization on chance work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 89 days after project start · Planned duration: 3 days
- #13Cumulative Scientific KnowledgeMedium
The ultimate payoff: stable, generalizable facts assembled across many studies into coherent theory. You learn what distinguishes genuine accumulation from a pile of disconnected results.
Completion check
The cumulative scientific knowledge work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 92 days after project start · Planned duration: 7 days
- #14Validity of Generalized InferencesLow
Concerns whether the conclusions you draw from a synthesis are actually trustworthy and appropriately scoped. You learn to distinguish a defensible generalization from an overreach.
Completion check
The validity of generalized inferences work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 99 days after project start · Planned duration: 3 days
- #15Rigor of Synthesis ProcessLow
The workflow that makes a synthesis credible: problem formulation, comprehensive search, systematic coding, sound analysis, and transparent reporting. You learn that method quality upstream determines trust downstream.
Completion check
The rigor of synthesis process work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 102 days after project start · Planned duration: 3 days
- #16Utility for Policy and PracticeLow
Tells you what separates a synthesis that decision-makers actually use from one that sits uncited in a journal archive. It covers relevance, accessibility, and the pathway from pooled estimate to defensible action.
Completion check
The utility for policy and practice work is complete: key decisions are recorded and outputs are ready for the next phase.
Choose or change the owner during setup.
Starts 105 days after project start · Planned duration: 3 days
Sign in to review and change this plan before creating a private project.
Template usage
- Recorded uses: 0
- Projects marked complete: 0 (self-declared)
- Independent completion results are not available.