Research methods library

Quantitative decision guides

Practical, careful guidance for planning, measurement, modeling, validation, and reproducible quantitative work.

Search by question, method, model, or research topic.

Clear filters

79 decision guides

Published May 3, 202614 min read

PCA or Factor Analysis? The Same Variables, Two Different Research Questions

Principal component analysis and factor analysis can produce similar-looking output while answering different research questions. This synthetic case study uses the same 12 correlated survey variables to show why PCA is a dimensionality-reduction method and common factor analysis is a latent-variable framework.

Read guide
Published April 29, 202616 min read

Collider Bias Explained: How Adjusting for the Wrong Variable Can Create an Association

Collider bias shows why adding more variables to a causal regression model can increase rather than reduce bias. Learn how colliders, descendants, selection, participant restriction, and loss to follow-up can open noncausal paths—and how DAG-based reasoning helps identify variables that should and should not be adjusted for.

Read guide
Published April 15, 202616 min read

From 18 Survey Items to a Defensible Factor Structure: An EFA Case Study

An EFA should do more than produce a rotated loading matrix. This synthetic 18-item case study shows how construct definitions, correlations, factor retention, rotation, cross-loadings, and item content combine to produce a provisional factor structure—and why that structure still requires independent confirmation.

Read guide
Published April 6, 202617 min read

Which Statistical Test Should I Use? A Practical Decision Guide for Health and Medical Research

A practical framework for choosing a statistical test in health and medical research based on the research question, outcome type, dependence structure, number of groups, target of inference, and method assumptions. It also explains when a simple test should give way to regression, survival analysis, or another modeling framework.

Read guide
Published April 6, 202617 min read

Propensity Scores in Observational Research: What They Can and Cannot Fix

Propensity scores can improve comparability on measured pretreatment covariates and reveal poor overlap in observational studies. This Resource explains what matching, stratification, and weighting can accomplish—and why they cannot establish randomization or eliminate unmeasured confounding.

Read guide
Published March 31, 202616 min read

MANOVA vs Multiple ANOVAs: How to Decide When You Have Several Outcomes

Having several dependent variables does not automatically mean you should use MANOVA. This practical guide explains when a joint multivariate test answers the research question, when separate ANOVAs are more interpretable, how outcome correlations and Type I error affect the choice, and why repeated measurements are a different design problem.

Read guide
Published March 11, 202617 min read

The CFA Did Not Fit: Should We Modify the Model?

Poor CFA model fit does not mean you should keep following modification indices until CFI or RMSEA reaches a preferred value. This synthetic case study shows how to diagnose loadings, residuals, and modification evidence, distinguish theory-supported revisions from model fishing, and validate a revised confirmatory factor analysis.

Read guide
Apply the guide in context

A general guide cannot see your full study

Your design, measurement, data structure, assumptions, and existing output can change the appropriate statistical decision. If the choice is still unclear, discuss the study in context.