How to critically evaluate a research article
To critically evaluate a paper is to judge how much you should trust its conclusions — not to summarise it. The skill is a set of questions you run on every study: does the design fit the question, is the evidence sound, and do the claims actually follow from the results? Here is the checklist I use.
The appraisal checklist
- The question — is it clear, specific, and answerable?
- Design fit — does the design match the question? (A cross-sectional study can’t answer a causal question.)
- Sample — is it big enough (powered?) and representative? How was it sampled?
- Measures — are the instruments valid and reliable?
- Analysis — is the statistical test appropriate? Are effect sizes reported, not just p-values?
- Claims vs results — do the conclusions stay within what the data show, or overreach?
- Bias & funding — sources of bias, conflicts of interest, who paid?
- Limitations — does the paper name its own, honestly?
Quantitative vs qualitative appraisal
For quantitative work, focus on design, sampling, measurement, and statistics. For qualitative work, switch to trustworthiness: credibility, transferability, dependability, and confirmability — plus reflexivity and a clear audit trail. Judging a qualitative study by sample size alone is a category error.
Red flags
- Conclusions that overreach the data.
- Causal language on a correlational design.
- No limitations section.
- Tiny or unrepresentative sample; vague or missing methods.
- Significance with no effect size; undisclosed funding.
Get the free Literature Review toolkit
Search-strategy templates, a synthesis-matrix worksheet, and a critical-appraisal checklist from Literature Review Simplified. We’ll email you the download link.
Frequently asked questions
What does critical evaluation mean?
Judging how trustworthy a study's conclusions are — design fit, sample, measures, analysis, and whether claims match results — not just summarising it.
What questions should I ask?
Clear question? Design fits? Sample adequate? Measures valid? Analysis appropriate? Claims supported? Bias/funding? Limitations named?
How do I appraise a qualitative study?
Use trustworthiness — credibility, transferability, dependability, confirmability — plus reflexivity and an audit trail.
What are red flags?
Overreaching conclusions, causal claims on correlational data, no limitations, tiny samples, vague methods, significance with no effect size.