Research Workflow

Systematic Literature Review: The Definitive Guide (2025)

Master the systematic literature review process. Complete guide covering protocol development, search strategy, screening, data extraction, and synthesis.

Back to blogApril 16, 20268 min read
researchliterature-reviewmethodologyacademic

A systematic literature review is the most rigorous form of research synthesis.

It's also the most misunderstood.

Many people confuse it with:

  • Casual reading of related papers
  • Narrative review (broad, unstructured, subjective)
  • Scoping review (exploratory, not comprehensive)

A true systematic literature review is different.

It's:

  • Systematic: Follows a documented protocol
  • Reproducible: Someone else could follow your steps and get the same results
  • Comprehensive: Searches all relevant databases systematically
  • Explicit: Every decision is documented and justified

This comprehensive guide walks through every step of conducting a systematic literature review.


When to Use a Systematic Literature Review

Appropriate Uses

Use a systematic review when you need to:

  • Answer a specific research question with rigorous evidence
  • Synthesize results from multiple studies (especially for controversial topics)
  • Update existing knowledge with new research
  • Identify gaps in current research
  • Provide evidence for clinical/policy decisions
  • Meta-analyze quantitative results

Examples:

  • "Is therapy effective for anxiety?" (requires synthesis of many studies)
  • "What are the latest approaches to renewable energy storage?" (recent field, many papers)
  • "How does remote work impact productivity?" (many studies with conflicting results)

Inappropriate Uses

Don't use systematic review if you:

  • Want a quick overview (too slow, too detailed)
  • Need exploratory understanding of a new topic (use scoping review instead)
  • Have access to only a few studies (insufficient data)
  • Need to update methodology constantly (systematic reviews are snapshot-based)

Types of Literature Reviews

TypePurposeTimeRigorWhen to Use
NarrativeOverview, backgroundFastLowExploratory
ScopingScope of a topicMediumMediumExploratory
SystematicAnswer specific questionSlowHighEvidence synthesis
Meta-analysisQuantitative synthesisVery slowVery highWhen data pooling appropriate

The Systematic Review Process: Overview

Phase 1: Planning (2–4 weeks)

Develop protocol, define research question, create search strategy

Phase 2: Searching (1–2 weeks)

Search all relevant databases, document search terms

Phase 3: Screening (2–4 weeks)

Screen titles/abstracts, then full texts

Phase 4: Data Extraction (3–6 weeks)

Extract data from included studies in standardized format

Phase 5: Synthesis (2–4 weeks)

Analyze and synthesize data (qualitative or quantitative)

Phase 6: Reporting (1–2 weeks)

Write up findings, create PRISMA diagram


Phase 1: Protocol Development

Step 1: Develop Your Research Question

Use the PICO framework:

P = Population: Who/what is the study about?

  • Example: "Adults with generalized anxiety disorder"

I = Intervention: What treatment/factor are you examining?

  • Example: "Cognitive-behavioral therapy"

C = Comparison: What's the comparison?

  • Example: "Waitlist control"

O = Outcome: What results matter?

  • Example: "Reduction in anxiety symptoms"

Full question: "In adults with generalized anxiety disorder, how effective is cognitive-behavioral therapy compared to waitlist control for reducing anxiety symptoms?"

Step 2: Create Inclusion/Exclusion Criteria

Inclusion criteria (must meet ALL):

  • Published in English (or your language)
  • Published after 2015 (recent research)
  • RCT or quasi-experimental design
  • Measured anxiety reduction quantitatively

Exclusion criteria (any exclude):

  • Non-English
  • Pre-2015
  • Only describes intervention, no outcome measurement
  • Case studies or single-subject designs

Step 3: Identify Search Databases

Search every relevant database:

  • PubMed (medicine)
  • PsycINFO (psychology)
  • Web of Science (multidisciplinary)
  • Google Scholar (broad, lower quality control)
  • Your field's specific databases

Step 4: Develop Search Strategy

Create search terms using Boolean operators:

(anxiety) AND (cognitive-behavioral OR CBT)
AND (therapy OR treatment)
AND (RCT OR randomized OR trial)

Search each database with identical search terms.

Document every search (database, date, terms, number of results).

Step 5: Develop Data Extraction Form

Create a standardized form for extracting data from each included study:

Study: [Author, Year]
Design: [RCT/Quasi-experimental]
Population: [N, demographics]
Intervention: [Description]
Comparison: [Description]
Outcome: [Measurement, result, effect size]
Bias Risk: [High/Medium/Low]

Use same form for every study (standardization = reproducibility).

Step 6: Register Your Protocol

Register your protocol (publicly):

  • PROSPERO (for health research)
  • OSF Registries (open science)
  • Your field's registry

This prevents changing your question after you see results.


Phase 2: Comprehensive Searching

Search Step 1: Database Searching

For each database:

  1. Use your standardized search terms
  2. Document: database name, date, search terms, number of results
  3. Export all results (usually as CSV or BibTeX)
  4. Remove duplicates across databases

Example searching log:

Date: 2025-01-15
Database: PubMed
Search: (anxiety) AND (CBT OR cognitive-behavioral) AND (trial)
Results: 342
Exported: 342 to reference manager

Search Step 2: Hand Searching

Search for papers manually in key journals:

  • Journal of Anxiety Disorders
  • Cognitive Therapy and Research
  • Behaviour Research and Therapy

Look at last 5 years of published articles.

This catches papers databases might miss.

Search Step 3: Reference Tracking

Look at references in included studies.

Check citations of included studies ("cited by" in Google Scholar).

This finds papers that databases might miss.

Search Step 4: Author Contact

If you can't find the full paper:

Email the author. Ask for a copy.

Most authors respond.

Search Result: Deduplicated List

After all searching:

  • Remove duplicates (same paper from multiple databases)
  • Import into reference manager (Zotero, Mendeley, EndNote)
  • Create final search results spreadsheet

Example:

Total records from databases: 1,500
After deduplication: 1,200
Ready for screening: 1,200

Phase 3: Screening

Screening Step 1: Title and Abstract Screening

Read title and abstract of all 1,200 papers.

Apply inclusion criteria strictly (if unclear, include).

Remove papers clearly outside scope.

Before: 1,200 papers After: 200 papers (approximate)

Screening Step 2: Dual Review (Reduce Bias)

Have TWO reviewers independently screen each paper.

If reviewers disagree, they discuss and reach consensus.

This reduces individual bias.

Documentation:

Reviewer 1: Include
Reviewer 2: Exclude
Discussion: Both reviewers agree: Exclude (not about anxiety)

Screening Step 3: Full-Text Screening

Retrieve full text of remaining papers (~200).

Read full text carefully.

Apply inclusion/exclusion criteria strictly.

Document reason for exclusion if applicable.

Before: 200 papers After: 45 papers (your included studies)


Phase 4: Data Extraction

Extraction Step 1: Standardized Form

Use your pre-designed extraction form for each study.

Extract:

  • Study characteristics (author, year, design)
  • Population (N, age, demographics)
  • Intervention (what, how long, intensity)
  • Comparison (what, how long)
  • Outcomes (what measured, results, effect sizes)
  • Risk of bias assessment

Extraction Step 2: Dual Review Again

Two reviewers independently extract data from each study.

Compare extractions. Resolve discrepancies.

Document the process.

Extraction Step 3: Risk of Bias Assessment

For each study, assess risk of bias:

  • Selection bias: Were participants randomly assigned?
  • Performance bias: Was there blinding?
  • Detection bias: Were outcomes assessed blindly?
  • Attrition bias: Did people drop out equally between groups?
  • Reporting bias: Were all outcomes reported?

Use a tool like Cochrane Risk of Bias assessment.

Rate each as: High risk / Low risk / Unclear


Phase 5: Data Synthesis

Synthesis Option 1: Qualitative Synthesis

If studies are too heterogeneous to combine:

Summarize findings narratively:

By outcome:

  • Anxiety reduction: 38/45 studies showed improvement
  • Depression reduction: 25/45 studies showed improvement
  • Quality of life: 20/45 studies showed improvement

By study type:

  • RCTs: [summary]
  • Quasi-experimental: [summary]

By population:

  • Mild anxiety: [summary]
  • Severe anxiety: [summary]

Synthesis Option 2: Meta-Analysis (Quantitative)

If studies measure similar outcomes with sufficient detail:

Pool results statistically:

  1. Extract effect sizes from each study
  2. Calculate pooled effect size (overall treatment effect)
  3. Assess heterogeneity (how different are study results?)
  4. Create forest plot (visual representation)
  5. Assess for publication bias

Example forest plot interpretation:

  • All studies show improvement
  • Effect sizes range 0.3 to 1.2
  • Pooled effect size: 0.72 (moderate effect)
  • Interpretation: CBT is moderately effective for anxiety

Phase 6: Reporting and Documentation

Reporting Step 1: PRISMA Checklist

Follow PRISMA (Preferred Reporting Items for Systematic Reviews) checklist.

27-item checklist ensuring you report:

  • Background and objectives
  • Search strategy
  • Study selection process
  • Data extraction methods
  • Risk of bias assessment
  • Results (including PRISMA flow diagram)
  • Synthesis findings
  • Conclusion and implications

Reporting Step 2: PRISMA Flow Diagram

Visual representation of review process:

Records identified (n=1,500)
         ↓
Records screened (n=1,200)
         ↓
Excluded (n=1,000)
         ↓
Full texts assessed (n=200)
         ↓
Excluded (n=155)
         ↓
Studies included (n=45)

Reporting Step 3: Documentation

Create appendices documenting:

  • Full search strategies per database
  • PRISMA checklist completed
  • Risk of bias summary
  • Data extraction form
  • List of excluded studies with reasons
  • Any protocol deviations

This allows reproducibility.


Tools That Help

Tool 1: Reference Managers

Zotero (free) or Mendeley (free tier available)

  • Import search results
  • Remove duplicates
  • Organize papers
  • Generate citations

Tool 2: Screening Software

Covidence (paid) or DistillerSR (paid)

  • Support dual reviewer screening
  • Track agreements/disagreements
  • Generate statistics

Tool 3: Data Extraction

Excel or Google Sheets

  • Simple but effective
  • Create standardized extraction form
  • Track dual extraction

Tool 4: Meta-Analysis Software

Revman (free) or Comprehensive Meta-Analysis (paid)

  • Pool effect sizes
  • Generate forest plots
  • Assess heterogeneity

Timeline: Realistic Expectations

PhaseDurationOutput
Planning2–4 weeksProtocol, registered
Searching1–2 weeksComprehensive list of papers
Screening2–4 weeks40–50 included studies
Extraction3–6 weeksStandardized data from all studies
Synthesis2–4 weeksResults, forest plots, conclusions
Reporting1–2 weeksFinal manuscript
Total11–22 weeksPublished review

(With 1–2 reviewers, part-time)


Common Mistakes

Mistake 1: Changing Criteria After Searching

You see papers and think "Oh, I should also look at anxiety + depression."

You change your criteria mid-review.

This introduces bias.

Fix: Lock your criteria before searching. Changes allowed only if documented.

Mistake 2: Single Reviewer

One person screens, extracts, and assesses bias.

Increases subjectivity and error.

Fix: Always dual review (two independent reviewers).

Mistake 3: Weak Search Strategy

You only search one database.

You miss papers.

Your review is incomplete.

Fix: Search ≥3 databases. Do hand searching and reference tracking.

Mistake 4: No Risk of Bias Assessment

You include all studies equally.

Low-quality studies skew your results.

Fix: Assess risk of bias for every study. Report it separately.

Mistake 5: Undocumented Decisions

Later, nobody remembers why papers were excluded or how decisions were made.

Fix: Document EVERYTHING. Every decision. Every discussion.


Realistic Expectations

What Systematic Reviews Do

✅ Rigorously synthesize evidence from multiple studies

✅ Provide reproducible, transparent methodology

✅ Reduce bias through standardized processes

✅ Guide clinical/policy decisions with high confidence

✅ Identify research gaps

What They Don't Do

❌ Guarantee "perfect" truth (they're limited by included studies)

❌ Happen quickly (takes 3–6 months minimum)

❌ Replace critical thinking (you still interpret results)

❌ Prevent all bias (they reduce it, not eliminate)


Conclusion

A systematic literature review is the gold standard for research synthesis.

Process:

  1. Plan: Protocol, research question, criteria
  2. Search: Multiple databases, hand search, reference tracking
  3. Screen: Title/abstract, then full text (dual review)
  4. Extract: Standardized forms, dual review
  5. Synthesize: Qualitative or meta-analysis
  6. Report: PRISMA-compliant manuscript

Why it matters:

  • Reproducible (transparent method)
  • Comprehensive (all available evidence)
  • Rigorous (reduces bias)
  • Guideline-compliant (PRISMA standards)

Timeline: 3–6 months for complete review

Start this week if you're planning a systematic review:

  1. Develop your research question (PICO)
  2. Create inclusion/exclusion criteria
  3. Register protocol (PROSPERO or OSF)
  4. Begin database searches

For more on research, see Build a Research Workflow. For citation management, check Citation Best Practices.

Be systematic. Be transparent. Be reproducible.

Conduct reviews that advance knowledge.

Keep reading

More WebSnips articles that pair well with this topic.