Research Workflow

Build a Research Workflow from Scratch: A Practical System for Serious Researchers

Design a systematic research workflow from discovery to output. Learn capture, organization, synthesis, and writing stages with practical tool recommendations.

Back to blogApril 16, 20267 min read
researchworkflowproductivityknowledge-management

Most people research by accident.

They Google something.

They read a few pages.

They remember (or forget) what they read.

They write something.

This is not a workflow. It's chaos.

Good research is reproducible. Documented. Intentional.

A documented research workflow ensures you can:

  • Reproduce your process later
  • Collaborate with others
  • Build on previous work reliably
  • Write faster (because you're organized)

This guide covers building a research workflow from scratch.


Why Your Current Research Process Isn't Working

Problem 1: No Capture System

You find a useful paper.

You think "I'll remember this."

Three weeks later, you forget where it came from.

Result: Lost sources. Panic during citation.

Problem 2: No Organization System

You have 200 bookmarks and 50 files.

They're named "Research1", "Article", "Stuff".

You can't find anything.

Result: Duplicated research. Wasted time.

Problem 3: No Evaluation System

You find conflicting sources.

You don't know which to trust.

You cite the one you read first.

Result: Weak research. Poor decisions.

Problem 4: No Synthesis System

You gather 50 sources.

You have no system for comparing them.

You write from memory.

Result: Incomplete coverage. Missed nuances.

Solution: A documented workflow that forces intentionality at each stage.


The Five Stages of a Research Workflow

Stage 1: Discovery

Goal: Find sources and decide if they're worth investigating.

Process:

  • Define your research question
  • Search multiple sources (databases, Google Scholar, primary sources)
  • Skim titles and abstracts
  • Decide: "Worth reading?" (yes/no/maybe)
  • Document your searches (reproducibility)

Outcome: A list of candidate sources

Stage 2: Capture

Goal: Save the full text and metadata of promising sources.

Process:

  • Import full text (PDF, webpage, article)
  • Save metadata (author, date, title, URL)
  • Use a citation manager to normalize data
  • Tag with topic/relevance

Outcome: Organized archive with searchable full text

Stage 3: Evaluation

Goal: Assess credibility and relevance of each source.

Process:

  • Read source (or abstract + introduction if lengthy)
  • Assess: author credibility, methodology, recency, bias
  • Note conflicting sources
  • Rate: highly relevant / relevant / low relevance
  • Document reasoning

Outcome: Curated sources with credibility assessment

Stage 4: Synthesis

Goal: Extract key insights and connect them.

Process:

  • Identify common themes across sources
  • Note conflicts and resolve them
  • Extract key data/quotes (with citations)
  • Create synthesis notes comparing sources
  • Spot research gaps

Outcome: Synthesized knowledge ready for writing

Stage 5: Output

Goal: Turn research into finished work.

Process:

  • Write draft (using research notes)
  • Cite sources (your citation manager generates bibliography)
  • Review for gaps
  • Revise

Outcome: Finished article/paper with citations


Stage 1 in Detail: Discovery

Step 1: Define Your Research Question

Vague: "Tell me about AI"

Clear: "What are the ethical implications of AI in criminal justice systems?"

Specificity drives search strategy and determines what counts as "relevant."

Step 2: Search Multiple Sources

SourceBest ForDrawback
Google ScholarBroad, multidisciplinaryLess curated
PubMedMedical/health researchLimited to health
JSTORAcademic depthRequires subscription
GoogleFast, broadNoisier results
Personal networksExpert perspectivesSubjective

Search each source with identical search terms (reproducibility).

Step 3: Document Your Search

Create a search log:

Date: 2025-01-15
Question: "Ethical implications of AI in criminal justice"
Search term: "AI criminal justice ethics"
Source: Google Scholar
Results: 1,240
Skimmed: 50 titles
Promising: 12

This allows someone else to repeat your search.

Step 4: Skim and Filter

Read title + abstract. Decide quickly:

  • YES: Directly answers your question (save)
  • MAYBE: Tangentially related (tag for later)
  • NO: Not relevant (skip)

Don't read full text yet. You're filtering, not analyzing.

Step 5: Create a Candidate List

Export filtered sources to your citation manager.

You now have a prioritized list to dive into.


Stage 2 in Detail: Capture

Step 1: Choose Your Tools

Citation Manager (required):

  • Zotero (free, open-source)
  • Mendeley (free tier available)
  • EndNote (paid, academic standard)

Web Clipper (optional but recommended):

  • WebSnips (for webpage capture)
  • Zotero browser extension (captures metadata + PDF)

Step 2: Import Sources

Import using:

  • ISBN/DOI: Type it in, system fetches metadata automatically
  • Browser extension: Captures page, auto-generates citation
  • PDF files: Upload, system extracts metadata
  • Batch import: Export from Google Scholar or database, import to manager

Step 3: Normalize Metadata

Check each source for complete data:

  • Title: Full and accurate?
  • Author: All authors listed?
  • Date: Publication date correct?
  • Source: Journal/website/publisher?
  • URL: Works (not broken link)?
  • PDF: Full text attached?

Fix incomplete metadata now (it's harder later).

Step 4: Tag and Organize

Create a tag structure (don't create folders; tags are more flexible):

Topic tags: #ai, #criminal-justice, #ethics
Status tags: #read, #toread, #skimmed
Quality tags: #highquality, #secondary, #opinion

Tag each source immediately after adding.

Step 5: Link to Your Research Question

Add a note to each source:

"Why I saved this: Discusses algorithmic bias in risk assessment tools"

Later, you'll remember context.


Stage 3 in Detail: Evaluation

Step 1: Read and Assess

For each source, evaluate:

Author credibility:

  • Is the author an expert in this field?
  • Do they have relevant qualifications or experience?
  • Have they published peer-reviewed work?

Methodology:

  • For empirical research: Was the study design sound?
  • For opinion pieces: Are arguments well-supported?

Recency:

  • Is the information current?
  • For fast-moving fields (AI), recent matters
  • For foundational concepts, older sources are fine

Bias:

  • Is the author representing multiple perspectives?
  • Do they disclose conflicts of interest?
  • Is the publication neutral or advocacy-oriented?

Step 2: Create an Evaluation Note

For each source, document:

Source: Smith, J. (2023). "AI in criminal justice"

Credibility: HIGH
- Published in peer-reviewed journal
- Author is criminal justice scholar with 15 years experience
- Cites other high-quality sources

Bias: LOW-MEDIUM
- Generally balanced
- Acknowledges limitations
- Doesn't overstate findings

Relevance: HIGH
- Directly discusses ethical implications
- Focuses on prediction bias (my key interest)

Key findings:
- AI risk assessment tools have 20-30% higher error rates for minority defendants
- Error compounding across system stages
- Regulatory frameworks still inadequate

Conflicts/gaps:
- Doesn't address bias mitigation strategies
- Limited sample size (3 jurisdictions)

Step 3: Compare and Contrast

Create a comparison matrix:

SourceMethodFinding on BiasFinding on RegulationQuality
Smith 2023Study20-30% errorInsufficientHigh
Jones 2022OpinionNot quantifiedAbsentMedium
Brown 2024Study15-25% errorEmergingHigh

This shows where consensus exists and where sources conflict.

Step 4: Flag Conflicts

When sources disagree:

Document the disagreement and investigate:

Conflict: Smith claims AI bias is 20-30%. Jones claims <5%.

Investigation:
- Smith studies U.S. systems
- Jones studies U.K. systems
- Different regulatory environments explain difference
- Conclusion: Both correct in their contexts

This prevents you from making false conclusions.


Stage 4 in Detail: Synthesis

Step 1: Extract Key Insights

For each source, pull out:

  • Key finding (the main point)
  • Supporting evidence (data, examples)
  • Implications (what this means)
  • Limitations (what we don't know)

Example:

Key finding: AI risk assessment tools show 20-30% higher error rates for minority defendants

Supporting evidence:
- Smith et al. analyzed 10,000 cases across 3 U.S. states
- Controlled for legal factors (prior record, charge severity)
- Racial bias persisted even after accounting for legal factors

Implications:
- Current tools perpetuate criminal justice inequities
- Risk assessment alone isn't sufficient; humans need override power

Limitations:
- Study limited to 3 jurisdictions
- Doesn't test bias mitigation strategies
- Doesn't address why bias exists

Step 2: Identify Common Themes

Read all your synthesis notes.

What patterns emerge?

Theme 1: Technical bias in AI
- Multiple sources document algorithmic bias
- Causes: biased training data, design decisions

Theme 2: Regulatory gaps
- Current regulations inadequate
- Need sector-specific oversight

Theme 3: Mitigation strategies
- Few sources discuss solutions
- Research gap identified

Step 3: Create Synthesis Notes

Write comparative notes:

# AI Bias: Sources Compare

All sources agree on:
- Bias exists in current AI criminal justice tools
- Root cause is biased training data

Sources disagree on:
- Magnitude (Smith: 20-30% error vs Jones: <5%)
- Regulatory solution (Brown: stronger oversight vs Wang: industry self-regulation)

Research gap:
- Limited discussion of how to audit and mitigate bias
- No sources address long-term justice system impact

This becomes your article outline.


Stage 5 in Detail: Output

Step 1: Organize Your Synthesis Notes

Create an outline based on themes:

1. Introduction: Define the problem
2. Technical bias exists (theme 1 + evidence)
3. Current regulations are inadequate (theme 2 + evidence)
4. Solutions are emerging (theme 3 + evidence)
5. Research gaps remain (what we don't know)
6. Conclusion: Call to action

Step 2: Write Using Your Research

Draft each section using your synthesis notes.

Your citation manager generates citations automatically (most managers integrate with Word/Google Docs).

Step 3: Cite as You Write

Every claim should be supported:

"AI risk assessment tools show 20-30% higher error rates for minority defendants [Smith, 2023]."

This prevents accidental plagiarism and strengthens your work.

Step 4: Review for Gaps

Before finalizing:

  • Are all claims cited?
  • Did I address conflicting sources?
  • Did I acknowledge research gaps?
  • Did I miss any key sources?

If you've missed major sources, your research process worked (you identified the gap).


Documentation: Making Your Workflow Reproducible

Document 1: Search Log

What you searched, where, when, how many results

Document 2: Source List

All sources, with reason for inclusion/exclusion

Document 3: Evaluation Assessments

Credibility ratings and reasoning for each source

Document 4: Synthesis Notes

Key findings, conflicts, themes, gaps

Document 5: Decision Journal

Why you made major decisions (included/excluded source, chose interpretation, etc.)

Why document?

  • Transparency (others can understand your process)
  • Reproducibility (others can verify)
  • Learning (you learn what worked/didn't work)

Tools for Each Stage

StageBest ToolAlternative
DiscoveryGoogle ScholarPubMed, JSTOR
CaptureZoteroMendeley
OrganizationCitation Manager tagsFolders (less recommended)
SynthesisNote app (Obsidian, Notion)Citation manager notes
OutputWord/Google DocsOverleaf (for LaTeX)

Realistic Expectations

Workflow Overhead

  • Small project (5 sources): 2–3 hours overhead
  • Medium project (30 sources): 8–15 hours overhead
  • Large project (100+ sources): 30+ hours overhead

This feels like extra work initially, but it saves time in writing (you're organized).

Writing Speed Improvement

  • Without workflow: 40 hours research + writing for a 5,000-word article
  • With workflow: 25 hours research + writing for same article

Workflow pays for itself after your second article.


Common Mistakes

Mistake 1: Treating All Sources Equally

You cite a blog post with equal weight as a peer-reviewed study.

Fix: Evaluate and differentiate source quality.

Mistake 2: Capturing Without Evaluating

You save 100 sources without reading them.

Later you cite blindly.

Fix: Read abstracts during discovery. Don't save everything.

Mistake 3: No Search Documentation

You repeat searches. Different results. Confusion.

Fix: Document every search with date, terms, results.

Mistake 4: Broken Metadata

You save sources with incomplete citations.

During writing, you can't cite properly.

Fix: Check metadata immediately after capturing.


Building Your First Workflow

Week 1: Set Up

  • Choose citation manager (recommend Zotero)
  • Set up tag structure
  • Choose note-taking app (Notion, Obsidian, etc.)
  • Create search log template

Week 2: First Project

  • Conduct discovery (document searches)
  • Capture 20–30 promising sources
  • Evaluate each (write assessment notes)
  • Extract key insights

Week 3: Synthesis

  • Identify themes
  • Resolve conflicts
  • Create synthesis notes
  • Draft outline

Week 4: Output

  • Write article using research
  • Cite automatically from manager
  • Review and revise
  • Publish

Conclusion

A documented research workflow transforms ad-hoc searching into reliable, reproducible research.

Five stages:

  1. Discovery: Find and filter sources
  2. Capture: Save with complete metadata
  3. Evaluation: Assess credibility
  4. Synthesis: Extract insights and compare
  5. Output: Write with strong citations

Benefits:

  • Reproducible (you can do it again)
  • Transparent (others understand your process)
  • Faster writing (you're organized)
  • Better quality (you've evaluated sources)

Start this week:

  1. Choose a research question
  2. Define your discovery process
  3. Set up a citation manager
  4. Find and save 10 sources
  5. Evaluate each one

By next week, you'll have a system that becomes more valuable the more you use it.

For more on research, see Systematic Literature Review. For citations, check Citation Management.

Research systematically. Document intentionally. Publish confidently.

Keep reading

More WebSnips articles that pair well with this topic.