Skip to content

Systematic Reviews

Session 4: Advanced Agentic Workflows

Agentic workflows work only when each AI role has a task, a boundary, and a verification gate.

Agentic design is the architecture of thinking at scale.

We now turn to designing agentic systems for complex, multi-step research processes. This is about architectural thinking: how to give each agent a role, define quality gates, and keep the human researcher in control.

This session also develops the critical thinking to decide when such systems are appropriate, how to maintain quality control, and where human judgment remains irreplaceable. By the end of this guide, you'll move from one-off prompting to deliberate orchestration.

Learning outcomes

By the end of this session, you'll be able to:

  • Design multi-agent workflows where different AI roles collaborate on complex research tasks
  • Implement quality control frameworks that maintain research rigor in automated systems
  • Critically evaluate when agentic approaches add value and when simpler methods work better
  • Navigate the ethical and professional considerations of increasingly autonomous research systems
  • Build practical, cost-effective workflows that integrate into your academic research practice

Multi-agent research architecture

Multi-agent research architecture
           +----------------------+
           | Human architect      |
           | goal / roles / gates |
           +----------+-----------+
                      |
                delegates through
                  checkpoints
                      |
                      v
           specialized AI roles
                      |
+-----------+  +----------+  +-----------+  +----------+
| discovery |  | analysis |  | synthesis |  | critique |
+-----+-----+  +----+-----+  +-----+-----+  +----+-----+
      |             |              |             |
  relevance       logic         novelty      integration
      |             |              |             |
      +-------------+------+-------+-------------+
                             |
                       all gates pass
                             |
                             v
                  +----------+----------+
                  | validated synthesis |
                  +----------+----------+
                             |
                     feedback / refine
                             |
                             +--------> Human architect

Info

Critical distinction: agentic workflows are not about removing humans from research. They are about strategic delegation of cognitive labor. The human architect maintains oversight, designs the system, and validates outputs. Quality control gates protect rigor when tasks become more automated.

Key concepts: the workshop prep kit

The readings below trace the arc from vision to practice: a high-level case for AI co-scientists, the engineering realities of multi-agent systems, practical implementation patterns, and how agentic workflows may reshape academic research.

Building your research architecture: a step-by-step guide

Part A: failure analysis

Review failure patterns first: before building a complex system, analyze the common failure modes documented in the Failure Museum. Understanding what goes wrong is the foundation for building systems you can inspect.

Identify quality-control checkpoints: these documented failures become checkpoints for the new system.

Part B: quality & ethics

Address ethical considerations: review institutional policies on AI use, data privacy, and proper documentation of AI assistance.

Build a quality-control framework: define the roles for human and AI at each stage of the research process, such as discovery, curation, analysis, and writing. Specify the verification method for each stage.

Warning

Do not skip this. Ethical frameworks protect both you and your research integrity.

Part C: multi-MCP orchestration

Build a research agent system: use a tool like Claude Code to connect multiple MCP servers, such as filesystem and web search.

Chain servers for workflows: design workflows that pass information between different servers to solve problems identified in your failure analysis. This is where theory meets practice.

For a step-by-step implementation of an SLR with Claude Code, including screening, extraction, and synthesis, see Building an SLR with Claude Code.


Recommended Exercise: Design Your Own Agentic Workflow

  1. Define your use case: build upon a systematic review or another research task.
  2. Design your architecture: map out which tasks will be automated vs. human-controlled.
  3. Specify your agents: define the roles and prompts for each AI agent in your system.
  4. Plan quality controls: identify verification points and failure modes, using your documented failures as a guide.
  5. Calculate costs: estimate API usage and time savings.

This is the capstone exercise for applying agentic thinking to your own research.

Pre-class setup for Session 4

Before this session, please ensure your research environment is fully prepared:

Curate your knowledge base

Have all your curated papers loaded and processed in your Cherry Studio knowledge base.

Test your workflow

Verify that the conversation export functionality to Obsidian is working correctly.

Prepare your protocol

Bring your draft systematic review protocol. We will be using it as the foundation for building our agentic workflows.

Beyond the guide

The workflows you design here can become the foundation for dissertation research, collaborative projects, and professional research practice.

The takeaway: agentic AI does not replace human expertise. It extends what the researcher can inspect, delegate, and verify.

Go deeper

Ready to explore advanced AI capabilities?


Navigation: Previous: Session 3Return to Case Study Overview

cite this page

Lin, X. (2026). Session 4: Advanced Agentic Workflows. Research Memex. https://research-memex.org/docs/case-studies/systematic-reviews/session-4-agentic-workflows

@misc{docs-case-studies-systematic-reviews-session-4-agentic-workflows-2026,
  author = {Xule Lin},
  title = {Session 4: Advanced Agentic Workflows},
  year = {2026},
  howpublished = {\url{https://research-memex.org/docs/case-studies/systematic-reviews/session-4-agentic-workflows}},
  note = {ORCID: 0000-0001-7885-4194}
}

one renderingthe source remains