Systematic Reviews
Session 4: Advanced Agentic Workflows
Agentic workflows work only when each AI role has a task, a boundary, and a verification gate.
Agentic design is the architecture of thinking at scale.
We now turn to designing agentic systems for complex, multi-step research processes. This is about architectural thinking: how to give each agent a role, define quality gates, and keep the human researcher in control.
This session also develops the critical thinking to decide when such systems are appropriate, how to maintain quality control, and where human judgment remains irreplaceable. By the end of this guide, you'll move from one-off prompting to deliberate orchestration.
Learning outcomes
By the end of this session, you'll be able to:
- Design multi-agent workflows where different AI roles collaborate on complex research tasks
- Implement quality control frameworks that maintain research rigor in automated systems
- Critically evaluate when agentic approaches add value and when simpler methods work better
- Navigate the ethical and professional considerations of increasingly autonomous research systems
- Build practical, cost-effective workflows that integrate into your academic research practice
Multi-agent research architecture
+----------------------+ | Human architect | | goal / roles / gates | +----------+-----------+ | delegates through checkpoints | v specialized AI roles | +-----------+ +----------+ +-----------+ +----------+ | discovery | | analysis | | synthesis | | critique | +-----+-----+ +----+-----+ +-----+-----+ +----+-----+ | | | | relevance logic novelty integration | | | | +-------------+------+-------+-------------+ | all gates pass | v +----------+----------+ | validated synthesis | +----------+----------+ | feedback / refine | +--------> Human architect
Info
Critical distinction: agentic workflows are not about removing humans from research. They are about strategic delegation of cognitive labor. The human architect maintains oversight, designs the system, and validates outputs. Quality control gates protect rigor when tasks become more automated.
Key concepts: the workshop prep kit
The readings below trace the arc from vision to practice: a high-level case for AI co-scientists, the engineering realities of multi-agent systems, practical implementation patterns, and how agentic workflows may reshape academic research.
- Conceptual architecture ("Towards an AI co-scientist"): the high-level vision, moving from single prompts to orchestrating a team of specialized AI roles.
- Engineering reality ("How we built our multi-agent research system"): the "what can go wrong" guide. Learning from professional teams helps anticipate and solve common problems.
- Practical implementation ("Claude Code: Best practices"): the primary lab manual, with specific instructions and code patterns for hands-on work.
- Professional context ("From Scarcity to Abundance"): how agentic workflows may change academic research practice.
Building your research architecture: a step-by-step guide
Part A: failure analysis
Review failure patterns first: before building a complex system, analyze the common failure modes documented in the Failure Museum. Understanding what goes wrong is the foundation for building systems you can inspect.
Identify quality-control checkpoints: these documented failures become checkpoints for the new system.
Part B: quality & ethics
Address ethical considerations: review institutional policies on AI use, data privacy, and proper documentation of AI assistance.
Build a quality-control framework: define the roles for human and AI at each stage of the research process, such as discovery, curation, analysis, and writing. Specify the verification method for each stage.
Warning
Do not skip this. Ethical frameworks protect both you and your research integrity.
Part C: multi-MCP orchestration
Build a research agent system: use a tool like Claude Code to connect multiple MCP servers, such as filesystem and web search.
Chain servers for workflows: design workflows that pass information between different servers to solve problems identified in your failure analysis. This is where theory meets practice.
For a step-by-step implementation of an SLR with Claude Code, including screening, extraction, and synthesis, see Building an SLR with Claude Code.
Recommended Exercise: Design Your Own Agentic Workflow
- Define your use case: build upon a systematic review or another research task.
- Design your architecture: map out which tasks will be automated vs. human-controlled.
- Specify your agents: define the roles and prompts for each AI agent in your system.
- Plan quality controls: identify verification points and failure modes, using your documented failures as a guide.
- Calculate costs: estimate API usage and time savings.
This is the capstone exercise for applying agentic thinking to your own research.
Pre-class setup for Session 4
Before this session, please ensure your research environment is fully prepared:
Curate your knowledge base
Have all your curated papers loaded and processed in your Cherry Studio knowledge base.
Test your workflow
Verify that the conversation export functionality to Obsidian is working correctly.
Prepare your protocol
Bring your draft systematic review protocol. We will be using it as the foundation for building our agentic workflows.
Beyond the guide
The workflows you design here can become the foundation for dissertation research, collaborative projects, and professional research practice.
The takeaway: agentic AI does not replace human expertise. It extends what the researcher can inspect, delegate, and verify.
Go deeper
Ready to explore advanced AI capabilities?
Related Resources
Complete tool installation and configuration
Core ReferencesPrompt templates and model guides
Failure MuseumLearn from common AI limitations
AI-Readable Docsllms.txt and Markdown access for AI tools
Navigation: Previous: Session 3 • Return to Case Study Overview
cite this page
Lin, X. (2026). Session 4: Advanced Agentic Workflows. Research Memex. https://research-memex.org/docs/case-studies/systematic-reviews/session-4-agentic-workflows
@misc{docs-case-studies-systematic-reviews-session-4-agentic-workflows-2026,
author = {Xule Lin},
title = {Session 4: Advanced Agentic Workflows},
year = {2026},
howpublished = {\url{https://research-memex.org/docs/case-studies/systematic-reviews/session-4-agentic-workflows}},
note = {ORCID: 0000-0001-7885-4194}
}one renderingthe source remains