Systematic Reviews
Session 2: Building the Human-AI Research Pipeline
A systematic review becomes easier to teach when the research pipeline is visible and testable.
Building the pipeline once teaches more than reading about it ten times.
This guide offers a hands-on workshop for designing and executing a systematic review with AI tools. The approach is cognitive-first: instead of just learning to operate tools, we learn to think with them. We engage with AI as a mirror that makes our own research processes visible, helping us deconstruct complex tasks like "finding a gap" or "building a theory" into explicit, repeatable steps.
By the end of this session, you'll move beyond generic AI interaction to purposeful orchestration.
Learning outcomes
By the end of this session, you'll be able to:
- Construct a high-quality, curated literature set using discovery (Research Rabbit) and management (Zotero) tools
- Deconstruct complex research tasks (e.g., "synthesizing a framework") into explicit, step-by-step cognitive operations
- Design and implement structured, multi-step prompts ("cognitive blueprints") that guide AI through sophisticated analytical work
- Critically evaluate AI-generated outputs, identifying common failure modes (like "botshit" and paradigm blindness)
- Architect a research workflow that strategically combines your domain expertise with AI capabilities
The complete research pipeline
seed papers | v citation discovery | v expanded set | v +--------+--------+ | Human curation | +--------+--------+ | v reference library | v AI-assisted analysis | +--------+--------+ | quality control | +--------+--------+ | issues? +----> revise method | | +<-----------+ | v research synthesis
Human judgment provides quality gates throughout this pipeline: AI handles scale and pattern detection, while researchers provide curation and evaluation.
Core readings: the AI toolkit
Mindset & mental models
Interpretive Orchestration
Why this matters: establishes the professional mindset for this approach. It frames the researcher as the person who designs and checks the workflow, not a passive operator.
"the void" by nostalgebraist
Why this matters: provides a mental model for context-setting. You are not simply "talking to an AI"; you are shaping a predictive system through the information you provide.
Techniques & best practices
The Prompt Report: A Systematic Survey of Prompt Engineering Techniques
Why this matters: provides a shared vocabulary and technical map for prompt engineering practice.
Gemini 2.5 Pro Capable of Winning Gold at IMO 2025
Why this matters: shows how strong results come from a strong process. It teaches scaffolding: building a thinking process for the AI to follow.
Risks & responsibility
Beware of Botshit: How to Manage the Epistemic Risks of Generative Chatbots
Why this matters: gives researchers a framework for identifying epistemic risk in chatbot outputs.
Supplementary readings
Quick reference guides
DAIR.AI — Prompt Engineering Guide
Why this matters: offers practical definitions and examples that complement the more formal "Prompt Report."
Anthropic — Prompt engineering best practices
Why this matters: moves from general theory to model-specific advice that you can test in your own workflow.
Foundational papers
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Why this matters: provides the research basis for breaking complex problems into reasoning steps.
ReAct: Synergizing Reasoning and Acting in LMs
Why this matters: explains the Reason → Act → Observe loop behind many agentic systems.
Advanced context
Andrej Karpathy — Context engineering thread
Why this matters: shifts attention from asking better questions to giving the model the information it needs to answer well.
Simon Willison — "In defense of prompt engineering"
Why this matters: explains why prompt engineering remains a useful research skill when it is treated as context design, not phrase tuning.
Session structure
Our hands-on session will follow this structure:
- Pipeline Overview - Understanding the complete workflow
- Discovery & Curation - Mastering Research Rabbit and Zotero
- AI Integration - Setting up Cherry Studio and MCP servers
- Pipeline Practice - Working with a sample literature set
We use the scaling and scalability literature as a shared case study throughout these guides: research on how organizations grow, and on whether their structures, processes, business models, and capabilities can handle that growth. In this course shorthand:
Scaling: growth in size or scope.
Scalability: the capacity to grow without the organization breaking or losing coherence.
A seed library of 10 foundational papers is provided, which you can expand using the discovery methods we learn today.
MCP server setup (Live demo)
During the AI Integration phase, we'll add the first MCP servers:
Follow Along
- Open Cherry Studio → Settings → MCP Configuration
- Enable @cherry/filesystem to access your research files
- Add @cherry/sequentialthinking for structured analysis
- Test both servers with your sample papers
- Test what changes when AI has direct file access.
For more MCP exploration, see the MCP Explorer Guide.
By the end, you'll have a complete, tested workflow for systematic reviews conducted through human-AI collaboration.
Pre-class setup for Session 2
Before our hands-on session, please complete the following setup to ensure you're ready to dive in.
Complete initial setup
Follow the Cherry Studio Setup Guide to complete Steps 1-6. This includes installation, API setup, and basic MCP configuration.
Test your environment
- Test at least one AI model to ensure it's responding.
- Test the Zotero MCP integration to confirm it can access your library.
Prepare your research vault
- Set up your Obsidian vault with the recommended folder structure from the setup guide.
- Bring 3-5 of your core "seed papers" as PDFs, ready to be added to your knowledge base.
During class, we will:
- Set up knowledge bases together
- Practice Zotero MCP searches
- Export conversations to Obsidian
- Create literature note templates
- Practice conversation forking for different analyses
How Do You Know It's Working?
Recommended Exercises
- Read the foundational papers on different review types (e.g., Llewellyn 2021, Yuki 2024).
- Develop a synthesis prompt: Using the provided sample papers, combine the IMO approach with a chosen paper's method.
- Prepare a presentation: Document notes for a 3-5 minute presentation on your synthesis.
- Continue expanding your personal literature library in Zotero using Research Rabbit.
- MCP Explorer Challenge: Find 2-3 MCP servers relevant to your research on smithery.ai, install one, and test it.
Note: the IMO paper provides a template for structuring AI thinking processes. Apply this to your own synthesis tasks.
Related Resources
Complete tool installation and configuration
Core ReferencesPrompt templates and model guides
Failure MuseumLearn from common AI limitations
AI-Readable Docsllms.txt and Markdown access for AI tools
Navigation: Return to Case Study Overview • Next: Session 3
cite this page
Lin, X. (2026). Session 2: Building the Human-AI Research Pipeline. Research Memex. https://research-memex.org/docs/case-studies/systematic-reviews/session-2-ai-powered-practice
@misc{docs-case-studies-systematic-reviews-session-2-ai-powered-practice-2026,
author = {Xule Lin},
title = {Session 2: Building the Human-AI Research Pipeline},
year = {2026},
howpublished = {\url{https://research-memex.org/docs/case-studies/systematic-reviews/session-2-ai-powered-practice}},
note = {ORCID: 0000-0001-7885-4194}
}one renderingthe source remains