research
Comprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research.
When & Why to Use This Skill
This comprehensive Claude research skill provides a powerful multi-source parallel research and content extraction system. It integrates multiple AI agents—including Claude, Perplexity, and Gemini—to perform deep-dive investigations, bypass web scraping blocks with intelligent retrieval layers, and utilize over 242 specialized Fabric patterns for wisdom extraction and content analysis. It is designed to transform raw web data into structured knowledge through automated workflows and parallel execution.
Use Cases
- Multi-source parallel research: Conduct extensive investigations on complex topics by launching multiple researcher agents simultaneously to ensure broader coverage and faster results than sequential searching.
- Intelligent content retrieval: Access data from difficult or bot-protected websites using a three-layer escalation system (WebFetch, BrightData, and Apify) that handles CAPTCHAs and complex JavaScript rendering.
- Automated wisdom extraction: Apply 242+ specialized Fabric patterns to summarize meetings, analyze technical papers, or extract key insights from YouTube videos via URL.
- Interview and subject preparation: Generate comprehensive background research and diverse sets of practice questions to prepare for professional interviews or deep-dive subject matter discussions.
- Knowledge synthesis and reporting: Automatically organize raw research outputs into structured markdown reports, synthesis notes, and permanent knowledge bases for long-term storage.
| name | research |
|---|---|
| description | Comprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research. |
Research Skill
API Keys Required
This skill works best with these optional API keys configured in ~/.env:
| Feature | API Key | Get It From |
|---|---|---|
| Perplexity Research | PERPLEXITY_API_KEY |
https://perplexity.ai/settings/api |
| Gemini Research | GOOGLE_API_KEY |
https://aistudio.google.com/app/apikey |
| BrightData Scraping | BRIGHTDATA_API_KEY |
https://brightdata.com |
Works without API keys:
- Claude-based research (uses built-in WebSearch)
- Basic web fetching (uses built-in WebFetch)
- Fabric patterns (if Fabric CLI installed)
Workflow Routing
Multi-Source Research Workflows
When user requests comprehensive parallel research:
Examples: "do research on X", "research this topic", "find information about Y", "investigate this subject"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/conduct.md
→ EXECUTE: Parallel multi-agent research using available researcher agents
When user requests Claude-based research (FREE - no API keys):
Examples: "use claude for research", "claude research on X", "use websearch to research Y"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/claude-research.md
→ EXECUTE: Intelligent query decomposition with Claude's WebSearch
When user requests Perplexity research (requires PERPLEXITY_API_KEY):
Examples: "use perplexity to research X", "perplexity research on Y"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/perplexity-research.md
→ EXECUTE: Fast web search with query decomposition via Perplexity API
When user requests interview preparation:
Examples: "prepare interview questions for X", "interview research on Y"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/interview-research.md
→ EXECUTE: Interview prep with diverse question generation
Content Retrieval Workflows
When user indicates difficulty accessing content:
Examples: "can't get this content", "site is blocking me", "CAPTCHA blocking"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/retrieve.md
→ EXECUTE: Escalation through layers (WebFetch → BrightData → Apify)
When user provides YouTube URL:
Examples: "get this youtube video", "extract from youtube URL"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/youtube-extraction.md
→ EXECUTE: YouTube content extraction using fabric -y
When user requests web scraping:
Examples: "scrape this site", "extract data from this website"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/web-scraping.md
→ EXECUTE: Web scraping techniques and tools
Fabric Pattern Processing
When user requests Fabric pattern usage:
Examples: "use fabric to X", "create threat model", "summarize with fabric"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/fabric.md
→ EXECUTE: Auto-select best pattern from 242+ Fabric patterns
Content Enhancement Workflows
When user requests content enhancement:
Examples: "enhance this content", "improve this draft"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/enhance.md
→ EXECUTE: Content improvement and refinement
When user requests knowledge extraction:
Examples: "extract knowledge from X", "get insights from this"
→ READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/extract-knowledge.md
→ EXECUTE: Knowledge extraction and synthesis
Multi-Source Research
Three Research Modes
QUICK RESEARCH MODE:
- User says "quick research" → Launch 1 agent per researcher type
- Timeout: 2 minutes
- Best for: Simple queries, straightforward questions
STANDARD RESEARCH MODE (Default):
- Default for most research requests → Launch 3 agents per researcher type
- Timeout: 3 minutes
- Best for: Most research needs, comprehensive coverage
EXTENSIVE RESEARCH MODE:
- User says "extensive research" → Launch 8 agents per researcher type
- Timeout: 10 minutes
- Best for: Deep-dive research, comprehensive reports
Available Research Agents
Check ${CLAUDE_PLUGIN_ROOT}/agents/ for agents with "researcher" in their name:
claude-researcher- Uses Claude's WebSearch (FREE, no API key needed)perplexity-researcher- Uses Perplexity API (requires PERPLEXITY_API_KEY)gemini-researcher- Uses Gemini API (requires GOOGLE_API_KEY)
Speed Benefits
- ❌ Old approach: Sequential searches → 5-10 minutes
- ✅ Quick mode: 1 agent per type → 2 minute timeout
- ✅ Standard mode: 3 agents per type → 3 minute timeout
- ✅ Extensive mode: 8 agents per type → 10 minute timeout
Intelligent Content Retrieval
Three-Layer Escalation System
Layer 1: Built-in Tools (Try First - FREE)
- WebFetch - Standard web content fetching
- WebSearch - Search engine queries
- When to use: Default for all content retrieval
Layer 2: BrightData MCP (requires BRIGHTDATA_API_KEY)
- CAPTCHA solving via Scraping Browser
- Advanced JavaScript rendering
- When to use: Bot detection blocking, CAPTCHA protection
Layer 3: Apify MCP (requires Apify account)
- Specialized site scrapers (Instagram, LinkedIn, etc.)
- Complex extraction logic
- When to use: Layers 1 and 2 both failed
Critical Rules:
- Always try simplest approach first (Layer 1)
- Escalate only when previous layer fails
- Document which layers were used and why
Fabric Pattern Selection
Categories (242+ Patterns)
Threat Modeling & Security:
create_threat_model,create_stride_threat_modelanalyze_threat_report,analyze_incident
Summarization:
summarize,create_5_sentence_summarysummarize_meeting,summarize_paper,youtube_summary
Wisdom Extraction:
extract_wisdom,extract_article_wisdomextract_insights,extract_main_idea
Analysis:
analyze_claims,analyze_code,analyze_debateanalyze_logs,analyze_paper
Content Creation:
create_prd,create_design_documentcreate_mermaid_visualization,create_user_story
Improvement:
improve_writing,improve_prompt,review_code
Usage
# Auto-select pattern based on intent
fabric [input] -p [selected_pattern]
# From URL
fabric -u "URL" -p [pattern]
# From YouTube
fabric -y "YOUTUBE_URL" -p [pattern]
File Organization
Working Directory (Scratchpad)
~/.claude/scratchpad/YYYY-MM-DD-HHMMSS_research-[topic]/
├── raw-outputs/
├── synthesis-notes.md
└── draft-report.md
Permanent Storage (History)
~/.claude/pai-history/research/YYYY-MM/YYYY-MM-DD_[topic]/
├── README.md
├── research-report.md
└── metadata.json
Key Principles
- Parallel execution - Launch multiple agents simultaneously
- Hard timeouts - Don't wait indefinitely, proceed with partial results
- Simplest first - Always try free tools before paid services
- Auto-routing - Skill analyzes intent and activates appropriate workflow
Examples
Example 1: Multi-source research
User: "Do research on quantum computing breakthroughs in 2024"
→ Activates conduct.md workflow
→ Launches parallel researcher agents (Claude, Perplexity, Gemini)
→ Synthesizes findings with source attribution and confidence levels
Example 2: Content extraction from YouTube
User: "Extract wisdom from this YouTube video: https://youtube.com/watch?v=abc123"
→ Activates youtube-extraction.md workflow
→ Uses Fabric CLI with -y flag for transcription
→ Applies extract_wisdom pattern to content
Example 3: Difficult site retrieval
User: "I can't get content from this CloudFlare-protected site"
→ Activates retrieve.md workflow
→ Escalates through layers: WebFetch → BrightData → Apify
→ Returns content in markdown format
Workflow Files
| Workflow | File | API Keys Needed |
|---|---|---|
| Multi-Source Research | workflows/conduct.md |
Varies by agent |
| Claude Research | workflows/claude-research.md |
None (FREE) |
| Perplexity Research | workflows/perplexity-research.md |
PERPLEXITY_API_KEY |
| Interview Prep | workflows/interview-research.md |
None |
| Content Retrieval | workflows/retrieve.md |
Optional: BRIGHTDATA_API_KEY |
| YouTube Extraction | workflows/youtube-extraction.md |
None (uses Fabric) |
| Web Scraping | workflows/web-scraping.md |
Optional: BRIGHTDATA_API_KEY |
| Fabric Patterns | workflows/fabric.md |
None |
| Content Enhancement | workflows/enhance.md |
None |
| Knowledge Extraction | workflows/extract-knowledge.md |
None |