research

multicam's avatarfrom multicam

Comprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research.

⭐1stars🔀0forks📁View on GitHub🕐Updated Dec 23, 2025

When & Why to Use This Skill

The Research skill is a comprehensive multi-source system designed for parallel research, deep content analysis, and intelligent data extraction. It leverages multiple AI agents—including Claude, Perplexity, and Gemini—alongside advanced retrieval layers to provide high-quality insights, bypass web blocks, and utilize over 242 specialized Fabric patterns for wisdom extraction and content enhancement.

Use Cases

  • Parallel Multi-Agent Research: Conduct deep-dive investigations into complex topics by launching multiple research agents simultaneously to gather diverse perspectives and verify facts.
  • Intelligent Content Retrieval: Access and extract data from difficult-to-reach websites using a three-layer escalation system that handles CAPTCHAs and bot detection.
  • YouTube & Media Extraction: Automatically extract transcripts and 'wisdom' from YouTube URLs to generate summaries, key insights, or structured notes.
  • Specialized Pattern Processing: Use 242+ Fabric patterns to instantly transform raw research into professional outputs like PRDs, threat models, or meeting summaries.
  • Interview & Academic Preparation: Generate comprehensive interview guides, diverse question sets, and deep-dive reports for academic or professional readiness.
nameresearch
contextfork
modelsonnet
descriptionComprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research.

Research Skill

API Keys Required

This skill works best with these optional API keys configured in ~/.env:

Feature API Key Get It From
Perplexity Research PERPLEXITY_API_KEY https://perplexity.ai/settings/api
Gemini Research GOOGLE_API_KEY https://aistudio.google.com/app/apikey
BrightData Scraping BRIGHTDATA_API_KEY https://brightdata.com

Works without API keys:

  • Claude-based research (uses built-in WebSearch)
  • Basic web fetching (uses built-in WebFetch)
  • Fabric patterns (if Fabric CLI installed)

Workflow Routing

Multi-Source Research Workflows

When user requests comprehensive parallel research: Examples: "do research on X", "research this topic", "find information about Y", "investigate this subject" → READ: ${PAI_DIR}/skills/research/workflows/conduct.md → EXECUTE: Parallel multi-agent research using available researcher agents

When user requests Claude-based research (FREE - no API keys): Examples: "use claude for research", "claude research on X", "use websearch to research Y" → READ: ${PAI_DIR}/skills/research/workflows/claude-research.ts → EXECUTE: Intelligent query decomposition with Claude's WebSearch

When user requests Perplexity research (requires PERPLEXITY_API_KEY): Examples: "use perplexity to research X", "perplexity research on Y" → READ: ${PAI_DIR}/skills/research/workflows/perplexity-research.ts → EXECUTE: Fast web search with query decomposition via Perplexity API

When user requests interview preparation: Examples: "prepare interview questions for X", "interview research on Y" → READ: ${PAI_DIR}/skills/research/workflows/interview-research.md → EXECUTE: Interview prep with diverse question generation

Content Retrieval Workflows

When user indicates difficulty accessing content: Examples: "can't get this content", "site is blocking me", "CAPTCHA blocking" → READ: ${PAI_DIR}/skills/research/workflows/retrieve.md → EXECUTE: Escalation through layers (WebFetch → BrightData → Apify)

When user provides YouTube URL: Examples: "get this youtube video", "extract from youtube URL" → READ: ${PAI_DIR}/skills/research/workflows/youtube-extraction.md → EXECUTE: YouTube content extraction using fabric -y

When user requests web scraping: Examples: "scrape this site", "extract data from this website" → READ: ${PAI_DIR}/skills/research/workflows/web-scraping.md → EXECUTE: Web scraping techniques and tools

Fabric Pattern Processing

When user requests Fabric pattern usage: Examples: "use fabric to X", "create threat model", "summarize with fabric" → READ: ${PAI_DIR}/skills/research/workflows/fabric.md → EXECUTE: Auto-select best pattern from 242+ Fabric patterns

Content Enhancement Workflows

When user requests content enhancement: Examples: "enhance this content", "improve this draft" → READ: ${PAI_DIR}/skills/research/workflows/enhance.md → EXECUTE: Content improvement and refinement

When user requests knowledge extraction: Examples: "extract knowledge from X", "get insights from this" → READ: ${PAI_DIR}/skills/research/workflows/extract-knowledge.md → EXECUTE: Knowledge extraction and synthesis


Multi-Source Research

Three Research Modes

QUICK RESEARCH MODE:

  • User says "quick research" → Launch 1 agent per researcher type
  • Timeout: 2 minutes
  • Best for: Simple queries, straightforward questions

STANDARD RESEARCH MODE (Default):

  • Default for most research requests → Launch 3 agents per researcher type
  • Timeout: 3 minutes
  • Best for: Most research needs, comprehensive coverage

EXTENSIVE RESEARCH MODE:

  • User says "extensive research" → Launch 8 agents per researcher type
  • Timeout: 10 minutes
  • Best for: Deep-dive research, comprehensive reports

Available Research Agents

Check ${PAI_DIR}/agents/ for agents with "researcher" in their name:

  • claude-researcher - Uses Claude's WebSearch (FREE, no API key needed)
  • perplexity-researcher - Uses Perplexity API (requires PERPLEXITY_API_KEY)
  • gemini-researcher - Uses Gemini API (requires GOOGLE_API_KEY)

Speed Benefits

  • ❌ Old approach: Sequential searches → 5-10 minutes
  • ✅ Quick mode: 1 agent per type → 2 minute timeout
  • ✅ Standard mode: 3 agents per type → 3 minute timeout
  • ✅ Extensive mode: 8 agents per type → 10 minute timeout

Intelligent Content Retrieval

Three-Layer Escalation System

Layer 1: Built-in Tools (Try First - FREE)

  • WebFetch - Standard web content fetching
  • WebSearch - Search engine queries
  • When to use: Default for all content retrieval

Layer 2: BrightData (requires BRIGHTDATA_API_KEY)

  • CAPTCHA solving via Scraping Browser
  • Advanced JavaScript rendering
  • When to use: Bot detection blocking, CAPTCHA protection

Layer 3: Apify (requires Apify account)

  • Specialized site scrapers (Instagram, LinkedIn, etc.)
  • Complex extraction logic
  • When to use: Layers 1 and 2 both failed

Critical Rules:

  • Always try simplest approach first (Layer 1)
  • Escalate only when previous layer fails
  • Document which layers were used and why

Fabric Pattern Selection

Categories (242+ Patterns)

Threat Modeling & Security:

  • create_threat_model, create_stride_threat_model
  • analyze_threat_report, analyze_incident

Summarization:

  • summarize, create_5_sentence_summary
  • summarize_meeting, summarize_paper, youtube_summary

Wisdom Extraction:

  • extract_wisdom, extract_article_wisdom
  • extract_insights, extract_main_idea

Analysis:

  • analyze_claims, analyze_code, analyze_debate
  • analyze_logs, analyze_paper

Content Creation:

  • create_prd, create_design_document
  • create_mermaid_visualization, create_user_story

Improvement:

  • improve_writing, improve_prompt, review_code

Usage

# Auto-select pattern based on intent
fabric [input] -p [selected_pattern]

# From URL
fabric -u "URL" -p [pattern]

# From YouTube
fabric -y "YOUTUBE_URL" -p [pattern]

File Organization

Working Directory (Scratchpad)

${PAI_DIR}/scratchpad/YYYY-MM-DD-HHMMSS_research-[topic]/
├── raw-outputs/
├── synthesis-notes.md
└── draft-report.md

Permanent Storage (History)

${PAI_DIR}/history/research/YYYY-MM/YYYY-MM-DD_[topic]/
├── README.md
├── research-report.md
└── metadata.json

Key Principles

  1. Parallel execution - Launch multiple agents simultaneously
  2. Hard timeouts - Don't wait indefinitely, proceed with partial results
  3. Simplest first - Always try free tools before paid services
  4. Auto-routing - Skill analyzes intent and activates appropriate workflow

WebSearch Tool Usage

Built-in Web Search (FREE)

Claude Code includes a built-in WebSearch tool for real-time web queries.

When to Use:

  • Current events and recent information
  • Documentation and API references
  • Pricing, availability, status checks
  • Fact verification beyond training data

Best Practices:

// Include year for recent info
WebSearch({ query: "Next.js 15 features 2024" })

// Be specific
WebSearch({ query: "TypeScript 5.4 satisfies operator examples" })

// Use domain filtering for trusted sources
WebSearch({
  query: "React hooks best practices",
  allowed_domains: ["react.dev", "kentcdodds.com"]
})

Query Optimization:

  • Include year: "React Server Components 2024"
  • Be specific: "Bun vs Node.js benchmark comparison"
  • Use domain filters: Focus on official docs or trusted sources

Source Citation: Always cite sources in research output:

## Sources
- [React Documentation](https://react.dev/...)
- [Official Blog Post](https://...)

WebSearch vs WebFetch

Need Tool
Search for information WebSearch
Get specific page content WebFetch
Multiple search results WebSearch
Full article extraction WebFetch

Integration with Research Workflows

WebSearch is the foundation of claude-researcher agent:

  1. Query decomposition into sub-queries
  2. Parallel WebSearch calls
  3. Result synthesis
  4. Source attribution

Workflow Files

Workflow File API Keys Needed
Multi-Source Research workflows/conduct.md Varies by agent
Claude Research workflows/claude-research.md None (FREE)
Perplexity Research workflows/perplexity-research.md PERPLEXITY_API_KEY
Interview Prep workflows/interview-research.md None
Content Retrieval workflows/retrieve.md Optional: BRIGHTDATA_API_KEY
YouTube Extraction workflows/youtube-extraction.md None (uses Fabric)
Web Scraping workflows/web-scraping.md Optional: BRIGHTDATA_API_KEY
Fabric Patterns workflows/fabric.md None
Content Enhancement workflows/enhance.md None
Knowledge Extraction workflows/extract-knowledge.md None