research

jeffh's avatarfrom jeffh

Comprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research.

⭐5stars🔀0forks📁View on GitHub🕐Updated Dec 28, 2025

When & Why to Use This Skill

This comprehensive Claude research skill provides a powerful multi-source parallel research and content extraction system. It integrates multiple AI agents—including Claude, Perplexity, and Gemini—to perform deep-dive investigations, bypass web scraping blocks with intelligent retrieval layers, and utilize over 242 specialized Fabric patterns for wisdom extraction and content analysis. It is designed to transform raw web data into structured knowledge through automated workflows and parallel execution.

Use Cases

  • Multi-source parallel research: Conduct extensive investigations on complex topics by launching multiple researcher agents simultaneously to ensure broader coverage and faster results than sequential searching.
  • Intelligent content retrieval: Access data from difficult or bot-protected websites using a three-layer escalation system (WebFetch, BrightData, and Apify) that handles CAPTCHAs and complex JavaScript rendering.
  • Automated wisdom extraction: Apply 242+ specialized Fabric patterns to summarize meetings, analyze technical papers, or extract key insights from YouTube videos via URL.
  • Interview and subject preparation: Generate comprehensive background research and diverse sets of practice questions to prepare for professional interviews or deep-dive subject matter discussions.
  • Knowledge synthesis and reporting: Automatically organize raw research outputs into structured markdown reports, synthesis notes, and permanent knowledge bases for long-term storage.
nameresearch
descriptionComprehensive research, analysis, and content extraction system. Multi-source parallel research using available researcher agents. Deep content analysis with extended thinking. Intelligent retrieval for difficult sites. Fabric pattern selection for 242+ specialized prompts. USE WHEN user says 'do research', 'extract wisdom', 'analyze content', 'find information about', or requests web/content research.

Research Skill

API Keys Required

This skill works best with these optional API keys configured in ~/.env:

Feature API Key Get It From
Perplexity Research PERPLEXITY_API_KEY https://perplexity.ai/settings/api
Gemini Research GOOGLE_API_KEY https://aistudio.google.com/app/apikey
BrightData Scraping BRIGHTDATA_API_KEY https://brightdata.com

Works without API keys:

  • Claude-based research (uses built-in WebSearch)
  • Basic web fetching (uses built-in WebFetch)
  • Fabric patterns (if Fabric CLI installed)

Workflow Routing

Multi-Source Research Workflows

When user requests comprehensive parallel research: Examples: "do research on X", "research this topic", "find information about Y", "investigate this subject" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/conduct.md → EXECUTE: Parallel multi-agent research using available researcher agents

When user requests Claude-based research (FREE - no API keys): Examples: "use claude for research", "claude research on X", "use websearch to research Y" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/claude-research.md → EXECUTE: Intelligent query decomposition with Claude's WebSearch

When user requests Perplexity research (requires PERPLEXITY_API_KEY): Examples: "use perplexity to research X", "perplexity research on Y" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/perplexity-research.md → EXECUTE: Fast web search with query decomposition via Perplexity API

When user requests interview preparation: Examples: "prepare interview questions for X", "interview research on Y" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/interview-research.md → EXECUTE: Interview prep with diverse question generation

Content Retrieval Workflows

When user indicates difficulty accessing content: Examples: "can't get this content", "site is blocking me", "CAPTCHA blocking" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/retrieve.md → EXECUTE: Escalation through layers (WebFetch → BrightData → Apify)

When user provides YouTube URL: Examples: "get this youtube video", "extract from youtube URL" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/youtube-extraction.md → EXECUTE: YouTube content extraction using fabric -y

When user requests web scraping: Examples: "scrape this site", "extract data from this website" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/web-scraping.md → EXECUTE: Web scraping techniques and tools

Fabric Pattern Processing

When user requests Fabric pattern usage: Examples: "use fabric to X", "create threat model", "summarize with fabric" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/fabric.md → EXECUTE: Auto-select best pattern from 242+ Fabric patterns

Content Enhancement Workflows

When user requests content enhancement: Examples: "enhance this content", "improve this draft" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/enhance.md → EXECUTE: Content improvement and refinement

When user requests knowledge extraction: Examples: "extract knowledge from X", "get insights from this" → READ: ${CLAUDE_PLUGIN_ROOT}/skills/research/workflows/extract-knowledge.md → EXECUTE: Knowledge extraction and synthesis


Multi-Source Research

Three Research Modes

QUICK RESEARCH MODE:

  • User says "quick research" → Launch 1 agent per researcher type
  • Timeout: 2 minutes
  • Best for: Simple queries, straightforward questions

STANDARD RESEARCH MODE (Default):

  • Default for most research requests → Launch 3 agents per researcher type
  • Timeout: 3 minutes
  • Best for: Most research needs, comprehensive coverage

EXTENSIVE RESEARCH MODE:

  • User says "extensive research" → Launch 8 agents per researcher type
  • Timeout: 10 minutes
  • Best for: Deep-dive research, comprehensive reports

Available Research Agents

Check ${CLAUDE_PLUGIN_ROOT}/agents/ for agents with "researcher" in their name:

  • claude-researcher - Uses Claude's WebSearch (FREE, no API key needed)
  • perplexity-researcher - Uses Perplexity API (requires PERPLEXITY_API_KEY)
  • gemini-researcher - Uses Gemini API (requires GOOGLE_API_KEY)

Speed Benefits

  • ❌ Old approach: Sequential searches → 5-10 minutes
  • ✅ Quick mode: 1 agent per type → 2 minute timeout
  • ✅ Standard mode: 3 agents per type → 3 minute timeout
  • ✅ Extensive mode: 8 agents per type → 10 minute timeout

Intelligent Content Retrieval

Three-Layer Escalation System

Layer 1: Built-in Tools (Try First - FREE)

  • WebFetch - Standard web content fetching
  • WebSearch - Search engine queries
  • When to use: Default for all content retrieval

Layer 2: BrightData MCP (requires BRIGHTDATA_API_KEY)

  • CAPTCHA solving via Scraping Browser
  • Advanced JavaScript rendering
  • When to use: Bot detection blocking, CAPTCHA protection

Layer 3: Apify MCP (requires Apify account)

  • Specialized site scrapers (Instagram, LinkedIn, etc.)
  • Complex extraction logic
  • When to use: Layers 1 and 2 both failed

Critical Rules:

  • Always try simplest approach first (Layer 1)
  • Escalate only when previous layer fails
  • Document which layers were used and why

Fabric Pattern Selection

Categories (242+ Patterns)

Threat Modeling & Security:

  • create_threat_model, create_stride_threat_model
  • analyze_threat_report, analyze_incident

Summarization:

  • summarize, create_5_sentence_summary
  • summarize_meeting, summarize_paper, youtube_summary

Wisdom Extraction:

  • extract_wisdom, extract_article_wisdom
  • extract_insights, extract_main_idea

Analysis:

  • analyze_claims, analyze_code, analyze_debate
  • analyze_logs, analyze_paper

Content Creation:

  • create_prd, create_design_document
  • create_mermaid_visualization, create_user_story

Improvement:

  • improve_writing, improve_prompt, review_code

Usage

# Auto-select pattern based on intent
fabric [input] -p [selected_pattern]

# From URL
fabric -u "URL" -p [pattern]

# From YouTube
fabric -y "YOUTUBE_URL" -p [pattern]

File Organization

Working Directory (Scratchpad)

~/.claude/scratchpad/YYYY-MM-DD-HHMMSS_research-[topic]/
├── raw-outputs/
├── synthesis-notes.md
└── draft-report.md

Permanent Storage (History)

~/.claude/pai-history/research/YYYY-MM/YYYY-MM-DD_[topic]/
├── README.md
├── research-report.md
└── metadata.json

Key Principles

  1. Parallel execution - Launch multiple agents simultaneously
  2. Hard timeouts - Don't wait indefinitely, proceed with partial results
  3. Simplest first - Always try free tools before paid services
  4. Auto-routing - Skill analyzes intent and activates appropriate workflow

Examples

Example 1: Multi-source research

User: "Do research on quantum computing breakthroughs in 2024"
→ Activates conduct.md workflow
→ Launches parallel researcher agents (Claude, Perplexity, Gemini)
→ Synthesizes findings with source attribution and confidence levels

Example 2: Content extraction from YouTube

User: "Extract wisdom from this YouTube video: https://youtube.com/watch?v=abc123"
→ Activates youtube-extraction.md workflow
→ Uses Fabric CLI with -y flag for transcription
→ Applies extract_wisdom pattern to content

Example 3: Difficult site retrieval

User: "I can't get content from this CloudFlare-protected site"
→ Activates retrieve.md workflow
→ Escalates through layers: WebFetch → BrightData → Apify
→ Returns content in markdown format

Workflow Files

Workflow File API Keys Needed
Multi-Source Research workflows/conduct.md Varies by agent
Claude Research workflows/claude-research.md None (FREE)
Perplexity Research workflows/perplexity-research.md PERPLEXITY_API_KEY
Interview Prep workflows/interview-research.md None
Content Retrieval workflows/retrieve.md Optional: BRIGHTDATA_API_KEY
YouTube Extraction workflows/youtube-extraction.md None (uses Fabric)
Web Scraping workflows/web-scraping.md Optional: BRIGHTDATA_API_KEY
Fabric Patterns workflows/fabric.md None
Content Enhancement workflows/enhance.md None
Knowledge Extraction workflows/extract-knowledge.md None