firecrawl-scrape

Scrape web pages and extract content via Firecrawl MCP

⭐1.3kstars🔀76forks📁View on GitHub🕐Updated Jan 1, 2026

When & Why to Use This Skill

The Firecrawl Scrape skill empowers Claude to programmatically access, scrape, and extract high-quality content from any URL or search query. By leveraging the Firecrawl MCP, it converts complex web pages into clean, LLM-friendly formats like Markdown, HTML, or plain text, making it an essential tool for automated data gathering and real-time web information retrieval.

Use Cases

  • Competitive Intelligence: Automatically scrape competitor websites to monitor product updates, pricing strategies, and latest announcements.
  • Market Research & Content Aggregation: Search the web for specific industry trends and extract full-page content to generate comprehensive summaries or market reports.
  • Data Extraction for AI Analysis: Convert messy web layouts into structured Markdown to provide high-quality, noise-free context for complex analytical tasks.
  • Technical Documentation Retrieval: Quickly pull API references or technical documentation into the agent's workspace to assist with coding and debugging.
namefirecrawl-scrape
descriptionScrape web pages and extract content via Firecrawl MCP
allowed-tools[Bash, Read]

Firecrawl Scrape Skill

When to Use

  • Scrape content from any URL
  • Extract structured data from web pages
  • Search the web and get content

Instructions

uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://example.com" \
    --format "markdown"

Parameters

  • --url: URL to scrape
  • --format: Output format - markdown, html, text (default: markdown)
  • --search: (alternative) Search query instead of direct URL

Examples

# Scrape a page
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://docs.python.org/3/library/asyncio.html"

# Search and scrape
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --search "Python asyncio best practices 2024"

MCP Server Required

Requires firecrawl server in mcp_config.json with FIRECRAWL_API_KEY.