firecrawl-scrape
Scrape web pages and extract content via Firecrawl MCP
When & Why to Use This Skill
The Firecrawl Scrape skill empowers Claude to programmatically access, scrape, and extract high-quality content from any URL or search query. By leveraging the Firecrawl MCP, it converts complex web pages into clean, LLM-friendly formats like Markdown, HTML, or plain text, making it an essential tool for automated data gathering and real-time web information retrieval.
Use Cases
- Competitive Intelligence: Automatically scrape competitor websites to monitor product updates, pricing strategies, and latest announcements.
- Market Research & Content Aggregation: Search the web for specific industry trends and extract full-page content to generate comprehensive summaries or market reports.
- Data Extraction for AI Analysis: Convert messy web layouts into structured Markdown to provide high-quality, noise-free context for complex analytical tasks.
- Technical Documentation Retrieval: Quickly pull API references or technical documentation into the agent's workspace to assist with coding and debugging.
| name | firecrawl-scrape |
|---|---|
| description | Scrape web pages and extract content via Firecrawl MCP |
| allowed-tools | [Bash, Read] |
Firecrawl Scrape Skill
When to Use
- Scrape content from any URL
- Extract structured data from web pages
- Search the web and get content
Instructions
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
--url "https://example.com" \
--format "markdown"
Parameters
--url: URL to scrape--format: Output format -markdown,html,text(default: markdown)--search: (alternative) Search query instead of direct URL
Examples
# Scrape a page
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
--url "https://docs.python.org/3/library/asyncio.html"
# Search and scrape
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
--search "Python asyncio best practices 2024"
MCP Server Required
Requires firecrawl server in mcp_config.json with FIRECRAWL_API_KEY.