enactfirecrawl
Scrape, crawl, search, and extract structured data from websites using Firecrawl API - converts web pages to LLM-ready markdown
When & Why to Use This Skill
The Firecrawl Claude skill enables seamless web data acquisition by scraping, crawling, and searching websites to produce LLM-ready markdown. It simplifies complex data extraction tasks by automatically handling anti-bot mechanisms and JavaScript rendering, allowing users to convert any web page into structured, actionable information optimized for AI models.
Use Cases
- Knowledge Base Construction: Crawl entire documentation websites or technical blogs to gather clean markdown content for RAG (Retrieval-Augmented Generation) systems and AI training.
- Market Intelligence: Search the web for the latest industry trends and use AI-powered extraction to generate structured reports on competitor activities and news headlines.
- E-commerce Data Analysis: Extract structured pricing, product descriptions, and availability from online stores using custom JSON schemas for automated monitoring.
- Lead Generation & Site Auditing: Map out all URLs within a domain to identify key landing pages or discover specific sub-pages for targeted data collection.
| name | enact/firecrawl |
|---|---|
| version | 1.2.0 |
| description | Extract structured data from a page using AI |
| enact | "2.0" |
| from | python:3.12-slim |
| secret | true |
| command | python /workspace/firecrawl.py ${action} ${url} ${formats} ${limit} ${only_main_content} ${prompt} ${schema} |
| timeout | 300s |
| license | MIT |
| readOnlyHint | true |
| openWorldHint | true |
| type | string |
| - scrape | Extract content from a single URL |
| - crawl | Discover and scrape all subpages of a website |
| - map | Get all URLs from a website (fast discovery) |
| - search | Search the web and get scraped results |
| - extract | Extract structured data using AI |
| default | "" |
| - For map | Search query to filter URLs |
| - For extract | Natural language instruction for what to extract |
| url | "https://news.ycombinator.com" |
| action | "extract" |
| limit | 5 |
| prompt | "Extract the top 5 news headlines with their URLs and point counts" |
Firecrawl Web Scraping Tool
A powerful web scraping tool that uses the Firecrawl API to convert websites into clean, LLM-ready markdown and extract structured data.
Features
- Scrape: Extract content from a single URL as markdown, HTML, or with screenshots
- Crawl: Automatically discover and scrape all accessible subpages of a website
- Map: Get a list of all URLs from a website without scraping content (extremely fast)
- Search: Search the web and get full scraped content from results
- Extract: Use AI to extract structured data from pages with natural language prompts
Setup
- Get an API key from firecrawl.dev
- Set your API key as a secret:
enact env set FIRECRAWL_API_KEY <your-api-key> --secret --namespace enact
This stores your API key securely in your OS keyring (macOS Keychain, Windows Credential Manager, or Linux Secret Service).
Usage Examples
Scrape a single page
enact run enact/firecrawl --url "https://example.com" --action scrape
Crawl an entire documentation site
enact run enact/firecrawl --url "https://docs.example.com" --action crawl --limit 20
Map all URLs on a website
enact run enact/firecrawl --url "https://example.com" --action map
Search the web
enact run enact/firecrawl --url "latest AI developments 2024" --action search --limit 5
Extract structured data with AI
enact run enact/firecrawl --url "https://news.ycombinator.com" --action extract --prompt "Extract the top 10 news headlines with their URLs"
Extract with a JSON schema
enact run enact/firecrawl \
--url "https://example.com/pricing" \
--action extract \
--prompt "Extract pricing information" \
--schema '{"type":"object","properties":{"plans":{"type":"array","items":{"type":"object","properties":{"name":{"type":"string"},"price":{"type":"string"}}}}}}'
Output
The tool returns JSON with:
- markdown: Clean, LLM-ready content
- metadata: Title, description, language, source URL
- extract: Structured data (for extract action)
- links: Discovered URLs (for map action)
API Features
Firecrawl handles the hard parts of web scraping:
- Anti-bot mechanisms
- Dynamic JavaScript content
- Proxies and rate limiting
- PDF and document parsing
- Screenshot capture