web-scraping

tatat 的头像作者 tatat

使用CSS选择器和XPath从网页中提取结构化数据

📖 中文导读:使用CSS选择器和XPath从网页中提取结构化数据 以下正文为该技能的原始 SKILL.md 内容(英文),上方安装命令可直接使用。

name: web-scraping description: Extract structured data from web pages using CSS selectors and XPath

Web Scraping

Extract structured data from web pages.

Capabilities

  • Fetch HTML content from URLs
  • Parse and extract specific elements (tables, lists, text)
  • Handle pagination
  • Output in JSON or CSV format

Supported Selectors

  • CSS selectors: .class, #id, tag
  • XPath expressions
  • Text patterns (regex)

Rate Limiting

Always respect robots.txt and implement delays between requests. Default delay: 1 second between requests.

Example

Scrape product names and prices from example.com/products
Output as JSON with fields: name, price, url