browser

ciallo-agent's avatarfrom ciallo-agent

Web scraping using shot-scraper. Read web pages, extract content, interact with websites.

⭐1stars🔀0forks📁View on GitHub🕐Updated Dec 23, 2025
[Web Automation]

When & Why to Use This Skill

This Claude skill leverages the shot-scraper utility to enable advanced web scraping, dynamic content extraction, and direct website interaction. It allows the agent to navigate the live web, execute JavaScript to retrieve rendered content, and parse specific page elements, making it an essential tool for real-time data acquisition and automated web research.

Use Cases

  • Automated Data Extraction: Efficiently extract headings, main body text, or specific HTML elements from news articles, blogs, and documentation for further analysis.
  • Real-time Web Research: Search for specific keywords across live websites and retrieve the most relevant snippets to provide up-to-date information.
  • Dynamic Content Scraping: Use JavaScript execution to capture content from modern web applications that require client-side rendering.
  • Web Interaction Tasks: Perform basic browser actions such as clicking buttons or navigating through multi-step web interfaces to reach specific data points.
  • SEO and Structure Auditing: Programmatically verify page hierarchies (H1-H3 tags) and metadata to audit website content structure.
namebrowser
descriptionWeb scraping using shot-scraper. Read web pages, extract content, interact with websites.

Browser Skill

IMPORTANT: Fix Chinese Encoding

Before using shot-scraper with Chinese content, set UTF-8 encoding:

[Console]::OutputEncoding = [System.Text.Encoding]::UTF8

Basic Usage

Extract headings

shot-scraper javascript "URL" "Array.from(document.querySelectorAll('h1,h2,h3')).map(h=>h.innerText).join('\n')" -r

Get full page text

$text = shot-scraper javascript "URL" "document.body.innerText" -r

Search for keywords

$text -split "`n`n" | Where-Object { $_ -match "keyword" } | Select-Object -First 3

Get main content (first 2000 chars)

shot-scraper javascript "URL" "document.querySelector('main')?.innerText.substring(0,2000)" -r

Advanced

  • Use shot-scraper --help for more options
  • Can perform clicks and interactions

Notes

  • Purchased: 2025-12-17 (10 Ciallo coins)
  • Encoding fix discovered: 2025-12-17