A
Claude Code logoClaude CodeScrape modern JavaScript sites without getting blocked

Resilient Web Scraper

Setuproll editorial@setuproll
86.0Overall score

Drives a real browser through Playwright to scrape sites that render with JavaScript, with retry, rate limiting and structured output baked in. For analysts and growth folks who need clean data from pages that defeat plain HTTP requests.

86.0Score
5Components

Install this build

Export
terminal
claude mcp add playwright -- npx -y @playwright/mcp@latest

Components

Model

  • Claude Sonnet 4.6

MCP servers

  • playwright
  • filesystem
  • postgres

Subagents

  • selector-finder
  • schema-normalizer

Hooks

  • PostToolUse: validate scraped JSON
  • Stop: dedupe rows

Rules

  • Respect robots.txt and rate limits
  • Retry with backoff, never hammer
  • Normalize to a typed schema before saving

Summary

Drives a real browser through Playwright to scrape sites that render with JavaScript, with retry, rate limiting and structured output baked in. For analysts and growth folks who need clean data from pages that defeat plain HTTP requests.

86.0 score

0 Reviews

Your rating
Sign in to post

Loading discussion...