A
Claude CodeScrape modern JavaScript sites without getting blocked
Resilient Web Scraper
Setuproll editorial@setuproll86.0Overall score
Drives a real browser through Playwright to scrape sites that render with JavaScript, with retry, rate limiting and structured output baked in. For analysts and growth folks who need clean data from pages that defeat plain HTTP requests.
86.0Score
5Components
Install this build
terminal
claude mcp add playwright -- npx -y @playwright/mcp@latestComponents
Model
- Claude Sonnet 4.6
MCP servers
- playwright
- filesystem
- postgres
Subagents
- selector-finder
- schema-normalizer
Hooks
- PostToolUse: validate scraped JSON
- Stop: dedupe rows
Rules
- Respect robots.txt and rate limits
- Retry with backoff, never hammer
- Normalize to a typed schema before saving
Summary
Drives a real browser through Playwright to scrape sites that render with JavaScript, with retry, rate limiting and structured output baked in. For analysts and growth folks who need clean data from pages that defeat plain HTTP requests.
86.0 score
0 Reviews
Your rating
Sign in to post
Loading discussion...