Rotate Scraping Proxies
Skill Verified ActiveEscalate blocked scraping campaigns with provider-neutral proxy rotation — decide between datacenter, residential, and mobile pools, integrate rotation with scrapling, configure session stickiness for stateful flows, monitor cost and health, and stay inside legal and ethical boundaries. Use as the next step after `headless-web-scraping` client-side stealth (StealthyFetcher, rate limiting, robots.txt) is insufficient and traffic is legitimate.
To enable users to overcome scraping blocks by ethically and effectively rotating proxy IPs, managing costs, and ensuring compliance with legal and ethical guidelines when standard stealth techniques fail.
Features
- Provider-neutral proxy pool selection (datacenter, residential, mobile)
- Integration with scraping frameworks (e.g., scrapling)
- Configuration for sticky sessions and per-request rotation
- Monitoring of proxy pool health, cost, and traffic limits
- Step-by-step guidance on legal and ethical considerations
Use Cases
- When standard client-side stealth (User-Agent, rate limiting) fails to bypass target website blocks.
- For legitimate scraping of public data that requires overcoming geo-blocking or IP-based rate limits.
- To manage complex stateful scraping flows (e.g., logins, multi-page processes) that require persistent proxy IPs.
- As an escalation step for scraping campaigns where a public API is unavailable and the use case is defensible.
Non-Goals
- Bypassing site Terms of Service prohibitions against automated access.
- Circumventing geo-licensing or paywalls.
- Enabling fraudulent activities like credential stuffing or content piracy.
- Replacing the use of official APIs when they are available and suitable.
Installation
/plugin install agent-almanac@pjt222-agent-almanacQuality Score
VerifiedTrust Signals
Similar Extensions
Hybrid Cloud Networking
100Configure secure, high-performance connectivity between on-premises infrastructure and cloud platforms using VPN and dedicated connections. Use when building hybrid cloud architectures, connecting data centers to cloud, or implementing secure cross-premises networking.
High Performance Browser Networking
100Optimize web performance through network protocols, resource loading, and browser rendering internals. Use when the user mentions "page load speed", "Core Web Vitals", "HTTP/2", "resource hints", "network latency", "render blocking", "TCP optimization", "service worker", or "critical rendering path". Also trigger when diagnosing slow page loads, optimizing time to first byte, choosing between WebSocket and SSE, or reducing bundle sizes. Covers TCP/TLS optimization, caching strategies, WebSocket/SSE, and protocol selection. For UI visual performance, see refactoring-ui. For font loading, see web-typography.
Node Connect
100Diagnose OpenClaw Android, iOS, or macOS node pairing, QR/setup code, route, auth, and connection failures.
Embedding Strategies
100Select and optimize embedding models for semantic search and RAG applications. Use when choosing embedding models, implementing chunking strategies, or optimizing embedding quality for specific domains.
Aws Cdk Development
100AWS Cloud Development Kit (CDK) expert for building cloud infrastructure with TypeScript/Python. Use when creating CDK stacks, defining CDK constructs, implementing infrastructure as code, or when the user mentions CDK, CloudFormation, IaC, cdk synth, cdk deploy, or wants to define AWS infrastructure programmatically. Covers CDK app structure, construct patterns, stack composition, and deployment workflows.
Fit Drift Diffusion Model
100Fit cognitive drift-diffusion models (Ratcliff DDM) to reaction time and accuracy data with parameter estimation (drift rate, boundary separation, non-decision time), model comparison, and parameter recovery validation. Use when modeling binary decision-making with reaction time data, estimating cognitive parameters from experimental data, comparing sequential sampling model variants, or decomposing speed-accuracy tradeoff effects into latent cognitive components.