The Proxy Playbook · Chapter 05
Matching Proxies to the Job
Eight short playbooks that pair common jobs with a proxy type, a rotation style and the pitfall to avoid, plus a ladder for escalating only when needed.
- Starting cheap and escalating on evidence
- Eight playbooks by use case
- An if/then decision table
- Signs of a mismatched setup
7 min read · page 31 of the PDF
One team checks 5,000 keyword rankings each morning and wants thousands of short-lived IPs. Another collects air fares through a five-step search and wants one address that holds still for ten minutes. Both say they need proxies.
Start cheap, escalate on evidence
A product catalog that loads through a shared datacenter IP gains nothing from a mobile IP except a larger bill. Chapter 2 ranked the four proxy types by trust, and cost climbs in the same order. The right choice is the cheapest type that completes the job.
In practice that rule is a ladder. Start on the first rung, run a real sample, and climb only when the results demand it.
Fast and cheap. Enough for open pages, public APIs and lightly protected sites.
Datacenter speed with a consumer network label. Suits logins and long sessions.
Household IPs in almost any country. Suits protected sites and local results.
Carrier IPs shared by many real users. Kept for mobile-first platforms and the hardest targets.
The ladder is a default order, not a law. Rungs two and three solve different problems. A static ISP address is the step up when one identity must stay put for weeks. Rotating residential is the step up when a site blocks datacenter ranges outright, or when the job needs many locations.
Rule out the free fixes first
A blocked request does not always mean the wrong proxy type. A bare HTTP client with default headers gets blocked on residential IPs too. Chapter 10 covers each fix in detail. The short version is five steps, in this order.
- Run a sample. Send a few hundred real requests to the real target. Record how many return the expected content.
- Fix the client. Send realistic headers, keep cookies where the site expects them, and slow the request rate.
- Fix the rotation. Switch between per-request rotation and sticky sessions to match how the site tracks a visit.
- Fix the location. Use exit IPs in a country the site actually serves.
- Climb one rung. If success is still below target, move up one proxy type and rerun the same sample.
Playbooks for collecting data
The four jobs below pull public pages at volume. They differ in how hard the targets push back and in how much location matters.
Web scraping
- Proxy: datacenter first, rotating residential for sites that block datacenter ranges.
- Rotation: a new IP per request for independent pages, sticky for pagination tied to a cookie.
- Pitfall: paying residential rates for pages a datacenter IP fetches without trouble.
SEO and SERP tracking
- Proxy: rotating residential with country and city targeting, or a SERP API billed per request.
- Rotation: a new IP for every query.
- Pitfall: results change with location, language and device. A ranking checked from the wrong city is a wrong ranking.
Price monitoring and e-commerce
- Proxy: datacenter for small stores, residential for large marketplaces with strong bot defenses.
- Rotation: per request for product pages, sticky when a delivery postcode or currency must persist.
- Pitfall: prices, stock and shipping vary by country. An exit in the wrong market records the wrong price.
Travel fare collection
- Proxy: residential in the country where the ticket would be sold.
- Rotation: one sticky session per search, from first query to final fare.
- Pitfall: rotating mid-search breaks the session. Script-heavy booking pages also eat per-GB traffic.
One pattern runs through all four. Independent pages rotate, and multi-step flows stick. A scraper reading 10,000 unrelated product pages can use 10,000 different IPs. A fare search that carries a session token from page one to page five cannot.
The target's defenses pick the proxy type, and the shape of the task picks the rotation.
ProxyLook keeps a page of matching providers for each of these jobs, including web scraping, SERP tracking and travel fares.
Playbooks for verification, accounts and AI
The next four jobs care less about volume. Each one has to look like a specific kind of visitor in a specific place.
Ad verification
- Proxy: residential or mobile in the exact market where the campaign runs.
- Rotation: sticky for one page visit, then a new IP for the next check.
- Pitfall: IP location databases disagree. Confirm the exit city before trusting what the ad server showed.
Social media management
- Proxy: one static ISP or mobile IP per account, in the account's home country.
- Rotation: none. The same account keeps the same address.
- Pitfall: rotating under a logged-in account, or stacking many accounts on one IP, ties them together.
Market research
- Proxy: residential spread across the countries being studied, datacenter for open sources.
- Rotation: per request for breadth, sticky when browsing a local site as one visitor.
- Pitfall: thin coverage. A network can be large overall and still hold few IPs in a small market.
AI agents and training data
- Proxy: sticky residential or ISP for agents that browse, datacenter first for bulk crawls.
- Rotation: one session per agent task, per-request rotation for crawls.
- Pitfall: an agent that changes IP mid-task loses its session. Full browsers also multiply traffic per page.
AI work is two jobs sharing one name. An agent that compares products or fills in forms behaves like one user and needs one stable session. A training-data crawl behaves like a scraper and follows the scraping playbook, with extra care over licensing and personal data.
Account work also depends on browser fingerprints, cookies and behavior, which a proxy does not touch. ProxyLook's companion book, The Multi-Account Handbook, covers that side in full.
A decision table for everything else
Plenty of jobs fit no named playbook. A compliance team checking how its own site renders abroad is one example. The conditions below usually settle the choice.
| If… | Then… |
|---|---|
| The page loads the same for any visitor, with no blocks | Shared datacenter, new IP per request |
| An account must look like one person for weeks | One static ISP or mobile IP per account |
| Results change by country or city | Residential with geo-targeting, and verify the exit location |
| The task spans several linked pages | A sticky session that outlasts the whole flow |
| Datacenter IPs meet blocks or CAPTCHAs on the first request | Step up to rotating residential |
| The platform is mobile-first or app-based | Mobile IPs from a carrier in the target country |
| Pages are heavy and billing is per GB | Block images and media, or price a per-IP plan |
| Residential still fails with a well-built client | Price a scraper API or unblocker billed per success |
Two rows can apply at once. A logged-in account that also needs city-level results takes the stricter answer for each part: a static IP, located in that city. For anything the table leaves open, the ProxyLook assistant takes a plain description of a job and suggests matching providers from the directory.
Signs of a mismatch
A setup that fit at launch can drift as targets and volumes change. The signs below are worth a monthly look at the usage dashboard.
- Residential traffic is going to a site that never blocked datacenter IPs.
- A logged-in account shows a new IP on every request.
- Per-GB traffic is spent on images, fonts and video the job never reads.
- The exit country differs from the market the data is meant to describe.
- Success fell after a volume increase, and nobody lowered the request rate per IP.
- Mobile IPs are in use out of habit, not because a test demanded them.
Stepping down is as valid as stepping up. Sites change their defenses in both directions, and a target that needed residential IPs last year may accept datacenter IPs today. Rerun the original sample on a cheaper rung every few months. If it passes, the cheaper rung is the right one.
Key takeaways
- Start with the cheapest proxy type that completes the job, and climb one rung at a time on evidence.
- Fix headers, request rate, rotation and location before paying for a higher proxy type.
- Independent pages suit per-request rotation, while multi-step flows and logins need sticky or static IPs.
- Location is part of the data for SERP, price, fare and ad checks, so verify the exit location.
- Managing multiple accounts can breach platform terms, and no proxy removes that risk from the operator.
Prefer the designed PDF? The Proxy Playbook is 91 pages, free, with no sign-up.
Download the PDF