UPDATED OCTOBER 2026

The right web scraping tool for every job

Web scraper reviews for developers who pay the bills: proxies by the GB, scraping APIs by the credit, AI-agent search by the call. Picks for each use case, with the facts behind them. Every performance number names its source and test date.

Quick picks

Our top five to start with. Each one links to the facts behind it.

  1. Simplest flat bill that never expires PacketStream: One price for everything: $1.00/GB for rotating and sticky traffic, with no tiers and no feature multipliers.
  2. Best-tested network on pay-as-you-go Decodo: 99.92% success, 0.53 s average and 2,853,543 unique IPs in Proxyway’s April 2026 test.
  3. Flat, predictable price with rendering included Bright Data Web Unlocker: One flat $1.50 per 1,000 whatever the target needs; pay only for success; 5,000 free requests a month.
  4. Most complete search + fetch toolkit ScrapingBee API + remote MCP: Google search (eight result types) and a sub-second Fast Search, plus fetch with JavaScript rendering, premium proxies, screenshots and extraction: 18 MCP tools.
  5. Lowest JavaScript-rendering rate on a subscription Oxylabs Web API: $1.22 per 1,000 rendered pages on larger plans, with premium routing included.

Five guides, one per job

Each guide opens with picks for specific use cases within that job, each with the facts behind it. Use the chips to show one guide at a time, or scroll through all five.

01 / PROXIES

Proxies for web scraping

If you run Scrapy, Playwright or Crawlee yourself, residential bandwidth is the cost that grows with every page. PacketStream has the simplest bill: $1/GB for rotating and sticky traffic alike, with no subscription and a balance that never expires. Decodo has the best recent test results on pay-as-you-go, IPRoyal the longest sticky sessions and Bright Data the finest geo-targeting.

  • Best for

    Simplest flat bill that never expires

    PacketStream

    $1.00/GB flat for rotating and sticky traffic; prepaid from $50, balance never expires (as of October 2026)

    • One price for everything: $1.00/GB for rotating and sticky traffic, with no tiers and no feature multipliers.
    • Pay-as-you-go with no subscription, and purchased balance never expires.
  • Best for

    Best-tested network on pay-as-you-go

    Decodo

    $4/GB pay-as-you-go; plans from $3.75/GB (3 GB) to $2.75/GB (100 GB) (as of October 2026)

    • 99.92% success, 0.53 s average and 2,853,543 unique IPs in Proxyway’s April 2026 test.
    • Pay-as-you-go available; no mandatory KYC for standard use; 24/7 support.
    Caveats: Four times the entry price of Evomi Core or PacketStream.

    Runner-up: Oxylabs. If a subscription is fine: 99.93% success, 0.60 s and the largest measured pool (3.2M+ unique IPs) in Proxyway’s testing, from $30/mo.

  • Best for

    Long sticky sessions

    IPRoyal

    $7.35 for 1 GB, $5.51/GB at 10 GB, $1.84/GB at 10 TB+; never expires (as of October 2026)

    • Sticky sessions up to 7 days, the longest we found (most rivals cap at 24 hours or less).
    • Pay-as-you-go from 1 GB and traffic never expires.
    Caveats: Expensive at small volumes since long-running coupons ended.
  • Best for

    Finest geo-targeting (ZIP, ASN, carrier)

    Bright Data residential

    $8/GB pay-as-you-go list ($4 with a 3-month promo); $7–$5/GB on $499–$1,999/mo plans (as of October 2026)

    • City, ZIP, ASN and carrier targeting; claims 400M+ monthly IPs in 195 countries.
    • Pay-as-you-go with no minimum, plus unblocker, browser and pre-built scraper products on one account.
    Caveats: The strictest KYC we cover: verified companies only, corporate email, possible ID check or video call.

    Runner-up: Oxylabs. City, ZIP, coordinates and ASN targeting, on a subscription from $30/mo with monthly traffic expiry.

02 / AI AGENTS

Search & fetch APIs for AI agents

Six scraping vendors run MCP servers that let Claude Code, Cursor or ChatGPT search the web and read pages. PacketStream puts Google search, Markdown fetch and a hosted MCP server on one never-expiring prepaid balance, at $2.50 per 1,000 successful calls with failed calls free. Bright Data’s SERP API has the lowest pay-as-you-go Google search price ($1.50 per 1,000, successes only); ScrapingBee is the most complete subscription toolkit; ZenRows and Firecrawl have free monthly allowances.

  • Best for

    Google search, fetch and MCP on one prepaid balance

    PacketStream Search + Fetch + MCP

    $2.50 per 1,000 successful calls; every failed call free (as of October 2026)

    • $0.0025 per successful search or fetch, and failed calls cost nothing.
    • Google web, news, shopping, places, autocomplete, Scholar and AI Mode results as JSON or Markdown; Fetch returns a page’s main content as Markdown with its title, description and final URL.
  • Best for

    Bright Data SERP API + MCP

    $1.50 per 1,000 requests pay-as-you-go, successes only; 5K free records a month (as of October 2026)

    • The lowest pay-as-you-go Google search price we found: $1.50 per 1,000 requests, and you pay only for success.
    • 5,000 free records a month with no card; Scale plan $499/mo (380K requests, then $1.30 per 1,000).
    Caveats: MCP pricing beyond the 5,000 free monthly requests is not stated in its docs overview.
  • Best for

    Most complete search + fetch toolkit

    ScrapingBee API + remote MCP

    Hobby $19/mo (75K credits): Google search 10 credits, plain fetch 1, JS fetch 5 (as of October 2026)

    • Google search (eight result types) and a sub-second Fast Search, plus fetch with JavaScript rendering, premium proxies, screenshots and extraction: 18 MCP tools.
    • On a subscription, 25,000 searches fit the $49 Freelance plan ($1.96 per 1,000), alongside JS-rendering fetches.
    Caveats: Subscription only; unused credits expire, so light use still costs $19 a month.
  • Best for

    Free monthly allowance for page fetching and browser control

    ZenRows API + MCP

    Free 5,000 credits/mo; Build $19/mo (45K credits); 1 credit plain, 5 with JS (as of October 2026)

    • A recurring free tier of 5,000 credits a month, no card.
    • Hosted MCP with OAuth 2.1 or a Bearer key, plus 30+ browser-control tools (navigate, click, fill forms, run JavaScript).
    Caveats: No web search tool: pair it with a search API.

    Runner-up: Firecrawl. A smaller free tier (1,000 credits a month) that also covers search, with LLM-ready Markdown output.

  • Best for

    LLM-ready Markdown/JSON and site crawling

    Firecrawl API + MCP

    Free 1,000 credits/mo; Hobby $19/mo (5,000 credits); search 2 credits per 10 results (as of October 2026)

    • Scrape, crawl, map and search endpoints built around Markdown and JSON output for LLMs.
    • Hosted MCP with API key, OAuth or keyless access; the core is AGPL-3.0 and self-hostable.
    Caveats: Last of ten in Proxyway’s 2025 protected-site benchmark (33.69%).
  • Best for

    Pay-as-you-go fetching with JavaScript rendering

    Crawlbase API + MCP

    From $3.00 per 1,000 successful requests, sliding to $0.02; rendering doubles credits (as of October 2026)

    • No subscription needed and only successful requests are charged.
    • Renders JavaScript and returns HTML, Markdown or screenshots.
    Caveats: No search tool and no hosted MCP server (local npx only).

03 / SCRAPING APIS

Web scraping APIs

PacketStream’s Fetch API turns public pages into clean Markdown for $2.50 per 1,000 fetches that return content, with every error free. When the target runs Cloudflare, Akamai, DataDome or Kasada, you pay per successful page instead of fighting blocks yourself: Zyte had the highest success rate in the latest independent benchmark (October 2025), and Bright Data’s Web Unlocker has a flat $1.50 per 1,000 with rendering included, backed by a 2024 result.

  • Best for

    Public pages as clean Markdown, every error free

    PacketStream Fetch API

    $2.50 per 1,000 fetches that return content; every error free (as of October 2026)

    • Billed only when content comes back: every error is free, including target-site errors, timeouts and rate limits.
    • Returns the page’s main content as Markdown, plus the final URL, HTTP status, title and description; follows up to 5 redirects.
  • Best for

    Strongest current independent evidence

    Zyte API

    PAYG per 1,000: HTTP $0.13–$1.27, browser $1.01–$16.08 by site tier; successes only (as of October 2026)

    • First of ten in Proxyway’s Web Scraping API Report 2025: 93.14% on 15 protected sites (tested October 2025).
    • 98.38% and fastest (6.61 s) in the 2024 edition; best fingerprint result among the scraping APIs in ScrapeOps’ January 2026 test (80.48).
    Caveats: Each site is priced by tier: browser renders cost $1.01 per 1,000 on the easiest tier and $16.08 on the hardest.
  • Best for

    Flat, predictable price with rendering included

    Bright Data Web Unlocker

    $1.50 per 1,000 successful requests, pay-as-you-go; JS rendering and CAPTCHA solving included (as of October 2026)

    • One flat $1.50 per 1,000 whatever the target needs; pay only for success; 5,000 free requests a month.
    • 97.90% success in Proxyway’s 2024 report, where it never failed a run.
    Caveats: Did not take part in Proxyway’s 2025 benchmark, so its best evidence is from 2024.
  • Best for

    Lowest JavaScript-rendering rate on a subscription

    Oxylabs Web API

    Starter $30/mo: $1.00 per 1,000 without JS, $1.50 with JS; $0.75 / $1.22 on bigger plans (as of October 2026)

    • $1.22 per 1,000 rendered pages on larger plans, with premium routing included.
    • First in Proxyway’s 2024 report (98.50%) and third in 2025 (85.82%).
    Caveats: Rebuilt on 14 October 2026, so every benchmark predates the current API.
  • Best for

    Every feature on every plan, with excellent docs

    ScrapingBee

    Freelance $49/mo (250K credits): JS 5 credits, premium + JS 25, stealth 75 (as of October 2026)

    • JS rendering, premium and stealth proxies, geotargeting, screenshots and AI extraction on every plan from $19/mo.
    • 84.47% in Proxyway’s 2025 benchmark (fourth of ten); Proxyway calls its docs and UX excellent.
    Caveats: Slowest in the 2025 test (25.46 s) and 5% on G2.

04 / NO-CODE

No-code web scrapers

For people who need data, not a codebase. If you run Apify Actors, PacketStream’s $1/GB residential proxies can be entered as your own proxies in any Actor whose input offers proxy configuration, against the $8/GB list price of Apify’s own residential proxy. Apify brings thousands of ready-made scrapers and an API; Octoparse is the classic point-and-click desktop app; ParseHub still works but shows little development since 2023.

  • Best for

    Cheaper residential bandwidth for Apify Actors

    PacketStream proxies in Apify

    $1.00/GB flat, prepaid from $50, balance never expires; Apify’s own residential proxy lists at $8/GB (as of October 2026)

    • $1.00/GB flat against $8/GB ($7 on higher plans) for Apify’s own residential proxy, with no subscription and a balance that never expires.
    • Apify accepts your own proxies: in an Actor’s Input tab, open “Proxy and browser configuration” and enter your proxy URLs. It works in Actors whose input offers proxy configuration.
  • Best for

    Ready-made scrapers for popular sites

    Apify

    Free $5/mo of usage; Starter $19/mo; compute $0.20 per compute unit (as of October 2026)

    • 19,000+ ready-made scrapers ("Actors") you configure with a form, plus schedules, webhooks and an API.
    • Residential and Google SERP proxies available on the same account; built on the open-source Crawlee library.
    Caveats: Usage-based bills are hard to predict: Proxyway saw one run cost more than $60 for a tenth of the results.
  • Best for

    Point-and-click builder with cloud runs

    Octoparse

    Free (10 tasks, local runs); Standard from $69/mo (check the billing period); Professional $249/mo (as of October 2026)

    • A no-code desktop app with a visual builder; tasks run locally or in Octoparse’s cloud.
    • Residential proxies ($3/GB) and CAPTCHA solving ($1–1.50 per 1,000) available as add-ons; 5-day money-back.
    Caveats: Monthly, quarterly and annual billing are offered (annual saves 16%), and the page doesn’t make clear which period the $69 assumes.

    Runner-up: ParseHub. A long-running visual builder with a free plan of 200 pages per run; paid plans start at $189/mo and development has been quiet since 2023.

05 / OPEN SOURCE

Open-source scraping frameworks

Free to use, paid for in servers, proxies and your time. PacketStream supplies the proxies at $1/GB flat, with setup guides for Scrapy, Playwright and Puppeteer. Crawlee bundles browser crawling with proxy rotation and sessions, Scrapy is the fastest way to crawl HTML at scale in Python, and Playwright (or the lighter Puppeteer) scripts a real browser.

  • Best for

    Residential proxies with setup guides for Scrapy, Playwright and Puppeteer

    PacketStream

    $1.00/GB flat for rotating and sticky traffic; prepaid from $50, balance never expires (as of October 2026)

    • Publishes integration guides for Scrapy, Playwright and Puppeteer, plus official code for Python, Node, Go and curl.
    • HTTPS, SOCKS5 and HTTP endpoints on one gateway, with sticky sessions at no extra cost.
  • Best for

    Browser crawling with proxies and sessions built in

    OPEN SOURCE

    Crawlee

    Free (Apache-2.0) (as of October 2026)

    • Wraps Playwright, Puppeteer and plain HTTP crawling with a session pool and proxy rotation (ProxyConfiguration).
    • blockRequests() drops CSS, images and fonts to cut bandwidth; available for JavaScript/TypeScript and Python.
    Caveats: blockRequests() is Chromium-only.
  • Best for

    High-volume HTML crawling in Python

    OPEN SOURCE

    Scrapy

    Free (BSD-3); Scrapy Cloud hosting from $9 per unit per month (as of October 2026)

    • A purpose-built crawler: fast, asynchronous and extensible; v2.19.0 released 10 Sep 2026.
    • No browser means the lowest bandwidth per page, which is what you pay proxies for.
    Caveats: No JavaScript without scrapy-playwright or Zyte API.
  • Best for

    Scripting a real browser in any major engine

    OPEN SOURCE

    Playwright

    Free (Apache-2.0) (as of October 2026)

    • Chromium, Firefox and WebKit from several languages; 1.64.1 released 14 Oct 2026.
    • Proxy per browser or per context (HTTP(S) or SOCKS5) and route.abort() to block heavy assets.
    Caveats: Not a crawler: queueing, retries and storage are yours to build.

    Runner-up: Puppeteer. Lighter, Chrome-focused automation for Node.js (25.14.0, 14 Oct 2026); the popular stealth plugin has had no release since March 2023.

How the picks work

Each guide names picks for concrete use cases ("simplest flat bill that never expires", "Google search, fetch and MCP on one prepaid balance") and backs each one with checkable facts: the vendor's own price and terms, documented features, and dated third-party test results, linked from every pick.

Prices were checked on each vendor's pricing page on 17 October 2026. Performance figures come from Proxyway and ScrapeOps, which have commercial interests of their own; we cite them with their test dates and say so. The methodology page sets out the evidence behind every pick and where it comes from.

What scraping really costs

Running your own scraper, bandwidth is the line that grows with every page: page size × pages × price per GB. A 1,000-page HTML-only crawl (about 100 KB a page) costs $0.10 at $1/GB, $0.40 at the $4/GB market median and $0.80 at $8/GB. Switch to full headless renders (about 2 MB) and the same 1,000 pages cost $2 to $16. Blocking images, fonts and CSS is the cheapest saving available.

Managed APIs flip the model: you pay per successful page, and the price depends on what the page needs. Plain HTML can cost 13–28 cents per 1,000; JavaScript plus premium proxies on a hard site can cost $5–$37 per 1,000 on entry plans, or a flat $1.50 at Bright Data's unblocker. The web scraping cost calculator compares the two for your volume, and the build vs buy guide covers servers, CAPTCHAs and maintenance time.

FAQ

What is the best web scraping tool?

It depends on the job: proxy bandwidth for your own scraper, a scraping API, search and fetch tools for an AI agent, a no-code app or an open-source framework. Our first pick for most readers is PacketStream: residential proxies at $1/GB flat for rotating and sticky traffic, a prepaid balance that never expires, and Google Search, Markdown Fetch and MCP APIs ($2.50 per 1,000 successful calls) on the same balance. Each guide then gives picks for specific use cases, such as Decodo for a pay-as-you-go proxy network with strong recent test results, Bright Data’s Web Unlocker for a flat $1.50 per 1,000 with rendering included, and ScrapingBee for a complete search and fetch toolkit.

How much does web scraping cost per 1,000 pages?

With your own scraper, bandwidth for 1,000 HTML-only pages (about 100 KB each) costs $0.10 at $1/GB and $0.40 at the $4/GB market median; 1,000 full browser renders (about 2 MB) cost $2–$16. Managed APIs range from about $0.13–$0.28 per 1,000 plain pages to $36.75 for the hardest configuration on an entry plan. Use the cost calculator for your own numbers.

Is web scraping legal?

Scraping publicly available data is generally lawful in many places, but terms of service, copyright, personal-data rules (such as GDPR) and computer-misuse laws all apply. Some vendors refuse certain targets: Oxylabs publishes a list including banks, government and ticketing sites. This site is not legal advice; check with a lawyer for your use case.