Learning center

A structured curriculum for web scraping. Start at foundations or jump to the stage that matches the problem in front of you.

Language
01

Foundations

Beginner

Choose your language. Each guide covers requests, parsing, JSON-LD extraction and proxies.

  1. 1.1 Web Scraping with Python: A Beginner's Guide Python
  2. 1.2 Web Scraping with Node.js: Axios, Cheerio & Puppeteer Node.js
  3. 1.3 Web Scraping with PHP: cURL, DOMDocument & Proxies PHP
  4. 1.4 Web Scraping with Go: net/http, goquery & Proxies Go
  5. 1.5 Web Scraping with Java: Jsoup, OkHttp & Proxies Java
  6. 1.6 Web Scraping with Rust: reqwest, scraper & Proxies Rust
  7. 1.7 Web Scraping Pagination: The Complete Guide technique
02

Dynamic sites

Intermediate

Pages that render with JavaScript: drive a browser yourself, or use a hosted one.

  1. 2.1 Web Scraping with Playwright in Python: Full Guide Python
  2. 2.2 Bright Data Scraping Browser: CAPTCHA-Solving Cloud Browser Playwright · Puppeteer
03

Staying unblocked

Intermediate

Why requests get blocked, and the proxies, rotation and CAPTCHA handling that fix it.

  1. 3.1 How to Avoid Getting Blocked While Web Scraping technique
  2. 3.2 Residential vs Datacenter vs Mobile Proxies: Which to Use? concept
  3. 3.3 Residential vs Datacenter Proxies for Web Scraping concept
  4. 3.4 Mobile Proxies vs Residential Proxies: Which to Use? concept
  5. 3.5 Shared vs Dedicated Proxies for Web Scraping concept
  6. 3.6 How to Rotate Proxies for Web Scraping Python · Node.js
  7. 3.7 Bypass CAPTCHAs in Web Scraping: A Practical Guide technique
  8. 3.8 US Proxies for Web Scraping: City-Level Geo-Targeting geo
  9. 3.9 China Proxies: Scrape Taobao, JD & Weibo at Scale geo
  10. 3.10 ISP Proxies for Web Scraping: Speed and Trust Python · Node.js

Apply it to a real site

All 20 solutions →

Site-by-site guides with runnable code in PHP, Node.js and Rust.

AirbnbAlibabaAliExpressAmazonBooking.comeBay Product Search ScrapingeBayEtsyFacebookGoogle SERPHow to Scrape Kayak Flight Prices and Search DataInstagram

Web scraping is a moving target — sites change, anti-bot systems evolve, and yesterday's script breaks tomorrow. These guides teach the fundamentals that stay useful: parsing, pagination, browser automation, proxies, and staying unblocked.

Choosing proxies? Start with residential vs datacenter proxies for the first decision every project faces, then mobile vs residential proxies for the escalation when residential IPs still get blocked.

New to scraping? Start with Web Scraping with Python, Web Scraping with Node.js, or Web Scraping with PHP — PHP's built-in cURL and DOMDocument make it a practical choice when your backend already runs on PHP. Then level up with Playwright for dynamic sites and how to avoid getting blocked. For location-sensitive data, see US proxies with city-level geo-targeting or China proxies for Taobao, JD.com, and Weibo. Not sure which proxy tier to buy? Shared vs. dedicated proxies breaks down the cost and reliability tradeoffs. If you'd rather skip code entirely, no-code web scraping covers visual data collectors for analysts and PMs. For a performance-first stack, Web Scraping with Rust walks through reqwest, the scraper crate, async Tokio concurrency, and proxy routing in a single guide. Prefer a simpler deployment story? Web Scraping with Go covers net/http, goquery, goroutine-based concurrency, and proxy routing — and compiles to a single static binary. Need the speed of datacenter proxies with residential-level IP trust? ISP proxies explains when static ISP IPs outperform both tiers and how to integrate them into a scraper.