Skip to content
#

webscraping

Star

Web scraping is the process of programmatically retrieving web pages and extracting structured data from them for analysis, storage, or reuse. It powers price monitoring, search indexing, market research, and training-data collection.

Scraping ranges from plain HTTP requests and HTML parsing to full browser automation for JavaScript-rendered and anti-bot-protected pages. The ecosystem includes request libraries, HTML parsers, headless browsers, and cloud extraction platforms.

Here are 10,483 public repositories matching this topic...

Language: All
Filter by language
All 10,483 Python 5,147 Jupyter Notebook 2,335 JavaScript 753 HTML 458 TypeScript 325 R 186 Java 176 Go 123 C# 107 PHP 68
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
Scrapling

D4Vinci / Scrapling

Sponsor
Star 82.9k

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

python crawler data automation ai mcp scraping crawling web-scraper web-scraping selectors xpath data-extraction stealth webscraping crawling-python playwright web-scraping-python ai-scraping mcp-server
  • Updated Sep 22, 2026
  • Python

CloakHQ / CloakBrowser

Star 31.6k

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

python recaptcha selenium fingerprint chromium cloudflare web-scraping webscraping browser-automation bot-detection ai-agents anti-detect undetected puppeteer captcha-bypass headless-browser cloudflare-bypass playwright antidetect-browser stealth-browser
  • Updated Sep 20, 2026
  • Python
Followers
349 followers
Website
github.com/topics/web-scraping

Related topics

browser-automation headless-browser playwright puppeteer selenium