Skip to content
#

webscraping

Star

Web scraping is the process of programmatically retrieving web pages and extracting structured data from them for analysis, storage, or reuse. It powers price monitoring, search indexing, market research, and training-data collection.

Scraping ranges from plain HTTP requests and HTML parsing to full browser automation for JavaScript-rendered and anti-bot-protected pages. The ecosystem includes request libraries, HTML parsers, headless browsers, and cloud extraction platforms.

Here are 5,148 public repositories matching this topic...

Language: Python
Filter by language
All 10,485 Python 5,148 Jupyter Notebook 2,335 JavaScript 754 HTML 458 TypeScript 325 R 186 Java 176 Go 123 C# 107 PHP 68
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
Scrapling

D4Vinci / Scrapling

Sponsor
Star 83.1k

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

python crawler data automation ai mcp scraping crawling web-scraper web-scraping selectors xpath data-extraction stealth webscraping crawling-python playwright web-scraping-python ai-scraping mcp-server
  • Updated Sep 23, 2026
  • Python

CloakHQ / CloakBrowser

Star 31.6k

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

python recaptcha selenium fingerprint chromium cloudflare web-scraping webscraping browser-automation bot-detection ai-agents anti-detect undetected puppeteer captcha-bypass headless-browser cloudflare-bypass playwright antidetect-browser stealth-browser
  • Updated Sep 20, 2026
  • Python

feder-cr / invisible_playwright

Sponsor
Star 3k

Your Playwright code runs on a real anti-detect Firefox instead of a detectable one, with the same API and an undetected fingerprint, so web scraping and browser automation in Python bypass captcha and anti-bot detection.

recaptcha user-agent akamai webscraping shadow-dom turnstile perimeterx incapsula bot-management antibot datadome headless-browser imperva hcaptcha fingerprintjs playwright antidetect kasada arkose antidetect-browser
  • Updated Sep 23, 2026
  • Python

zohaibbashir / Google-Maps-Scrapper

Star 1.5k

This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

python googlemaps data google maps google-maps chromium python3 webscraping data-scraping google-maps-scraping google-maps-scrapping google-maps-scraper google-maps-scraper-python
  • Updated May 18, 2026
  • Python
Followers
349 followers
Website
github.com/topics/web-scraping

Related topics

browser-automation headless-browser playwright puppeteer selenium