Skip to content

[GitHub Trending] D4Vinci/Scrapling

6.7 relevance
Score Breakdown
technical depth
6
novelty
5
actionability
7
community
7
strategic
3
personal
5

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Web scraping framework, moderate novelty and relevance.

Open Source github.com
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! - D4Vinci/Scrapling
Summary

Scrapling is an adaptive Python web scraping framework with a parser that auto-relocates elements when websites update, and fetchers that bypass Cloudflare Turnstile out of the box. Its spider framework supports concurrent multi-session crawls with pause/resume and automatic proxy rotation, offering multiple fetcher types (Stealthy, Async, Dynamic) and a CLI.

Author

D4Vinci