About
About scrapfly.dev, the engineering blog of Scrapfly.
Summarize this article with
scrapfly.dev is the engineering blog of Scrapfly. We are a small, deeply technical team building the infrastructure that powers production web scraping for thousands of teams.
Our stack, in rough proportions:
- Go for the API surface, proxy fleet, browser pool orchestrator, and BYOP relay.
- Python for the scrape engine, browser automation, and anti-bot research.
- PHP / Symfony for the dashboard, billing, and customer-facing surfaces.
- C++ and a forked Chromium (we call it Scrapium) for the browser layer.
- Kubernetes, ClickHouse, MongoDB, MariaDB, RabbitMQ, Redis for the boring-but-load-bearing parts.
Want to write for us? Pitch a post at dev@scrapfly.io. We pay for guest posts that meet our editorial bar.
Want to work on this stuff full time? We are hiring.