omkarcloud /botasaurus
The All in One Framework to Build Undefeatable Scrapers
★ 5,844⑂ 508👁 37⑃ 18● 213▤ 0
+3
日增长
5,844
stars
508
forks
37
watchers
18
prs
213
issues
0
releases
README
🤖 Botasaurus 🤖
The All in One Framework to Build Undefeatable Scrapers
The web has evolved. Finally, web scraping has too.
🐿️ Botasaurus In a Nutshell
How wonderful that of all the web scraping tools out there, you chose to learn about Botasaurus. Congratulations!
And now that you are here, you are in for an exciting, unusual, and rewarding journey that will make your web scraping life a lot easier.
Now, let me tell you about Botasaurus in bullet points. (Because as per marketing gurus, YOU as a member of the Developer Tribe have a VERY short attention span.)
So, what is Botasaurus?
Botasaurus is an all-in-one web scraping framework that enables you to build awesome scrapers in less time, with less code, and with more fun.
We have put all our web scraping experience and best practices into Botasaurus to save you hundreds of hours of development time!
Now, for the magical powers awaiting you after learning Botasaurus:
- In terms of humaneness, what Superman is to Man, Botasaurus is to Selenium and Playwright. Easily pass every (Yes, E-V-E-R-Y) bot test, and build undetected scrapers.
In the video below, watch as we bypass some of the best bot detection systems:
- ✅ Cloudflare Web Application Firewall (WAF)
- ✅ BrowserScan Bot Detection
- ✅ Fingerprint Bot Detection
- ✅ Datadome Bot Detection)
- ✅ Cloudflare Turnstile CAPTCHA
🔗 Want to try it yourself?
See the code behind these tests here
- Perform realistic, human-like mouse movements and say sayonara to detection
!human-mode-demo
- Convert your scraper into a desktop app for Mac, Windows, and Linux in 1 day, so not only developers but everyone can use your web scraper.
!desktop-app-photo
- Turn your scraper into a beautiful website, making it easy for your customers to use it from anywhere, anytime.
!pro-gmaps-demo
- Save up to 97%, yes 97%, on browser proxy costs by using browser-based fetch requests.
- Easily save hours of development time with easy parallelization, profiles, extensions, and proxy configuration. Botasaurus makes asynchronous, parallel scraping child's play.
- Use caching, sitemap, data cleaning, and other utilities to save hours of time spent writing and debugging code.
- Easily scale your scraper to multiple machines with Kubernetes, and get your data faster than ever.
And those are just the highlights. I mean!
There is so much more to Botasaurus that you will be amazed at how much time you will save with it.
🚀 Getting Started with Botasaurus
Let's dive right in with a straightforward example to understand Botasaurus.
In this example, we will go through the steps to scrape the heading text from https://www.omkar.cloud/.
!Botasaurus in action
Step 1: Install Botasaurus
First things first, you need to install Botasaurus. Run the following command in your terminal:
shell
python -m pip install --upgradeTop issues
#132Need xpath support6 comments · 2024-06-07#280how to get response payload ?4 comments · 2025-09-14#259Scraping issue with normal website3 comments · 2025-06-20#151when running on server getting error: HTTP server ListenAndServe: listen tcp: lookup tcp/▒H▒▒▒: Servname not supported for ai_socktype4 comments · 2024-07-06#276Unable to Bypass Cloudflare Captcha4 comments · 2025-08-22#269No way of doing keypresses3 comments · 2025-07-11#257js_to_run_before_new_document :: ChromeException: Invalid parameters [code: -32602]3 comments · 2025-06-10#248[bug] current logic prevents custom headful mode3 comments · 2025-05-02
Discussions
#311Chromeleon (a Chromium build for AI agents) with botasaurus's `chrome_executable_path`: snippet + test notes0 comments · 2026-11-08#310Need This Project in VBA0 comments · 2026-10-28#307Is patching WebGL strings pointless if rendering is still SwiftShader? (F5/Shape, ~40% blocks)0 comments · 2026-08-28#306Sponsorship Inquiry0 comments · 2026-08-08#300Firefox-source-patched stealth as a sibling engine (FYI)1 comments · 2026-05-27#292What can i do to make it less detectable in docker container?0 comments · 2025-11-28#283Documentation0 comments · 2025-09-19#273How to use page scrolling?1 comments · 2025-07-28