firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
THE DUDE’S BRIEF
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand.…
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
Check the setup guide for supported systems and dependencies. Open-source code does not guarantee free hosting, model access, or third-party APIs.
Model weights, datasets, dependencies, hosting and paid APIs can have separate terms or costs. Stars show attention, not quality, safety or earnings.
Use the official repository and setup guide to verify prerequisites and installation steps. Review the code license before adoption. This page reflects a dated catalog observation; check the source for changes.
No linked conversations in our selected sample yet. This does not mean there are no discussions or reported problems.
Selected source links are not a sentiment score. How we select and label evidence
Related by category; these projects may serve different use cases.
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Connect an AI agent to a web browser.
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: and follow here for daily tips and tricks:
Make browser tasks repeatable.