firecrawl/firecrawl
Firecrawl
Firecrawl is an API and open server for search, crawling, and turning web pages into clean Markdown or structured data.
Catalog projects marked with #crawler. Tags work as dedicated landing pages, so related tools are easier to find and connect.
This collection holds 5 projects with a combined 370,540 GitHub stars. Main languages: Python, TypeScript, JavaScript.
Firecrawl is an API and open server for search, crawling, and turning web pages into clean Markdown or structured data.
Crawl4AI is a Python crawler and web-data extraction tool that prepares pages for LLM, RAG, and agent workflows.
Scrapling is a Python web scraping framework for requests, crawling, and adaptive data extraction.
Scrapy is a Python framework for web crawlers and structured data extraction from websites.
EasySpider is a visual tool for browser automation and web data collection.