unclecode/crawl4ai
Crawl4AI
Crawl4AI is a Python crawler and web-data extraction tool that prepares pages for LLM, RAG, and agent workflows.
Catalog projects marked with #data-extraction. Tags work as dedicated landing pages, so related tools are easier to find and connect.
This collection holds 5 projects with a combined 295,770 GitHub stars. Main languages: Python.
Crawl4AI is a Python crawler and web-data extraction tool that prepares pages for LLM, RAG, and agent workflows.
Scrapling is a Python web scraping framework for requests, crawling, and adaptive data extraction.
Scrapy is a Python framework for web crawlers and structured data extraction from websites.
Docling is a Python tool for converting documents into structured data for search and ИИ systems.
LangExtract is a Google Python library for extracting structured data from unstructured text.