unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
View on GitHub →PythonApache-2.0aiai-agentscrawlerdata-extractionllm
Stars
84.2k
Δ 7d
—
Δ 30d
—
Age
2 yrs
Last push
4h ago
90-day star history
Where this sits in the catalog
GroupAgent capabilities
RankingsNot in any top 20 today — see the rankings
Most-wanted open issues
Ranked by 👍 reactions. 37 open issues total, checked 2026-09-25.
| Issue | 👍 | Comments | Opened |
|---|---|---|---|
| 7 | 15 | 1 yr | |
Bring Docker API server to feature parity with Crawl4AI v0.7.x ✨ Enhancement, ⚙️ Under Review | 4 | 3 | 1 yr |
| 4 | 2 | 5 mo | |
| 1 | 2 | 3 mo | |
| 0 | 22 | 1 yr |
Alternatives in RAG & retrieval
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with…
⭐91.3k
+3507d
Go
2 yrs
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
⭐35.8k
+1367d
Python
1 yr
817 structured cybersecurity skills for AI agents · Mapped to 6 frameworks: MITRE ATT&CK, NIST CSF 2.0, MITRE…
⭐33.4k
+4137d
Python
7 mo
Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.
⭐32.4k
+1,2587d
Python
4 mo