Firecrawl — Web Scraping for LLMs
firecrawl/firecrawl — API turning any web page into clean Markdown for LLMs. Gained +2,200 stars/week, 202,354 ⭐ total.
Key Features
- JS Rendering — renders JavaScript (SPA, React, Vue)
- Clean Markdown — clean Markdown output
- Structured Data — extract JSON by schema
- Bypass Protection — bypass Cloudflare, CAPTCHAs
- Crawl — recursive site crawling
- API + SDK — REST, Python, Node.js, Go
Use Cases
- RAG — web indexing for LLMs
- Competitor monitoring
- Training data collection
- Research automation
Technologies
- Language: TypeScript
- License: MIT
- SDK: Python, Node.js, Go, Rust
How to Start
- Repository: github.com/firecrawl/firecrawl
- Cloud: firecrawl.dev (free tier)
- Self-host: Docker
Growth: +2,200 ⭐/week | 314/day | TypeScript | MIT
