Firecrawl — Web Scraping for LLMs

firecrawl/firecrawl — API turning any web page into clean Markdown for LLMs. Gained +2,200 stars/week, 202,354 ⭐ total.

Key Features

  • JS Rendering — renders JavaScript (SPA, React, Vue)
  • Clean Markdown — clean Markdown output
  • Structured Data — extract JSON by schema
  • Bypass Protection — bypass Cloudflare, CAPTCHAs
  • Crawl — recursive site crawling
  • API + SDK — REST, Python, Node.js, Go

Use Cases

  • RAG — web indexing for LLMs
  • Competitor monitoring
  • Training data collection
  • Research automation

Technologies

  • Language: TypeScript
  • License: MIT
  • SDK: Python, Node.js, Go, Rust

How to Start

  1. Repository: github.com/firecrawl/firecrawl
  2. Cloud: firecrawl.dev (free tier)
  3. Self-host: Docker

Growth: +2,200 ⭐/week | 314/day | TypeScript | MIT