Firecrawl CLI

Features

• Web scraping and content extraction
• Web search and result aggregation
• Website crawling and URL discovery
• Interactive browser sessions
• Agent skill integration
• Structured data extraction via schema

Use Cases

• Automating data collection from websites for analysis
• Enriching AI agent capabilities with live web browsing
• Performing targeted web searches and information retrieval
• Developing applications that require programmatic web interaction

Non-Goals

• Providing a visual web scraping UI
• Replacing a full web browser for general user browsing
• Managing complex application state beyond web scraping contexts

Workflow

1. Install the CLI globally or via npx.
2. Authenticate with Firecrawl API key or via browser login.
3. Execute commands like `scrape`, `search`, `crawl`, or `agent` with appropriate arguments.
4. Optionally, install agent skills for AI agent integration using `firecrawl setup skills`.

Practices

• Web scraping best practices
• Agent integration
• Secure API key management

Prerequisites

• Node.js and npm/npx installed
• Firecrawl API key (for cloud service) or self-hosted instance URL
• An AI coding agent (for skill installation)