Skip to main content

Firecrawl Crawl

Skill Active
Part of:Firecrawl

Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.

Purpose

To provide a robust and flexible command-line interface for bulk content extraction, web crawling, and data discovery from the web.

Features

  • Bulk website content extraction
  • Web crawling with depth and path filtering
  • Web search with source and category filtering
  • AI-powered agent for structured data extraction
  • Interact with scraped pages in a live browser session

Use Cases

  • When you need to crawl a site and extract all pages from a docs section.
  • When you want to bulk-scrape multiple pages following links on a website.
  • When performing web searches and needing to scrape results directly.
  • When automating data extraction tasks from web pages using natural language prompts.

Non-Goals

  • Replacing a full-fledged browser automation framework for complex UI interactions.
  • Performing real-time data streaming from dynamic web applications.
  • Executing arbitrary remote code with elevated privileges.

Trust

  • warning:Issues AttentionIn the last 90 days, 4 issues were opened and 1 was closed, indicating a low closure rate and potentially slow maintainer response.

Installation

First, add the marketplace

/plugin marketplace add firecrawl/cli
/plugin install cli@firecrawl

Quality Score

75 /100
Analyzed 1 day ago

Trust Signals

Last commit2 days ago
Stars383
Status
View Source

Similar Extensions

Agent Browser

100

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

Skill
shanraisshan

Project Session Manager

100

Worktree-first dev environment manager for issues, PRs, and features with optional tmux sessions

Skill
Yeachan-Heo

Oh My Claudecode

100

Process-first advisor routing for Claude, Codex, or Gemini via `omc ask`, with artifact capture and no raw CLI assembly

Skill
Yeachan-Heo

Github

100

Use gh for GitHub issues, PR status, CI/logs, comments, reviews, releases, and API queries.

Skill
steipete

Telegram Crabbox E2e Proof

100

Use when reviewing, reproducing, or proving OpenClaw Telegram behavior with a real Telegram user on Crabbox, including PR review workflows that need an agent-controlled Telegram Desktop recording, TDLib user-driver commands, Convex-leased credentials, WebVNC observation, and motion-trimmed artifacts.

Skill
steipete

Chatgpt Search

100

Search ChatGPT and extract the full response + hydration JSON that powers the UI. Attaches to a running Chrome instance (port 9222 by default), opens ChatGPT, submits a query, waits for the streamed response, and returns structured data: messages, product cards, hydration JSON, and API calls. Use when asked to "search chatgpt", "ask chatgpt", "chatgpt search", "get chatgpt response", or "scrape chatgpt".

Skill
SeifBenayed

© 2025 SkillRepo · Find the right skill, skip the noise.