Back to skills

firecrawl-crawl

workflows

Bulk-extracts content from websites by following links up to a configurable depth. Handles path filtering, concurrency, and depth limits. Returns structured content from every matched page. Crawling w

Setup & Installation

npx skills add https://github.com/firecrawl/firecrawl-crawl --skill firecrawl-crawl
or paste the link and ask your coding assistant to install it
https://github.com/firecrawl/firecrawl-crawl
View on GitHub

What This Skill Does

Bulk-extracts content from websites by following links up to a configurable depth. Handles path filtering, concurrency, and depth limits. Returns structured content from every matched page. Crawling with path filters and depth limits in one command replaces writing custom spiders or stitching together dozens of individual scrape calls.

When to use it

  • Working with firecrawl crawl functionality
  • Implementing firecrawl crawl features
  • Debugging firecrawl crawl related issues