其他

firecrawl-map

firecrawl/cli

Discover and list a site's URLs, with search filtering. Use for "map the site" or "find the URL for" requests — when the user knows the site but not the exact page, or wants site structure.

  • 8万 次安装
  • 674 星标
  • 收录于

安装命令

npx skills add https://github.com/firecrawl/cli --skill firecrawl-map

要点

Discover and filter URLs on a website, with optional search to locate specific pages.

  • Supports filtering by search query to find pages matching keywords within large sites
  • Includes sitemap handling strategies (include, skip, or use only) and optional subdomain inclusion
  • Outputs results as plain text or JSON with configurable URL limits
  • Commonly paired with firecrawl-scrape: use map with search to find the target URL, then scrape it

SKILL.md

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.