数据与研究

firecrawl-agent

firecrawl/cli

Autonomously navigate websites and extract structured data across pages. Use when the task requires navigation or no suitable ready-made workflow or data provider covers it.

  • 8.1万 次安装
  • 674 星标
  • 收录于

安装命令

npx skills add https://github.com/firecrawl/cli --skill firecrawl-agent

要点

AI-powered autonomous extraction of structured data from complex multi-page websites.

  • Navigates sites intelligently to locate and extract data, returning results as JSON with optional schema validation
  • Supports custom JSON schemas for predictable structured output, or freeform extraction when schema is not provided
  • Offers two model tiers (spark-1-mini and spark-1-pro) with credit limits and optional waiting for inline results
  • Best suited for multi-page extraction tasks; use simpler scrape or crawl skills for single-page or bulk extraction without AI reasoning

SKILL.md

firecrawl agent

AI-powered autonomous extraction. The agent navigates sites and extracts structured data (takes 2-5 minutes).

Before starting autonomous extraction for structured records or listings, check firecrawl search alexandria '<data you need>' for a ready-made workflow or data provider. Inspect a matching contract with firecrawl list <provider> <capability> --pretty and execute with firecrawl scrape --alexandria <provider>/<capability> --options '<input JSON>' if it covers the task. Use the exact provider, capability, and input fields from that contract. Continue with Agent when no suitable tool exists or the task requires autonomous navigation.

Quick start

# Extract structured data
firecrawl agent "extract all pricing tiers" --wait --json -o .firecrawl/pricing.json

# With a JSON schema for structured output
firecrawl agent "extract products" --schema '{"type":"object","properties":{"name":{"type":"string"},"price":{"type":"number"}}}' --wait --json -o .firecrawl/products.json

# Focus on specific pages
firecrawl agent "get feature list" --urls "<url>" --wait --json -o .firecrawl/features.json