站点地图抓取MCP服务

SitemapKit MCP Server 是一个通过 Model Context Protocol 为 AI 代理提供 XML 站点地图发现、嵌套索引解析及去重 URL 列表提取的服务,适用于 SEO 审计、内容清单、研究及代理工作流。

  • by 0nl1n1n
  • TypeScript
  • 本地部署
  • 更新于
在 GitHub 查看 0nl1n1n/sitemapkit-mcp

使用说明

SitemapKit MCP Server

Give AI agents a reliable XML sitemap crawler through the Model Context Protocol (MCP). The SitemapKit extraction API discovers sitemap files, parses nested sitemap indexes, and returns a deduplicated URL list for SEO audits, content inventories, research, and agent workflows.

Works with MCP-compatible clients including Claude Desktop, Cursor, Windsurf, and other AI assistants that support local stdio servers.

Tools

Tool Description
discover_sitemaps Find all sitemap files for a domain (checks robots.txt, common paths, sitemap indexes)
extract_sitemap Extract all URLs from a specific sitemap file
full_crawl Discover + extract all URLs across all sitemaps in one call

Setup

1. Get an API key

Sign up at sitemapkit.com and grab your API key from app.sitemapkit.com/settings/api.

2. Configure your MCP client

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json:

{
  "mcpServers": {
    "sitemapkit": {
      "command": "npx",
      "args": ["-y", "sitemapkit-mcp"],
      "env": {
        "SITEMAPKIT_API_KEY": "your-api-key-here"
      }
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project (or the global ~/.cursor/mcp.json):

{
  "mcpServers": {
    "sitemapkit": {
      "command": "npx",
      "args": ["-y", "sitemapkit-mcp"],
      "env": {
        "SITEMAPKIT_API_KEY": "your-api-key-here"
      }
    }
  }
}

Windsurf

Add to ~/.codeium/windsurf/mcp_config.json:

{
  "mcpServers": {
    "sitemapkit": {
      "command": "npx",
      "args": ["-y", "sitemapkit-mcp"],
      "env": {
        "SITEMAPKIT_API_KEY": "your-api-key-here"
      }
    }
  }
}

Usage examples

Once configured, you can ask your AI assistant:

  • "Find all sitemaps for stripe.com"
  • "Extract every URL from https://example.com/sitemap.xml"
  • "Get the full URL list for shopify.com, up to 5000 URLs"

Continuous sitemap monitoring

This MCP server is designed for on-demand discovery and extraction. To watch a website continuously, detect newly published pages, and send signed webhook alerts, use SitemapKit Monitoring.

The free plan includes one daily monitor. Paid plans add more websites, higher URL limits, and checks as often as every hour. See the webhook documentation for payloads, signatures, and retry behavior.

API limits

Limits depend on your SitemapKit plan. The meta.quota field in each response tells you how many requests you have remaining this month.

Plan API requests/month URLs per extraction
Free 100 1,000
Starter 5,000 10,000
Pro 50,000 50,000

See current API and monitoring allowances on the pricing page.

License

MIT