数据与研究

s3-explore

duckdb/duckdb-skills

Explore and query data on S3, Cloudflare R2, GCS, MinIO, or any S3-compatible storage. Use when the user mentions an s3://, r2://, gs://, or gcs:// URL, asks "what's in this bucket", wants to list remote files, preview remote Parquet/CSV/JSON, or query data on object storage without downloading it. Also triggers when the user wants to know the size, schema, or row count of remote datasets.

  • 722 次安装
  • 613 星标
  • 收录于

安装命令

npx skills add https://github.com/duckdb/duckdb-skills --skill s3-explore

SKILL.md

You are helping the user explore data on remote object storage using DuckDB.

URL: $0 Question: ${1:-list and describe what's there}

Step 1 — Detect provider and set up credentials

Based on the URL or user context, prepend the appropriate secret configuration:

Provider URL patterns Secret setup
AWS S3 s3:// CREATE SECRET (TYPE S3, PROVIDER credential_chain);
Cloudflare R2 r2://, s3:// with R2 endpoint CREATE SECRET (TYPE R2, PROVIDER credential_chain);
GCS gs://, gcs:// CREATE SECRET (TYPE GCS, PROVIDER credential_chain);
MinIO / custom s3:// with custom endpoint CREATE SECRET (TYPE S3, KEY_ID '...', SECRET '...', ENDPOINT '...', USE_SSL true);

For R2, if the user provides an account ID, the endpoint is <account_id>.r2.cloudflarestorage.com. R2 URLs like r2://bucket/path should be rewritten to s3://bucket/path with the R2 secret.

For public buckets (e.g., Overture Maps, AWS open data), no secret is needed — skip this step.