AI导哈

营销与写作

writing-evals

axiomhq/skills

Scaffolds evaluation suites for the Axiom AI SDK. Generates eval files, scorers, flag schemas, and config from natural-language descriptions. Use when creating evals, writing scorers, setting up flag schemas, or configuring axiom.config.ts.

  • 2194 次安装
  • 17 星标
  • 收录于

安装命令

npx skills add https://github.com/axiomhq/skills --skill writing-evals

SKILL.md

Writing Evals

You write evaluations that prove AI capabilities work. Evals are the test suite for non-deterministic systems: they measure whether a capability still behaves correctly after every change.

Prerequisites

Verify the SDK is installed:

ls node_modules/axiom/dist/

If not installed, install it using the project's package manager (e.g., pnpm add axiom).

Always check node_modules/axiom/dist/docs/ first for the correct API signatures, import paths, and patterns for the installed SDK version. The bundled docs are the source of truth — do not rely on the examples in this skill if they conflict.

Philosophy

相关 Skills

axiom-sreaxiomhq/skillsExpert SRE investigator for incidents and debugging. Uses hypothesis-driven methodology and systematic triage. Can query Axiom observability when available. Use for incident response, root cause analysis, production debugging, or log investigation.测试与安全5185building-dashboardsaxiomhq/skillsDesigns and builds Axiom dashboards via API. Covers chart types, APL and metrics/MPL query patterns, SmartFilters, layout, and configuration options. Use when creating dashboards, migrating from Splunk, or configuring chart options.数据与研究4543query-metricsaxiomhq/skillsRuns metrics queries against Axiom MetricsDB via scripts. Discovers available metrics, tags, and tag values. Use when asked to query metrics, explore metric datasets, check metric values, or investigate OTel metrics data.数据与研究3787controlling-costsaxiomhq/skillsAnalyzes Axiom query patterns to find unused data, then builds dashboards and monitors for cost optimization. Use when asked to reduce Axiom costs, find unused columns or field values, identify data waste, or track ingest spend.数据与研究2752spl-to-aplaxiomhq/skillsTranslates Splunk SPL queries to Axiom APL. Provides command mappings, function equivalents, and syntax transformations. Use when migrating from Splunk, converting SPL queries, or learning APL equivalents of SPL patterns.其他2636axiom-alertingaxiomhq/skillsCreate and manage Axiom monitors and notifiers via the v2 public API. Use when building alerting, routing notifications, validating monitor behavior, and maintaining alert configurations end-to-end.后端与数据库2522