Metrum Insights Documentation

Metrum Insights helps teams run reproducible AI system benchmarks across models, modalities, serving frameworks, hardware, and deployment environments.

Start with the workflow:

1. Define what you want to learn: model, modality, precision, framework, input/output shape, concurrency, hardware, and success metrics.
2. Model the benchmark in Metrum Insights: project, workloads, scenarios, hardware instances, command templates, and run settings.
3. Onboard hardware or provision cloud capacity.
4. Execute the benchmark and collect job status, outputs, telemetry, logs, SUT data, and cost evidence.
5. Package the results into reports that can be compared and reproduced.

Recommended entry points:

• Benchmark Lifecycle
• Workflow Examples
• Benchmark Planning
• Hardware Modeling
• Command Templates
• Product Installation
• Runbook API Reference