agent-metrics-osiris
bởi nantes
DevOps & CloudTóm tắt
Observability and metrics for AI agents - track calls, errors, latency.
Mô tả
Kỹ năng này làm gì
A Python/PowerShell tool that tracks API calls, errors, latency, and system resource usage for AI agents. Outputs a terminal dashboard and exports metrics to JSON.
Captures granular per-label metrics locally without requiring an external observability platform.
Khi nào nên dùng
- Tracking error rates across multiple agent runs
- Comparing latency between different API providers
- Monitoring CPU and memory usage during long agent tasks
- Exporting metrics snapshots for post-run analysis
- Auditing call volume to stay within API rate limits
Quy trình ví dụ
User asks: show me a summary of my agent's performance after a long run
- 1
Record each API call with
record --type call --label api_openai - 2
Record any errors with
record --type error --label api_error --details ... - 3
Record task latency with
record --type latency --label task_process --value 1500 - 4
Run
dashboardaction to view totals, error rate, and avg latency - 5
Run
export --format jsonto save metrics to a file
Terminal dashboard showing 1,247 calls, 1.84% error rate, 234ms avg latency, plus a metrics.json file
Cài đặt
clawhub install nantes/agent-metrics-osirisChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.