Agents / support-bot
support-bot
v2.1.0last run 10 min ago
Runs · 24 h
26
176 over 7 days
Failed · 24 h
7.7%
p50 duration · 24 h
2.76s
Mean cost · 24 h
$0.0007
Is it getting worse?
last 24 h(26 runs)vsprevious 7 days(171 runs)no regression
| Metric | previous 7 days | last 24 h | Change | Verdict |
|---|---|---|---|---|
| Failed runs | 1.2% | 7.7% | +6.5 pts | stable |
| Failed tool calls | 1.2% | 7.7% | +6.5 pts | stable |
| Mean duration | 2.75s | 2.76s | +0% | stable |
| Mean cost | $0.0008 | $0.0007 | −2% | stable |
| Steps per run | 3 | 3 | 0% | stable |
| Tokens per run | 2485 | 2481 | −0% | stable |
| Repeated tool calls | 0 | 0 | 0 | stable |
| Runs on a new tool path | 0.0% | 0.0% | 0.0 pts | stable |
| Score · helpful | 0.87 | 0.85 | −0.02 | stable |
A metric is flagged only when the change is both statistically significant (one-sided test, p < 0.01, Holm-corrected for the number of metrics) and large enough to matter (+15% on a mean, +3 pts on a rate, −0.05 on a score), with at least 20 runs on each side.
Last 14 days
stepsrepeated tool calls
p50p95
Tool paths
Agent version v2.1.0· 347 runs
| orders.lookup | 100% |
Agent versions
| Agent version | First run | Runs | Failed | p50 duration | Mean cost | Steps | Repeats | Score · helpful |
|---|---|---|---|---|---|---|---|---|
| v2.1.0 | 14 d ago | 347 | 2.0% | 2.76s | $0.0007 | 3 | 0 | 0.86 |
Recent runs
Runs with repeated tool calls →| Run | Version | Status | Started | Duration | Steps | Cost | Flags |
|---|---|---|---|---|---|---|---|
| run_b620555f | v2.1.0 | failed | 10 min ago | 2.76s | 3 | $0.0008 | 1 tool errorhelpful 0.00 |
| run_8a33d8a4 | v2.1.0 | ok | 1 h ago | 1.99s | 3 | $0.0006 | |
| run_4ba045fc | v2.1.0 | ok | 2 h ago | 2.65s | 3 | $0.0009 | |
| run_5ed0aba4 | v2.1.0 | ok | 4 h ago | 2.56s | 3 | $0.0008 | |
| run_151b5f75 | v2.1.0 | ok | 5 h ago | 2.64s | 3 | $0.0007 | |
| run_820d1552 | v2.1.0 | ok | 5 h ago | 2.76s | 3 | $0.0008 | |
| run_81f405b5 | v2.1.0 | ok | 6 h ago | 2.90s | 3 | $0.0008 | helpful 0.00 |
| run_c22cd801 | v2.1.0 | ok | 6 h ago | 2.12s | 3 | $0.0007 | |
| run_c8f0f242 | v2.1.0 | ok | 7 h ago | 3.54s | 3 | $0.0008 | |
| run_2ed81c66 | v2.1.0 | ok | 7 h ago | 2.75s | 3 | $0.0007 | |
| run_bd70749b | v2.1.0 | ok | 9 h ago | 2.92s | 3 | $0.0006 | |
| run_3be4ca74 | v2.1.0 | ok | 9 h ago | 2.50s | 3 | $0.0009 |