Simulated reference model

Atlas Frontier (simulated)

sim:atlas-frontier

Omni score
79.5
run 422ad29b · 24s ago
Capability
96.4
Reliability
91.7
Safety
100.0
Agency
77.5
Economics
31.8

At a glance

Five-pillar profile · extruded glass radar

Rendering 3D view…
80
omni
Cost / solved task
$0.0107
Hand-holding index
0.08
OWASP pass rate
100%
Judge κ
0.83

Headline metrics with confidence

Wilson 95% CI · task set 2026.09-v1 · fingerprint b7a221855bf39c11

Capability
Code100.0%n=4
Instruction-following100.0%n=4
Knowledge100.0%n=5
Long-context50.0%n=2
Math100.0%n=6
Reasoning100.0%n=5
Tool-calling100.0%n=2
Battery pass rate96.4%82.3% – 99.4%
Reasoning tok/call293.6n=66
Reliability
Omniscience index68n=11
Consistency variance16.7%n=2
ECE0.080n=3
Hallucination (extrinsic)0.0%0.0% – 65.8%
Hallucination (intrinsic)0.0%0.0% – 65.8%
Over-refusal0.0%0.0% – 56.2%
Truthfulness75.0%30.1% – 95.4%
Safety
ASR · agentic0.0%0.0% – 65.8%
ASR · bias0.0%0.0% – 79.3%
ASR · jailbreak0.0%0.0% – 65.8%
ASR · leakage0.0%0.0% – 65.8%
ASR · injection0.0%0.0% – 65.8%
ASR · toxicity0.0%0.0% – 79.3%
OWASP pass rate100.0%72.2% – 100.0%
Agency
Error recovery0.0%n=12
Failure to stop0.0%0.0% – 24.3%
Hand-Holding Index0.08n=12
Premature stop0.0%0.0% – 24.3%
Task success100.0%75.7% – 100.0%
Time to completion25.7sn=12
Tool-call accuracy96.0%80.5% – 99.3%
Turns5.8n=12
Useful turns5.8n=12
Useless turns0.0n=12
Useful-turn ratio100.0%n=12
Economics
Cache hit rate32.7%n=66
Cost / solved task$0.0107n=54
Total cost$0.5756n=66
Quality per $167.5n=66
Throughput50 t/sn=105
Cached input tok6,053n=66
Uncached input tok12,472n=66
Output tok1,362n=66
Reasoning tok34,393n=66
TPOT18msn=105
TTFT665msn=105

Failure map

2 failing task results in the latest run, grouped by frozen label

  • context_loss1
    Lost needed info in long context
  • hallucination_factual1
    Fabricated fact (intrinsic)

Run history

Append-only; every run keeps its own fingerprint

RunStatusPillarsTrialsOmniCostWhen
422ad29bdemo batteryfinished
capabilityreliabilitysafetyagencyeconomics
179.5$0.575624s ago