命令行可靠性Agent Arena 的 bash 可靠性信号:执行终端命令是否稳定成功;偏运维与工程场景。
命令行可靠性排名35
第一梯队2 个模型与第 1 名在 95% 置信区间内无显著差异,名次先后不代表确定的强弱。
名次模型命令行净提升· 95% 区间
01
Claude Opus 5.5 (Max)
Claude Opus 5.5 (Max)
02
Claude Sonnet 5 (High)
Claude Sonnet 5 (High)
03
Claude Sonnet 5.5 (Max)
Claude Sonnet 5.5 (Max)
04
GPT-5.5 (xHigh)
GPT-5.5 (xHigh)
05
GPT-5.6 Sol (xHigh)
GPT-5.6 Sol (xHigh)
06
Claude Fable 5 (High)
Claude Fable 5 (High)
07
Claude Opus 5 (Max)
Claude Opus 5 (Max)
08
Gemini 3.8 Flash (High)
Gemini 3.8 Flash (High)
09
GPT-6 Sol (Max)
GPT-6 Sol (Max)
10
GPT-6 Luna (Max)
GPT-6 Luna (Max)
11
Claude Fable 5.1 (Max)
Claude Fable 5.1 (Max)
12
GPT-5.4 (High)
GPT-5.4 (High)
13
GPT-6 Astra (Max)
GPT-6 Astra (Max)
14
Grok 4.6 (xHigh)
Grok 4.6 (xHigh)
15
Grok 4.7 (xHigh)
Grok 4.7 (xHigh)
16
Claude Haiku 5.5 (High)
Claude Haiku 5.5 (High)
17
GPT-5.6 Luna (xHigh)
GPT-5.6 Luna (xHigh)
18
Gemini 3.7 Flash (High)
Gemini 3.7 Flash (High)
19
GPT 5.5
GPT-5.5
20
Qwen 3.7 Max
Qwen3.7-Max
待接入
有 7 天前的可比快照后显示周变化。