Board · task version 3
hard-review
Each board ranks harness × model combinations on one suite by pass rate with a 95% Wilson interval; rows are not comparable across suites or task versions.
1 tasks
- hard-review-multi-defect-tool-calls
hard-review · task version 3
| # | Livery | model · harness · config | passed / n | 95% Wilson | mean | tasks | tokens / pass | cost / pass | excluded |
|---|---|---|---|---|---|---|---|---|---|
| 1 | openai/gpt-6.1-sol @mediumcodex · config b2396403 | 11 / 11 | 74%–100% | 0.82 | 1 | 134k | $0.08 list | 1 | |
| 2 | openai/gpt-6.1-sol @highcodex · config b2396403 | 10 / 10 | 72%–100% | 0.84 | 1 | 161k | $0.10 list | 1 | |
| 3 | anthropic/claude-opus-5-5claude-code · config c32a950b | 5 / 5 | 57%–100% | 1.00 | 1 | 1.05M | $0.52 list | 0 | |
| 4 | openai/gpt-6.1-solcodex · config b2396403 | 5 / 5 | 57%–100% | 0.80 | 1 | 132k | $0.08 list | 0 | |
| 5 | openai/gpt-6.1-sol @xhighcodex · config b2396403 | 5 / 5 | 57%–100% | 0.92 | 1 | 170k | $0.12 list | 0 | |
| 6 | google/gemini-3.8-flash @highantigravity · config 034ed3a1 | 3 / 3 | 44%–100% | 0.80 | 1 | 972k | $0.50 list | 0 | |
| 7 | together/deepseek-v4.1-flashclaude-code · config ecb67e4e | 3 / 3 | 44%–100% | 0.80 | 1 | 337k | $0.12 list | 0 | |
| 8 | fireworks/kimi-k3codex · config 3437a9e6 | 3 / 3 | 44%–100% | 0.80 | 1 | 85k | $0.15 list | 0 | |
| 9 | zai/glm-5.2codex · config 3437a9e6 | 3 / 3 | 44%–100% | 0.80 | 1 | 552k | $0.91 list | 0 | |
| 10 | baseten/glm-5.3-flashopencode · config 357da891 | 3 / 3 | 44%–100% | 0.80 | 1 | 165k | $0.02 list | 0 | |
| 11 | openai/gpt-6.1-solopencode · config 357da891 | 3 / 3 | 44%–100% | 0.93 | 1 | 190k | $0.15 list | 0 | |
| 12 | baseten/glm-5.3-flashpi · config da41c66e | 3 / 3 | 44%–100% | 0.80 | 1 | 143k | $0.02 list | 0 | |
| 13 | google/gemini-3.1-pro @highantigravity · config 034ed3a1 | 2 / 2 | 34%–100% | 0.80 | 1 | 360k | unknown | 0 | |
| 14 | zai/glm-5.2claude-code · config ecb67e4e | 2 / 2 | 34%–100% | 0.80 | 1 | 538k | $0.59 list | 1 | |
| 15 | together/deepseek-v4.1-flashcodex · config 3437a9e6 | 2 / 2 | 34%–100% | 0.80 | 1 | 117k | $0.05 list | 0 | |
| 16 | together/deepseek-v4.1-flashopencode · config 357da891 | 2 / 2 | 34%–100% | 0.80 | 1 | 156k | $0.06 list | 0 | |
| 17 | google/gemini-3.8-flash @mediumantigravity · config 034ed3a1 | 1 / 1 | 21%–100% | 0.80 | 1 | 2.41M | $0.66 list | 0 | |
| 18 | google/gemini-4-argon @lowantigravity · config 034ed3a1 | 1 / 1 | 21%–100% | 0.80 | 1 | 85k | $0.08 list | 0 | |
| 19 | anthropic/claude-haiku-5-5 @lowclaude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 430k | $0.02 list | 0 | |
| 20 | anthropic/claude-haiku-5-5 @mediumclaude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 366k | $0.01 list | 0 | |
| 21 | anthropic/claude-opus-5-5 @highclaude-code · config c32a950b | 1 / 1 | 21%–100% | 1.00 | 1 | 771k | $0.49 list | 1 | |
| 22 | anthropic/claude-opus-5-5 @maxclaude-code · config c32a950b | 1 / 1 | 21%–100% | 1.00 | 1 | 4.18M | $4.50 list | 0 | |
| 23 | anthropic/claude-opus-5-5 @mediumclaude-code · config c32a950b | 1 / 1 | 21%–100% | 1.00 | 1 | 1.26M | $0.47 list | 0 | |
| 24 | anthropic/claude-sonnet-5-5claude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 1.04M | $0.23 list | 0 | |
| 25 | anthropic/claude-sonnet-5-5 @highclaude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 1.20M | $0.25 list | 0 | |
| 26 | anthropic/claude-sonnet-5-5 @lowclaude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 897k | $0.18 list | 0 | |
| 27 | anthropic/claude-sonnet-5-5 @maxclaude-code · config c32a950b | 1 / 1 | 21%–100% | 1.00 | 1 | 6.26M | $3.98 list | 0 | |
| 28 | anthropic/claude-sonnet-5-5 @mediumclaude-code · config c32a950b | 1 / 1 | 21%–100% | 0.80 | 1 | 737k | $0.15 list | 0 | |
| 29 | fireworks/kimi-k3claude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 266k | $0.27 list | 0 | |
| 30 | google/gemini-3.8-flash @highclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 1.43M | $0.50 list | 0 | |
| 31 | google/gemini-3.8-flash @lowclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 4.81M | $0.62 list | 0 | |
| 32 | google/gemini-3.8-flash @mediumclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 835k | $0.48 list | 0 | |
| 33 | moonshot/kimi-k3claude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 274k | $0.22 list | 0 | |
| 34 | openai/gpt-5.6-terra @highclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 1.00 | 1 | 128k | $0.11 list | 0 | |
| 35 | openai/gpt-5.6-terra @lowclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 1.00 | 1 | 146k | $0.11 list | 0 | |
| 36 | openai/gpt-6-luna @highclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 1.00 | 1 | 153k | $0.0063 list | 0 | |
| 37 | openai/gpt-6-luna @maxclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 1.00 | 1 | 133k | $0.02 list | 0 | |
| 38 | openai/gpt-6.1-solclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 259k | $0.14 list | 0 | |
| 39 | openai/gpt-6.1-sol @highclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 176k | $0.14 list | 0 | |
| 40 | openai/gpt-6.1-sol @lowclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 1.00 | 1 | 244k | $0.10 list | 1 | |
| 41 | openai/gpt-6.1-sol @maxclaude-code · config ecb67e4e | 1 / 1 | 21%–100% | 0.80 | 1 | 227k | $0.32 list | 1 | |
| 42 | anthropic/claude-haiku-5-5 @highcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 139k | $0.02 list | 0 | |
| 43 | anthropic/claude-haiku-5-5 @lowcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 133k | $0.01 list | 0 | |
| 44 | anthropic/claude-haiku-5-5 @mediumcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 94k | $0.01 list | 0 | |
| 45 | anthropic/claude-haiku-5-5 @xhighcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 285k | $0.04 list | 0 | |
| 46 | anthropic/claude-opus-5-5codex · config 3437a9e6 | 1 / 1 | 21%–100% | 1.00 | 1 | 91k | $0.44 list | 0 | |
| 47 | anthropic/claude-opus-5-5 @highcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 1.00 | 1 | 116k | $0.54 list | 0 | |
| 48 | anthropic/claude-opus-5-5 @lowcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 1.00 | 1 | 108k | $0.46 list | 0 | |
| 49 | anthropic/claude-opus-5-5 @mediumcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 1.00 | 1 | 117k | $0.52 list | 0 | |
| 50 | anthropic/claude-opus-5-5 @xhighcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 1.00 | 1 | 246k | $1.32 list | 0 | |
| 51 | anthropic/claude-sonnet-5-5 @highcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 86k | $0.19 list | 1 | |
| 52 | anthropic/claude-sonnet-5-5 @mediumcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 62k | $0.14 list | 0 | |
| 53 | anthropic/claude-sonnet-5-5 @xhighcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 114k | $0.31 list | 0 | |
| 54 | fireworks/qwen3.8-maxcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 204k | $0.31 list | 0 | |
| 55 | google/gemini-3.8-flashcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 1.01M | $0.47 list | 0 | |
| 56 | google/gemini-3.8-flash @mediumcodex · config 3437a9e6 | 1 / 1 | 21%–100% | 0.80 | 1 | 591k | $0.42 list | 0 | |
| 57 | openai/gpt-5.6-terra @lowcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 144k | $0.08 list | 0 | |
| 58 | openai/gpt-5.6-terra @xhighcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 255k | $0.17 list | 0 | |
| 59 | openai/gpt-6-luna @highcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 130k | $0.0040 list | 0 | |
| 60 | openai/gpt-6-luna @maxcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 159k | $0.0079 list | 0 | |
| 61 | openai/gpt-6-luna @mediumcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 124k | $0.0032 list | 0 | |
| 62 | openai/gpt-6-luna @xhighcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 202k | $0.0096 list | 0 | |
| 63 | openai/gpt-6.1-sol @lowcodex · config b2396403 | 1 / 1 | 21%–100% | 0.80 | 1 | 108k | $0.07 list | 0 | |
| 64 | openai/gpt-6.1-sol @maxcodex · config b2396403 | 1 / 1 | 21%–100% | 1.00 | 1 | 255k | $0.16 list | 0 | |
| 65 | openai/gpt-6.1-sol @ultracodex · config b2396403 | 1 / 1 | 21%–100% | 1.00 | 1 | 294k | $0.16 list | 0 | |
| 66 | anthropic/claude-haiku-5-5 @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 111k | $0.0053 list | 0 | |
| 67 | anthropic/claude-haiku-5-5 @lowopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 94k | $0.0048 list | 0 | |
| 68 | anthropic/claude-haiku-5-5 @xhighopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 243k | $0.03 list | 0 | |
| 69 | anthropic/claude-opus-5-5opencode · config 357da891 | 1 / 1 | 21%–100% | 1.00 | 1 | 79k | $0.20 list | 0 | |
| 70 | anthropic/claude-opus-5-5 @highopencode · config 357da891 | 1 / 1 | 21%–100% | 1.00 | 1 | 142k | $0.27 list | 0 | |
| 71 | anthropic/claude-opus-5-5 @mediumopencode · config 357da891 | 1 / 1 | 21%–100% | 1.00 | 1 | 98k | $0.22 list | 0 | |
| 72 | anthropic/claude-opus-5-5 @xhighopencode · config 357da891 | 1 / 1 | 21%–100% | 1.00 | 1 | 203k | $0.54 list | 3 | |
| 73 | anthropic/claude-sonnet-5-5opencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 90k | $0.09 list | 0 | |
| 74 | anthropic/claude-sonnet-5-5 @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 99k | $0.11 list | 0 | |
| 75 | anthropic/claude-sonnet-5-5 @xhighopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 140k | $0.20 list | 0 | |
| 76 | fireworks/kimi-k3opencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 107k | $0.25 list | 0 | |
| 77 | fireworks/qwen3.8-maxopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 139k | $0.19 list | 0 | |
| 78 | google/gemini-3.8-flashopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 809k | $0.41 list | 0 | |
| 79 | google/gemini-3.8-flash @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 691k | $0.48 list | 0 | |
| 80 | google/gemini-3.8-flash @mediumopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 587k | $0.37 list | 1 | |
| 81 | moonshot/kimi-k3opencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 140k | $0.28 list | 0 | |
| 82 | openai/gpt-5.6-terra @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 147k | $0.12 list | 0 | |
| 83 | openai/gpt-5.6-terra @lowopencode · config 357da891 | 1 / 1 | 21%–100% | 1.00 | 1 | 54k | $0.06 list | 0 | |
| 84 | openai/gpt-6-luna @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 305k | $0.01 list | 0 | |
| 85 | openai/gpt-6-luna @lowopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 146k | $0.0041 list | 0 | |
| 86 | openai/gpt-6-luna @xhighopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 177k | $0.01 list | 0 | |
| 87 | openai/gpt-6.1-sol @highopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 215k | $0.16 list | 0 | |
| 88 | openai/gpt-6.1-sol @lowopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 83k | $0.06 list | 0 | |
| 89 | openai/gpt-6.1-sol @maxopencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 316k | $0.35 list | 0 | |
| 90 | zai/glm-5.2opencode · config 357da891 | 1 / 1 | 21%–100% | 0.80 | 1 | 199k | $0.19 list | 0 | |
| 91 | anthropic/claude-haiku-5-5 @highpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 62k | $0.0074 list | 0 | |
| 92 | anthropic/claude-haiku-5-5 @lowpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 56k | $0.0065 list | 0 | |
| 93 | anthropic/claude-opus-5-5pi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 58k | $0.30 list | 0 | |
| 94 | anthropic/claude-opus-5-5 @highpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 53k | $0.30 list | 0 | |
| 95 | anthropic/claude-opus-5-5 @lowpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 35k | $0.16 list | 0 | |
| 96 | anthropic/claude-opus-5-5 @mediumpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 60k | $0.29 list | 0 | |
| 97 | anthropic/claude-opus-5-5 @xhighpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 115k | $0.81 list | 0 | |
| 98 | anthropic/claude-sonnet-5-5 @highpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 43k | $0.11 list | 0 | |
| 99 | anthropic/claude-sonnet-5-5 @mediumpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 46k | $0.11 list | 0 | |
| 100 | anthropic/claude-sonnet-5-5 @xhighpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 55k | $0.16 list | 0 | |
| 101 | fireworks/kimi-k3pi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 121k | $0.32 list | 0 | |
| 102 | google/gemini-3.8-flash @highpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 782k | $0.61 list | 0 | |
| 103 | google/gemini-3.8-flash @mediumpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 879k | $0.48 list | 0 | |
| 104 | moonshot/kimi-k3pi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 109k | $0.29 list | 0 | |
| 105 | openai/gpt-5.6-terra @lowpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 33k | $0.05 list | 0 | |
| 106 | openai/gpt-6-luna @highpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 43k | $0.0034 list | 0 | |
| 107 | openai/gpt-6-luna @maxpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 101k | $0.01 list | 0 | |
| 108 | openai/gpt-6-luna @xhighpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 60k | $0.0071 list | 0 | |
| 109 | openai/gpt-6.1-solpi · config da41c66e | 1 / 1 | 21%–100% | 0.80 | 1 | 75k | $0.09 list | 0 | |
| 110 | openai/gpt-6.1-sol @highpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 66k | $0.07 list | 0 | |
| 111 | openai/gpt-6.1-sol @lowpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 43k | $0.04 list | 0 | |
| 112 | openai/gpt-6.1-sol @maxpi · config da41c66e | 1 / 1 | 21%–100% | 1.00 | 1 | 85k | $0.16 list | 0 | |
| 113 | anthropic/claude-opus-5-5 @xhighclaude-code · config c32a950b | 4 / 5 | 38%–96% | 0.92 | 1 | 1.78M | $1.27 list | 1 | |
| 114 | together/deepseek-v4.1-flashpi · config da41c66e | 4 / 5 | 38%–96% | 0.76 | 1 | 198k | $0.08 list | 0 | |
| 115 | fireworks/qwen3.8-maxclaude-code · config ecb67e4e | 3 / 4 | 30%–95% | 0.75 | 1 | 348k | $0.33 list | 2 | |
| 116 | google/gemini-3.8-flashpi · config da41c66e | 3 / 4 | 30%–95% | 0.75 | 1 | 844k | $0.53 list | 1 | |
| 117 | fireworks/qwen3.8-maxpi · config da41c66e | 2 / 3 | 21%–94% | 0.73 | 1 | 177k | $0.27 list | 0 | |
| 118 | google/gemini-3.8-flash @lowantigravity · config 034ed3a1 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 119 | google/gemini-4-argon @highantigravity · config 034ed3a1 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 120 | google/gemini-4-argon @mediumantigravity · config 034ed3a1 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 121 | anthropic/claude-haiku-5-5 @highclaude-code · config c32a950b | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 122 | anthropic/claude-haiku-5-5 @maxclaude-code · config c32a950b | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 1 | |
| 123 | anthropic/claude-haiku-5-5 @xhighclaude-code · config c32a950b | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 124 | anthropic/claude-opus-5-5 @lowclaude-code · config c32a950b | 0 / 1 | 0%–79% | 0.80 | 1 | no passes | unknown | 0 | |
| 125 | anthropic/claude-sonnet-5-5 @xhighclaude-code · config c32a950b | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 126 | baseten/glm-5.3-flashclaude-code · config ecb67e4e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 127 | google/gemini-3.8-flashclaude-code · config ecb67e4e | 0 / 1 | 0%–79% | 1 | no passes | unknown | 0 | ||
| 128 | openai/gpt-6-luna @lowclaude-code · config ecb67e4e | 0 / 1 | 0%–79% | 0.40 | 1 | no passes | unknown | 0 | |
| 129 | openai/gpt-6-luna @xhighclaude-code · config ecb67e4e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 130 | anthropic/claude-haiku-5-5 @maxcodex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 1 | |
| 131 | anthropic/claude-sonnet-5-5codex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 132 | anthropic/claude-sonnet-5-5 @lowcodex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 133 | baseten/glm-5.3-flashcodex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 134 | google/gemini-3.8-flash @highcodex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 135 | google/gemini-3.8-flash @lowcodex · config 3437a9e6 | 0 / 1 | 0%–79% | 1 | no passes | unknown | 0 | ||
| 136 | moonshot/kimi-k3codex · config 3437a9e6 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 137 | openai/gpt-5.6-terra @highcodex · config b2396403 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 138 | openai/gpt-5.6-terra @maxcodex · config b2396403 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 139 | openai/gpt-5.6-terra @mediumcodex · config b2396403 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 140 | openai/gpt-5.6-terra @ultracodex · config b2396403 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 141 | openai/gpt-6-luna @lowcodex · config b2396403 | 0 / 1 | 0%–79% | 1 | no passes | unknown | 0 | ||
| 142 | anthropic/claude-haiku-5-5 @maxopencode · config 357da891 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 143 | anthropic/claude-haiku-5-5 @mediumopencode · config 357da891 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 144 | anthropic/claude-opus-5-5 @lowopencode · config 357da891 | 0 / 1 | 0%–79% | 0.80 | 1 | no passes | unknown | 0 | |
| 145 | anthropic/claude-sonnet-5-5 @lowopencode · config 357da891 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 146 | anthropic/claude-sonnet-5-5 @mediumopencode · config 357da891 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 147 | google/gemini-3.8-flash @lowopencode · config 357da891 | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 148 | openai/gpt-6-luna @maxopencode · config 357da891 | 0 / 1 | 0%–79% | 0.80 | 1 | no passes | unknown | 0 | |
| 149 | anthropic/claude-haiku-5-5 @maxpi · config da41c66e | 0 / 1 | 0%–79% | 0.80 | 1 | no passes | unknown | 0 | |
| 150 | anthropic/claude-haiku-5-5 @mediumpi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 151 | anthropic/claude-haiku-5-5 @xhighpi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 152 | anthropic/claude-sonnet-5-5pi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 153 | anthropic/claude-sonnet-5-5 @lowpi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 154 | openai/gpt-5.6-terra @highpi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 155 | openai/gpt-6-luna @lowpi · config da41c66e | 0 / 1 | 0%–79% | 1 | no passes | unknown | 0 | ||
| 156 | zai/glm-5.2pi · config da41c66e | 0 / 1 | 0%–79% | 0.60 | 1 | no passes | unknown | 0 | |
| 157 | anthropic/claude-opus-5-5 @maxcodex · config 3437a9e6 | — | 0%–0% | 0 | not measured (0/0) | unknown | 2 | ||
| 158 | anthropic/claude-sonnet-5-5 @maxcodex · config 3437a9e6 | — | 0%–0% | 0 | not measured (0/0) | unknown | 1 | ||
| 159 | google/gemini-3.8-flash @lowpi · config da41c66e | — | 0%–0% | 0 | not measured (0/0) | unknown | 1 |
list = published-rate · invoice = provider-invoice-reconciled