pingdotgg/ t3code
Run by mupt-ai · Released 2026-10-02 · 39 tasks · 9 settings
Model Tradeoffs
Which coding agent works best on pingdotgg/t3code? Most accurate: Claude Opus 5.5, 76.9% at $2.05 per task. Best for less: GPT-6.1 Sol, 66.7% at $0.31. 9 model settings scored on 39 tasks from its merged pull requests.
All Settings
| Model | Harness | Reasoning | Access | Accuracy | Cost / Task | Frontier |
|---|---|---|---|---|---|---|
| Claude Opus 5.5 | Claude Code | High | API Key | 76.9% | $2.05 | Yes |
| GPT-6.1 Sol | Codex | Low | API Key | 66.7% | $0.31 | Yes |
| GLM 5.3 Flash | Pi | High | Vercel AI Gateway | 64.1% | $0.35 | No |
| GPT-6.1 Sol | Codex | High | API Key | 64.1% | $0.60 | No |
| Claude Sonnet 5.5 | Claude Code | High | API Key | 59.0% | $0.87 | No |
| Kimi K3 | Pi | High | Vercel AI Gateway | 56.4% | $2.38 | No |
| GLM 5.3 | Codex | High | Vercel AI Gateway | 51.3% | $3.01 | No |
| GPT-6 Luna | Codex | High | API Key | 46.2% | $0.037 | Yes |
| GPT-6 Luna | Codex | Low | API Key | 25.6% | $0.041 | No |
Tasks
All 39 tasks, each with its instruction, tests, and solution to browse and download.