Which models know sales?
48 model configurations coach GPT- and Sonnet-generated synthetic sales calls with hidden ground truth. A judge scores each coaching note from 0–100 on whether it found the real strengths, flaws, and next moves.
- Calls
- 50
- Models
- 48
- Evaluations
- 2400
- Benchmark
- 87.4
Leaderboard
Weighted for needle recall, sales instinct, prioritization, technical accuracy, false-positive control, and raw score across 2400 evaluations.
| # | Model | Benchmark | Raw avg | P10 floor | Cost / call | Distribution | n |
|---|---|---|---|---|---|---|---|
| 1 | gpt-5.6 sol maxLeader GPT-5.6 Sol · max | 90.0 | 89.7 | 80.3 | $0.37 | 50 | |
| 2 | gpt-5.6 terra max GPT-5.6 Terra · max | 90.0 | 89.6 | 80.6 | $0.10 | 50 | |
| 3 | gpt-5.6 luna max GPT-5.6 Luna · max | 89.9 | 89.7 | 83.7 | $0.06 | 50 | |
| 4 | gpt-5.6 luna xhigh GPT-5.6 Luna · xhigh | 89.9 | 89.7 | 81.7 | $0.04 | 50 | |
| 5 | gpt-5.6 terra low GPT-5.6 Terra · low | 89.9 | 89.5 | 84.5 | $0.05 | 50 | |
| 6 | gpt-5.6 sol low GPT-5.6 Sol · low | 89.8 | 89.5 | 81.3 | $0.12 | 50 | |
| 7 | gpt-5.6 sol xhigh GPT-5.6 Sol · xhigh | 89.7 | 89.5 | 83.1 | $0.17 | 50 | |
| 8 | gpt-5.6 terra xhigh GPT-5.6 Terra · xhigh | 89.7 | 89.2 | 78.6 | $0.08 | 50 | |
| 9 | gpt-5.6 terra high GPT-5.6 Terra · high | 89.7 | 89.3 | 82.0 | $0.06 | 50 | |
| 10 | gpt-5.6 sol none GPT-5.6 Sol · none | 89.6 | 89.3 | 81.4 | $0.12 | 50 | |
| 11 | gpt-5.6 sol high GPT-5.6 Sol · high | 89.4 | 89.2 | 79.8 | $0.12 | 50 | |
| 12 | gpt-5.4 xhigh GPT-5.4 · xhigh | 89.3 | 89.0 | 79.9 | $0.28 | 50 | |
| 13 | gpt-5.6 sol medium GPT-5.6 Sol · medium | 89.3 | 89.0 | 79.7 | $0.13 | 50 | |
| 14 | gpt-5.4 high GPT-5.4 · high | 89.2 | 89.0 | 81.9 | $0.10 | 50 | |
| 15 | gpt-5.5 medium GPT-5.5 · medium | 89.1 | 88.8 | 82.0 | $0.12 | 50 | |
| 16 | gpt-5.5 xhigh GPT-5.5 · xhigh | 89.1 | 89.0 | 78.5 | $0.20 | 50 | |
| 17 | gpt-5.6 terra none GPT-5.6 Terra · none | 89.1 | 88.8 | 79.7 | $0.05 | 50 | |
| 18 | gpt-5.6 terra medium GPT-5.6 Terra · medium | 89.1 | 88.9 | 80.1 | $0.05 | 50 | |
| 19 | gpt-5.5 high GPT-5.5 · high | 88.9 | 88.6 | 79.4 | $0.14 | 50 | |
| 20 | gpt-5.6 luna medium GPT-5.6 Luna · medium | 88.7 | 88.6 | 82.0 | $0.02 | 50 | |
| 21 | gpt-5.6 luna high GPT-5.6 Luna · high | 88.7 | 88.6 | 78.9 | $0.03 | 50 | |
| 22 | gpt-5.6 luna low GPT-5.6 Luna · low | 88.6 | 88.5 | 79.4 | $0.02 | 50 | |
| 23 | gpt-5.4 medium GPT-5.4 · medium | 88.4 | 88.3 | 80.1 | $0.06 | 50 | |
| 24 | gpt-5.5 none GPT-5.5 · none | 88.3 | 88.1 | 76.6 | $0.13 | 50 | |
| 25 | gpt-5.6 luna none GPT-5.6 Luna · none | 88.0 | 87.7 | 79.7 | $0.02 | 50 | |
| 26 | gpt-5.5 low GPT-5.5 · low | 87.8 | 87.7 | 78.3 | $0.14 | 50 | |
| 27 | fable 5 high Claude Fable 5 · high | 87.7 | 87.5 | 77.0 | $0.46 | 50 | |
| 28 | gpt-5.4 low GPT-5.4 · low | 87.5 | 87.4 | 78.3 | $0.05 | 50 | |
| 29 | gpt-5.4 none GPT-5.4 · none | 87.5 | 87.4 | 78.2 | $0.05 | 50 | |
| 30 | opus 4.7 max Claude Opus 4.7 · max | 87.2 | 87.3 | 75.0 | $0.21 | 50 | |
| 31 | opus 4.7 high Claude Opus 4.7 · high | 86.6 | 86.8 | 77.8 | $0.17 | 50 | |
| 32 | muse spark 1.1 high Muse Spark 1.1 · high | 86.6 | 86.4 | 77.0 | $0.03 | 50 | |
| 33 | muse spark 1.1 medium Muse Spark 1.1 · medium | 86.4 | 86.2 | 78.4 | $0.02 | 50 | |
| 34 | muse spark 1.1 minimal Muse Spark 1.1 · minimal | 85.7 | 85.7 | 75.8 | $0.02 | 50 | |
| 35 | muse spark 1.1 low Muse Spark 1.1 · low | 85.6 | 85.4 | 75.1 | $0.02 | 50 | |
| 36 | opus 4.8 medium Claude Opus 4.8 · medium | 85.6 | 85.8 | 72.1 | $0.14 | 50 | |
| 37 | opus 4.7 medium Claude Opus 4.7 · medium | 85.5 | 85.6 | 74.0 | $0.33 | 50 | |
| 38 | opus 4.7 xhigh Claude Opus 4.7 · xhigh | 85.5 | 85.6 | 73.1 | $0.17 | 50 | |
| 39 | opus 4.7 low Claude Opus 4.7 · low | 85.5 | 85.6 | 75.6 | $0.13 | 50 | |
| 40 | opus 4.8 max Claude Opus 4.8 · max | 85.4 | 85.4 | 72.9 | $0.18 | 50 | |
| 41 | opus 4.8 xhigh Claude Opus 4.8 · xhigh | 85.3 | 85.2 | 73.0 | $0.16 | 50 | |
| 42 | opus 4.8 high Claude Opus 4.8 · high | 84.9 | 84.9 | 68.8 | $0.15 | 50 | |
| 43 | sonnet 4.6 Claude Sonnet 4.6 · default | 84.5 | 84.6 | 71.9 | $0.10 | 50 | |
| 44 | sonnet 5 Claude Sonnet 5 · default | 84.3 | 84.6 | 71.6 | $0.05 | 50 | |
| 45 | opus 4.8 low Claude Opus 4.8 · low | 83.7 | 84.0 | 67.2 | $0.12 | 50 | |
| 46 | glm 5.2 GLM 5.2 · default | 83.6 | 84.0 | 71.3 | $0.03 | 50 | |
| 47 | deepseek v4 pro DeepSeek V4 Pro · default | 83.1 | 83.5 | 69.1 | $0.0047 | 50 | |
| 48 | gemini 3.1 pro previewTrailing Gemini 3.1 Pro Preview · default | 78.7 | 78.9 | 66.6 | $0.03 | 50 | |
| Filtered benchmark | 87.4 | ||||||
gpt-5.6 sol max
89.7 raw avg · 80.3 p10 floor · $0.37/call
ExxonMobil AI governance and safety review for energy operations with Anthropic
GPT-5.6 Luna: none → max
88.0 → 89.9 as effort scales
Methodology
The calls are synthetic, immutable benchmark cases with hidden coaching ground truth.
Generate cases
Each case starts with two companies, a call type, duration, quality target, web research, and role notes.
Write turn by turn
Half the current calls come from the original GPT-based generator and half from a Claude Sonnet 4.6 generator. Both are written one speaker turn at a time.
Judge semantically
Coach models see only the visible case. A judge model sees hidden ground truth, scores eight dimensions, and rolls the sales-critical axes into the benchmark ranking.
- Calls
- 50
- Model configs
- 48
- Judged runs
- 2400
- Origins
- 2
- Axes
- 8
Browse the calls
Pick a call to see the hidden answer key and model scores.
Berkshire Hathaway Data governance discovery across decentralized business units with Collibra
Pave Pricing and packaging objection call with Stripe
The Home Depot Renewal save call after usage and support concerns with Twilio
Wayfair Integration deep dive for catalog modernization with MongoDB
Delta Air Lines Enterprise discovery for service management modernization with Atlassian
McKesson HR transformation qualification and stakeholder mapping with Workday
Mercury First discovery for frontend platform consolidation with Vercel
Apple Technical security review for zero trust architecture with Palo Alto Networks
Duolingo Renewal QBR and expansion planning with Amplitude
McKesson HR transformation qualification and stakeholder mapping with Workday
CVS Health AI contact-center transformation discovery with OpenAI
Rippling Product-led expansion discovery for developer workflow with GitHub
ExxonMobil AI governance and safety review for energy operations with Anthropic
Mercury First discovery for frontend platform consolidation with Vercel
Linear Technical demo for observability and incident response with Datadog
Canva Competitive displacement discovery for edge security with Cloudflare
Target Security architecture review for endpoint consolidation with CrowdStrike
JPMorgan Chase Technical workshop for search and observability consolidation with Elastic
Pave Pricing and packaging objection call with Stripe
Amazon Cloud operating model discussion for internal platform teams with HashiCorp
Ford Motor Company Procurement negotiation for workflow automation with ServiceNow
Costco Wholesale Proof-of-concept readout for analytics and productivity workflow with Microsoft
Walmart Executive discovery for AI infrastructure and store operations with NVIDIA
Wayfair Integration deep dive for catalog modernization with MongoDB
Target Security architecture review for endpoint consolidation with CrowdStrike
CVS Health AI contact-center transformation discovery with OpenAI
Rippling Product-led expansion discovery for developer workflow with GitHub
Toast Data platform proof-of-concept kickoff with Snowflake
Delta Air Lines Enterprise discovery for service management modernization with Atlassian
Sweetgreen Executive alignment for identity modernization with Okta
Canva Competitive displacement discovery for edge security with Cloudflare
Sweetgreen Executive alignment for identity modernization with Okta
The Walt Disney Company Design collaboration demo with brand and asset workflow discussion with Figma
Walmart Executive discovery for AI infrastructure and store operations with NVIDIA
Runway Security review before developer-tool rollout with Snyk
Amazon Cloud operating model discussion for internal platform teams with HashiCorp
UnitedHealth Group Healthcare CRM expansion objection handling with Salesforce
Runway Security review before developer-tool rollout with Snyk
The Walt Disney Company Design collaboration demo with brand and asset workflow discussion with Figma
UnitedHealth Group Healthcare CRM expansion objection handling with Salesforce
The Home Depot Renewal save call after usage and support concerns with Twilio
Linear Technical demo for observability and incident response with Datadog
Ford Motor Company Procurement negotiation for workflow automation with ServiceNow
Duolingo Renewal QBR and expansion planning with Amplitude
Apple Technical security review for zero trust architecture with Palo Alto Networks
Costco Wholesale Proof-of-concept readout for analytics and productivity workflow with Microsoft
Toast Data platform proof-of-concept kickoff with Snowflake
Berkshire Hathaway Data governance discovery across decentralized business units with Collibra
JPMorgan Chase Technical workshop for search and observability consolidation with Elastic
ExxonMobil AI governance and safety review for energy operations with Anthropic
Does spending more on reasoning help?
For families with multiple reasoning settings, this shows the benchmark score at each level.