Skip to main content
Van Data Team

Data verified October 28, 2026

AI model benchmarks

The newest AI models ranked on independent benchmarks, price and context window. Model records include linked official sources, and each score names the leaderboard it comes from.

Download JSON or CSVMethodology
Latest release
GPT-6.1 TerraOpenAI · Oct 26
New in the last 30 days
20models
Top Arena Text score
1,525Gemini 4 Argon
Current models
115from 25 providers

Share this

Leaderboard

The newest models, ranked

Newest release first. Narrow it to this week or this month, rank it by any benchmark, price or context window, or keep one provider. Scores come only from independent leaderboards; # is the model's rank among current models on that benchmark.

Rank by
Provider

68 language models

Current language models with their independent benchmark scores, prices and release dates
#ModelArenaElo
1
GPT-6.1 TerraNew

OpenAI · Oct 26, 2026

Not measured
2
Kimi K3.1 ProNew

Moonshot Kimi · Oct 23, 2026

Not measured
3
Mercury 3New

Inception · Oct 19, 2026

Not measured
4
MiniMax M3.1 FlashNew

MiniMax · open weights · Oct 19, 2026

Not measured
5
Beam 1.0New

Reflection AI · open weights · Oct 16, 2026

Not measured
6
Muse Spark OpenNew

Meta · open weights · Oct 15, 2026

Not measured
7
Nemotron 3.5 Bolt 74B-A9BNew

NVIDIA · open weights · Oct 15, 2026

Not measured
8
Nemotron 3.5 Super VLNew

NVIDIA · open weights · Oct 15, 2026

Not measured
9
Muse WonderNew

Meta · Oct 12, 2026

Not measured
10
Claude Haiku 5.5New

Anthropic · Oct 7, 2026

Not measured
Scores fromArena · 2026-10-12Epoch AI · 2026-10-12

Charts

The market at a glance

Three views of the current language models on Arena Text, the independent benchmark that covers the most of them. Hover any point to name it.

Quality against price

Arena Text · measured Oct 8, 2026

5 current models sit on the price and quality frontier: none is beaten on both. The cheapest is MiMo-V2.6-Flash at $0.18 per 1M tokens blended, the strongest Gemini 4 Argon at 1,525.

Quality against priceArena Text score against blended token price for 41 current language models.1,2501,3001,3501,4001,4501,5001,550$0.30$1$3$10MOST ATTRACTIVE QUADRANTMedian price $3Median 1,475Blended price per 1M tokens (3 input : 1 output), log scaleArena Text (Elo)Gemini 4 ArgonClaude Opus 5.5Gemini 3.8 FlashGPT-6.1 SolMiMo-V2.6-ProGLM-5.3-FlashMistral Large 4
On the frontier:Gemini 3.8 Flash1,497 · $1.50Gemini 4 Argon1,525 · $4GLM-5.3-Flash1,475 · $0.24MiMo-V2.6-Pro1,480 · $0.54MiMo-V2.6-Flash1,451 · $0.18
Quality against price: the data
Arena Text score against blended token price for 41 current language models.
ModelProviderBlended price per 1M tokensArena Text (Elo)
Gemini 4 ArgonGoogle$41,525
Claude Opus 5.5Anthropic$81,507
Claude Fable 5Anthropic$201,504
Claude Fable 5.1Anthropic$201,501
Gemini 3.8 FlashGoogle$1.501,497
Muse Spark 1.3Meta$21,494
Claude Opus 5Anthropic$101,490
Kimi K3Moonshot Kimi$61,488
Gemini 3.7 FlashGoogle$1.501,486
GPT-5.6 SolOpenAI$81,485
GPT-6.1 SolOpenAI$41,484
Qwen3.8-MaxAlibaba Qwen$31,483
GPT-5.5OpenAI$111,482
Gemini 3.6 FlashGoogle$31,482
Claude Opus 4.8Anthropic$101,481
MiMo-V2.6-ProXiaomi MiMo$0.541,480
GLM-5.3Z.ai$2.151,478
Claude Sonnet 5.5Anthropic$41,476
GPT-5.4OpenAI$5.631,475
GPT-6 AstraOpenAI$201,475
DeepSeek-V4.1-FlashDeepSeek$0.521,475
GLM-5.3-FlashZ.ai$0.241,475
Gemini 3 Flash PreviewGoogle$1.131,473
Grok 4.20xAI$1.561,472
GPT-5.6 TerraOpenAI$4.501,466
Grok 4.5xAI$31,466
DeepSeek-V4-ProDeepSeek$1.981,465
Claude Sonnet 5Anthropic$41,461
GPT-6 SolOpenAI$41,456
Gemini 3.5 Flash-LiteGoogle$0.851,455
Grok 4.6xAI$31,454
GPT-5.6 LunaOpenAI$0.451,452
MiMo-V2.6-FlashXiaomi MiMo$0.181,451
GPT-6 LunaOpenAI$0.201,443
Grok 4.7xAI$31,443
Grok 4.3xAI$1.561,442
Mistral Large 4Mistral AI$2.061,429
GPT-4.1OpenAI$3.501,415
Solar Pro 4Upstage$0.521,386
GPT-4.1 miniOpenAI$0.701,383
GPT-4.1 nanoOpenAI$0.181,322
Scores fromArena · 2026-10-12

The best score, release by release

Arena Text · measured Oct 8, 2026

The best Arena Text score has risen from 1,324 to 1,525. Gemini 4 Argon set the current record, released Sep 30, 2026.

The best score, release by releaseArena Text score by release date for 66 language models.1,1501,2001,2501,3001,3501,4001,4501,5001,550Jul 2024Jan 2025Jul 2025Jan 2026Jul 2026Release dateArena Text (Elo)Gemini 4 ArgonClaude Fable 5
Latest records:Claude Fable 51,504 · Jun 9, 2026Claude Opus 5.51,507 · Sep 22, 2026Gemini 4 Argon1,525 · Sep 30, 2026
The best score, release by release: the data
Arena Text score by release date for 66 language models.
ModelProviderReleasedArena Text (Elo)
Gemini 4 ArgonGoogleSep 30, 20261,525
Claude Opus 5.5AnthropicSep 22, 20261,507
Claude Fable 5AnthropicJun 9, 20261,504
Claude Fable 5.1AnthropicSep 1, 20261,501
Gemini 3.8 FlashGoogleSep 2, 20261,497
Muse Spark 1.3MetaSep 2, 20261,494
Claude Opus 5AnthropicJul 24, 20261,490
Kimi K3Moonshot KimiJul 16, 20261,488
Gemini 3.1 Pro PreviewGoogleFeb 19, 20261,487
Gemini 3.7 FlashGoogleAug 13, 20261,486
GPT-5.6 SolOpenAIJul 9, 20261,485
GPT-6.1 SolOpenAISep 29, 20261,484
Qwen3.8-MaxAlibaba QwenAug 2, 20261,483
GPT-5.5OpenAIApr 23, 20261,482
Gemini 3.6 FlashGoogleJul 21, 20261,482
Claude Opus 4.8AnthropicMay 28, 20261,481
MiMo-V2.6-ProXiaomi MiMoSep 22, 20261,480
Gemini 3.5 FlashGoogleMay 19, 20261,478
GLM-5.3Z.aiAug 18, 20261,478
Claude Sonnet 5.5AnthropicSep 28, 20261,476
GPT-5.4OpenAIMar 5, 20261,475
GLM-5.3-FlashZ.aiAug 26, 20261,475
GPT-6 AstraOpenAISep 3, 20261,475
DeepSeek-V4.1-FlashDeepSeekSep 10, 20261,475
Gemini 3 Flash PreviewGoogleDec 17, 20251,473
Grok 4.20xAIMar 10, 20261,472
GPT-5.6 TerraOpenAIJul 9, 20261,466
Grok 4.5xAIJul 16, 20261,466
DeepSeek-V4-ProDeepSeekAug 13, 20261,465
Claude Sonnet 5AnthropicJun 30, 20261,461
GPT-6 SolOpenAISep 22, 20261,456
Gemini 3.5 Flash-LiteGoogleJul 21, 20261,455
Grok 4.6xAIAug 12, 20261,454
GPT-5.6 LunaOpenAIJul 9, 20261,452
MiMo-V2.6-FlashXiaomi MiMoSep 22, 20261,451
Gemini 2.5 ProGoogleMar 25, 20251,445
Grok 4.7xAISep 21, 20261,443
GPT-6 LunaOpenAISep 22, 20261,443
Mistral Large 4Mistral AIOct 6, 20261,429
Muse GlimmerMetaAug 10, 20261,425
Kimi K2 InstructMoonshot KimiJul 11, 20251,418
GPT-4.1OpenAIApr 14, 20251,415
Grok 3xAIFeb 19, 20251,411
DeepSeek-R1DeepSeekJan 20, 20251,398
Claude 3.7 SonnetAnthropicFeb 24, 20251,388
Solar Pro 4UpstageAug 6, 20261,386
GPT-4.1 miniOpenAIApr 14, 20251,383
Gemini 2.0 FlashGoogleDec 11, 20241,360
DeepSeek-V3DeepSeekDec 26, 20241,358
Nemotron 3.5 LightningNVIDIAAug 11, 20261,349
GPT-4oOpenAIMay 13, 20241,346
Granite 4.2 30BIBMAug 25, 20261,340
Grok 2xAIAug 13, 20241,336
Llama 3.1 405BMetaJul 23, 20241,335
Gemini 1.5 ProGoogleFeb 15, 20241,324
Claude 3 OpusAnthropicMar 4, 20241,322
GPT-4.1 nanoOpenAIApr 14, 20251,322
Mistral Large 2Mistral AIJul 24, 20241,314
Gemini 1.5 FlashGoogleMay 14, 20241,287
Claude 3 SonnetAnthropicMar 4, 20241,281
Llama 3 70BMetaApr 18, 20241,277
DeepSeek-Coder-V2 InstructDeepSeekJun 17, 20241,265
Claude 3 HaikuAnthropicMar 13, 20241,262
Qwen2 72B InstructAlibaba QwenJun 7, 20241,262
Ministral 8BMistral AIOct 16, 20241,238
Llama 3 8BMetaApr 18, 20241,224
Scores fromArena · 2026-10-12

Each provider's best model

Arena Text · measured Oct 8, 2026

14 providers have a current model scored on Arena Text. Google leads with Gemini 4 Argon.

  1. 1

    Google

    Gemini 4 ArgonNew
    1,525 Elo
  2. 2

    Anthropic

    Claude Opus 5.5
    1,507 Elo
  3. 3

    Meta

    Muse Spark 1.3
    1,494 Elo
  4. 4

    Moonshot Kimi

    Kimi K3
    1,488 Elo
  5. 5

    OpenAI

    GPT-5.6 Sol
    1,485 Elo
  6. 6

    Alibaba Qwen

    Qwen3.8-Max
    1,483 Elo
  7. 7

    Xiaomi MiMo

    MiMo-V2.6-Pro
    1,480 Elo
  8. 8

    Z.ai

    GLM-5.3
    1,478 Elo
  9. 9

    DeepSeek

    DeepSeek-V4.1-Flash
    1,475 Elo
  10. 10

    xAI

    Grok 4.20
    1,472 Elo
  11. 11

    Mistral AI

    Mistral Large 4New
    1,429 Elo
  12. 12

    Upstage

    Solar Pro 4
    1,386 Elo
  13. 13

    NVIDIA

    Nemotron 3.5 Lightning
    1,349 Elo
  14. 14

    IBM

    Granite 4.2 30B
    1,340 Elo

Elo rating; the axis starts at 1,300, since a rating has no zero.

Scores fromArena · 2026-10-12

Explore

Filter and compare any models

Choose a task, filter its models by provider, capability or status, and select up to four to compare side by side. Missing values stay visible as Not reported.

The explorer opens as you reach it. Every model also has its own page in the directory below, and the whole dataset downloads as JSON or CSV.

Model pages

Every model, one page each

Pricing, specs, independent scores, alternatives and sources for all 142 models, grouped by provider.

Google 28

OpenAI 24

xAI 15

Anthropic 13

Alibaba Qwen 8

Meta 8

ElevenLabs 7

Mistral AI 7

DeepSeek 6

Moonshot Kimi 6

NVIDIA 3

Inception 2

Xiaomi MiMo 2

Z.ai 2

Black Forest Labs 1

ByteDance Seed 1

Cartesia 1

IBM 1

Microsoft AI 1

MiniMax 1

Reflection AI 1

Runway 1

Stability AI 1

StepFun 1

Upstage 1

Head-to-head comparisons

All 425 comparisons

Methods and provenance

Evidence library

Open only the methodology, production guidance, release history, sources, or answers you need. Complete records remain available in the page HTML.

How to read benchmark data

How to read the benchmark data

Use the catalog to screen candidates, then verify them on your workload. Linked official sources support each record as a whole; they are not a field-by-field audit trail. Benchmark results retain their publisher and compatible snapshot.

Keep task families separate

Scores and operational metrics should not be compared across task families. Text reasoning, image quality, video quality, and speech error metrics answer different questions.

Match one benchmark snapshot

Compare results only when the task family, benchmark version, measurement date, and eligible model set match. Different snapshots may use different prompts, evaluators, or datasets.

Follow the score direction

Higher-is-better metrics reward a larger result; lower-is-better metrics such as error rate reward a smaller result. The direction belongs to the named benchmark, not to every task.

Match the pricing unit

A price per million tokens, image, audio minute, video second, or realtime minute is a different cost basis. Compare only the same unit and tier, then add retries, review, tooling, and infrastructure.

Check lifecycle and source status

Current models are active provider offerings; Legacy models remain for historical context. Official records come from providers, while independent results come from benchmark publishers, each with a visible verification date.

Keep missing data missing

Not reported is not zero. The explorer excludes missing values from rankings and does not infer them from a related model.

Scope begins 2024-01-01. Dataset version 2026-10-28. Last verified 2026-10-28. 215 source records.

Production fit

Why a benchmark winner may not fit production

Benchmark rank and production fit measure different things. A result can support a shortlist without deciding the system design.

  • A public score may cover one narrow task while your system combines retrieval, tools, permissions, and review.
  • Production acceptance also depends on latency, reliability, safety, data handling, regional availability, and total cost.
  • Van Data Team recommendations are transparent editorial shortlists. They use published fields and results, apply no hidden weighting, and must be tested on representative work.
Release timeline

Model release timeline since 2024

Generated from exact explorer release dates. Models without a verified exact date remain in the inventory and are omitted here rather than assigned an inferred date.

  1. 2026 Q4

    • GPT-6.1 Terra2026-10-26
    • Kimi K3.1 Pro2026-10-23
    • Voxtral Mini TTS 32026-10-20
    • Voxtral Small Transcribe 32026-10-20
    • Mercury 32026-10-19
    • MiniMax M3.1 Flash2026-10-19
    • Beam 1.02026-10-16
    • Muse Spark Open2026-10-15
    • Nemotron 3.5 Bolt 74B-A9B2026-10-15
    • Nemotron 3.5 Super VL2026-10-15
    • Grok Voice 3.02026-10-14
    • Muse Wonder2026-10-12
    • Claude Haiku 5.52026-10-07
    • Mistral Large 42026-10-06
    • Nano Banana 2.12026-10-06

  2. 2026 Q3

    • Gemini 4 Argon2026-09-30
    • GPT-6.1 Sol2026-09-29
    • Claude Sonnet 5.52026-09-28
    • Eleven v42026-09-28
    • Eleven v4 Turbo2026-09-28
    • Claude Opus 5.52026-09-22
    • Gemini 3.8 Flash TTS2026-09-22
    • Gemini 3.8 Flash-Lite TTS2026-09-22
    • GPT-6 Luna2026-09-22
    • GPT-6 Sol2026-09-22
    • MiMo-V2.6-Flash2026-09-22
    • MiMo-V2.6-Pro2026-09-22
    • Grok 4.72026-09-21
    • Qwen3.8-Omni-Flash2026-09-20
    • Grok Voice Transcribe 2.02026-09-18
    • Gemini 3.8 Live2026-09-15
    • DeepSeek-V4.1-Flash2026-09-10
    • GPT-Live 12026-09-10
    • GPT Image 2.5 Flare2026-09-08
    • GPT Image 2.5 Sunburst2026-09-08
    • Mercury 2.52026-09-08
    • GPT-6 Astra2026-09-03
    • MAI-Transcribe-22026-09-03
    • Gemini 3.8 Flash2026-09-02
    • Muse Spark 1.32026-09-02
    • Claude Fable 5.12026-09-01
    • Claude Mythos 5.12026-09-01
    • Gemini Omni Flash 1.12026-08-27
    • Sonic 3.62026-08-27
    • Gemini 3.5 Transcribe2026-08-26
    • GLM-5.3-Flash2026-08-26
    • Qwen3.8-Flash-Next2026-08-26
    • Granite 4.2 30B2026-08-25
    • GLM-5.32026-08-18
    • DeepSeek-V4-Pro2026-08-13
    • Gemini 3.7 Flash2026-08-13
    • Grok 4.62026-08-12
    • Nemotron 3.5 Lightning2026-08-11
    • Muse Glimmer2026-08-10
    • Solar Pro 42026-08-06
    • Wan 3.0 Video2026-08-06
    • Qwen3.8-Max2026-08-02
    • GPT Transcribe2026-07-28
    • Claude Opus 52026-07-24
    • Gemini 3.5 Flash-Lite2026-07-21
    • Gemini 3.6 Flash2026-07-21
    • Grok 4.52026-07-16
    • Kimi K32026-07-16
    • GPT-5.6 Luna2026-07-09
    • GPT-5.6 Sol2026-07-09
    • GPT-5.6 Terra2026-07-09

  3. 2026 Q2

    • Claude Sonnet 52026-06-30
    • Gemini 3.1 Flash Lite Image2026-06-30
    • Gemini Omni Flash Preview2026-06-30
    • Claude Fable 52026-06-09
    • Claude Opus 4.82026-05-28
    • Gemini 3 Pro Image2026-05-28
    • Gemini 3.1 Flash Image2026-05-28
    • Gemini 3.5 Flash2026-05-19
    • Gemini 3.1 Flash-Lite2026-05-07
    • GPT-Realtime-22026-05-07
    • GPT-5.52026-04-23
    • Gemini 3.1 Flash TTS Preview2026-04-15

  4. 2026 Q1

    • Veo 3.1 Lite Preview2026-03-31
    • Gemini 3.1 Flash Live Preview2026-03-26
    • Grok 4.202026-03-10
    • GPT-5.42026-03-05
    • Gemini 3.1 Pro Preview2026-02-19
    • Scribe v22026-01-09

  5. 2025 Q4

    • Gemini 3 Flash Preview2025-12-17
    • Scribe v2 Realtime2025-11-11
    • Veo 3.1 Preview2025-10-15

  6. 2025 Q3

    • Kimi K2 Base2025-07-11
    • Kimi K2 Instruct2025-07-11

  7. 2025 Q2

    • Kimi-Dev-72B2025-06-17
    • GPT-4.12025-04-14
    • GPT-4.1 mini2025-04-14
    • GPT-4.1 nano2025-04-14
    • Kimi-VL-A3B-Instruct2025-04-09

  8. 2025 Q1

    • Gemini 2.5 Pro2025-03-25
    • GPT-4o Transcribe2025-03-20
    • Claude 3.7 Sonnet2025-02-24
    • Grok 32025-02-19
    • Qwen2.5-VL 72B Instruct2025-01-26
    • DeepSeek-R12025-01-20

  9. 2024 Q4

    • DeepSeek-V32024-12-26
    • Gemini 2.0 Flash2024-12-11
    • Ministral 8B2024-10-16

  10. 2024 Q3

    • Llama 3.2 11B Vision2024-09-25
    • Qwen2.5 32B Instruct2024-09-19
    • Pixtral 12B2024-09-17
    • Grok 22024-08-13
    • Mistral Large 22024-07-24
    • Llama 3.1 405B2024-07-23

  11. 2024 Q2

    • DeepSeek-Coder-V2 Instruct2024-06-17
    • Qwen2 72B Instruct2024-06-07
    • Qwen2 7B Instruct2024-06-07
    • Codestral 22B2024-05-29
    • Gemini 1.5 Flash2024-05-14
    • GPT-4o2024-05-13
    • DeepSeek-V2 Chat2024-05-06
    • Llama 3 70B2024-04-18
    • Llama 3 8B2024-04-18
    • Grok-1.5V2024-04-12

  12. 2024 Q1

    • Grok-1.52024-03-28
    • Claude 3 Haiku2024-03-13
    • Claude 3 Opus2024-03-04
    • Claude 3 Sonnet2024-03-04
    • Gemini 1.5 Pro2024-02-15
Source catalog · 215 records

Source catalog

Official sources come from model providers. Independent sources come from a separate benchmark publisher. Each row shows its publisher, verification date, version, license status, and coverage; missing metadata is not filled or inferred.

Official provider sources

OpenAI
  • GPT-5.4 model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model documentation verifies the dated snapshot, token limits, modalities, and exact standard token prices represented here.

  • Introducing GPT-5.5
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official release announcement verifies model identity and the 2026-04-23 release date.

  • GPT-5.5 model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model documentation verifies token limits, modalities, and exact standard token prices represented here.

  • GPT-5.6: Frontier intelligence that scales with your ambition
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official release announcement verifies the Sol, Terra, and Luna identities and 2026-07-09 general-availability date.

  • OpenAI GPT-5.6 model catalog
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model catalog verifies the Sol, Terra, and Luna token limits, modalities, roles, and exact standard token prices represented here.

  • Hello GPT-4o
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Introducing GPT-4.1 in the API
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • OpenAI API pricing
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    Official pricing page used only for the exact token prices represented in model records.

  • GPT-4o model
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official provider documentation used to verify exact model specifications.

  • GPT-4.1 model
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official provider documentation used to verify exact model specifications.

  • GPT-4.1 mini model
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official provider documentation used to verify exact model specifications.

  • GPT-4.1 nano model
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official provider documentation used to verify exact model specifications.

  • GPT Image 2 model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT-Realtime-1.5 model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • gpt-audio-1.5 model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT-4o Transcribe model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • TTS-1 model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT-6 Astra model reference
    Verified
    2026-09-09
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • OpenAI API pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT-Live 1 model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Full-duplex voice model; audio and text in and out; $0.05 per voice-session minute billed per second; reasoning and tools delegated to a separately billed backend model.

  • OpenAI API changelog
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Release dates: gpt-image-2.5-sunburst and gpt-image-2.5-flare 2026-09-08; gpt-live-1 generally available 2026-09-10.

  • GPT Image 2.5 Sunburst model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Most capable image generation and editing model; token rates match GPT Image 2.

  • GPT Image 2.5 Flare model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Fastest model for everyday image generation; token rates match GPT Image 2.

  • GPT-5.6 Sol model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    1.05M context, 128K max output, knowledge cutoff 2026-02-16, six reasoning-effort levels.

  • GPT-5.6 Terra model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    1.05M context, 128K max output, knowledge cutoff 2026-02-16, six reasoning-effort levels.

  • GPT-5.6 Luna model
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    1.05M context, 128K max output, knowledge cutoff 2026-02-16, six reasoning-effort levels.

  • GPT-Realtime-2 model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT Transcribe model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GPT-6.1 Terra model reference
    Verified
    2026-10-28
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Anthropic
  • Introducing Claude Opus 4.8
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official release documentation verifies model identity, release date, the published context window, and standard input/output pricing.

  • Introducing Claude Sonnet 5
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official release documentation verifies model identity, release date, API availability, and introductory pricing through 2026-08-31.

  • Claude Fable 5 and Claude Mythos 5
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official release announcement verifies Claude Fable 5 identity, 2026-06-09 release date, API access, standard token pricing, and general availability after redeployment.

  • Claude models overview
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official current-model documentation verifies Fable's text-and-image inputs, 1,000,000-token context window, 128,000-token output limit, and current API availability.

  • Introducing the next generation of Claude
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official provider documentation used to verify model identity and release details.

  • Claude 3.7 Sonnet and Claude Code
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Claude pricing
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    Official pricing documentation used only for the exact token prices represented in model records.

  • Claude 3 Haiku
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify exact model specifications.

  • Claude models overview
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify exact model specifications.

  • Claude API pricing
    Verified
    2026-10-11
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Claude models overview
    Verified
    2026-10-11
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Claude Mythos limited availability
    Verified
    2026-09-09
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Google
  • Gemini API release notes
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Official release notes verify the dated Gemini 3.5 Flash, Gemini 3.1 Flash Live, Gemini 3.1 Flash TTS, Gemini 3.1 Flash Lite Image, Gemini 3 Pro Image, and Gemini Omni Flash releases represented in this catalog.

  • Gemini 3.5 Flash model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Official model documentation verifies model code, modalities, and token limits; exact token prices remain unreported here.

  • Gemini 3.6 Flash model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Official model documentation verifies model code, 2026-07-21 update, modalities, and token limits.

  • Using the latest Gemini models
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity, pricing

    Official latest-model guidance verifies the exact standard input/output prices represented for Gemini 3.6 Flash.

  • Gemini 3.5 Flash-Lite model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Official model documentation verifies the stable model code, multimodal inputs, token limits, capabilities, and July 2026 update.

  • Gemini 3.5 Flash-Lite pricing
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    pricing

    Official pricing table verifies the standard paid-tier input, cached-input, and output rates represented here.

  • Our next-generation model: Gemini 1.5
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Gemini 1.5 Flash
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Introducing Gemini 2.0
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Gemini 2.5: Our most intelligent AI model
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Gemini Developer API pricing
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    Official Gemini Developer API pricing table used only for exact published token, image, audio-minute, and video-second prices represented in model records.

  • Gemini API models
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify exact model specifications.

  • Gemini 2.5 Pro
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify exact model specifications.

  • Gemini 3.1 Flash Image pricing
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party pricing table used to verify Gemini 3.1 Flash Image standard token and resolution-specific image prices.

  • Gemini native image generation capabilities
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party native image guide used to verify Gemini 3.1 Flash Image generation, editing, image input, and mixed text/image output capabilities.

  • Gemini Developer API pricing and native media model identifiers
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Gemini 3.8 Flash model card
    Verified
    2026-09-09
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Gemini 3.7 Flash model
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Official model documentation verifies the stable Gemini 3.7 Flash code, text/image/video/audio inputs, text output, token limits, structured outputs, thinking, and URL context.

  • Introducing Gemini 3.7 Flash
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official Google announcement verifies the 2026-08-13 release, coding and agent positioning, and introductory token prices through 2026-12-31 before the documented 2027 rate change.

  • Gemini 3.1 Pro Preview
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini 3.1 Pro Preview endpoint, multimodal inputs, text output, token limits, and documented capabilities.

  • Gemini 3 Flash Preview
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini 3 Flash Preview endpoint, multimodal inputs, text output, token limits, and documented capabilities.

  • Gemini 3.1 Flash-Lite
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the stable Gemini 3.1 Flash-Lite endpoint, multimodal inputs, text output, token limits, and documented capabilities.

  • Gemini 3.5 Live Translate
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini 3.5 Live Translate preview endpoint, audio input, translated-audio and transcript output, and token limits.

  • Gemini Live API
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Live API guide verifies realtime audio model operation and the preview endpoint lifecycle applies to the live-model records.

  • Gemini 3.1 Flash Live Preview
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini 3.1 Flash Live preview endpoint, supported realtime multimodal inputs, text and audio output, token limits, and capabilities.

  • Gemini 3.1 Flash TTS Preview
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini 3.1 Flash TTS preview endpoint, text input, audio output, token limits, and audio generation capability.

  • Text-to-speech generation
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Text-to-Speech guide verifies controllable speech generation and streaming support for the Gemini 3.1 Flash TTS preview endpoint.

  • Gemini 3.1 Flash Lite Image
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the stable Gemini 3.1 Flash Lite Image endpoint, text and image inputs, text and image output, token limits, and image generation and editing capabilities.

  • Gemini 3 Pro Image
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the stable Gemini 3 Pro Image endpoint, text and image inputs and outputs, token limits, and image generation capability.

  • Gemini Omni Flash
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Model card verifies the Gemini Omni Flash preview endpoint, text, image, and video inputs, video output, context window, and 3-to-10-second output range.

  • Generate and edit videos with Gemini Omni Flash
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Gemini Omni Flash guide verifies preview lifecycle, conversational video editing, native multimodal context, and generated video with audio.

  • Gemini deprecations
    Verified
    2026-08-18
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    identity

    Lifecycle table verifies published stable or preview status and announced shutdown dates only for the Gemini endpoints that reference it.

  • Gemini Nano Banana 2.1
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Stable model gemini-nano-banana-2.1: text, image, video and PDF input; image and text output; 1K, 2K and 4K output.

  • Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Two speech-to-speech models for the Gemini API and Google AI Studio.

  • Gemini 3.8 text-to-speech models
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Gemini 3.8 Flash TTS and Flash-Lite TTS announcement.

  • Gemini 4 Argon announcement
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Gemini 3.5 Transcribe model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Veo 3.1 Lite Preview model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Gemini 4 Argon is now available for everyone
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

SpaceXAI
  • Grok 4.3 model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model documentation verifies Grok 4.3 modalities, context window, reasoning modes, aliases, and standard short-context prices.

  • xAI inference models API reference
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official API reference exposes Grok 4.3 modalities, aliases, and token pricing fields; its object creation timestamp is not treated as a public release date.

  • Skills in web, iOS, and Android
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official 2026-05-18 announcement confirms Grok 4.3 was live across grok.com, iOS, and Android by that date; it is not treated as the model's exact release date.

  • SpaceXAI API release notes
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official release notes verify Grok 4.20 and Grok 4.20 Multi-agent API availability on 2026-03-10.

  • Grok 4.20 System Card
    Verified
    2026-08-07
    Dataset version
    2026-04-07
    License
    Not stated
    Covers
    identity

    Official system card verifies Grok 4.20 identity, single-agent and multi-agent deployment modes, supported input modalities, and intended uses.

  • SpaceXAI model pricing
    Verified
    2026-08-14
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official current pricing table verifies active Grok 4.6, Grok 4.5, and Grok 4.20 variants, their documented context windows, and standard and long-context token rates.

  • Grok model retirement on May 15, 2026
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official lifecycle notice verifies Grok 3 retirement and redirect to Grok 4.3, and identifies Grok 4.3 as the recommended general replacement.

  • Introducing Grok 4.5
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official announcement verifies the model identity, release date, and intended coding, agentic, and knowledge-work scope.

  • Grok 4.5 model
    Verified
    2026-08-07
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model documentation verifies modalities, context window, and standard short-context token prices; the model caution discloses higher long-context rates.

  • Introducing Grok 4.6
    Verified
    2026-08-14
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official announcement verifies the 2026-08-12 release date and positioning for long-running agents, coding, and knowledge work.

  • Grok 4.6 model
    Verified
    2026-08-14
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model documentation verifies the exact model ID, text and image input, text output, 500,000-token context window, reasoning, function calling, structured outputs, and standard token prices.

  • grok-imagine-image model
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Video generation
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Imagine API pricing
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Meta
  • Introducing Meta Llama 3
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Introducing Llama 3.1
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Llama 3.2
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Meta Model API model list
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Meta Model API pricing and rate limits
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Muse Wonder model card
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Muse Glimmer documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Muse Glimmer
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Muse Spark Open
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official announcement, 2026-10-15: 816B total and 42B active parameters, 1M-token context, weights under the Muse Model License.

  • Muse Spark Open model card
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official open-weights repository: text, image, video and audio in, text out; no first-party API.

xAI
  • Announcing Grok-1.5
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Grok-1.5 Vision Preview
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Grok-2 Beta Release
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Grok 3 Beta
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • xAI models and pricing
    Verified
    2026-10-11
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Official model catalog used to verify documented model availability and pricing fields, not historical release dates.

  • grok-imagine-video-1.5-lite
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Text and image to video at $0.020 per output second; batch API supported.

  • xAI models and pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Grok Voice Transcribe 2.0 model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Grok Voice Transcribe 2.0 announcement
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Grok Imagine Video 1.5 model
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Grok Voice 3.0
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Grok Voice 3.0 model
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

DeepSeek
  • DeepSeek-V2
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • DeepSeek-Coder-V2
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • DeepSeek-V3
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • DeepSeek-R1
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • DeepSeek API pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    Official pricing documentation consulted for price provenance; unavailable exact values remain unreported.

  • DeepSeek-V4.1-Flash release
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official release note, 2026-09-10: 552B-parameter MoE with native visual understanding; 8B active parameters for input and 16B for output.

  • DeepSeek-V4.1-Flash model weights
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official open-weights repository, created 2026-09-10, MIT licence, image-text-to-text.

  • DeepSeek-V4-Pro update (2026-08-13)
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • DeepSeek-V4-Pro-0813 model weights
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • DeepSeek-V4.1-Flash-1017
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official release note, 2026-10-17: a minor update served under the same API name at unchanged prices.

  • DeepSeek-V4.1-Flash-1017 model weights
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official open-weights repository, MIT licence, image-text-to-text, 1M-token context.

Mistral AI
  • Codestral
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Large Enough
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Announcing Pixtral 12B
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Un Ministral, des Ministraux
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Mistral AI pricing
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    Official pricing page consulted for price provenance; unavailable exact values remain unreported.

  • Introducing Mistral Large 4
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Public preview announced 2026-10-06 at $1.36 / $4.18 per 1M input / output tokens; weights promised by the end of October.

  • Mistral Large 4 model card
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Model id mistral-large-4-0, public preview, 1M context, 1.05T total and 52B active parameters, 1.6B vision encoder.

  • Voxtral 3
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Voxtral Small Transcribe 3
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Voxtral TTS 3
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Qwen Team
  • Hello Qwen2
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Qwen2.5: A Party of Foundation Models
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Qwen2.5-VL
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

Moonshot AI
  • Kimi-VL
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Kimi-Dev
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Kimi K2
    Verified
    2026-08-06
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official provider documentation used to verify model identity and release details.

  • Kimi platform model and pricing documentation
    Verified
    2026-10-28
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Kimi K3.1 Pro
    Verified
    2026-10-28
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Kimi K3.1 Pro quickstart
    Verified
    2026-10-28
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Runway
  • Available AI Models
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

ElevenLabs
  • ElevenLabs models
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Scribe v2
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Scribe v2 Realtime
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • ElevenLabs API pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Eleven v4 announcement
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Stability AI
  • Stability AI Developer Platform pricing
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Black Forest Labs
  • FLUX image generation endpoints
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • FLUX API pricing
    Verified
    2026-08-10
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Alibaba Cloud
  • Alibaba Cloud Model Studio model list
    Verified
    2026-09-09
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • qwen3.8-omni-flash model information
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Text, image, audio and video input; text output; 1M-token context; 131,072 max output tokens.

  • Qwen3.8-Omni-Flash: Omni Senses. Agentic Delivery.
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    Official announcement published 2026-09-20.

  • Alibaba Cloud Model Studio model pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    International (Singapore) rates used.

  • Alibaba Cloud Model Studio newly released models
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Wan3.0 video generation API reference
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Z.ai
  • Z.ai API pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Z.ai release notes
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GLM-5.3 documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • GLM-5.3-Flash documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Xiaomi
  • Xiaomi MiMo API pay-as-you-go pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Xiaomi MiMo model updates
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • MiMo-V2.6-Pro model weights
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • MiMo-V2.6-Flash model weights
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Alibaba Qwen
  • Qwen3.8-Flash-Next model card
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

NVIDIA
  • NVIDIA Nemotron 3.5 Lightning 30B-A3B model card
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • NVIDIA Nemotron 3.5 Lightning announcement
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • NVIDIA expands Nemotron with Super VL and Bolt models
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • NVIDIA Nemotron 3.5 Super VL 120B-A12B model card
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB model card
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

IBM
  • Granite 4.2 30B model card
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Granite 4.2 documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Inception
  • Inception models
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Introducing Mercury 2.5
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Diffusion at Scale: Introducing Mercury 3
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Upstage
  • Solar Pro 4 documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

StepFun
  • Step 5 Preview documentation
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • StepFun API pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Microsoft
  • MAI-Transcribe in Azure Speech
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Microsoft AI
  • MAI-Transcribe-2 announcement
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Cartesia
  • Cartesia TTS models
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Cartesia pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

BytePlus
  • BytePlus ModelArk model releases
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • BytePlus ModelArk pricing
    Verified
    2026-10-13
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Reflection AI
  • Beam is now available
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Beam 1.0 501B-A23B model card
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • Reflection developer documentation
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

MiniMax
  • MiniMax M3.1 Flash
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • MiniMax M3.1 Flash model card
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

  • MiniMax API text generation guide
    Verified
    2026-10-23
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity

    First-party provider documentation used only for the stated model identity, capabilities, lifecycle, access, and pricing.

Independent benchmark sources

LiveBench
  • LiveBench category-weighted averaging implementation
    Verified
    2026-08-07
    Dataset version
    LiveBench-2026-06-25@19e766a5de4de07d672ed5bf9f0a69ceed1d39bf
    License
    Apache-2.0
    Covers
    benchmark

    Pinned implementation averages task scores within each of the seven categories, then averages the category scores; the paired categories_2026_06_25.json file defines category membership.

  • LiveBench 2026-06-25 task results
    Verified
    2026-08-07
    Dataset version
    LiveBench-2026-06-25@19e766a5de4de07d672ed5bf9f0a69ceed1d39bf
    License
    Apache-2.0
    Covers
    benchmark

    Snapshot and measurement date: 2026-06-25. Overall scores are imported only for unambiguous model mappings and are recomputed with the pinned category-weighted averaging implementation.

  • LiveBench datasheet and methodology
    Verified
    2026-08-06
    Dataset version
    LiveBench-2024-11-25
    License
    Apache-2.0
    Covers
    benchmark

    Primary benchmark documentation confirms objective scoring, public distribution, and Apache 2.0 reuse terms.

  • LiveBench 2024-11-25 task results
    Verified
    2026-08-06
    Dataset version
    LiveBench-2024-11-25@347e3d0b6a4916cd66f8bda31ce7ecdd7436ecc3
    License
    Apache-2.0
    Covers
    benchmark

    Snapshot and measurement date: 2024-11-25. Exact published snapshot; only direct Web of Lies V2 percentages with unambiguous model mappings are imported.

OpenRouter
  • OpenRouter models API catalogue
    Verified
    2026-09-09
    Dataset version
    Not versioned
    License
    Not stated
    Covers
    identity, pricing

    Third-party API catalogue used only to cross-check published token prices, context limits, and listing dates against first-party documentation.

Epoch AI
  • Epoch AI Benchmarking Hub data (benchmark_data.zip)
    Verified
    2026-10-12
    Dataset version
    benchmark_data.zip retrieved 2026-10-12, sha256 prefix 2fb16ca26aea846c
    License
    CC-BY-4.0
    Covers
    benchmark

    Results Epoch AI ran itself (the GPQA Diamond, FrontierMath Tiers 1-3 v2 and SimpleQA Verified files), not the external files it collects from other publishers. A model maps only when its Epoch row is unambiguous: exact name, or a dated version pinned by the record release date. Where Epoch lists several reasoning-effort settings, the best published configuration is used and its row is recorded in sourceRow. Scores are converted from 0-1 to 0-100 and rounded to one decimal. Epoch evaluated rows between 2023 and 2026-10-09; every result is dated to this capture. Credit: Epoch AI, Capabilities and benchmarking, epoch.ai, CC BY 4.0.

  • GPQA Diamond benchmark (Epoch AI)
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    198 four-option graduate-level questions in biology, physics and chemistry, written by domain experts; random guessing scores 25%. Epoch runs the evaluation itself.

  • FrontierMath benchmark (Epoch AI)
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    Original research-level mathematics problems written and vetted by expert mathematicians. Tiers 1-3 v2 (released 2026-06-12) is the 295-problem base set after a revision that corrected errors in 42% of problems. Scores come from Epoch-run private sets. OpenAI funded the benchmark and has access to part of it.

  • SimpleQA Verified benchmark (Epoch AI)
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    A 1,000-question factoid benchmark from Google, building on SimpleQA from OpenAI. Epoch runs it itself and reports the proportion answered correctly, not the F1-based score Google reports.

Arena
  • Arena leaderboard dataset (lmarena-ai/leaderboard-dataset)
    Verified
    2026-10-12
    Dataset version
    lmarena-ai/leaderboard-dataset@e16f9023298691b4596eca61b4e31161dff31200
    License
    CC-BY-4.0
    Covers
    benchmark

    Ratings from blind pairwise human votes, published by Arena (formerly LMArena) in its public leaderboard dataset and pinned here to one commit. The overall category of the latest split is used; for text, the style-controlled leaderboard, which is the default view on arena.ai. A model maps only when its Arena row names the same model; where Arena lists several quality or resolution settings of one model, the best rated row is used and recorded in sourceRow. Ratings are rounded to whole points. Credit: Arena, lmarena-ai/leaderboard-dataset on Hugging Face, CC BY 4.0.

  • Arena Text-to-Image leaderboard
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    People compare two anonymous images generated from the same prompt and vote for the better one. Arena fits a Bradley-Terry model to the votes and reports ratings on an Elo-like scale.

  • Arena Image Edit leaderboard
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    People compare two anonymous edits of the same image from the same instruction and vote for the better one. Arena fits a Bradley-Terry model to the votes and reports ratings on an Elo-like scale.

  • Arena Text-to-Video leaderboard
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    People compare two anonymous videos generated from the same prompt and vote for the better one. Arena fits a Bradley-Terry model to the votes and reports ratings on an Elo-like scale.

  • Arena Image-to-Video leaderboard
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    People compare two anonymous videos animated from the same image and prompt and vote for the better one. Arena fits a Bradley-Terry model to the votes and reports ratings on an Elo-like scale.

  • Arena Text leaderboard
    Verified
    2026-10-12
    Dataset version
    Not versioned
    License
    CC-BY-4.0
    Covers
    benchmark

    People put the same prompt to two anonymous models and vote for the better answer. Arena fits a Bradley-Terry model to the votes; the rating used here is the style-controlled one, which is the default view on arena.ai.

Artificial Analysis
  • Artificial Analysis Speech Arena leaderboard (text to speech)
    Verified
    2026-10-13
    Dataset version
    Provider voice leaderboard, read 2026-10-13
    License
    Artificial Analysis Terms of Use
    Covers
    benchmark

    Listeners compare two anonymous clips of the same text and vote for the more natural one; Artificial Analysis fits Elo ratings to the votes, using each provider's own voices. Cited with a link as Artificial Analysis asks; its terms reserve redistribution, so these scores are shown on the page and left out of the dataset download.

  • Artificial Analysis speech-to-text leaderboard (AA-WER v2, non-streaming)
    Verified
    2026-10-13
    Dataset version
    AA-WER v2, read 2026-10-13
    License
    Artificial Analysis Terms of Use
    Covers
    benchmark

    Artificial Analysis transcribes the same held-out audio through each provider API and reports the weighted word error rate. Cited with a link as Artificial Analysis asks; its terms reserve redistribution, so these scores are shown on the page and left out of the dataset download.

  • Artificial Analysis speech-to-text leaderboard (AA-WER Streaming)
    Verified
    2026-10-13
    Dataset version
    AA-WER Streaming, read 2026-10-13
    License
    Artificial Analysis Terms of Use
    Covers
    benchmark

    Artificial Analysis streams the same held-out audio through each provider realtime API and reports the word error rate of the final transcript. Cited with a link as Artificial Analysis asks; its terms reserve redistribution, so these scores are shown on the page and left out of the dataset download.

  • Artificial Analysis Video Arena leaderboard (AA-Video-T2V v2.0)
    Verified
    2026-10-13
    Dataset version
    AA-Video-T2V v2.0, read 2026-10-13
    License
    Artificial Analysis Terms of Use
    Covers
    benchmark

    People compare two anonymous videos generated from the same prompt and vote for the better one; Artificial Analysis fits Elo ratings to the votes. Cited with a link as Artificial Analysis asks; its terms reserve redistribution, so these scores are shown on the page and left out of the dataset download.

  • Artificial Analysis Video Arena leaderboard (AA-Video-I2V v1.0)
    Verified
    2026-10-13
    Dataset version
    AA-Video-I2V v1.0, read 2026-10-13
    License
    Artificial Analysis Terms of Use
    Covers
    benchmark

    People compare two anonymous videos animated from the same image and prompt and vote for the better one; Artificial Analysis fits Elo ratings to the votes. Cited with a link as Artificial Analysis asks; its terms reserve redistribution, so these scores are shown on the page and left out of the dataset download.

FAQ

AI model benchmark FAQ

What does an AI model benchmark score mean?

A benchmark score reports performance on one defined evaluation. Compare scores only when the task family, benchmark version, measurement date, scoring method, and eligible model set match; the result is a screening signal, not a prediction for every workload.

How fresh are the model and source records?

Each source shows a verification date, and the page shows the dataset version and last verified date. A verification date confirms when Van Data Team checked the linked record; it does not promise that a provider page has stayed unchanged since then.

Why are some model values marked Not reported?

Not reported means the catalog does not have a compatible, directly sourced value for that exact model record. Missing values remain empty rather than being estimated, copied from a related model, or treated as zero.

How should I compare AI model pricing?

Compare only the same pricing unit and tier, such as a million tokens, image, audio minute, video second, character, or realtime minute. Prices are provider list prices checked on the source verification date, not live quotes; retries, review, tooling, and infrastructure also affect production cost.

Does open-weight access mean a model is free to run?

No. Open weights means the model parameters are available for deployment under the provider license. This can provide infrastructure control, but compute, serving, monitoring, security, and engineering still carry costs.

How should I choose models for a production evaluation?

Start with the use case, select a small evidence-backed shortlist, and test it on representative work. Set acceptance thresholds for quality, latency, cost, reliability, safety, and human review before comparing results.

Where do the benchmark scores come from, and how often are they updated?

Only from independent publishers: Epoch AI (GPQA Diamond, FrontierMath and SimpleQA Verified), LiveBench, the Arena leaderboards for text, images and video, and Artificial Analysis for speech and video. Vendor launch numbers are never mixed in. Where a model was tested at several reasoning-effort settings, the best published setting is shown with its exact leaderboard row. The dataset is updated when a review verifies a material model, price or benchmark change, and the last verified date records it.

How can Van Data Team help with model evaluation?

Van Data Team can turn a shortlist into a production evaluation with representative cases, measurable acceptance rules, model routing, workflow controls, observability, and cost tracking tailored to your system.

Production evaluation

Turn a model shortlist into a production decision

We design representative evaluations and the workflow controls needed to operate the selected model with clear quality, cost, and review boundaries.

  • Evaluation cases and acceptance thresholds tied to real work
  • Model routing, tool permissions, observability, and human review design
Review the methodologyBook a consultation