ChartQA

ChartQA - Benchmark Leaderboard & Model Performance | AI Stats

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Meta	Llama 4 Maverick	05 Apr 2025	90%	-	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	89.50%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	89.50%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	-	89.50%	-	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	89.50%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Meta	Llama 4 Scout	05 Apr 2025	88.80%	-	Yes	Source
Qwen	Qwen 2 VL 72B	-	88.30%	-	Yes	Source
Qwen	Qwen 2 VL 2B	-	88.30%	inferred family alias from qwen2-vl-72b (score=0.4083; benches=15)	Yes	Source
Mistral	Pixtral Large	18 Nov 2024	88.10%	-	Yes	Source
Mistral	Mistral Small 3.2	20 Jun 2025	87.40%	-	Yes	Source
Qwen	Qwen 2.5 1.5B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 VL 7B Instruct	-	87.30%	-	Yes	Source
Qwen	Qwen 2.5 3B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3531; benches=32)	Yes	Source
Qwen	Qwen 2.5 0.5B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
DeepSeek	DeepSeek VL2	13 Dec 2024	86%	-	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2025-06-03)	03 Jun 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	85.70%	-	Yes	Source
OpenAI	GPT 4o Audio (2024-10-01)	01 Oct 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2024-12-17)	17 Dec 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
Meta	Llama 3.2 90B Vision Instruct	-	85.50%	inferred high-confidence family alias from llama-3.2-90b-instruct (score=0.5873; benches=13)	Yes	Source
Qwen	Qwen 2.5 Coder 3B	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	85.30%	-	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
DeepSeek	DeepSeek VL2 Small	13 Dec 2024	84.50%	-	Yes	Source
Meta	Llama 3.2 1B Instruct	25 Sept 2024	83.40%	inferred family alias from llama-3.2-11b-instruct (score=0.4200; benches=11)	Yes	Source
Meta	Llama 3.2 11B Vision Instruct	-	83.40%	inferred high-confidence family alias from llama-3.2-11b-instruct (score=0.5873; benches=11)	Yes	Source
Mistral	Pixtral 12B	17 Sept 2024	81.80%	inferred version-family alias from pixtral-12b-2409	Yes	Source
Microsoft	Phi 3.5 vision instruct	23 Aug 2024	81.80%	-	Yes	Source
Microsoft	Phi 3 Vision 128K Instruct	-	81.80%	inferred family alias from phi-3.5-vision-instruct (score=0.3495; benches=9)	Yes	Source
Microsoft	Phi 4 multimodal instruct	01 Feb 2025	81.40%	-	Yes	Source
DeepSeek	DeepSeek VL2 Tiny	13 Dec 2024	81%	-	Yes	Source
xAI	Grok 1.5V	12 Apr 2024	76.10%	-	Yes	Source

Recorded Results

Average Score

Score Range

Leading Model

Models Using This Benchmark