Ministral-8B
Mistral AI131K context2024-10-16
Overall Rank
#15
of 23 models
Overall Score
69.3
avg across benchmarks
Best Task
Key Information Extraction
85.7
Weakest Task
Visual QA
57.4
Benchmark Performance
OlmOCR Benchv1.0
16/23
| Overall | Math | Table | Present | Absent | Order |
|---|---|---|---|---|---|
| 57.8 | 50.8 | 79.2 | 42.0 | 55.7 | 71.4 |
OmniDocBenchv1.5
13/23
| Overall | Text Edit↓ | CDM↑ | TEDS↑ | TEDS-S↑ | Read Order↓ |
|---|---|---|---|---|---|
| 78.3 | 0.157 | 83.3 | 67.1 | 73.8 | 0.125 |
IDP Core Benchv1.0
14/23
| Overall | KIE | OCR | Table | VQA |
|---|---|---|---|---|
| 71.7 | 85.7 | 67.8 | 75.9 | 57.4 |
Capability Profile
Strength Analysis
Auto-generated from benchmark scores
Strengths
- Key Information Extraction85.7
- Text Extraction84.3
Weaknesses
- Visual QA57.4
- Table Understanding74.1