Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejhbl0226_45.png

What is the quantity of Vitamin A per serving size (IU)?

OCR text of the page · 549 characters; the scanned image itself is not published
Nutritional content of Sabatasso 617( "School Lunch Cooked Sausage Pizza"
Nutrients
Percentage
per
of
Nutrient
serving
US RDA
Serving size
4. 5
Energy
372
Protein
19
Carbohydrate
27
Fat
21
Fiber
Minerals
Sodium
39
Potassium
209
Calcium
Magnesium
Phosphorus
Iron
Zinc
Copper
Manganese
Vitamins
TO
1009
D
IU
m
9.2
Niacin
1.6
Thismin
0.14
10
Riboflavin
0.31
Pantothenate
Biotin
Cobalamin (B12)
Folate
Pyridozine (B6)
Added for nutritional fortification
Nutritional data taken from USDA Handbook #456
https //www.industrydocuments uest edu/does/jhbl0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1009
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1009

4 characters5 tokens

Aux 2015

Wrong

The quantity of Vitamin A per serving size (IU) is 1009.

56 characters19 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Nutritional content of Sabatasso 617( "School Lunch Cooked Sausage Pizza"

Nutritional content of Sabatasso 617( "School Lunch Cooked Sausage Pizza"

Nutritional content of Sabatasso 617( "School Lunch Cooked Sausage

224 characters64 tokens