Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelslw0227_31.png

How many men and women were in the population sample?

OCR text of the page · 674 characters; the scanned image itself is not published
TABLE I
Percentage of Elderly Subjects in Edinburgh, Scotland,
Whose Daily Intake of Various Nutrients Was Less
Than That Recommended by DHSS (1969) 1
Men
Women
Nutrient
8 of
Recom-
% of
Recom-
Subjects
mended
Subjects
mended
Intake2
Intake 2
Energy
53 . 7
2100 kcal
74.0
1900 kcal
Total Protein
14. 8
53 g
32.9
48 g
Iron
40 . 8
10 mg
83 .5
10 mg
Calcium
500 mg
8. 2
500 mg
Vitamin D
72. 3
2.5 ug
86.3
2.5 ug
Summarized from Lonergan et al. (1975). Population sample
involved 54 men and 67 women between the ages of 75 and 90.
2 Recommended intakes are based on those of the United Kingdom
Department of Health and Social Security (DHSS) (1969) .
SOL
.ucsf.edu/docs/Islw0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
54 MEN AND 67 WOMEN54 men and 67 women
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

54 men and 67 women

19 characters9 tokens

Aux 2015

Partial · ANLS 0.95

54 men and 67 women.

20 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Men Women

9 characters3 tokens