Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqnwd0227_19.png

Protein intake among low income group is highest for which ethnic group?

OCR text of the page · 806 characters; the scanned image itself is not published
TABLE 2
Mean Nutrient Intake for Men Sixty Years of Age and Over by Ethnic
Groups in Low Income and High Income ratio States
Ten State Nutrition Survey (1968-1970)
White
Black
Spanish American
Low
High
Low
High
Low
High
Income
Income
Income
Income
Income
Income
Number of Persons
189
101
160
47
43
21
Calories
1937
2181
1508
1833
1812
1826
Protein (Gm)
77.6
88.8
64.4
75. 1
78. 2
77. 7
Calcium (Gm)
0. 870
0. 811
0. 540
0. 605
0. 462
0. 874
Iron (mg)
12.2
15.0
10.6
11. 1
13. 7
11 . 7
Vitamin A (IU)
5, 138
5 , 341
5, 028
4 , 086
3, 354
3, 046
Thiamine (mg)
1. 17
1 . 17
1. 01
1. 17
1. 25
1. 28
Riboflavin (mg)
1 . 86
1. 79
1. 75
1. 41
1. 71
1. 83
Niacin (mg)
16.15
22.29
15.04
14.52
23.80
12. 79
Vitamin C (mg)
57 . 8
62. 8
56. 1
45.5
50.6
54.5
Source: https://www.industrydocuments.ucsf.edu/docs/qnwd0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Spanish American
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

White

5 characters2 tokens

Aux 2015

Wrong

The mean nutrient intake for men aged 60+ by ethnic group in low-income and high-income states is highest for Black (88.8 g/day) followed by Spanish American (88.8 g/day), then Low Income (85.1 g/day), then **

221 characters64 tokens

PiT-FT 2015

Wrong

<|assistant|<|<assistant|<|<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<

148 characters64 tokens

ChronoGPT 2015

Wrong

Low Income and High Income Ratio States

Protein intake among low income group is highest for which ethnic group?

Question:

What is the highest protein intake among low income group?

OCR text: Table 2 Mean Nutrient Intake for Men Sixty Years of Age and Over

263 characters64 tokens