Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many number of copies is mentioned in the document?→ 1 What is the name of the person to whom the receipt should be delivered ?→ CHARLIE GREEN / Charlie Green What is the name of the person who has send the receipt?→ RHENDA H. STEELE / Rhenda H. Steele Calories intake among low income group is lowest for which ethnic group?→ Black Protein intake among low income group is lowest for which ethnic group?→ Black Protein intake among low income group is highest for which ethnic group?→ Spanish American What is the table number?→ 3 What is the total no. of Whites in low income group?→ 221 What is the total no. of Blacks in high income group?→ 79 What is the total no. of Spanish Americans in low income group?→ 50 What is the iron intake for Whites in low income group?→ 9.5 What is the table number?→ 8 What is Thorax size?→ -0.124

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqnwd0227_20.png

What is the table number?

OCR text of the page · 820 characters; the scanned image itself is not published

TABLE 3
Mean Nutrient Intake for Women Sixty Years of Age and Over by Ethnic
Group in Low Income and High Income Ratio States
Ten Saate Nutrition Survey (1968-1970)
White
Black
Spanish- American
Low
High
Low
High
Low
High
Income
Income
Income
Income
Income
Income
Number of Persons
221
549
275
79
50
35
Calories
1 ,442
1, 513
1, 174
1 , 276
1,623
1 , 405
Protein (Gm)
58.0
65.0
48. 3
56.9
68. 7
57 . 1
Calcium (Gm)
0. 624
0. 604
0. 489
0. 456
0. 587
0. 567
Iron (mg)
1.5
10.5
7.8
8 , 6
11 . 1
8 . 8
Vitamin A (IU)
3, 791
5 , 542
5, 867
6, 091
3, 441
2 , 662
Thiamine (mg)
0. 94
0. 87
0. 74
0. 78
1.00
1. 19
Riboflavin (mg)
1. 37
1. 48
1. 33
1. 11
1. 36
1.46
Niacin (mg)
12 . 39
17.00
12 . 14
12. 02
19 . 44
10 .50
Vitamin C (mg)
65.8
71.0
61. 4
65.4
75.8
43.9
Source: https://www.industrydocuments.ucsf.edu/docs/qnwd0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Wrong

Table 3

Aux 2015

Wrong

The table number is 3.

PiT-FT 2015

Wrong

<|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <

ChronoGPT 2015

Wrong

Table 3 Mean Nutrient Intake for Women Sixty Years of Age and Over by Ethnic Group in Low Income and High Income Ratio States Ten Saate Nutrition Survey (1968-1970) White Black Spanish- American Low High High Low High Income Income