Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesnyc0227_125.png

What is number of civilian and military dependent in Johore?

OCR text of the page · 1,350 characters; the scanned image itself is not published
TABLE VIII-1. PERCENT DISTRIBUTION OF CIVILIAN AND MILITARY DEPENDENT SAMPLE BY LOCATION, AREA OF
ORIGIN, RURAL VS. URBAN ORIGIN, RACE AND AGE, MALAYA
Location
Johore
Kedah
Kelantan
Selangor
Perak
Pahang
Negri
Sembilan
Malacca
Total
Number
1, 028
887
636
559
1, 414
668
52
669
5,913
Area of Origin
Percent Distribution
Selangor
1.6
2 .3
0. 8
0.5
63.3
0.3
0.7
1.2
6.7
Kelantan
2.4
85. 2
0 .9
0.7
0.4
2.1
0.3
10.4
Pahang
.6
0 .6
0.5
77.5
0 .3
9 .1
Johore
65.2
1 . 8
0 . 3
0.9
0.5
1.0
1.5
12.1
Malacca
5 . 8
5.3
5 .8
4.3
2.0
7.5
100.0
86.4
14.8
Perak
3 .4
5 . 3
4.1
3.2
84.0
6.4
6.7
23.7
Kedah
1.1
80.9
1.6
1,1
0.8
0.4
1. 2
13.0
120
Trengganu
0.3
0.6
0.2
1.0
0. 2
Penang
0.5
2.2
0 .5
1.6
0.4
0.4
0.6
0 .8
Others
19.2
0.3
0.8
6.1
11.7
2.7
1 . 8
7.3
Rural
64 .8
83.4
73.4
32.4
100.0
74.2
100.0
99.4
79.2
Urban
35.2
16.6
26.6
67.6
25.7
0 .6
20.8
Race
Chinese
52.0
8 .8
22.0
15.7
91.2
26.5
7,8
39.9
Malay
33 .8
89 .7
76.4
52 .8
6.2
73.5
100.0
88.9
53.3
Indian
14.1
1. 2
30.2
2.3
3.3
6.4
Other
0.2
0.2
0. 05
Civilians
Males
Number
485
370
255
260
729
267
40
337
2, 743
Age (years)
Percent Distribution
5-9
19.8
2.4
25.9
34.6
42.0
47.2
5.0
37.4
29.9
10-14
28.9
38.9
23.1
40.8
39.8
36.0
25.0
38.0
35.5
15-44
30.9
51.1
23 .9
16.5
10.3
12.4
62.5
16.6
23.0
45+
20.4
7 .6
27.0
8 . 1
8.0
4.5
7.5
8.0
11.6
Source: https://www.industrydocuments.ucsf.edu/docs/snyc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
10281,028
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.83

1, 028

6 characters7 tokens

Aux 2015

Wrong

We are given a table of percentages of civilian and military dependent populations by location, area of origin, rural vs. urban origin, race, and age. We are to answer the question: "What is the number of civilian and military dependent in Johore?"

We need to extract the numbers from the table and then

304 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Number of civilians and military dependent in Johore Number of civilians and military dependent in Kelantan Number of civilians and military dependent in Penang Number of civilians and military dependent in Trengganu Number of civilians and military dependent in Malacca Number of civilians and military dependent in Kedah

322 characters64 tokens