Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesnyc0227_125.png

What is the number of male civilians in the location Kedah?

OCR text of the page · 1,350 characters; the scanned image itself is not published
TABLE VIII-1. PERCENT DISTRIBUTION OF CIVILIAN AND MILITARY DEPENDENT SAMPLE BY LOCATION, AREA OF
ORIGIN, RURAL VS. URBAN ORIGIN, RACE AND AGE, MALAYA
Location
Johore
Kedah
Kelantan
Selangor
Perak
Pahang
Negri
Sembilan
Malacca
Total
Number
1, 028
887
636
559
1, 414
668
52
669
5,913
Area of Origin
Percent Distribution
Selangor
1.6
2 .3
0. 8
0.5
63.3
0.3
0.7
1.2
6.7
Kelantan
2.4
85. 2
0 .9
0.7
0.4
2.1
0.3
10.4
Pahang
.6
0 .6
0.5
77.5
0 .3
9 .1
Johore
65.2
1 . 8
0 . 3
0.9
0.5
1.0
1.5
12.1
Malacca
5 . 8
5.3
5 .8
4.3
2.0
7.5
100.0
86.4
14.8
Perak
3 .4
5 . 3
4.1
3.2
84.0
6.4
6.7
23.7
Kedah
1.1
80.9
1.6
1,1
0.8
0.4
1. 2
13.0
120
Trengganu
0.3
0.6
0.2
1.0
0. 2
Penang
0.5
2.2
0 .5
1.6
0.4
0.4
0.6
0 .8
Others
19.2
0.3
0.8
6.1
11.7
2.7
1 . 8
7.3
Rural
64 .8
83.4
73.4
32.4
100.0
74.2
100.0
99.4
79.2
Urban
35.2
16.6
26.6
67.6
25.7
0 .6
20.8
Race
Chinese
52.0
8 .8
22.0
15.7
91.2
26.5
7,8
39.9
Malay
33 .8
89 .7
76.4
52 .8
6.2
73.5
100.0
88.9
53.3
Indian
14.1
1. 2
30.2
2.3
3.3
6.4
Other
0.2
0.2
0. 05
Civilians
Males
Number
485
370
255
260
729
267
40
337
2, 743
Age (years)
Percent Distribution
5-9
19.8
2.4
25.9
34.6
42.0
47.2
5.0
37.4
29.9
10-14
28.9
38.9
23.1
40.8
39.8
36.0
25.0
38.0
35.5
15-44
30.9
51.1
23 .9
16.5
10.3
12.4
62.5
16.6
23.0
45+
20.4
7 .6
27.0
8 . 1
8.0
4.5
7.5
8.0
11.6
Source: https://www.industrydocuments.ucsf.edu/docs/snyc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
370
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

370

3 characters4 tokens

Aux 2015

Wrong

We are given a table of percentages for the distribution of civilian and military dependent samples by location, area of origin, rural vs. urban origin, race, and age. We are to answer the question: "What is the number of male civilians in the location Kedah?"

We need to extract the number of male

299 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 15.0 16.0

70 characters64 tokens