Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerrnc0227_44.png

What is the name of the country studied here?

OCR text of the page · 1,444 characters; the scanned image itself is not published
APPENDIX I
PAKISTAN
NUTRIENT VALUES USED IN CALCULATIONS
(Values per 100 grams "As Purchased" basis)
Calo-
Pro-
Fat
Ca
Fe
Vit. A
Thia-
Ribo-
Niacin
Vit. C
Ref. Item
ries
tein
mine
flavin
Food
Gms
Gms
Mg
Mg
I. U.
Mg
Mg
Mg
Mg
Atta
341
819
1. 7
31
2.5
0 . 51
0. 09
4.5
A. 31
Rice
360
6.8
0 .7
6
0 , 8
0 . 12
0. 03
1 . 5
Wheat Flour
340
8 .8
1 . 7
18
1 , 2
-
0.27
0. 07
2. 5
A: 30
Biscuit
341
9.0
1 . 7
31
2 .5
0. 51
0. 09
4.5
D.
Cornmeal
355
9.2
3.9
10
2.4
510
0. 38
0. 11
2.0
1
A
7
Dhal, Chana
359
20.8
4.7
162
8.4
90
0 . 49
0 . 18
1. 6
A 207
Dhal, Mung
339
24.4
1. 4
91
6.3
40
0 . 68
0. 21
2.0
A 211
Dhal, Masur
339
24.0
1 . 2
34
7.4
90
0 . 56
0 . 24
2 .2
210
Dhal, gram
359
20.8
162
8 .4
0 . 18
Lentils
24.0
4.7
207
339
1 . 2
34
7.4
90
0 . 49
1 . 6
90
0 . 56
0 . 24
2 .2
210
Gram, atta
359
20. 8
4 .7
162
8. 4
90
0 . 49
0. 18
1 . 6
1 207
Mutton, goat 123
14
7.0
1. 7
0. 13
0. 24
4.2
B 198
35 -
Beef
138
15.5
8.0
8
9
2 .3
20
0 . 06
0 . 13
A 228
Fish
51
11 . 4
0 .3
7
0 .3
0. 04
0 . 06
3 .7
10.9
6 .8
8
0 . 8
1 . 5
A284b
Chicken
108
220
0. 04
0. 09
4 .3
A266b
Eggs
144
11 . 4
10 .2
48
2,4
1020
0.09
0. 26.
0 . 1.
HIHII
A 321
Milk, fresh
66
3 . 7
3.5 123
0. 1
140
0. 04
0 . 18
0. 1
H
A 330
Milk, can
(Multiply fresh by 2.25)
Sugar
385
Gur, Sugar
380
80 11. 4
280
1
1 1
A 352
-
D
Ghee, milk
870
90
2060
", Veg . Cotton-
I
I
1
A 344
seed
884
100
Butter
716
0 .6
81
1
B 278
20
3300
I
A 342
Source: https://www.industrydocuments.ucsf.edu/docs/rrnc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
pakistanPakistan
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

PAKISTAN

8 characters5 tokens

Aux 2015

Wrong

We are given a list of nutrient values for a single country (Pakistan) and need to identify the name of the country.

The list includes:

  • Nutrient values per 100 grams "As Purchased" basis
  • Calo-
  • Pro-
  • Fat
  • Ca
217 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
Appendicitis
Appendicitis
Appendicitis

The same 13-character fragment repeats 12 times until the token limit. Showing the first three.

168 characters64 tokens