Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerrnc0227_44.png

What is the calories intake for Atta?

OCR text of the page · 1,444 characters; the scanned image itself is not published
APPENDIX I
PAKISTAN
NUTRIENT VALUES USED IN CALCULATIONS
(Values per 100 grams "As Purchased" basis)
Calo-
Pro-
Fat
Ca
Fe
Vit. A
Thia-
Ribo-
Niacin
Vit. C
Ref. Item
ries
tein
mine
flavin
Food
Gms
Gms
Mg
Mg
I. U.
Mg
Mg
Mg
Mg
Atta
341
819
1. 7
31
2.5
0 . 51
0. 09
4.5
A. 31
Rice
360
6.8
0 .7
6
0 , 8
0 . 12
0. 03
1 . 5
Wheat Flour
340
8 .8
1 . 7
18
1 , 2
-
0.27
0. 07
2. 5
A: 30
Biscuit
341
9.0
1 . 7
31
2 .5
0. 51
0. 09
4.5
D.
Cornmeal
355
9.2
3.9
10
2.4
510
0. 38
0. 11
2.0
1
A
7
Dhal, Chana
359
20.8
4.7
162
8.4
90
0 . 49
0 . 18
1. 6
A 207
Dhal, Mung
339
24.4
1. 4
91
6.3
40
0 . 68
0. 21
2.0
A 211
Dhal, Masur
339
24.0
1 . 2
34
7.4
90
0 . 56
0 . 24
2 .2
210
Dhal, gram
359
20.8
162
8 .4
0 . 18
Lentils
24.0
4.7
207
339
1 . 2
34
7.4
90
0 . 49
1 . 6
90
0 . 56
0 . 24
2 .2
210
Gram, atta
359
20. 8
4 .7
162
8. 4
90
0 . 49
0. 18
1 . 6
1 207
Mutton, goat 123
14
7.0
1. 7
0. 13
0. 24
4.2
B 198
35 -
Beef
138
15.5
8.0
8
9
2 .3
20
0 . 06
0 . 13
A 228
Fish
51
11 . 4
0 .3
7
0 .3
0. 04
0 . 06
3 .7
10.9
6 .8
8
0 . 8
1 . 5
A284b
Chicken
108
220
0. 04
0. 09
4 .3
A266b
Eggs
144
11 . 4
10 .2
48
2,4
1020
0.09
0. 26.
0 . 1.
HIHII
A 321
Milk, fresh
66
3 . 7
3.5 123
0. 1
140
0. 04
0 . 18
0. 1
H
A 330
Milk, can
(Multiply fresh by 2.25)
Sugar
385
Gur, Sugar
380
80 11. 4
280
1
1 1
A 352
-
D
Ghee, milk
870
90
2060
", Veg . Cotton-
I
I
1
A 344
seed
884
100
Butter
716
0 .6
81
1
B 278
20
3300
I
A 342
Source: https://www.industrydocuments.ucsf.edu/docs/rrnc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
341
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

341

3 characters4 tokens

Aux 2015

Wrong

We are given the following nutritional values for Atta (rice) from the Pakistani Nutrition Data Sheet (PNDS) for the year 2027. The values are per 100 grams of "As Purchased" basis.

We are to calculate the calories intake for Atta using the

245 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Atta

  • Calories -Fat
  • Pro-
  • Mg
  • Vit-
  • Niacin
  • Ribo-
  • Flavin
  • Mg
  • Niacin
  • Ribo-
  • Vit-
  • Niacin
  • Ribo-
111 characters64 tokens