Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehslf0227_9.png

What is the total fat in butter(g)?

OCR text of the page · 477 characters; the scanned image itself is not published
FAT AVAILABLE THROUGH HOUSEHOLD PURCHASE-1965
(Fats and Oils)
(per person per day)
Total
Fatty Acids
Fat
Sat.
Poly.
Cholesterol
g
mg
Spreads :
19. 5
6. 6
3. 0
21.8
Butter
6. 7
3. 8
0. 2
20. G
Margarine
12. 9
2. 8
2 . 8
1. 2
Shortenings:
1.1. 9
3. 6
2.0
1. 8
Lard
5. 1
1. 9
0.5
4. 8
Vegetable
6. 8
1 , 7
1. 5
0
Cooking & Salad Oils:
7. 1
1. 2
3. 7
0
Salad Dressings:
6. 3
1. 1
4. 3
7 . 7
Total
44. 8
12. 6
12. 9
34.0
Source: https:7/www.industrydocuments. ucsi.edu/docs/hsif0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
6.7
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

6.7

3 characters4 tokens

Aux 2015

Wrong

44.8

4 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Fats and Oils Total Fatty Acids Fat Sat. Poly. Cholesterol G Margarine Lard Shortenings Cooking & Salad Oils Total Fat Fat Sat. Poly. Cholesterol G Margarine L

159 characters64 tokens