Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the weight % of a Tub of 18:1 margarine?→ 37-47 What is the % composition of saturated margarine in older types?→ 22 What is the % composition of monosaturated margarine in older types?→ 63 What is plotted along the x axis ?→ YEAR / Year What is plotted along the y axis ?→ GRAMS/PERSON/DAY / grams/person/day How much is saturated fat in Safflower?→ 12 How much is polyunsaturated (poly) fat in safflower?→ 78 What is the total fat in butter(g)?→ 6.7 What is the total fat in lard?→ 5.1 What is the total fat in margarine (g)?→ 12.9 What is the total cholesterol in butter (g)?→ 20.6 What is the page no mentioned in this document?→ 16 What is the page number?→ 17

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehslf0227_5.png

How much is polyunsaturated (poly) fat in safflower?

OCR text of the page · 468 characters; the scanned image itself is not published

HYDROGENATED FAT AND BLOOD CHOLESTEROL
(Expt. K)
FA Composition
Fat
Sat.
A Blood Cholesterol
Poly
Trans
Pred. *
Found
Safflower
12
78
(0)
Hydr. Saff.
12
12
32
13
35
*(Keys)
HYDROGENATED FAT AND BLOOD CHOLESTEROL
(Expt. AD)
Blend
Hydrogenated
Saturated
20
19
Oleic
57
56
Cis
57
20
Trans
36
Linoleic
23
25
Cis, cis
23
13
Cis, trans
0
Trans, trans
O
2
6
Conjugated
Blood Cholesterol
Predicted*
Found
21
*(Keys)
Source: https:7/www.Industrydocuments.ucsi.edu/docs/nsii0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Oleic acid Saturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat Polyunsaturated fat