Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesnyc0227_138.png

What Proteins are studied in the first table?

OCR text of the page · 1,021 characters; the scanned image itself is not published
TABLE VIII-5. TOTAL PLASMA PROTEINS BY AGE AND SEX, CIVILIANS AND DEPENDENTS,
MALAYA
Sex
Children
Males
Females
Nonpregnant
Pregnant,
nonlactating
lactating
Age (years)
<15
15-44
45+
15-44
45+
No. subjects
267
80
23
111
24
33
gm/100 ml
Mean
7.3
7.4
7.2
7.5
7.4
7.4
S. E. 1/
0. 06
0. 07
0. 11
0. 05
0. 10
0. 10
("Deficient")
Percent Distribution
<6.00
6.00-6.39 ("LOW")
1.9
5.0
3.6
6.40-6.99 ("Acceptable")
28 .8
13.8
39.1
11.7
16.7
21.2
27.00
("High")
69.3
81 , 2
60.9
84.7
83.3
78.8
1/ S.E. = standard error.
TABLE VIII-6. PLASMA ALBUMIN LEVELS, CIVILIANS AND DEPENDENTS, MALAYA
Sex
Children
Males
Females
Nonpregnant,
Pregnant,
nonlactating
lactating
Age (years)
<15
15-44
15-44
45+
No. subjects
266
80
23
110
24
33
gm/100 ml
Mean
3.8
4.0
3.6
3. 8
3.7
3.5
S. E.1/
0. 06
0. 04
0. 10
0.05
0. 06
0. 11
Percent Distribution
<2.5
0. 8
0.9
3.0
2.5-3.4
22.9
30.4
14.5
20.8
27.3
3.5 - 5.0
76 . 3
6.2
92.5
69.6
84.5
79.2
69 .7
>5.0
1 . 2
1/ S.E. = standard error.
135
Source: https://www.industrydocuments.ucsf.edu/docs/snyc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
TOTAL PLASMA PROTEINSTotal plasma ProteinsTOTAL PLASMATOTAL PLASMA PROTEINS BY AGE AND SEX, CIVILIANS AND DEPENDENTS, MALAYA
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

TOTAL PLASMA PROTEINS

21 characters8 tokens

Aux 2015

Wrong

We are given a table of plasma protein levels by age and sex in Malaya, with the following information:

  • TABLE VIII-5: Total plasma proteins by age and sex, civilians and dependents, Malaya
  • TABLE VIII-6: Plasma albumin levels, civilians and dependents, Malaya
265 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Table VIII-5. Total Plasma Proteins by Age and Sex, Civilians and Dependents, Malaya Sex Children Males Females Nonpregnant, Pregnant, nonlactating lactating Age (years) <15 15

176 characters64 tokens