Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesnyc0227_138.png

What levels are studied in the second table?

OCR text of the page · 1,021 characters; the scanned image itself is not published
TABLE VIII-5. TOTAL PLASMA PROTEINS BY AGE AND SEX, CIVILIANS AND DEPENDENTS,
MALAYA
Sex
Children
Males
Females
Nonpregnant
Pregnant,
nonlactating
lactating
Age (years)
<15
15-44
45+
15-44
45+
No. subjects
267
80
23
111
24
33
gm/100 ml
Mean
7.3
7.4
7.2
7.5
7.4
7.4
S. E. 1/
0. 06
0. 07
0. 11
0. 05
0. 10
0. 10
("Deficient")
Percent Distribution
<6.00
6.00-6.39 ("LOW")
1.9
5.0
3.6
6.40-6.99 ("Acceptable")
28 .8
13.8
39.1
11.7
16.7
21.2
27.00
("High")
69.3
81 , 2
60.9
84.7
83.3
78.8
1/ S.E. = standard error.
TABLE VIII-6. PLASMA ALBUMIN LEVELS, CIVILIANS AND DEPENDENTS, MALAYA
Sex
Children
Males
Females
Nonpregnant,
Pregnant,
nonlactating
lactating
Age (years)
<15
15-44
15-44
45+
No. subjects
266
80
23
110
24
33
gm/100 ml
Mean
3.8
4.0
3.6
3. 8
3.7
3.5
S. E.1/
0. 06
0. 04
0. 10
0.05
0. 06
0. 11
Percent Distribution
<2.5
0. 8
0.9
3.0
2.5-3.4
22.9
30.4
14.5
20.8
27.3
3.5 - 5.0
76 . 3
6.2
92.5
69.6
84.5
79.2
69 .7
>5.0
1 . 2
1/ S.E. = standard error.
135
Source: https://www.industrydocuments.ucsf.edu/docs/snyc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
PLASMA ALBUMIN LEVELSPLASMA ALBUMIN levelsPLASMA ALBUMIN
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

PLASMA ALBUMIN LEVELS

21 characters9 tokens

Aux 2015

Wrong

We are given two tables:

Table VIII-5 - Plasma proteins by age and sex, civilians and dependents, Malaysia

Table VIII-6 - Plasma albumin levels, civilians and dependents, Malaysia

We are to answer: "What levels are studied in the second table?"

261 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Table VIII-6. PLASMA ALBUMIN LEVELS, CIVILIANS AND DEPENDENTS, MALAYA Sex Children Males Females Nonpregnant, Pregnant, nonlactating lactating Age (

148 characters64 tokens