Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehldg0227_7.png

How many children were found to be unsatisfactory for study and returned ?

OCR text of the page · 1,110 characters; the scanned image itself is not published
SECTION 1
STUDIES ON THE EFFECT OF MILK PROTEIN
DILUTION IN CHILDREN AT M. I. T.
Studies on the effect of dilution of skim milk protein were
commenced on fourteen mentally retarded children. Of these fourteen
children, seven were found to be unsatisfactory for study and returned,
within two weeks of admission to the M. I. T. Clinical Center, to their
respective State schools.
Details of experimental design, diet, and analytical procedures
were previously described in the 1967 Annual Progress Report and are
further described in Section 3 of this report.
Details are given in Table 2 for the seven children who were
studied during the entire experimental period.
Table 2
Age and weight of children and experimental design used for
studies of milk protein dilution
Subject
Age
Initial Wt.
Final Wt.
Days on
Days on
(yrs. )
( 1b. )
(1b. ) Baseline Diet
Dilution
P. K.
61.5
58. 5
18
20
W. M.
33.0
36, 0
26
83
C. R.
33.0
35.0
25
32
R. O'C.
34. 0
36.0
33
32
B. L.
41.0
43.0
29
40
S. D.
35.0
37.0
25
12
J. W.
Z2. 0
23.5
40
30
1. Dilution at 20% level.
Source: https://www.industrydocuments.ucsf.edu/docs/hldg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
seven7
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

seven

5 characters2 tokens

Aux 2015

Wrong

The question asks how many children were found to be unsatisfactory for study and returned.

Looking at the provided text, we see:

  • "SECTION 1"
  • "STUDIES ON THE EFFECT OF MILK PROTEIN"
  • "DILUTION IN CHILDREN AT M. I
219 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

SECTION 1 SECTION 2 SECTION 3 SECTION 4 SECTION 5 SECTION 6 SECTION 7 SECTION 8 SECTION 9 SECTION 10 SECTION 11 SECTION 12 SECTION 13 SECTION 14 SECTION 15 SECTION 16

166 characters64 tokens