Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyyml0226_3.png

How much was the total research expenses for second fiscal year?

OCR text of the page · 1,791 characters; the scanned image itself is not published
OPERATING STATEMENT TO THE END OF THE
SECOND FISCAL YEAR
Unexpended Income (after Reserves) at End of First Fiscal Year ........ . $315,135.46
Income for Fiscal Year Ending June 30, 1945 (70% Basis) . . . . . . . . . . . . .. ..
318, 653.47
$633, 788.93
Expenses for Second Fiscal Year
Ending June 30th, 1945:
General Expenses . . . . . . . ...
$ 22, 093.29
Salaries . .. . . . . . . . . . . ....
. . . . ........
52,169. 83
Taxes (Social Sec. and Unemployment Ins. ) ..
867.33
Publicity . ......
42,429.53
Library . . . . ..
4, 509. 36
Office Equipment . . ..
1, 845.83
Petty Cash and Accounts Receivable
. . . . . .
110.00 $124,025.17
Research Expenses for Second Fiscal Year:
M. I . T. . . . . . . . . . . . . .
. . . . ...
$ 25,000.00
Grants to Other Universities . . . . . . .
108, 095.00
Special Studies . .
7, 072. 30
140, 167. 30
Other Appropriations for Second Fiscal Year:
Expenses in Connection with Symposium on
Fluoride . . . . . . . . .
S
2,454.17
Records for Broadcasting . . ..
2,000.00
Special Awards . . . . . . .
50,000. 00
Motion Picture Project . ...
. . . . . . . .
. . . . . . ......
9, 000. 00
New York Academy of Medicine - Contribution
500.00
63,954.17 328, 146.64
$305, 642. 29
Reserves During Second Fiscal Year for Commit-
ments Beyond June 30th, 1946:
Reserve for Dr. Hockett's salary . . .. .. . . .. .
$ 11, 666.67
Reserve for M. I. T. Grant . . . . .. .. . . . . . . .. .
16, 666.67
Reserve for Other Grants (Projects Nos.
1-3 4-15 and 26) . . . .
. . . . . ..
15, 766.67
44, 100.01 261, 542.28
Add Expenses for Library, Office Equipment and
Petty Cash and Accounts Receivable ...
6,465.19
Unexpended Balance (after Reserves) at the end
of the Second Fiscal Year . . . .. . . . . . ..
$268, 007.47
Source: https://www.industrydocuments.ucsf.edu/docs/yym10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
140,167.30
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

140,167.30

10 characters11 tokens

Aux 2015

Wrong

The total research expenses for the second fiscal year are $305,642.29.

75 characters24 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Operating Statement:

Operating Statement: Operating Statement: End of Second Fiscal Year: End of Second Fiscal Year: End of Second Fiscal Year: End of Second Fiscal Year: End of Second Fiscal Year: End of Second Fiscal Year: End of Second Fiscal

255 characters64 tokens