Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyshb0228_21.png

Which is the Fiscal Year End?

OCR text of the page · 384 characters; the scanned image itself is not published
W. K. KELLOGG FOUNDATION
INCOME AND EXPENDITURES
Fiscal Year Ended August 31, 1963
Income
Trusts
$ 7,265,516
Investments
1,634,431
8,899,947
Expenditures
Program payments . .
11,369,878
Refunds on expenditures in prior years
(42,262 )
Administration . .
610,775
11,938,391
Excess of expenditures over income . .
$ 3,038,444
Source: https://www.industrydocuments.ucsf.edu/docs/yshb0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
August 31, 1963
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Fiscal Year Ended August 31, 1963

33 characters15 tokens

Aux 2015

Wrong

Fiscal Year Ended August 31, 1963

Answer: Fiscal Year Ended August 31, 1963

76 characters31 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

W. K. KELLOGG FOUNDATION INCOME AND EXPENDITURES Fiscal Year Ended August 31, 1963 Income Trusts Investments 8,899,947 Expenditures Program payments . . 11,369,878 Refund

170 characters64 tokens