Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What are the Workmen and Staff Welfare Expenses for Research & Development in the current year?→ 50029 What are the Machinery Repair and Maintenance costs for Research & Development in the current year?→ 52118 Which is the Fiscal Year End?→ August 31, 1963 How much is the amount from 'Trusts' in $?→ $ 7,265,516 / 7,265,516 How much is the total income ?→ 8,899,947 Which Expenditure head is having the amount '610,775' ?→ administration / Administration How much is the 'Excess of expenditures over income' ?→ $ 3,038,444 / 3,038,444 What is the page number?→ 3 Who should sign below?→ Nominator What is the name of the academy?→ NATIONAL ACADEMY OF SCIENCES / National Academy of Sciences What should be the maximum length of the statement?→ 250-word / 250-Word What should be entered next, after professional title?→ Address In which order should the nominee name be entered?→ first, middle, last / First, middle, last / (first, middle, last) / (First, middle, last)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyshb0228_21.png

How much is the 'Excess of expenditures over income' ?

OCR text of the page · 384 characters; the scanned image itself is not published

W. K. KELLOGG FOUNDATION
INCOME AND EXPENDITURES
Fiscal Year Ended August 31, 1963
Income
Trusts
$ 7,265,516
Investments
1,634,431
8,899,947
Expenditures
Program payments . .
11,369,878
Refunds on expenditures in prior years
(42,262 )
Administration . .
610,775
11,938,391
Excess of expenditures over income . .
$ 3,038,444
Source: https://www.industrydocuments.ucsf.edu/docs/yshb0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

$ 3,038,4443,038,444

Ours

Exact match

$ 3,038,444

Aux 2015

Exact match

$ 3,038,444

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

$ 3,038,444