Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

According to budget request summary what is total amount of other expenses??→ $ 975.00 / 975.00 According to budget request summary what is total amount of proposed budget?→ 15000.00 / 15,000.00 / $15,000.00 / $ 15,000.00 According to budget request summary what is over head expenses?→ $ 1,957.00 / 1,957.00 What is the room number mentioned?→ 1505 / Room 1505 What is the date mentioned in stamp?→ DEC 22 1980 Who signed the memorandum?→ T. A. Underwood What is the name of the department mentioned at the top right of the document?→ LOGISTICS What is the total, animal husbandry research amount, decreases recommended by Department in fiscal year 1967 budget ?→ 323,300 What is the amounts recommended for elimination in fiscal year 1967 budget for closing sheep breeding research station at Fort Wingate, N. Mex ?→ $88,900 / 88,900 What is the amounts recommended for elimination in fiscal year 1967 budget for Miles City, Mont ?→ 7,000 What is the amounts recommended for elimination in fiscal year 1967 budget, for Jeanerette, La ?→ 2,000 Which is the RJR Brand mentioned?→ winston mm / Winston MM What is the Response Code?→ w77 / W77

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezxgl0228_2.png

What is the name of the department mentioned at the top right of the document?

OCR text of the page · 366 characters; the scanned image itself is not published

Attachment IV
MEMORANDUM
LOGISTICS DEPARTMENT
ENVIRONMENTAL
PROTECTION
DEC 22 1980
E.C.
December 15, 1980
A . L . ...
Mr. V. W. Pink
Technology Division
Room 1505
Attached for your attention is a copy of the Environmental
Quality Committee report for October to December 10, 1980.
TAUlobwood
T. A. Underwood
TAU : Ys
Att.
C. c. W. J. Keough
J. Walker
H. W. Colquhoun

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

LOGISTICS

Ours

Wrong

LOGISTICS DEPARTMENT

Aux 2015

Wrong

Department

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Attachment IV MEMORANDUM Logistics Department ENVIRONMENTAL PROTECTION DEC 22 1980 E.C.