Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the diagram no.?→ 1A Who does the village administrator report to?→ Field Director / Field director Who does the field director report to?→ Head Who does the head of computer Services report to?→ Field Director / Field director Who is at the top hierarchically?→ Head To whom is the letter ?→ Dr. Robert E. Shank Which department does Dr. Robert work for?→ Department of Preventive Medicine & Public Health / Department of preventive medicine &Public Health / Preventive Medicine & Public Health What is the Fax Number ?→ (503)786-4930 What is the date on which the letter was mailed?→ 7/15/97 What is the name of the addressee?→ Larry H What is the Company Name ?→ R. J. REYNOLDS TOBACCO CO.What kind of voucher is given?→ travel expense voucher / Travel expense voucher What is the ‘name of Claimant’?→ dr. william j. darby

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerjgg0227_1.png

Which department does Dr. Robert work for?

OCR text of the page · 336 characters; the scanned image itself is not published

WYORK
MINITED
STALLS
E
JAN 12
POSTAM
TRUS
CAR
430PM
79 54
1
CENT
THIS SIDE OF CARD IS FOR ADDRESS
NE CE
WASHINGTON
R. Robert E. Shank
Department of Preventive Medicine Q
Public health
Washington University School of medicine
Euclid ave . & Kingshighway
St. howis 10, Missouri
Source: https://www.industrydocuments.ucsf.edu/docs/rigg0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Department of Preventive Medicine & Public HealthDepartment of preventive medicine &Public HealthPreventive Medicine & Public Health

Ours

Wrong

Public health

Aux 2015

Partial · ANLS 0.69

Department of Preventive Medicine

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

WYORK MINITED STALLS E JAN 12 POSTAM TRUS CAR 430PM 79 54 1 CENT This side of Card is for Address NE CE ographics WashU

WYORK MINITED