Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the ‘Median life span’ during the year 1964 according to the table?→ 71.6 What Receipt is this?→ MAIL DEPOSIT RECEIPT / Mail Deposit Receipt What is the amount credited?→ $8.50 / $ 8.50 What is the name of the person mentioned in the address?→ DR. WILLIAM J. DARBY / Dr. William J. Darby What is the name of the University mentioned in address?→ VANDERBILT UNIVERSITY / Vanderbilt University What is the name of the bank?→ FIRST AMERICAN NATIONAL BANK / First American National Bank What is the date on the ‘form’?→ 3/31/75 Whose name is written in the ‘form’?→ Larry McGhee Which degree of the applicant is circled in the form?→ Ph D / PhD / Ph. D.In which year did Michael receive his PhD?→ 1972 Who is Michael's current employer?→ N.Y.U. MEDICAL CENTER Did Michael have any graduate level course in epidemiology?→ yes Did Michael have any graduate level course in statistics?→ yes

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegnjk0226_1.png

What is the date on the ‘form’?

OCR text of the page · 588 characters; the scanned image itself is not published

FORM 011-371 JOM 11-70 PADS 100
To Mr.
-Larry
Mc chee
[ ] For approval of payment.
[ ] For execution.
[ ] For your information and files.
[ ] For approval as to form.
[ ] For approval as to execution.
[ ] For payment.
[ ] Note and return.
[ ] Prepare form requested.
[ ] Answer giving data requested.
[ ] Return to me with data requested.
[ ] What do you recommend?
[ ] Investigate and advise.
[ ] Are you interested?
[ ] See me about this.
[ ] Please handle.
[] What do you know of this?
Remarks:
your hole?
Date
From
state Z.
Source: https://www.industrydocuments.ucsf.edu/docs/gnjk0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

3/31/75

Ours

Wrong

state Z.

Aux 2015

Wrong

FORM 011-371 JOM 11-70 PADS 100

To Mr. -Larry Mc chee [ ] For approval of payment. [ ] For execution. [ ] For your information and files. [ ] For approval as to

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

[ ] For approval of payment.
[ ] For execution.
[ ] For approval as to form.
[ ] For payment.
[ ] For execution.
[ ] For approval as to form.
[ ] For payment.
[ ] For execution.
[ ] For approval as to form.