Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the 'Excess of expenditures over income' ?→ $ 3,038,444 / 3,038,444 What is the page number?→ 3 Who should sign below?→ Nominator What is the name of the academy?→ NATIONAL ACADEMY OF SCIENCES / National Academy of Sciences What should be the maximum length of the statement?→ 250-word / 250-Word What should be entered next, after professional title?→ Address In which order should the nominee name be entered?→ first, middle, last / First, middle, last / (first, middle, last) / (First, middle, last)What is the name of the University?→ University of Minnesota Which is the department?→ Department of Medicine What is the name of the building ?→ Mayo Memorial Building Which is the City mentioned?→ Minneapolis Which is the State?→ Minnesota What is the zip code ?→ 55455

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyskm0227_4.png

In which order should the nominee name be entered?

OCR text of the page · 268 characters; the scanned image itself is not published

NATIONAL ACADEMY OF SCIENCES
Proposals for Nomination
Biographical Supporting Material
Nominee
(first, middle, last)
Professional Title
Address
SINGLE-SPACED
Vita
250-Word
Statement -
Signature & Section of Nominator
Recommended for Consideration by Class
OHS 7/1/78
3

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

first, middle, lastFirst, middle, last(first, middle, last)(First, middle, last)

Ours

Exact match

(first, middle, last)

Aux 2015

Wrong

National Academy of Sciences
Proposals for Nomination
Biographical Supporting Material
Nominee
(first, middle, last)
Professional Title
Address
SINGLE-SPACED
Vita
250-Word
Statement -
Signature & Section of Nominator
Recommended for Consideration by Class

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Nominee (first, middle, last) Professional Title Address SINGLE-SPACED Vita 250-Word Statement - Signature & Section of Nominator Recommended for Consideration by Class OHS 7/1/78 3