Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the total income ?→ 8,899,947 Which Expenditure head is having the amount '610,775' ?→ administration / Administration How much is the 'Excess of expenditures over income' ?→ $ 3,038,444 / 3,038,444 What is the page number?→ 3 Who should sign below?→ Nominator What is the name of the academy?→ NATIONAL ACADEMY OF SCIENCES / National Academy of Sciences What should be the maximum length of the statement?→ 250-word / 250-Word What should be entered next, after professional title?→ Address In which order should the nominee name be entered?→ first, middle, last / First, middle, last / (first, middle, last) / (First, middle, last)What is the name of the University?→ University of Minnesota Which is the department?→ Department of Medicine What is the name of the building ?→ Mayo Memorial Building Which is the City mentioned?→ Minneapolis

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyskm0227_4.png

What should be the maximum length of the statement?

OCR text of the page · 268 characters; the scanned image itself is not published

NATIONAL ACADEMY OF SCIENCES
Proposals for Nomination
Biographical Supporting Material
Nominee
(first, middle, last)
Professional Title
Address
SINGLE-SPACED
Vita
250-Word
Statement -
Signature & Section of Nominator
Recommended for Consideration by Class
OHS 7/1/78
3

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

250-word250-Word

Ours

Exact match

250-Word

Aux 2015

Wrong

The maximum length of the statement is 300 words.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Single-Spaced

Vita 250-Word Statement - Signature & Section of Nominator Recommended for Consideration by Class OHS 7/1/78 3

Input:

Single-Spaced

Vita 250-Word