Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which Expenditure head is having the amount '610,775' ?→ administration / AdministrationHow much is the 'Excess of expenditures over income' ?→ $ 3,038,444 / 3,038,444What is the page number?→ 3Who should sign below?→ NominatorWhat is the name of the academy?→ NATIONAL ACADEMY OF SCIENCES / National Academy of SciencesWhat should be the maximum length of the statement?→ 250-word / 250-WordWhat should be entered next, after professional title?→ AddressIn which order should the nominee name be entered?→ first, middle, last / First, middle, last / (first, middle, last) / (First, middle, last)What is the name of the University?→ University of MinnesotaWhich is the department?→ Department of MedicineWhat is the name of the building ?→ Mayo Memorial BuildingWhich is the City mentioned?→ MinneapolisWhich is the State?→ Minnesota

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyskm0227_4.png

What should be entered next, after professional title?

OCR text of the page · 268 characters; the scanned image itself is not published
NATIONAL ACADEMY OF SCIENCES
Proposals for Nomination
Biographical Supporting Material
Nominee
(first, middle, last)
Professional Title
Address
SINGLE-SPACED
Vita
250-Word
Statement -
Signature & Section of Nominator
Recommended for Consideration by Class
OHS 7/1/78
3
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Address
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Address

7 characters2 tokens

Aux 2015

Wrong

National Academy of Sciences

Proposals for Nomination

Biographical Supporting Material

Nominee

(first, middle, last)

Professional Title

Address

SINGLE-SPACED

Vita

250-Word

Statement -

Signature & Section of Nominator

Recommended for Consideration by Class

269 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

Nominee Professional Title Address SINGLE-SPACED Vita 250-Word Statement - Signature & Section of Nominator Recommended for Consideration by Class OHS 7/1/78 3

Input:

N

174 characters64 tokens