Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepgxg0227_1.png

On 21 Friday, what is his program for the entire day?

OCR text of the page · 1,257 characters; the scanned image itself is not published
PROGRAM FOR DR. ROBERT SHANK
19 Wednesday
12:00 - To Sao Paulo by VASP.
13:15 - Arrive Sao Paulo - to Hotel Excelsior - lunch there or nearby
14:30 - To Escola Paulista de Medicina - Dean Jose Maria de Freitas -
basic sciences.
20 Thursday
09:00 - Escola Paulista de Medicina - Complete basic sciences, if
necessary, in forenoon (Microbiology, Pharmacology, Bio-
chemistry are principal RF interests). Rest of day with
clinical medicine.
21 Friday
09:00 - To Escola Paulista de Medicina - Entire day in Clinical
Medicine.
22 Saturday
09:00 - To Escola Paulista de Medicina, with Zerbini and Decourt
in forenoon. Afternoon free for sightseeing or further
visits as desired.
23 Sunday
Free - Could go to Ribeirao Preto if Zeferino Vaz desires.
24 Monday
07:00 - To Ribeirao Preto by WASP. Buy ticket after consulting
with Dr. Zeferino Vas; he may buy ticket for RES, and will
wither accompany RES to Ribeirao Preto or send someone.
8:15 -
Arrive Ribeirao Preto - Hotel Umuarama - rest of day in
basic science departments.
25 Tuesday
Ribeirao Preto - Preventive Medicine, Clinica Medicine, etc.
26 Wednesday
Ribeirao Preto - As for Tuesday
27 Thursday
Return to Sao Paulo
28 Friday
Sao Paulo to Lima
Source: https://www.industrydocuments.ucsf.edu/docs/pgxg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Entire day in Clinical MedicineClinical Medicine
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

09:00 - To Escola Paulista de Medicina - Entire day in Clinical Medicine.

73 characters19 tokens

Aux 2015

Wrong

Program for Dr. Robert Shank
19 Wednesday
12:00 - To São Paulo by VASP
13:15 - Arrive São Paulo - to Hotel Excelsior - lunch there or nearby
14:30 - To Escola Paulista de Medicina - Dean José Maria de Freitas -

218 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

PROGRAM FOR DR. ROBERT SHANK

Instruction:

Question: On 21 Friday, what is his program for the entire day?

OCR text: PROGRAM FOR DR. ROBERT SHANK

Input:

165 characters64 tokens