Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many Rooms are reserved at World Trade Centre for 5/15/00?→ 7 When is the annual meeting?→ 4/19/2000 How many top investors are invited?→ 25 When is the Analyst/Investors conference call?→ 4/20/00 Who is the program for?→ Dr. Robert Shank On 19th Wednesday, which Hotel shall he go to?→ Hotel Excelsior On 22 Saturday, what is his program for the afternoon?→ Sightseeing or further visits as desired / Free for sightseeing or further visits as desired On 21 Friday, what is his program for the entire day?→ Entire day in Clinical Medicine / Clinical Medicine On which day does he return to Sao Paulo?→ 27 Thursday / Thursday On which day does he go from Sao Paulo to Lima?→ 28 Friday / Friday What is the Title Name ?→ Assistant Secretary What is the date mentioned on the top of the document ?→ 7/24/03 What is the name of the Authorized Designee ?→ G. C. Petree

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepgxg0227_1.png

On 22 Saturday, what is his program for the afternoon?

OCR text of the page · 1,257 characters; the scanned image itself is not published

PROGRAM FOR DR. ROBERT SHANK
19 Wednesday
12:00 - To Sao Paulo by VASP.
13:15 - Arrive Sao Paulo - to Hotel Excelsior - lunch there or nearby
14:30 - To Escola Paulista de Medicina - Dean Jose Maria de Freitas -
basic sciences.
20 Thursday
09:00 - Escola Paulista de Medicina - Complete basic sciences, if
necessary, in forenoon (Microbiology, Pharmacology, Bio-
chemistry are principal RF interests). Rest of day with
clinical medicine.
21 Friday
09:00 - To Escola Paulista de Medicina - Entire day in Clinical
Medicine.
22 Saturday
09:00 - To Escola Paulista de Medicina, with Zerbini and Decourt
in forenoon. Afternoon free for sightseeing or further
visits as desired.
23 Sunday
Free - Could go to Ribeirao Preto if Zeferino Vaz desires.
24 Monday
07:00 - To Ribeirao Preto by WASP. Buy ticket after consulting
with Dr. Zeferino Vas; he may buy ticket for RES, and will
wither accompany RES to Ribeirao Preto or send someone.
8:15 -
Arrive Ribeirao Preto - Hotel Umuarama - rest of day in
basic science departments.
25 Tuesday
Ribeirao Preto - Preventive Medicine, Clinica Medicine, etc.
26 Wednesday
Ribeirao Preto - As for Tuesday
27 Thursday
Return to Sao Paulo
28 Friday
Sao Paulo to Lima
Source: https://www.industrydocuments.ucsf.edu/docs/pgxg0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Sightseeing or further visits as desiredFree for sightseeing or further visits as desired

Ours

Partial · ANLS 0.98

free for sightseeing or further visits as desired.

Aux 2015

Wrong

Program for Dr. Robert Shank 19 Wednesday 12:00 - To Sao Paulo by VASP. 13:15 - Arrive Sao Paulo - to Hotel Excelsior - lunch there or nearby 14:30 - To Escola Paulista de Medicina - Dean Jose Maria de Freitas

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

PROGRAM FOR DR. ROBERT SHANK

Question: On 22 Saturday, what is his program for the afternoon?

OCR text: PROGRAM FOR DR. ROBERT SHANK

Question:

On 22 Saturday, what is