Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethvd0227_1.png

Who wrote this Memorandum?

OCR text of the page · 699 characters; the scanned image itself is not published
WASHINGTON
UNIVERSITY
SCHOOL OF MEDICINE
SAINT LOUIS
660 SOUTH KINGSHIGHWAY BLVD.
OFFICE OF THE DEAN
December 11, 1967
MEMORANDUM
TO: DEPARTMENT HEADS
FROM: DEAN'S OFFICE
SUBJECT:
Change of Due Dates for Monthly Payroll Recommendations
for December
- Academic and Nonacademic
Due to the decreased number of working days available to
process payrolls during this month, the Payroll Office on the Main
Campus has changed the deadline for December. To accomodate their
deadline, it becomes necessary to request your December payroll
recommendations as soon as possible, but no later than December 14,
1967.
The paychecks will be issued in the usual manner at 2:00
p.m. on December 29, 1967. (No change)
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
dean's officeDEAN'S OFFICE
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

DEAN'S OFFICE

13 characters6 tokens

Aux 2015

Wrong

To whom it may concern:

The Payroll Office on the Main Campus has changed the deadline for December. To accomodate their deadline, it becomes necessary to request your December payroll recommendations as soon as possible, but no later than December 14, 1967.

The paychecks will be issued

289 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

OCR text:

23 characters9 tokens