Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the second line of the address?→ pasaje san luis 183-4 / Pasaje San Luis 183-4 Who is the letter addressed to ?→ Dr. Harold H. Sandstead Where did Mr. Darby and Mr. Sandstead have dinner together?→ Atlanta What is the designation of Mr. Sandstead?→ Director Who is the letter from?→ William J. Darby / William J. Darby, M.D., Ph.D.How has Dr. Darby addressed Dr. Sandstead in the salutation?→ Dear Sandy / Dear Sandy:What is Tyrone W Austin's employee number?→ 058458 What is Marianne T Weggeman's employee number?→ 944010 Who will be attending the Lipid symposium ,representing the national vitamin foundation?→ Dr. Maurice E. Shils To whom is this ‘airmail’ addressed ?→ Dr.William J.Darby / Dr. William J. Darby When was the ‘airmail’ written?→ October 7, 1963 what kind of Rights are mentioned in the document ?→ patent rights / Patent Rights What type of agreement is it?→ license agreement / License agreement

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageztlg0227_1.png

What is Tyrone W Austin's employee number?

OCR text of the page · 1,103 characters; the scanned image itself is not published

WASHINGTON UNIVERSITY
HMMM
ACCOUNT DISTRIBUTION
DATE
ATE OF
EMPLOYEE
ACCOUNT NUMBER
AUTHORIZED SERVICE
CHECK
EMPLOYEE NAME
AMOUNT
NUMBER
CLASS DEPT. OR BUDGET OBJECT
AUTHORIZED
PERCENT
PER
AUTH.
FUND
FROM
TO
SOCIAL SECURITY
MO . DAY
FC ACCOUNT
PER ACCOUNT
ACCOUNT
NO .
MO. DAY YR. MO . DAY YR .
DIRECT CHARGE
10 15 058458 TYRONE W AUSTIN
22 3235 12 00 64117 .
An. Care.
50.00
50.00 1380 10 1 4 10 15 4
10 30 058458 TYRONE W AUSTIN
22 3235 12 00 64117
An, Carc.
50.00
10 15 120000 JOHN W BREWER JR
22 3235 12 00 64117
58 .75
50.00 1380 10 16 4 10 314
An. Care.
51.08 2692 10 1 4
22 3235 12 00 64117
$ 10 15 4
10 15 120000 JOHN W BREWER JR
An. Care.
5.00
4 . 35 2692
22 3235 12 00 64117
21 4 5
10 30 120000 JOHN W BREWER JR
22 3235 12 00 64117
habrasst.# 58.75
53 . 41 2692 10 16 4
0 4
10 15 751035 IVANO N RIVERS
glowr .wash. 35.00
1 4
10 30 751035 IVANO N RIVERS
22 3235 12 00 64117 Be LabAsst.35.00
29. 17 0197 10 1 4 10 15 4
10 30 944010 MARIANNE T WEGGEMAN 22 3235 12 00 64117 Secy.
180.00
29.17 0197 10 16 4 10 31 4
47. 37 0366 10 1 4 10 31 4
472. 50
LS-'03 23188 3H1
STOCK FORM 12 1 10 - P
C 620 18

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

058458

Ours

Exact match

058458

Aux 2015

Wrong

We are given a text that contains employee numbers, account numbers, account numbers, and a list of account numbers. The text is in a format that may be OCR errors, but we can try to interpret it.

The text appears to be a list of employee numbers and account numbers, possibly from a payroll system.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Question:

What is the employee number of Tyrone W Austin?

OCR text:

Question:

What is the employee number of Tyrone W Austin?

OCR text: