Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxwv0228_1.png

To whom the ‘memorandum ’ is written ?

OCR text of the page · 629 characters; the scanned image itself is not published
AMERICAN
REC'D APR 1 5 1982
MEAT
INSTITUTE
Serving The Meat Industry Since 1906
March 31, 1982
MEMORANDUM
To :
FMI Workshop Speakers
From :
MEM
Re :
"Odds and Ends"
FMI staff reminds me to urge you to return your permission
to record forms. If you have not sent it in, (it is in
the FMI speakers manual) I have enclosed another copy for
your convenience.
For those of you who need equipment and have not let me
know, FMI also needs a listing of it soon. Just call me!
P.O. Box 3556, Washington, D.C. 20007 . 1700 North Moore Street, Arlington, VA. 22209 . 703/841-2400
Source: https://www.industrydocuments.ucsf.edu/docs/fxwy0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
fmi workshop speakersFMI Workshop Speakers
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

FMI Workshop Speakers

21 characters5 tokens

Aux 2015

Wrong

To whom the 'memorandum' is written.

36 characters12 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
FMI Workshop Speakers

FMI Workshop Speakers

FMI Workshop Speakers

The same 23-character fragment repeats 9 times until the token limit. Showing the first three.

208 characters64 tokens