Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqqvf0227_1.png

What is the heading in bold text at the top of the advertisement?

OCR text of the page · 647 characters; the scanned image itself is not published
The best thing
between two sandwiches.
Soft drinks go with all kinds of
drinks contain the purest, filtered water.
sandwiches. Round ones, square ones,
So sandwich soft drinks among
fat ones and lean ones.
your sandwiches. And celebrate Na-
Not only do they quench large
tional Sandwich Month every month in
thirsts in a fun way; they also help bal-
the year.
ance the diet. After all, healthy bodies
For information on soft drinks and
need 5 to 6 glasses of water a day. Soft the balanced diet, write:
NATIONAL SOFT DRINK ASSOCIATIONS
1128 SIXTEENTH ST., N. W., WASHINGTON, D. C. 20036
Source: https://www.industrydocuments.ucsf.edu/docs/qqvf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
The best thing between two sandwichesThe best thing between two sandwiches.
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

National Soft Drink Associations

32 characters5 tokens

Aux 2015

Wrong

The best thing

14 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

soft drinks and sandwiches.

27 characters5 tokens