Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqqvf0227_1.png

What according to the advertisement 'helps balance the diet'?

OCR text of the page · 647 characters; the scanned image itself is not published
The best thing
between two sandwiches.
Soft drinks go with all kinds of
drinks contain the purest, filtered water.
sandwiches. Round ones, square ones,
So sandwich soft drinks among
fat ones and lean ones.
your sandwiches. And celebrate Na-
Not only do they quench large
tional Sandwich Month every month in
thirsts in a fun way; they also help bal-
the year.
ance the diet. After all, healthy bodies
For information on soft drinks and
need 5 to 6 glasses of water a day. Soft the balanced diet, write:
NATIONAL SOFT DRINK ASSOCIATIONS
1128 SIXTEENTH ST., N. W., WASHINGTON, D. C. 20036
Source: https://www.industrydocuments.ucsf.edu/docs/qqvf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Soft drinkssoft drinks
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

they

4 characters2 tokens

Aux 2015

Wrong

The best thing between two sandwiches.

38 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Partial · ANLS 0.92

soft drinks.

12 characters3 tokens