Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerxwd0228_19.png

What is the price per copy for the booklet?

OCR text of the page · 823 characters; the scanned image itself is not published
Emulsifiers
Colors
Dough
conditioners
Creaming
Curing
Acidifiers
Air replacement
Clarifiers
Dispersing
Texturizers
Alkalizers
Solvents
Flavor
enhancers
Color
retainers
Drying
Flavors
Anticaking
"READ THE LABEL"
This 36-page, cartoon-illustrated booklet tells in simple terms
what information is required by the law to appear on the labels
of foods, drugs, medical devices, and cosmetics. The booklet,
designed to be helpful to consumers, tells what to look for on food
labels to get your money's worth; what information a drug label
must bear so that you may use the product safely. Available
from Superintendent of Documents, Government Printing Office,
Washington 25, D.C., at 20 cents (cash) per copy. On orders
for 100 or more there is a 25 percent discount.
Source: https://www.industrydocuments.ucsf.edu/docs/rxwd0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
20 cents20 cents (cash) per copy
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

20 cents (cash) per copy

24 characters9 tokens

Aux 2015

Wrong

The price per copy for the booklet is 20 cents.

47 characters14 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER, 1992

OCTOBER, 1992

OCTOBER, 1992

OCTOBER, 1992

Input:

OCTOBER, 1992

Input:

OCTOBER, 1992

112 characters64 tokens