Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqhym0081_1.png

What is the Surgeon General's warning?

OCR text of the page · 770 characters; the scanned image itself is not published
Smooth
character
Foolproof
How To
dating advice
impress someone
at the beach
SMOOTH
MS GS# 325
SMOOTH
Never date a woman named Dove.
1. Run into the water, grab someone and drag her back
Never date a woman who has
to the shore, as if you've saved her from drowning
12 older brothers.
The more she kicks and screams, the better.
Never date a woman whose
2. If you're overweight, lie on
father is called "Captain."
a towel with vertical stripes.
Always break the ice
3. " you're underweight, lie on
by offering her a Camel.
a towel with horizontal stripes.
4. Always have plenty of Came's
ready when the beach
party begins.
REYNOLDS TOBACCO CO
SURGEON GENERAL'S WARNING: Cigarette
Smoke Contains Carbon Monoxide.
LOOK FOR MORE
SMOOTH MOVES
COMING YOUR
WAY SOON.
51359 3597
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
cigarette smoke contains carbon monoxide.Cigarette smoke contains Carbon monoxide
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Cigarette Smoke Contains Carbon Monoxide.

41 characters10 tokens

Aux 2015

Wrong

The Surgeon General's warning is a public health advisory issued by the U.S. Surgeon General to inform the public about the dangers of smoking.

143 characters31 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Smooth character Foolproof Foolproof Smooth Smooth Smooth Smooth Smooth Smooth Smooth

85 characters33 tokens