Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqhym0081_1.png

What is the smooth move when the beach party begins?

OCR text of the page · 770 characters; the scanned image itself is not published
Smooth
character
Foolproof
How To
dating advice
impress someone
at the beach
SMOOTH
MS GS# 325
SMOOTH
Never date a woman named Dove.
1. Run into the water, grab someone and drag her back
Never date a woman who has
to the shore, as if you've saved her from drowning
12 older brothers.
The more she kicks and screams, the better.
Never date a woman whose
2. If you're overweight, lie on
father is called "Captain."
a towel with vertical stripes.
Always break the ice
3. " you're underweight, lie on
by offering her a Camel.
a towel with horizontal stripes.
4. Always have plenty of Came's
ready when the beach
party begins.
REYNOLDS TOBACCO CO
SURGEON GENERAL'S WARNING: Cigarette
Smoke Contains Carbon Monoxide.
LOOK FOR MORE
SMOOTH MOVES
COMING YOUR
WAY SOON.
51359 3597
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
always have plenty of camels ready when the beach party begins.Always have plenty of Camels ready when the beach party begins.
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.98

Always have plenty of Camel's ready when the beach party begins.

64 characters14 tokens

Aux 2015

Wrong

51359 3597

10 characters11 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Smooth character Foolproof How To dating advice impress someone at the beach SMOOTH

Smooth

92 characters34 tokens