Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekmmf0227_5.png

Who has printed it?

OCR text of the page · 254 characters; the scanned image itself is not published
WE'RE FIGHTING FOR
YOUR LIFE
American Heart Association
National Center 7320 Greenville Avenue Dallas 75231
71-014-A
7-78-35M
Printed by the American Heart Association's Communications Division
Source: https://www.industrydocuments.ucsf.edu/docs/kmmf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
the american heart association's communications divisionAmerican Heart Association's Communications Division
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

American Heart Association's Communications Division

52 characters7 tokens

Aux 2015

Partial · ANLS 0.50

American Heart Association

26 characters4 tokens

PiT-FT 2015

Wrong

Question: Who has printed it?

OCR text: WE'RE FIGHTING FOR YOUR LIFE American Heart Association National Center 7320 Greenville Avenue Dallas 75231 71-014-A 7-78-35M Printed by the American Heart Association's Communications Division

235 characters64 tokens

ChronoGPT 2015

Partial · ANLS 0.54

The American Heart Association

30 characters4 tokens