Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegpnn0081_4.png

Which brand shows a decline in performance?

OCR text of the page · 208 characters; the scanned image itself is not published
VI. PREVIOUS PERFORMANCE
POMONA OCT. '91 VS. JAN. '92
CAMEL GROWTH - INDEX 109
ALL OTHER RJR BRANDS HELD STEADY
MARLBORO SHOWED A SLIGHT DECLINE - INDEX 98
TREMENDOUS SAVINGS DIFFERENCE - INDEX 300
51338 6009
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
marlboroMarlboro
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Camel

5 characters3 tokens

Aux 2015

Wrong

CAMEL GROWTH - INDEX 109

24 characters13 tokens

PiT-FT 2015

Wrong

<|user|>

<|user|>

<|user|>

<|user|>

<|user|>

<|user|>

<|user|>

<|user|>

<|user|>

91 characters64 tokens

ChronoGPT 2015

Wrong

VIII. PREVIOUS PERFORMANCE POMONA Oct. '91 VS. JAN. '92 CAMEL GROWTH - INDEX 109 ALL OTHER RJR BRANDS HELD STEADY MARIBORO SHOWED A SLIGHT DECLINE - IND

152 characters64 tokens