Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxyn0081_14.png

What are the non menthol brands ?

OCR text of the page · 267 characters; the scanned image itself is not published
Questionnaire
HH Census
Consumption
Usual Brand
Current Brand
Purchase Patterns
ASET Tracker
(18-34)
(18-24)
Non-Menthol
Menthol
CAMEL/Marlboro
SALEM/Newport
Demographics
25+
NOW/Carlton
CAMBRIDGE/Bristol
CAMEL Cash 18+
CAMEL Wides
A&U 18+
Research Recruit
51337 6218
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Camel/Marlboro
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

CAMEL Cash 18+, CAMEL Wides, A&U 18+

36 characters22 tokens

Aux 2015

Wrong

Questionnaire HH Census Consumption Usual Brand Current Brand Purchase Patterns ASET Tracker (18-34) (18-24) Non-Menthol Menthol CAMEL/Marlboro SALEM/Newport Demographics 25

173 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

CAMEL/Marlboro CAMEL Cash 18+ ASET Tracker (18-34) (18-24) Non-Menthol Menthol SALEM/Newport Demographics 25+ Now/Carlton CAMBRIDGE

131 characters64 tokens