Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefncj0037_1.png

What is the heading of the table?

OCR text of the page · 621 characters; the scanned image itself is not published
B&W) PROTECTED BY MINNESOTA TOBACCO LITIGATION PROTECTIVE ORDER
YFM_SMOKER PROFILE
YEM
ALL SMOKERS
INDEX
SEX
MALE
47%
504
94
FEMALE
53
50
106
CONFIDENTIAL MINNESOTA TOBACCO LITIGATION
AGE
21-35
31
38
32
36+
111
INCOME
0 - $19,999
45
34
132
$20, 000 - 39, 999
34
33
10
$40, 000+
21
32
56
B&W SALES REGIONS
NORTHEAST
15
60
EAST COAST
10
80
CENTRAL
15
14
107
SOUTHEAST
10
100
SOUTH CENTRAL
14
12
117
NORTH CENTRAL
17
15
113
SOUTHWEST
11
122
WEST
36
16
100
SOURCE: TOTAL 1992 WEIGHTED BRAND/BLACK SWITCHER DATA
(SMOKERS 21 YEARS AND UP)
EGOByTJ 1.&
B12 71401
... .
Source: https://www.industrydocuments.ucsf.edu/docs/fncj0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
VFM smoker profileVFM Smoker Profile
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.78

SMOKER PROFILE

14 characters5 tokens

Aux 2015

Wrong

B&W) PROTECTED BY MINNESOTA TOBACCO LITIGATION PROTECTIVE ORDER

63 characters21 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM YEM

79 characters59 tokens