Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefpmx0225_10.png

In which segment does the state which is on the north western corner fall?

OCR text of the page · 1,195 characters; the scanned image itself is not published
3. Geographic Focus
RJReynolds
KOOL will prioritize geographies and focus its marketing efforts
WA
ME
Influential multi-cultural
MT
AD
1A
cities where KOOL is
Strong share
relatively strong
growth
MN
OF
WI
WY
New York
Influential multi-cultural Share growth
Detroit
V Philadelphia
1B
cities where KOOL is
in selected
NE
Chicag
OH
D
weak
neighborhood
CO
St. Louis
MO
Large KOOL markets
Strong share
NC
2
where Newport is
growth
Angeles
SC
relatively weak
NM
tlanta
INTX Dallas
Large menthol markets
3
where both KOOL and
Moderate
STX Houston
Newport are strong
share growth
FL
New
Miami
Orleans
4
Markets where KOOL
Maintain
is weak
share
Priority 1A - Cities
Priority 1B - Cities
The market is highly concentrated - 13 cities account for 30% of ASU30 smokers, 6 states account for 30% of
Priority 2 - States
FP Menthol volume
Priority 3 - States
Performance in influential multicultural markets/neighborhoods affects larger geographies
54506 4047
Strong KOOL markets can be a source for relatively inexpensive share growth
Priority 4 - States
Contestable space in strong Newport markets is expensive
(1) States do not include contribution from cities included above
DRAFT 05/09/2006 CONFIDENTIAL
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Priority 44Priority 4 - States
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Strong Newport markets

22 characters4 tokens

Aux 2015

Wrong
  1. Geographic Focus

RJReynolds

KOOL will prioritize geographies and focus its marketing efforts WA ME Influential multi-cultural MT AD 1A cities where KOOL is Strong share relatively strong growth MN OF WI WY New

214 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

1A RJReynolds KOOL

Question:

In which segment does the state which is on the north western corner fall?

OCR text: 3. Geographical Focus RJReynolds KOOL

  1. Geographical Focus
181 characters64 tokens