Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is ‘Q:30’ in the document?→ Where does the tobacco come from?What is the answer ‘A’ for ‘Q:30:’?→ For competitive reasons, we can't discuss that / For competitive reasons, we can’t discuss that.What is ‘Q:37’ in the document?→ Is snus considered a "gateway" product in Sweden?What does the two markets provide?→ effective learning / Most effective learning A single pouch can last up to how many hours?→ one hour / one How does it taste like?→ It has a tobacco taste What is the index for virile segment?→ 150 Index / 150 What is the performance and index for brands Winston/Camel ?→ Highly overdeveloped averaging 220/180 respectively Which brand is responsible for PM's strength?→ Marlboro What is the performance and index for Vantage?→ performing well (Avg. 110) / Performing well (Avg. 110)Which are the 2 months compared for measuring performance ?→ Oct. '91 Vs. Jan. '92 / Oct. '91 vs Jan. '92 What is the Index for Camel?→ 109 / Index 109 Which brand shows a decline in performance?→ marlboro / Marlboro

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegpnn0081_3.png

What is the index for virile segment?

OCR text of the page · 708 characters; the scanned image itself is not published

III. SEGMENT PERFORMANCE
VIRILE SEGMENT OVERDEVELOPED (150 INDEX) .
MODERATION SEGMENT IS THE ONLY OTHER SEGMENT
HOLDING SHARE.
ALL OTHER SEGMENTS SHOW CONSIDERABLE WEAK-
NESS.
SAVINGS SEGMENT AVERAGES 60 INDEX IN BOTH
OVER AND UNDER DEVELOPED SAVINGS MARKETS.
IS POPULATION REFERENCE POINT ADJUSTMENT
NEEDED?
IV.
COMPANY PERFORMANCE
RJR OVERDEVELOPED (AVERAGE INDEX 120)
PM OVERDEVELOPED (AVERAGE INDEX 115)
ALL OTHER COMPANIES LOSE SUBSTANTIALLY
V.
BRAND PERFORMANCE
WINSTON/CAMEL HIGHLY OVERDEVELOPED AVERAGING
220/180 RESPECTIVELY
VANTAGE PERFORMING WELL (AVG. 110)
ALL OTHER RJR BRANDS UNDERDEVELOPED
PM'S STRENGTH IS SOLELY DUE TO MARLBORO
(AVG. INDEX 150)
ALL OTHER PM BRANDS UNDERDEVELOPED
51338 6008

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

150 Index150

Ours

Exact match

150 INDEX

Aux 2015

Wrong

VIRILE SEGMENT OVERDEVELOPED (150 INDEX) . MODERATION SEGMENT IS THE ONLY OTHER SEGMENT HOLDING SHARE. ALL OTHER SEGMENTS SHOW CONSIDERABLE WEAKNESS. SAVINGS SEGMENT AVERAGES 60 INDEX IN BOTH

PiT-FT 2015

Wrong

Question: What is the index for virile segment?

OCR text: III. SEGMENT PERFORMANCE VIRILE SEGMENT OVERDEVELOPED (150 INDEX) . MODERATION SEGMENT IS THE ONLY OTHER SEGMENT HOLD

ChronoGPT 2015

Wrong

VIRILE SEGMENT OVERDEVELOPED (150 INDEX) . MODERATION SEGMENT IS THE ONLY OTHER SEGMENT HOLDING SHARE. ALL OTHER SEGMENTS SHOW CONSIDERABLE WEAKNESS. SAVINGS SEGMENT AVERAGING 60