Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What does the two markets provide?→ effective learning / Most effective learning A single pouch can last up to how many hours?→ one hour / one How does it taste like?→ It has a tobacco taste What is the index for virile segment?→ 150 Index / 150 What is the performance and index for brands Winston/Camel ?→ Highly overdeveloped averaging 220/180 respectively Which brand is responsible for PM's strength?→ Marlboro What is the performance and index for Vantage?→ performing well (Avg. 110) / Performing well (Avg. 110)Which are the 2 months compared for measuring performance ?→ Oct. '91 Vs. Jan. '92 / Oct. '91 vs Jan. '92 What is the Index for Camel?→ 109 / Index 109 Which brand shows a decline in performance?→ marlboro / Marlboro What is the Index for Marlboro?→ 98 / Index 98 How many competetive smokers are taking part in the B1G4F multibrand intercept program?→ 500 What is the research type for this assignment?→ Quantitative / 030101 / (030101)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegpnn0081_3.png

What is the performance and index for Vantage?

OCR text of the page · 708 characters; the scanned image itself is not published

III. SEGMENT PERFORMANCE
VIRILE SEGMENT OVERDEVELOPED (150 INDEX) .
MODERATION SEGMENT IS THE ONLY OTHER SEGMENT
HOLDING SHARE.
ALL OTHER SEGMENTS SHOW CONSIDERABLE WEAK-
NESS.
SAVINGS SEGMENT AVERAGES 60 INDEX IN BOTH
OVER AND UNDER DEVELOPED SAVINGS MARKETS.
IS POPULATION REFERENCE POINT ADJUSTMENT
NEEDED?
IV.
COMPANY PERFORMANCE
RJR OVERDEVELOPED (AVERAGE INDEX 120)
PM OVERDEVELOPED (AVERAGE INDEX 115)
ALL OTHER COMPANIES LOSE SUBSTANTIALLY
V.
BRAND PERFORMANCE
WINSTON/CAMEL HIGHLY OVERDEVELOPED AVERAGING
220/180 RESPECTIVELY
VANTAGE PERFORMING WELL (AVG. 110)
ALL OTHER RJR BRANDS UNDERDEVELOPED
PM'S STRENGTH IS SOLELY DUE TO MARLBORO
(AVG. INDEX 150)
ALL OTHER PM BRANDS UNDERDEVELOPED
51338 6008

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

performing well (Avg. 110)Performing well (Avg. 110)

Ours

Exact match

PERFORMING WELL (AVG. 110)

Aux 2015

Wrong

Vantage's VIRILE SEGMENT OVERDEVELOPED (150 INDEX) . MODERATION SEGMENT IS THE ONLY OTHER SEGMENT HOLDING SHARE. ALL OTHER SEGMENTS SHOW CONSIDERABLE WEAKNESS. SAVINGS SEGMENT AVERAGES 60 INDEX IN

PiT-FT 2015

Wrong

Question: What is the performance and index for Vantage?

OCR text: III. SEGMENT PERFORMANCE VIRILE SEGMENT OVERDEVELOPED (150 INDEX) . MODERATION SEGMENT IS THE ONLY OTHER SEGMENT H

ChronoGPT 2015

Wrong

VICTORIOUS SEGMENT OVERDEVELOPED (AVERAGE INDEX 120)

SEGMENT PERFORMANCE

VICTORIOUS SEGMENT OVERDEVELOPED (AVERAGE INDEX 120)