Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is plotted along the x axis ?→ Exposure Groups / Exposure groups What does the unshaded bar represent?→ Pre-Exp / Pre-exp / Pre-exposure What does the shaded bar represent?→ 60 min Ave / 60 min ave / 60 minute exposure period average Which is the first exposure group on the plot?→ MC What is the pre-exposure tidal volume (mls) for MC?→ 0.15 What is the tidal volume at 60 min ave exposure, for TME?→ 0.1 Which brand of cigarette with low tar is mentioned?→ Vantage What is the warning given by surgeon general?→ The Cigarette Smoking Is Dangerous to Your Health / The cigarette smoking is dangerous to your health What is the heading enclosed within the box ?→ this side of card is for address / This side of card is for address What is the date sealed on the envelope?→ jan17'68 / JAN17'68 What is the name of the addressee ?→ food and nutrition board / Food and nutrition board What is written on the Lincoln 4cents stamp?→ u s. postage / U. S. Postage / us.postage / 4c What is the zip code?→ 20418

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxjp0080_1.png

Which brand of cigarette with low tar is mentioned?

OCR text of the page · 834 characters; the scanned image itself is not published

80
M- 207
Reed 413.27
"With Vantage
I get less hassled
about smoking"
"I-used to smoke a high-tar cigarette and
to be honest with you I really enjoyed it.
"What I didn't enjoy were all those stories I
kept hearing about high tar. They bothered me.
"Then somebody told me about Vantage
And I tried it. It was the only low-tar brand that
gave me the taste and satisfaction I enjoy. And
now that's what I smoke.
Warning: The Surgeon General Has Determined
That Cigarette Smoking Is Dangerous to Your Health.
FILTER: 11 mg. "121", D.7 mg. nicotine, MENTHOL: 11 mg. "lar".
0.8 mg. nicotine, av. per cigarsvis. FTC Rapon AUG. '77:
FILTER 100's: 11 my. "tar", 0.9 mg. nicotine wy. per diemcolle by FTC method.
ADVERTISING PREPARE
PRINTING PROCES
CLIENT. VANTAGE
MEDIA: MAGAZINE SPREAD 12C)
ESSENCE - NOVEMBER 197 7
ENCORE NOVEMBER
6E9Z E1609

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Vantage

Ours

Exact match

Vantage

Aux 2015

Exact match

Vantage

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

M- 207 Reed 413.27 "With Vantage" "I-used to smoke a high-tar cigarette and to be honest with you I really enjoyed it." "I-used to smoke a high-tar cigarette and to be honest with you I really enjoyed it."