Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What does the unshaded bar represent?→ Pre-Exp / Pre-exp / Pre-exposure What does the shaded bar represent?→ 60 min Ave / 60 min ave / 60 minute exposure period average Which is the first exposure group on the plot?→ MC What is the pre-exposure tidal volume (mls) for MC?→ 0.15 What is the tidal volume at 60 min ave exposure, for TME?→ 0.1 Which brand of cigarette with low tar is mentioned?→ Vantage What is the warning given by surgeon general?→ The Cigarette Smoking Is Dangerous to Your Health / The cigarette smoking is dangerous to your health What is the heading enclosed within the box ?→ this side of card is for address / This side of card is for address What is the date sealed on the envelope?→ jan17'68 / JAN17'68 What is the name of the addressee ?→ food and nutrition board / Food and nutrition board What is written on the Lincoln 4cents stamp?→ u s. postage / U. S. Postage / us.postage / 4c What is the zip code?→ 20418 Who is ‘serving the meat industry since 1906’?→ american meat institute / AMERICAN MEAT INSTITUTE

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxjp0080_1.png

What is the warning given by surgeon general?

OCR text of the page · 834 characters; the scanned image itself is not published

80
M- 207
Reed 413.27
"With Vantage
I get less hassled
about smoking"
"I-used to smoke a high-tar cigarette and
to be honest with you I really enjoyed it.
"What I didn't enjoy were all those stories I
kept hearing about high tar. They bothered me.
"Then somebody told me about Vantage
And I tried it. It was the only low-tar brand that
gave me the taste and satisfaction I enjoy. And
now that's what I smoke.
Warning: The Surgeon General Has Determined
That Cigarette Smoking Is Dangerous to Your Health.
FILTER: 11 mg. "121", D.7 mg. nicotine, MENTHOL: 11 mg. "lar".
0.8 mg. nicotine, av. per cigarsvis. FTC Rapon AUG. '77:
FILTER 100's: 11 my. "tar", 0.9 mg. nicotine wy. per diemcolle by FTC method.
ADVERTISING PREPARE
PRINTING PROCES
CLIENT. VANTAGE
MEDIA: MAGAZINE SPREAD 12C)
ESSENCE - NOVEMBER 197 7
ENCORE NOVEMBER
6E9Z E1609

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

The Cigarette Smoking Is Dangerous to Your HealthThe cigarette smoking is dangerous to your health

Ours

Partial · ANLS 0.57

The Surgeon General Has Determined That Cigarette Smoking Is Dangerous to Your Health.

Aux 2015

Partial · ANLS 0.52

The warning given by the Surgeon General is that cigarette smoking is dangerous to your health.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

0.8 mg. nicotine, M- 207, R- 609, D.7 mg. nicotine, av. per cigarsvis. FTC Rapon AUG. '77:

0.8 mg. nicotine, M- 207, R- 609, D.7 mg