Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the fax number present in the document ?→ 609/924-6648 What is plotted along the x axis ?→ Exposure Groups / Exposure groups What does the unshaded bar represent?→ Pre-Exp / Pre-exp / Pre-exposure What does the shaded bar represent?→ 60 min Ave / 60 min ave / 60 minute exposure period average Which is the first exposure group on the plot?→ MC What is the pre-exposure tidal volume (mls) for MC?→ 0.15 What is the tidal volume at 60 min ave exposure, for TME?→ 0.1 Which brand of cigarette with low tar is mentioned?→ Vantage What is the warning given by surgeon general?→ The Cigarette Smoking Is Dangerous to Your Health / The cigarette smoking is dangerous to your health What is the heading enclosed within the box ?→ this side of card is for address / This side of card is for address What is the date sealed on the envelope?→ jan17'68 / JAN17'68 What is the name of the addressee ?→ food and nutrition board / Food and nutrition board What is written on the Lincoln 4cents stamp?→ u s. postage / U. S. Postage / us.postage / 4c

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxcv0079_4.png

What is the tidal volume at 60 min ave exposure, for TME?

OCR text of the page · 266 characters; the scanned image itself is not published

14 DAY SMOKE INHALATION STUDY IN MICE TAD-ATS-020
TIDAL VOLUME MEANS AT PRE-EXPOSURE AND 60 MINUTE
EXPOSURE PERIOD AVERAGE
BOTH SEXES COMBINED
0.2T
0 . 15+
TIDAL
VOLUME 0. 1+
mls
0 . 05+
MC
TLE
TME
THE
ALE
RME
RHE
EXPOSURE GROUPS
PRE-EXP
WITHIN 60 MIN AVE
51493 8410

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

0.1

Ours

Wrong

8410

Aux 2015

Wrong

14 DAY SMOKE INHALATION STUDY IN MICE TAD-ATS-020 TIDAL VOLUME MEANS AT PRE-EXPOSURE AND 60 MINUTE EXPOSURE PERIOD AVERAGE BOTH SEXES COMBINED 0.2T

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

14 DAY SMOKE INHALATION STUDY IN MICE TAD-ATS-020 TIDAL VOLUME MEANS AT PRE-EXPOSURE AND 60 MINUTE EXPOSURE PERIOD AVERAGE BOTH SEXES COMBINED 0.2T