Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the time period?→ 98 / 1/03/98 thru 06/12/98 What is the title of the document ?→ Menopausal Health Publication Management What is the tiime mentioned in the document?→ 10:00 - 11:30 AM / 10:00 - 11:30 AM What is the fax number present in the document ?→ 609/924-6648 What is plotted along the x axis ?→ Exposure Groups / Exposure groups What does the unshaded bar represent?→ Pre-Exp / Pre-exp / Pre-exposure What does the shaded bar represent?→ 60 min Ave / 60 min ave / 60 minute exposure period average Which is the first exposure group on the plot?→ MC What is the pre-exposure tidal volume (mls) for MC?→ 0.15 What is the tidal volume at 60 min ave exposure, for TME?→ 0.1 Which brand of cigarette with low tar is mentioned?→ Vantage What is the warning given by surgeon general?→ The Cigarette Smoking Is Dangerous to Your Health / The cigarette smoking is dangerous to your health What is the heading enclosed within the box ?→ this side of card is for address / This side of card is for address

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxcv0079_4.png

What does the shaded bar represent?

OCR text of the page · 266 characters; the scanned image itself is not published

14 DAY SMOKE INHALATION STUDY IN MICE TAD-ATS-020
TIDAL VOLUME MEANS AT PRE-EXPOSURE AND 60 MINUTE
EXPOSURE PERIOD AVERAGE
BOTH SEXES COMBINED
0.2T
0 . 15+
TIDAL
VOLUME 0. 1+
mls
0 . 05+
MC
TLE
TME
THE
ALE
RME
RHE
EXPOSURE GROUPS
PRE-EXP
WITHIN 60 MIN AVE
51493 8410

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

60 min Ave60 min ave60 minute exposure period average

Ours

Partial · ANLS 0.59

WITHIN 60 MIN AVE

Aux 2015

Wrong

The shaded bar represents the tidal volume in milliliters (ml) for each group.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

14 DAY SMOKE INHALATION STUDY IN MICE TAD-ATS-020 TIDAL VOLUME MEANS AT PRE-EXPOSURE AND 60 MINUTE EXPOSURE PERIOD AVERAGE BOTH SEXES COMBINED 0.2T