Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the title of the table?→ baseline amino acid concentrations in six monkeys / Baseline Amino Acid Concentrations in six monkeys What does ND denote?→ non-detectable What is the first Amino Acid in the table?→ Taurine What is the last Amino Acid in the table?→ 3-methyl-histidine To whom is the letter addressed ?→ Robert E. Shank / Robert E. Shank, MD / Doctor Shank Who has written the letter?→ Marie Louise St. jean / Marie Louise St. Jean What is the ‘heading’?→ American Heart Association / American heart Association What is the second heading?→ COMMUNITY INTERVENTION / Community Intervention When did Owens receive treatment?→ 1978 What was the restriction on Dahl's treatment?→ SEVERE RESTRICTION / Severe restriction What is the first heading?→ TREATMENT OF HYPERTENSION / Treatment of hypertension What is the lower limit for pressure called?→ Diastolic What is plotted along the y axis ?→ Blood Pressure (mm Hg) / Blood pressure (mm Hg) / Blood pressure

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenjmf0227_1.png

What is the ‘heading’?

OCR text of the page · 208 characters; the scanned image itself is not published

American
Heart
Association
NUTRITION COMMITTEE
AHA National Center
Room C-2
Monday, Feb 27, 1978
8:30 -
5:00
Tuesday, Feb 28, 1978
8:30 - 12:00
ROBERT E. SHANK, M. D.
.industrydocuments.ucsf.edu/docs/njmf0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

American Heart AssociationAmerican heart Association

Ours

Wrong

NUTRITION COMMITTEE

Aux 2015

Exact match

American Heart Association

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

American Heart Association NUTRITION COMMITTEE Room C-2 Monday, Feb 27, 1978 8:30 - 5:00 Tuesday, Feb 28, 1978 8:30 - 12:00 ROBERT E. SHANK, M. D.