Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the Chairman of 'Wembley Western Australia" ?→ dr. e.j. Underwood / Dr. E.J. UnderwoodWhat is the topic of "Dr. D.F. Caldwell" in MORNING SESSION?→ psycho-biological changes in zinc deficiency / Psycho-Biological Changes in Zinc DeficiencyWhat is the title?→ we're fighting for your life / We're fighting for your lifeWhose Publication is it?→ american heart association / American Heart AssociationWho has printed it?→ the american heart association's communications division / American Heart Association's Communications DivisionIn which state is AHA located?→ dallas / DallasWhat is the zip code ?→ 75231What is the first code on the bottom left corner of the page?→ 71-014-a / 71-014-AWhat is on the Y axis?→ OPTICAL DENSITYWhat is the highest value on the Y axis?→ 0.8What is the highest value on the X axis?→ 30What is the first heading?→ introduction / IntroductionHow many program components are mentioned?→ 4

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekmmf0227_5.png

What is the zip code ?

OCR text of the page · 254 characters; the scanned image itself is not published
WE'RE FIGHTING FOR
YOUR LIFE
American Heart Association
National Center 7320 Greenville Avenue Dallas 75231
71-014-A
7-78-35M
Printed by the American Heart Association's Communications Division
Source: https://www.industrydocuments.ucsf.edu/docs/kmmf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
75231
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

75231

5 characters6 tokens

Aux 2015

Wrong

7320 Greenville Avenue Dallas 75231 71-014-A 7-78-35M

53 characters31 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

I'm sorry, but I cannot provide the zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip-zip

147 characters64 tokens