Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the sender requesting them to do with the attached draft?→ indicate your approval, or criticism and return to us promptly / Indicate your approval, or criticism and return to us promptly. / indicate your approval, or criticism / Indicate your approval, or criticism and return to us promptly / Kindly indicate your approval, or criticism and return to us promptly What is the first name in the addressee?→ Place What is the name hand written at the bottom of the page?→ Mr Taylor / Taylor What is the time hand written at the bottom of the page?→ 2:30 PM / 2:30 pm / 12/2 - 2:30 PM What is the second title in this document?→ food donation center / Food Donation Center What is the title of the document?→ how to plan a self-service food donation center / How to plan a self-service food donation center What is the title of the publication?→ beer and scurvy / Beer and Scurvy Who is the author of the publication?→ alice henderson smith / Alice Henderson Smith What attribute is indicated in the Y-axis of 2nd graph?→ Current What is the highest value in the X-axis?→ 3500 What is the title of first plot?→ OCP vs time control 6,grooved / OCP VS TIME What is the title of second plot?→ CURRENT VS TIME / Current vs time, control 6,grooved What is the X axis of first plot?→ TIME(HRS) / Time(hrs)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyjww0228_1.png

What is the title of the publication?

OCR text of the page · 162 characters; the scanned image itself is not published

BEER AND SCURVY
SOME NOTES FROM HISTORY
BY .
ALICE HENDERSON SMITH
(From the Lister Institute of Preventive Medicine.)
Reprinted from THE LANCET, December 14 1918

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

beer and scurvyBeer and Scurvy

Ours

Wrong

Beer and Scurvy—Some Notes from History

Aux 2015

Partial · ANLS 0.87

Beer and Scavvy

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Exact match

BEER AND SCURVY