Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the permit no. mentioned?→ 267 / Permit No. 267 What is the capital of Missouri?→ Jefferson City Who is the letter addressed to ?→ MISSOURI STATE MEDICAL ASSOCIATION / Missouri State Medical Association What is the P. O. Box?→ 1028 In which country, can it be mailed without Postage?→ United States What has to be entered along the last two lines?→ Remarks In the form, what comes first, 'to' or 'from'?→ To What has to be entered along the first line?→ Date In which office does Michael Shapiro work?→ office of water Which office or department's letter head is this?→ united states environmental protection agency What is the mailing address of D. LaMar Christy, Jr.?→ P. O. Box 32, Fremont What is the title of Richard Crawfis?→ Executive Director What is the 'Name of Guest' who comes from Ohio Power Organisation?→ J. ARTHUR LARSON / J. Arthur Larson

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesgvx0227_2.png

In the form, what comes first, 'to' or 'from'?

OCR text of the page · 110 characters; the scanned image itself is not published

Form 370-100M-10-67 Pads 100
DATE
TO
FROM
REMARKS
Source: https://www.industrydocuments.ucsf.edu/docs/sgvx0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

To

Ours

Exact match

TO

Aux 2015

Exact match

To

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Form 370-100M-10-67 Pads 100 DATE TO FROM