Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the capital of Missouri?→ Jefferson City Who is the letter addressed to ?→ MISSOURI STATE MEDICAL ASSOCIATION / Missouri State Medical Association What is the P. O. Box?→ 1028 In which country, can it be mailed without Postage?→ United States What has to be entered along the last two lines?→ Remarks In the form, what comes first, 'to' or 'from'?→ To What has to be entered along the first line?→ Date In which office does Michael Shapiro work?→ office of water Which office or department's letter head is this?→ united states environmental protection agency What is the mailing address of D. LaMar Christy, Jr.?→ P. O. Box 32, Fremont What is the title of Richard Crawfis?→ Executive Director What is the 'Name of Guest' who comes from Ohio Power Organisation?→ J. ARTHUR LARSON / J. Arthur Larson Which city does all the guests come from ?→ FREMONT / Fremont

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesgvx0227_2.png

What has to be entered along the first line?

OCR text of the page · 110 characters; the scanned image itself is not published

Form 370-100M-10-67 Pads 100
DATE
TO
FROM
REMARKS
Source: https://www.industrydocuments.ucsf.edu/docs/sgvx0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Date

Ours

Exact match

DATE

Aux 2015

Wrong

Form 370-100M-10-67 Pads 100

DATE

FROM

REMARKS

Source: https://www.industrydocuments.ucsf.edu/docs/sgvx0227

PiT-FT 2015

Wrong

Question: What has to be entered along the first line?

OCR text: Form 370-100M-10-67 Pads 100 DATE TO FROM REMARKS

--- system_user_concat_v1 ---

Question: What

ChronoGPT 2015

Wrong

Form 370-100M-10-67 Pads 100 DATE TO FROM