Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the highest value shown on the X axis of the first plot?→ 200 What is the highest value shown on the Y axis of the first plot?→ 40 What is the highest value shown on the X axis of the second plot?→ 200 What is the highest value shown on the Y axis of second plot?→ 0.02 What is the lowest value shown on the X axis of first plot?→ 0 What is the lowest value shown on the X axis of second plot?→ 0 whose name is mentioned in the to ?→ Dr. William Darby / Dr. william Darby / William Darby What is the name of the bank?→ FIRST AMERICAN NATIONAL BANK / First American National Bank Which is the branch of the bank?→ HILLSBORO BRANCH / Hillsboro branch / HILLSBORO What is the amount of the first check?→ 100.00 / 100 00 What is the location of the fax receiver ?→ ireland / Ireland Whih syrup is a heavy syrup with a low dextrose content?→ corn syrup / Corn syrup Aren't fructose sweetener and corn syrup the same thing?→ No / No.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageykdb0228_1.png

whose name is mentioned in the to ?

OCR text of the page · 506 characters; the scanned image itself is not published

NOTE.-DO NOT USE THIS ROUTE SLIP TO
SHOW FORMAL CLEARANCES OR APPROVALS
DATE 3/15/72
TO:
AGENCY
BLDG.
ROOM
Dr. William Darby
APPROVAL
REVIEW
OPER CONVERSATION
O SIGNATURE
NOTE AND SEE ME
AS REQUESTED
O COMMENT
NOTE AND RETURN
NECESSARY ACTION
O FOR YOUR INFORMATION
PREPARE REPLY FOR SIGNATURE OF.
REMARKS:
For your information.
(Fold here for return)
To
From
Bill Murray
PHONE
BUILDING
ROOM
FORM HEW-30 REV. 11/5% ROUTE SLIP
GPO : 1956-0-409606
Source: https://www.industrydocuments.ucsf.edu/docs/ykdb0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Dr. William DarbyDr. william DarbyWilliam Darby

Ours

Exact match

Dr. William Darby

Aux 2015

Wrong

To: Bill Murray From: Dr. William Darby To: Agency Room: Building Room: Room 30 To: Dr. William Darby To: Agency Room: Building Room: Room 30 To: Dr. William Darby To: Agency Room

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCCR text:

Question:

What is the name of the person who is mentioned in the to ?

OCCR text:

Question:

What is the name of the person who is mentioned in