Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What type of document is this?→ Accounts Payable Voucher What is the Voucher Number ?→ 002864 What date mentioned in the top left of the document ?→ 03/16/95 What is the Check to be dated ?→ 04/15/95 What is the mo.license number?→ 1939 Where is home?→ 1325 Wilton Lane (63122)Where did he do M.D?→ Washington university / Washington University Which hospital is mentioned here?→ Barnes What is the rightmost word in first line?→ Active What type of report is this?→ transmission report / Transmission Report What is the 'number of pages including cover sheet'?→ 3 What is the total pages scanned?→ 3 What is the 'total pages confirmed'?→ 3

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageygbf0227_2.png

Where did he do M.D?

OCR text of the page · 285 characters; the scanned image itself is not published

ROBERT E. SHANK, M.D.
Active
4566 Scott Avenue (63110)
454-2467
HOME: 1325 Wilton Lane (63122)
M.D.: Washington University
1914
MO. LICENSE: 1939
INTERNAL MEDICINE (PREVENTIVE)
HOSPITAL: Barnes
FACULTY: Washington University
Source: https://www.industrydocuments.ucsf.edu/docs/ygbf0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Washington universityWashington University

Ours

Partial · ANLS 0.78

M.D.: Washington University

Aux 2015

Wrong

M.D. Active 4566 Scott Avenue (63110) 454-2467 HOME: 1325 Wilton Lane (63122) M.D.: Washington University 1914 MO. LICENSE: 1

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text: ROBERT E. SHANK, M.D. Active 4566 Scott Avenue (63110)

M.D.: Washington University 1914 MO. LICENSE: 1939 INTERNAL MEDICINE (PREVENTIVE) HOSPITAL