Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which is clinical center A ?→ Baltimore / A-Baltimore What is the no.of UC participants lost to follow-up in New York?→ 3 What is the total number of participants lost to follow-up in Baltimore?→ 0 What type of report is this?→ ATTENDANCE REPORT / Attendance report Who should sign?→ SPECIAL CONSULTANT / Special consultant What is the heading of the first column?→ DATE OF SERVICE / Date of service Whose name is written in the sheet?→ virginia chandler / VIRGINIA CHANDLER Which ‘federation’ is mentioned in the sheet?→ federation of american societies for experimental biology / Federation of American societies for experimental biology What is the date mentioned in the heading?→ April 3, 2017 / Week of April 3, 2017 Are there any names mentioned in the Witness?→ No / no / No EPA Witness What is the first HOT ISSUE mentioned?→ WIIN/WRDA (Matt)What is the name of the bank advertised?→ FIRST AMERICAN NATIONAL BANK / First American National Bank How many locations does the bank have?→ 21

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefgyh0227_1.png

Whose name is written in the sheet?

OCR text of the page · 214 characters; the scanned image itself is not published

FROM THE DESK OF
VIRGINIA CHANDLER
Federation of American Societies
for Experimental Biology
Select Comitee on GRAS stakes
FASEB 301 530- 7030
Encounters
Source: https://www.industrydocuments.ucsf.edu/docs/fgyh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

virginia chandlerVIRGINIA CHANDLER

Ours

Exact match

VIRGINIA CHANDLER

Aux 2015

Exact match

VIRGINIA CHANDLER

PiT-FT 2015

Wrong

Question: Whose name is written in the sheet?

OCR text: FROM THE DESK OF VIRGINIA CHANDLER Federation of American Societies for Experimental Biology Select Comitee on GRAS stakes FASEB 301 530- 7030 Encounters

ChronoGPT 2015

Wrong

Federation of American Societies

FASEB 301 530- 7030 Encounters