Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegjdg0227_8.png

By what date, would the student have completed work?

OCR text of the page · 634 characters; the scanned image itself is not published
To :
State of California
Department of Public Health
Division of Research
(date)
2151 Berkeley Way
Berkeley 4, California
is a student in good standing at
(Professional School Name)
He (she) will have completed the
year in June, 1965.
On the basis of completed work, his (her) relative class standing is in
the :
highest quarter
next to highest quarter
next to lowest quarter
lowest quarter
class standing not available
Remarks :
This student's present scholastic record is:
satisfactory
unsatisfactory
Signed.
Dean,
(Professional School)
or if authorized representative give
title.
Source: https://www.industrydocuments.ucsf.edu/docs
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
June, 1965
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

June, 1965

10 characters8 tokens

Aux 2015

Wrong

To : State of California Department of Public Health Division of Research (date) 2151 Berkeley Way Berkeley 4, California is a student in good standing at (Professional School Name) He (she) will have completed the year in June, 196

232 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

satisfactory satisfactory

25 characters7 tokens