Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqznm0227_1.png

What is the date sealed in the ‘letter’?

OCR text of the page · 214 characters; the scanned image itself is not published
fire: Heing Endowment:
Penn state
MAY 1 5 1980
DR. DARBY.
this is not quite complete-
I'll put the rest in the mail
tomorrow.
Helen. D.
Budget ma'd 5/ 16
Source: https://www.industrydocuments.ucsf.edu/docs/gznm0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
may 15 1980May 15 1980
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Budget ma'd 5/ 16

17 characters10 tokens

Aux 2015

Partial · ANLS 0.91

May 1 1980

10 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

chronoGPT

Input:

chronoGPT

Input:

chronoGPT

Input:

chronoGPT

Input:

chronoG

99 characters64 tokens