Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezpkd0228_7.png

What is the name of the organization?

OCR text of the page · 436 characters; the scanned image itself is not published
AMERICAN PHYSIOLOGICAL SOCIETY
9650 WISCONSIN AVE., WASHINGTON 14, D. C.
This slip must accompany Official Institutional Purchase Order
Journal
Galley no.
Author(s)
Title of article
Quantity of reprints
ordered
. . . . . . . ... .....
with covers
. . . . . . . . . . ...... without covers
Shipping Label
Send Invoice
To:
To:
Your purchase order no.
Copies of invoice required
Source: https://www.industrydocuments.ucsf edu/docs/zpkd0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
AMERICAN PHYSIOLOGICAL SOCIETYAmerican Physiological Society
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

AMERICAN PHYSIOLOGICAL SOCIETY

30 characters9 tokens

Aux 2015

Exact match

American Physiological Society

30 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text:
[OCR text
119 characters64 tokens