Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyjgx0227_5.png

Which country's document is this based on the "Printed" details at the footer?

OCR text of the page · 458 characters; the scanned image itself is not published
AN ORIGINAL POLAROID LAND PHOTOGRAPH
SUBJECT
DATE
NAME
ADDRESS
REGULAR SIZE COPIES
For your convenience
when ordering copies,
indicate the number of
WALLET SIZE COPIES
copies desired in the
appropriate box for the
5 x 7 ENLARGEMENTS
size(s) you select.
You can get quality work
by Polaroid Copy Service
8 x 10 ENLARGEMENTS
through your dealer or
by mail.
35mm SLIDES
P558B-1 4/72
Printed in U.S.A.
Source: https://www.industrydocuments.ucsf edu/docs/vigx0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
U.S.A.
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

U.S.A.

6 characters5 tokens

Aux 2015

Wrong

The document is based on the "Printed" details at the footer, which indicates it is a printed document.

103 characters24 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

OCR text: AN ORIGINAL POLAROID LAND PHOTOGRAPH SUBJECT DATE NAME ADDRESS REGULAR SIZE COPIES copies desired in the 5 x 7 ENLARGEMENTS size(s) you select.

153 characters64 tokens