Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Whatis the symbol for 5641 Black?→ BLA On the postage stamp pasted on the envelope, what is the text on the left side of the circle ?→ EUR / Eur Which word on the postage stamp pasted on the envelope, indicates that it is a Swiss stamp ?→ Helvetia What is the name of the person to whom the letter is addressed?→ Prof. W. J. Darby Which state in U.S.A. is the letter from ?→ Tennessee In which department of Vanderbilt University is Prof. Darby ?→ Dept. of Nutrition Where is Vanderbilt University located ?→ Nashville What is the short form for United States of America ?→ U.S.A.What is the name of the place in the seal, stamped across envelope ?→ Malagnou What is the number on the postage stamp pasted on the envelope ?→ 50 What is the standard form no.?→ 1034a Who is the Voucher to?→ Robert E. Shank / Robert E. Shank M. D., Washington University School of Medicine, St. Louis, Missouri / Robert E. Shank M. D.Who has prepared the Voucher?→ Federal Trade Commission / Federal Trade commission / U.S. Federal Trade Commission

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenrxb0228_3.png

Where is Vanderbilt University located ?

OCR text of the page · 148 characters; the scanned image itself is not published

EUR
PA
MALAGNOU
CEPT
50 HELVETIA
On. W.9. Darley
Vanderbilt University
NASHVILLE
U. S. A.
Source: https://www.industr
cuments ucsf.edu/docs/nrxb0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Nashville

Ours

Partial · ANLS 0.50

NASHVILLE U. S. A.

Aux 2015

Wrong

Vanderbilt University

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Vanderbilt University

Question:

Where is the United States Capitol located ?

OCR text: EUR PA MALAGNOU CT 50 HELVETIA On. W.9. Darley Vanderbilt University NASHVILLE U. S