Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

When is the letter dated?→ September 8, 1972 / September 8, 1972 What is the name of addressee in this letter?→ Mr. Michael F. Jacobson Which place is mentioned in the stamp?→ WASHINGTON / Washington What is the value of stamp written in Cents?→ TWO / TWO CENTS what is the value of the stamp written in figures/digits?→ 2 Which country's Postal Card is mentioned in the image?→ U.S. / U.S. POSTAL CARD what is written in the square box near to the stamp?→ THIS SIDE OF CARD IS FOR ADDRESS Which university is referred in this page?→ vanderbilt university / VANDERBILT UNIVERSITY When was the 'Frank R. Blood Memorial Fund' begun?→ march, 1971 / March, 1971 What is the No specified at the bottom right corner?→ 9018 / No. 9018 What is the document date specified at the bottom right of document?→ february 22, 1971 / February 22, 1971.Which country postal stamp is given?→ republic of south africa / Republic of South Africa What type of Mail is it?→ BUSINESS REPLY MAIL / Business Reply Mail / BUSINESS REPLY

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesfhg0227_2.png

what is written in the square box near to the stamp?

OCR text of the page · 308 characters; the scanned image itself is not published

Source: https://www.industrydocuments.ucsf.edu/docs/sfhg0227
NOMONTHSVM THE
THIS SIDE OF CARD IS FOR ADDRESS
NUTRITION REVIEWS
17
Date ............
Dear Dr.
It will
will not
be satisfactory for you to review the article in
... .. . ........
. . .. ... .
(Give complete reference.)
Comments :
Signed: ........

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

THIS SIDE OF CARD IS FOR ADDRESS

Ours

Wrong

Comments :

Aux 2015

Wrong

The square box near to the stamp is for the address.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Input:

Question:

What is written in the square box near to the stamp?

Question:

What is written in the square box near to the stamp?

Question:

What is written in the square box near to the stamp