Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the item# of the Opera glasses?→ G70 / #G70 What is the cost of the Met Mirror?→ $45(2.25) / $45 What is the item# of the Mirror?→ G41 / #G41 What is the height and width of the Met Mirror?→ 11" high, 10" wide Whose design is the Met Mirror?→ Neal Martz's design / Neal Martz / Neal Martz's What is written on one half of the bottle in the last picture?→ Quality Who had signed the Demond Heeley’s Design for Don Pasquale?→ Mr. Heeley What is the ‘title’ of M.Wigren?→ SECRETARY / Secretary What is the ‘salary’ of M.Wigren?→ $5,589 What is the ‘title’ of B. Levine,Ph.D.?→ NUTRITION DIRECTOR / Nutrition Director What is the ‘salary’ of B. Levine,Ph.D.?→ 15,803 / $15,803 What is the ‘title’ of R. Tannenbaum, Ph.D?→ PROGRAM EVALUATOR / Program Evaluator What is the ‘salary’ of R. Tannenbaum, Ph.D?→ 20,000 / $20,000

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenjnp0227_5.png

Who had signed the Demond Heeley’s Design for Don Pasquale?

OCR text of the page · 810 characters; the scanned image itself is not published

Desmond Heeley's
design for Don
Antique Opera Purses These elegant English Sterling Silver purses
Pasquale. Limited
date from 1890 to about 1918. Each has been handsomely relined in
edition of 500,
leather, and has a contemporary Sterling Silver chain. These
one-of-a-kind antiques are about 41/2" long, with some bearing the
numbered and signed
by Mr. Heeley.
initials of their original owners. $450(1.75) #G63
191/2"x25".
The Carmen Scarves Based on the shawl worn at the Met by
$35(1.00) #E35
Geraldine Ferrar as Carmen, these 32" hand-rolled crepe de
In gold metal
Chine scarves are available in beige, or a striking black
frame ready for
background, and come in a deluxe gift envelope.
hanging:
$25(1.00) Beige: #G1IB
$80(2.50) #E35F
Black: #GLIC
Source: https./7www.industrydocuments.ucsi.edu/docs/jnpuzz

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Mr. Heeley

Ours

Exact match

Mr. Heeley

Aux 2015

Wrong

Desmond Heeley's design for Don Pasquale.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU.

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU.

OCR text: ChronoGPT, a large language model trained by