Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagephdw0004_3.png

What is the name of the Authorized Designee ?

OCR text of the page · 907 characters; the scanned image itself is not published
Part 5.
Execution by Authorized Designee
Under penalty of perjury, I state that the information contained in this Certification is true and
accurate.
Authorized Designee (Print or Type Name): G. C. Petree
Title: Assistant Secretary
Signature of Authorized Designee:
Date :
7/24/03
Mail the completed Certificate to:
Melissa S. Whipkey
Staff Attorney/Manager - Tobacco Product Manufacturer Compliance Unit
Office of the Attorney General of Maryland
200 St. Paul Place, 20th Floor
Baltimore, Maryland 21202
TE OF NORTH CAROLINA
to wit:
COUNTY OF FORSYTH
Subscribed to and sworn to before me this 27 " day of July, 2003
by G. C. Petree, who having first been duly sworn, made oath the foregoing is accurate
and correct to the best of his knowledge and belief.
Notary Public
My Commission expires: May 4, 2008
... ... . . - -..- -- - . . .
52903 7966
Source: https://www.industrydocuments.ucsf.edu/docs/phdw0004
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
G. C. Petree
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

G. C. Petree

12 characters7 tokens

Aux 2015

Wrong

Assistant Secretary

19 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU,

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU,

Question:

What is the name of the Authorized Designee ?

218 characters64 tokens