Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesxjh0227_1.png

Who is Charlotte McDaniel?

OCR text of the page · 1,125 characters; the scanned image itself is not published
$ 1 - serial # 5476840 80A
December 31, 1970
Mrs. Ramona Olson
4441 - 47th Avenue South
Minneapolis, Minnesota 55406
Dear Mrs. Olson:
Please forgive our delay in answering your letter
of October 12. We have been in the process of reorganizing
our consumer correspondence department, and your letter was
somehow caught in the change over.
Thank you so much for taking the time to advise us
of the difficulty you had in redeeming your coupon for ten
pounds of GW sugar. We made this offer in good faith and are
most appreciative of information regarding areas in which our
consumers have had problems.
I am enclosing $1.25, in currency, which is the
redemption value of this coupon. Please accept this refund
along with our sincere apologies for any inconvenience we may
have caused you.
Thank you for using Great Western products. We hope
we may continue to count you among our consumers.
On behalf of everyone here at Great Western Sugar, I
wish you and yours a very happy and prosperous year in 1971!
Sincerely ,
Charlotte McDaniel
Public Relations Representative
Source: https://www.industrydocuments.ucsf.edu/docs/sxjh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Public Relations RepresentativePublic relations representativeGreat western company
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Public Relations Representative

31 characters4 tokens

Aux 2015

Wrong

$ 1 - serial # 5476840 80A December 31, 1970 Mrs. Ramona Olson 4441 - 47th Avenue South Minneapolis, Minnesota 55406 Dear Mrs. Olson:

133 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

#1 - The Great Western Sugar Company #2 - The Great Western Sugar Company #3 - The Great Western Sugar Company #4 - The Great Western Sugar Company #5 - The Great Western Sugar Company #6 - The Great Western Sugar Company #7 - The Great Western Sugar Company

260 characters64 tokens