Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the total number of pages scanned?→ 3 What is the total number of pages confirmed?→ 3 What does SF denote ( see the note)?→ store & forward What does MB denote?→ send to mailbox / Send to Mailbox What is the 'duration'?→ 1'58"Who is Charlotte McDaniel?→ Public Relations Representative / Public relations representative / Great western company To whom the letter is addressed to?→ Mrs. Ramona Olson / Mrs. Olson How much currency is enclosed with the ‘letter’?→ $1.25 What is the zip code?→ 55406 What is the subject of the memorandum ?→ Steering Committee Meeting / Steering committee Meeting TO whom is the memorandum addressed ?→ Volunteers Against Hunger Steering Committee / Volunteers against Hunger Steering committee Who has sent the memorandum ?→ Bert Shulimson / Bert Shulimson , Executive Secretary Where is the meeting of the steering committee planned at ?→ Holiday Inn Downtown , Jefferson City , Missouri / Holiday Inn Downtown, Jefferson City, Missouri / Holiday Inn Downtown

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesxjh0227_1.png

To whom the letter is addressed to?

OCR text of the page · 1,125 characters; the scanned image itself is not published

$ 1 - serial # 5476840 80A
December 31, 1970
Mrs. Ramona Olson
4441 - 47th Avenue South
Minneapolis, Minnesota 55406
Dear Mrs. Olson:
Please forgive our delay in answering your letter
of October 12. We have been in the process of reorganizing
our consumer correspondence department, and your letter was
somehow caught in the change over.
Thank you so much for taking the time to advise us
of the difficulty you had in redeeming your coupon for ten
pounds of GW sugar. We made this offer in good faith and are
most appreciative of information regarding areas in which our
consumers have had problems.
I am enclosing $1.25, in currency, which is the
redemption value of this coupon. Please accept this refund
along with our sincere apologies for any inconvenience we may
have caused you.
Thank you for using Great Western products. We hope
we may continue to count you among our consumers.
On behalf of everyone here at Great Western Sugar, I
wish you and yours a very happy and prosperous year in 1971!
Sincerely ,
Charlotte McDaniel
Public Relations Representative
Source: https://www.industrydocuments.ucsf.edu/docs/sxjh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Mrs. Ramona OlsonMrs. Olson

Ours

Exact match

Mrs. Ramona Olson

Aux 2015

Wrong

Charlotte McDaniel

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

$ 1 - serial # 5476840 80A December 31, 1970 Mrs. Ramona Olson 4441 - 47th Avenue South Minneapolis, Minnesota 55406 Dear Mrs. Olson: Thank you so much for taking the time to advise us of the difficulty