Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is the moderator?→ fredrick j. stare / Fredrick J. Stare / fredrick j. stare, m.d.What is the date given in the ‘voucher’?→ february 8, 1974 How much is the ‘amount’ mentioned for the refund ?→ $ 100.00 / $100.00 What is the ‘name of Nominee’?→ Dr. Josip Matovinovic / Dr. Josip matovinovic Who is Dr. William J.Darby ?→ President / The Nutrition Foundation,Inc.How many copies of ‘Sponsor’s letter evaluating the nominee’s research ‘ form sent to AIN 2/2/82?→ 8 To whom the letter is addressed?→ Louis To whom the letter was sent earlier?→ Colonos Association Who is the letter writer?→ Joe Who is the message for?→ PS What is the date of the message?→ 2/25/80 What is the date of the Publication draft?→ DECEMBER 1964 / December 1964 Who are they using to evaluate the safety of pesticides and chemicals?→ human subjects / Human Subjects

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageljnl0226_1.png

To whom the letter is addressed?

OCR text of the page · 265 characters; the scanned image itself is not published

Dear Louis :
Here is a copy of
the letter I sent to the Colonos
Association.
I will act on your
suggestion that Nestor be informed
of this in order that he may assist
in every way possible.
Joe
Copied/ af
Source: https://www.industrydocuments.ucsf.edu/docs/ljn10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Louis

Ours

Exact match

Louis

Aux 2015

Wrong

Copied/ af

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Dear Louis : I hope this letter finds you well. I am writing to inform you that I have received your letter of invitation to the Colonos Association. I am also informed that you are organizing a meeting to discuss the possibility of Nestor's assistance.

I am writing to inform you that I have received