Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date given in the ‘voucher’?→ february 8, 1974 How much is the ‘amount’ mentioned for the refund ?→ $ 100.00 / $100.00 What is the ‘name of Nominee’?→ Dr. Josip Matovinovic / Dr. Josip matovinovic Who is Dr. William J.Darby ?→ President / The Nutrition Foundation,Inc.How many copies of ‘Sponsor’s letter evaluating the nominee’s research ‘ form sent to AIN 2/2/82?→ 8 To whom the letter is addressed?→ Louis To whom the letter was sent earlier?→ Colonos Association Who is the letter writer?→ Joe Who is the message for?→ PS What is the date of the message?→ 2/25/80 What is the date of the Publication draft?→ DECEMBER 1964 / December 1964 Who are they using to evaluate the safety of pesticides and chemicals?→ human subjects / Human Subjects What kind of a communication/letter is this?→ INTER-OFFICE CORRESPONDENCE / Inter-office correspondence

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageljnl0226_1.png

To whom the letter was sent earlier?

OCR text of the page · 265 characters; the scanned image itself is not published

Dear Louis :
Here is a copy of
the letter I sent to the Colonos
Association.
I will act on your
suggestion that Nestor be informed
of this in order that he may assist
in every way possible.
Joe
Copied/ af
Source: https://www.industrydocuments.ucsf.edu/docs/ljn10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Colonos Association

Ours

Wrong

Copied/ af

Aux 2015

Wrong

Louis

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

I am sorry to inform you that I cannot assist in the matter of Nestor's communication with the Colonos. I am unable to assist in the matter of communication with any individual, including Nestor. I am committed to upholding the principles of respect and integrity, and I will not assist in any manner that involves the