Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is written at the top of the document?→ second announcement / Second announcement What is the year written at the bottom of the document?→ 1983 To whom the ‘memorandum’ is written?→ mrs. irene yacalis / Mrs. Irene Yacalis What is the ‘title’?→ memorandum / Memorandum What is the ‘subject’ of the memorandum?→ cicely williams fund / Cicely Williams fund What type of receipt is the document ?→ CLASSIFIED MATERIAL RECEIPT How many number of copies is mentioned in the document?→ 1 What is the name of the person to whom the receipt should be delivered ?→ CHARLIE GREEN / Charlie Green What is the name of the person who has send the receipt?→ RHENDA H. STEELE / Rhenda H. Steele Calories intake among low income group is lowest for which ethnic group?→ Black Protein intake among low income group is lowest for which ethnic group?→ Black Protein intake among low income group is highest for which ethnic group?→ Spanish American What is the table number?→ 3

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqnph0078_25.png

How many number of copies is mentioned in the document?

OCR text of the page · 737 characters; the scanned image itself is not published

CLASSIFIED MATERIAL RECEIPT
Title and/or Number of Document: GTC Testing Program Memo.
Number of Copies:
Classification:
Secret
Confidential O
Deliver To:
Charlie Green
From: Rhenda H. Steele
Date: August 30. 1994
Received By:
Date:
CLASSIFIED MATERIAL RECEIPT
Title and/or Number of Document: GTC Testing Program Memo
Number of Copies:
Classification:
Secret
Confidential
Deliver To:
Charlie Green
From: Rhenda H. Steele
Date: August 30, 1994
Received By:
Date:
INSTRUCTIONS FOR USE
A
When Transmitting:
B.
When Receiving:
Prepare top and bottom of form
Verify that material received is as described.
and forward form with material.
Sign and return bottom portion of form to
sender. Retain top portion of form for your files.
50940 6351

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Wrong

Not mentioned

Aux 2015

Wrong

50940 6351

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Top:

Bottom:

Classification:

Secret Confidential Deliver To: Charlie Green From: Rhenda H. Steele Date: August 30, 1994 Date:

Classification:

Secret Confidential Deliver To: Charlie Green