Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenpbb0079_10.png

What is the date on which the request for change was prepared?

OCR text of the page · 876 characters; the scanned image itself is not published
RJRT
REQUEST FOR CHANGE
F-1001
8/88
RFC
ORIGINATOR Name:
Date Prepared
Page
8 /25 /15
Date
Kussell
Barnes
1_of
Position
Telephone No.
Received By
Development
5 342
Department Name and Location
Engineer
Change Order Number
NPT
Brand/Assembly/Material Affected
Type of Change
Addition
Design
Spec Change
Emergency
X
Deletion
Compatibil
Cost Reduction
Urgent
Change
Manufacturability
Other
Routine
Description of Problem
Current
specification
has
2.
target
method of 4.8 9 wirk
limits of 4.5 to 5.1 70.
This
operation
for
no
longer
performed.
Abo, specification is
wrong,
BEST
COPY
Proposed Solution
Dalete
menthol
specification.
51482 5048
Signature
Title
Date
Accepted for
Investigation
Final Disposition
Approved
Rejected
SPEC HOLDER
DATE
Action Taken or Reason for Rejection
8/25/ 58
PRODUCT REVIEW COMMITTEE
MDT for KAN
Proposed Effective Date:
PRODUCT/ ACCEPTANCE COMMITTEE
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
8/25/88
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.71

8/25/15

7 characters8 tokens

Aux 2015

Partial · ANLS 0.71

8/25/15

7 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

RJRT REQUEST FOR CHANGE F-1001 8/88

OCR text: RJRT REQUEST FOR CHANGE F-1001 8/88

RJRT REQUEST FOR CHANGE F-1001 8/88

120 characters64 tokens