Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelrwj0224_2.png

What is the fax number given in the contract?

OCR text of the page · 989 characters; the scanned image itself is not published
CONTRACT ROUTING FORM
Route Date:
9/7/2005
Originator: Lori MacWilliams
CONTRACT
PO#
DOCUMENT
DOCUMENT TYPE:
CROSS
CONTRACT
EFFECTIVE
EXPIRATION
(When
NUMBER
Select as many as applicable:
REFERENCE
VALUE.
DATE
(SuppSvas to provide)
DOC. NO.
DATE
Applicable)
Contract
Job Assignment
$125,000
9/7/2005
12/31/2005
Amendment
Other (see below)
Other Defined.
Supplier Name:
Coyne Beahm Shouse, Inc.
Phone #:
(336) 605-7227
Address
6522 Bryan Boulevard
Fax #
336/605-7171
Address 2
Cell #:
City, State Zip
Greensboro, NC 27409
Contact Name / Title
Roger L. Beahm/Chairman
e-Mail address:
rbeahm@ CoyneBeahmShouse.com
Client Department:
Innovations Business Unit - Camel PREP
OVERVIEW / SCOPE:
2005 Addendum / Intellectual Property
GL Code:
Q1 73-6303 8150.835 Program #: 808453
PPS
PPS Entry Date: .
Line Item# _ _1:14802.
Contract #: _
By:
Bid Waiver:
Yes *
X No
If yes, must include signed Bid Waiver in the contract file
53411 3885
Source: https://www.industrydocuments.ucsf.edu/docs/Irwj0224
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
336/605-7171
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

336/605-7171

12 characters13 tokens

Aux 2015

Wrong

CONTRACT ROUTING FORM Route Date: 9/7/2005 Originator: Lori MacWilliams CONTRACT PO# DOCUMENT DOCUMENT TYPE: CROSS CONTRACT EFFECTIVE EXPIRATION (When NUMBER Select as many as applicable:

188 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
[
1 characters64 tokens