Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelxcj0224_1.png

What is the Delivery Date?

OCR text of the page · 1,582 characters; the scanned image itself is not published
. . ... .
REQUEST FOR GRATIS TOBACCO PRODUCTS
It is the policy of RJRT to explicitly and proactively prohibit access of its products to anyone other than adult smokers at least 21 years of age.
X
(RJRT Policy & Procedure Number 04-05-002
Type of Order New Order
GRATIS REQUEST NUMBER 0088010
If Change, Original Gratis Request No.
Originator
Amy Brown Watson
Department Consumer & Sensory Prod. Development
Company R. J. Reynolds Tobacco Company
Phone Ext. 4210
Date 10/26/2004
General Ledger No. 04-75-2350-8750-855
PPS No. 807685-01-35-05
# of Ship To(s) 00
Delivery Date 11/03/2004
Region/Division No.
Count as Sales No
Ship To Address MARC, Inc.
311 C. South Westgate Drive
Greensboro, NC 27407
Delivery Instructions MARC, please pick up product from R&D Inventory and take to CDC for release. Deliver product
in the a.m. on Wednesday November 3, 2004
Purpose In-Home Testing - Delivery to a national panel of smokers - distribution follows.
Where
When
Coupons/Sleeves/Etc. Instructions
Closure Label _ Complimentary
AB04-09 (70 cnts ea Non-Menthol, 50 ctns ea Mentho!)
Origin of Product R&D
2-010 D & B (non-menthol), 4-011 D & B (mentho!)
DATE /0- 26- 0 4/
TOTALS: Pack
0 CTN
240 6M
0 10M
0 12M
0 Grand
240
Case Size
Brand
Style
Product
Quantity
Delete
Code
Button
Carton
Eclipse
Eclipse FF Box
18113
140
Carton
Eclipse
Eclipse FF Men Box
18613
100
ORIGINAL TO: CUSTOMER SERVICES COPIES TO: (1) CENTRAL DIST. CENTER (CDC), (2) GRATIS OPERATIONS. (3) TAX DEPT.
RJRT Form 1484 - Rev. 09/16/2004
Page 1 OF 1
53420 7049
Source: https://www.industrydocuments.ucsf.edu/docs/Ixcj0224
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
11/03/2004
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

11/03/2004

10 characters11 tokens

Aux 2015

Wrong

The Delivery Date is: November 3, 2004

42 characters17 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

of Ship To(s) 00

of Ship To(s) 00

of Ship To(s) 00

of Ship To(s) 00

of Ship To(s) 00

of Ship To(s) 00

of Ship To(s) 00

134 characters64 tokens