Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqxhc0228_6.png

What is the cost of 'wrap and mail'?

OCR text of the page · 675 characters; the scanned image itself is not published
. ..
* Page 2
Imposition, Presswork thru Binding
Base
Additional
Adhesive Bound
4400
copies
1000 copies
128 pages & covers (covers 1-4
in 1 color other than
black)
$878. 92
$147 .58
32 pages additional
147 . 76
23.53
16 pages additional
130.15
18. 13
8 pages additional
117.35
15.95
4 pages additional
63. 68
9 . 70
2 pages additional to insert in
the center of a signature
95.49
17. 09
Extra for :
Gathering 8 signatures
11 .37
2 . 58
Stock: current prices
Text :
60 1b. White Process Plate (WP #13)
. 99/page/1000
Cover :
65 1b. Ivory Navajo Cover
20.68/1000
Mailing
Wrap and mail
36. 79/1000
Apply labels (Cheshire)
22. 70/1000
www.industrydocuments.ucsf.edu/docs/axhc0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
36.79/1000
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

36.79/1000

10 characters11 tokens

Aux 2015

Wrong

$878.92

7 characters8 tokens

PiT-FT 2015

Wrong

<|<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<assistant|<<ass

150 characters64 tokens

ChronoGPT 2015

Wrong

Text:

. ..

  • Page 2 Imposition, Presswork thru Binding Base Additional Adhesive Bound 4400 copies 1000 copies 128 pages & covers (covers 1-4) $878. 92 $147 . 58 32 pages additional 137
188 characters64 tokens