Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezlwc0228_5.png

What is the total donation?

OCR text of the page · 773 characters; the scanned image itself is not published
BUDGET
TPC RELATIONSHIP TO INSTITUTE
ACTIVITY
CURRENTLY BUDGETED IN
DONATION
CONTRACT
1. Nutritionist-M.D. and
TPC RED
$50, 000
$37, 500 (75%)
$12, 500 (25%)
Technician
2. Product Safety Analytical Activity
TPC R&D
40, 000
4, 000 (10%)
36, 000
(90%)
3.
Support outside Research Organization
30, 850
30, 850 (100%)
U. of Wisc. (Food Res. Inst.)
R .F .
2, 500
U. of Wisc. (Staph. Toxin)
R.F .
3, 000
Am. Inst. of Nutrition
R .F .
350
Nutrition Foundation
R . F .
12, 500
Calorie Control Council
R.F. 12, 500
4. . Sponsorship Nutrition Today
Consumer
183, 000
183, 000 (100%%)
5. Administrative
22, 000
22, 000 (100%)
- Outside Board
TPC R&D 12, 000
- Services
TPC R&D 10, 000
SUMMARY
SCURCE
R . F .
30, 850
$ 94, 350
$231, 500
Consumer
183, 000
R&D
112, 000
$325, 850
So
0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$ 94,350$94,350
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.50

$325,850

8 characters9 tokens

Aux 2015

Partial · ANLS 0.50

$325,850

8 characters9 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

BUDGET TPC RELATIONSHIP TO INSTITUTE ACTIVITY

Question:

What is the total donation?

OCR text: BUDGET TPC RELATIONSHIP TO INSTITUTE ACTIVITY

BUDGET T

156 characters64 tokens