Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezlwc0228_5.png

What type of financial information is this?

OCR text of the page · 773 characters; the scanned image itself is not published
BUDGET
TPC RELATIONSHIP TO INSTITUTE
ACTIVITY
CURRENTLY BUDGETED IN
DONATION
CONTRACT
1. Nutritionist-M.D. and
TPC RED
$50, 000
$37, 500 (75%)
$12, 500 (25%)
Technician
2. Product Safety Analytical Activity
TPC R&D
40, 000
4, 000 (10%)
36, 000
(90%)
3.
Support outside Research Organization
30, 850
30, 850 (100%)
U. of Wisc. (Food Res. Inst.)
R .F .
2, 500
U. of Wisc. (Staph. Toxin)
R.F .
3, 000
Am. Inst. of Nutrition
R .F .
350
Nutrition Foundation
R . F .
12, 500
Calorie Control Council
R.F. 12, 500
4. . Sponsorship Nutrition Today
Consumer
183, 000
183, 000 (100%%)
5. Administrative
22, 000
22, 000 (100%)
- Outside Board
TPC R&D 12, 000
- Services
TPC R&D 10, 000
SUMMARY
SCURCE
R . F .
30, 850
$ 94, 350
$231, 500
Consumer
183, 000
R&D
112, 000
$325, 850
So
0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Budget
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

BUDGET

6 characters4 tokens

Aux 2015

Wrong

The question asks for the type of financial information. The OCR text contains a mix of numbers, letters, and symbols. The text is likely from a budget document or financial report.

Looking at the text:

  • "BUDGET"
  • "TPC RELATIONSHIP TO INSTITUTE"
  • "
253 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

TPC Relation to Institute Budget TPC Relation to Institute TPC Relation to Institute TPC Relation to Institute TPC Relation to Institute TPC Relation to Institute TPC Relation to Institute TPC Relation to Institute TPC Relation to

230 characters64 tokens