Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexndv0228_1.png

How much grants paid in the year 1981,according to the ‘table’?

OCR text of the page · 886 characters; the scanned image itself is not published
DENTAL CARIES PROJECT
Expenditures and Projections
1979
1980
1981
1982
Grants Paid
$
$
$81, 520.00
$
Grants Committed
81 , 518.00
Grants Extended
81 , 520.00*
Grants - NEW
20, 000. 00*
Literature & Books
400 . 36
10.20
20.00**
Telephone & Telegraph
625.72
592 . 18
111.43
100.00**
Postage & Mailing
18.60
967.79
222.07
200 .00**
Conferences & Travel
13,572.07
28,931. 20
5,742.21
5,000 .00**
Publication of Report
2, 685. 82
92.68
- 0 -
Coordinator
3,095.00
4,000.00
4,000 .00**
Overhead
14,961. 37
41, 743. 49
4,200.00
4,000.00**
TOTAL
$29, 177. 76 $78,415.84
$95,898. 59
$196, 358.00 **
INCOME
24,000.00
85 , 000. 00
229,500.00
200 ,000.00**
Yearly Balance
($ 5,177.76) $ 6,584. 16
$133 , 601.41 $ 3.642.00**
Accumulated Balance
($ 5,177.76) $ 1, 406. 40
$135, 007.81 $138,649.81**
*pending approval
* *estimates
1/13/82 iy
Source: https://www.industrydocuments.ucsf.edu/docs/xndv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
81,520.00$81,520.0081,520$81,520
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.91

$81, 520.00

11 characters12 tokens

Aux 2015

Wrong

The question asks for the total amount of grants paid in the year 1981, according to the table.

Looking at the table, the grants paid in 1981 are:

  • $81,520.00 (from Grants Paid)
  • $81,
187 characters64 tokens

PiT-FT 2015

Wrong

<|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <

127 characters64 tokens

ChronoGPT 2015

Wrong

$

Question:

How much grants paid in the year 1981, according to the 'table'?

OCR text: DENTAL CARIES PROJECT Expenditures and Projections 1979 1980 1981 1982 Grants Paid $ $ $ $

184 characters64 tokens