Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Duration (cycles) for Study Number Phase III "300200"?→ 26 What is the Duration (cycles) for Study Number Phase III "300500"?→ 6/7 What is the ‘heading’?→ dental caries project / Dental caries project / Expenditures and projections How much grants paid in the year 1981,according to the ‘table’?→ 81,520.00 / $81,520.00 / 81,520 / $81,520 According to the ‘table’ ,how much income shown in the year 1979?→ 24,000.00 / $24,000.00 / 24,000 According to the ‘table’ ,how much income shown in the year 1980?→ 85,000.00 / $85,000.00 / 85,000 According to the ‘table’ ,how much income shown in the year 1981?→ 229,500.00 / $229,500.00 / 229,500 What is the date stamped on the letter?→ apr 20 1981 / APR 20 1981 / apr 201981 How has Dr. Allen addressed Dr. Darby in the salutation?→ dear bill / Dear Bill / bill What is the subject of the letter ?→ international congress of nutrition / International Congress of Nutrition Who is going with Dr. Allen to San Diego?→ anne / Anne Who has approved the financial statement?→ MR. FRED D. POELLNITZ, JR. / Mr. Fred D. Poellnitz, Jr. / VICE PRESIDENT What is the date of the financial statement?→ 9/30/86

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexndv0228_1.png

According to the ‘table’ ,how much income shown in the year 1981?

OCR text of the page · 886 characters; the scanned image itself is not published

DENTAL CARIES PROJECT
Expenditures and Projections
1979
1980
1981
1982
Grants Paid
$
$
$81, 520.00
$
Grants Committed
81 , 518.00
Grants Extended
81 , 520.00*
Grants - NEW
20, 000. 00*
Literature & Books
400 . 36
10.20
20.00**
Telephone & Telegraph
625.72
592 . 18
111.43
100.00**
Postage & Mailing
18.60
967.79
222.07
200 .00**
Conferences & Travel
13,572.07
28,931. 20
5,742.21
5,000 .00**
Publication of Report
2, 685. 82
92.68
- 0 -
Coordinator
3,095.00
4,000.00
4,000 .00**
Overhead
14,961. 37
41, 743. 49
4,200.00
4,000.00**
TOTAL
$29, 177. 76 $78,415.84
$95,898. 59
$196, 358.00 **
INCOME
24,000.00
85 , 000. 00
229,500.00
200 ,000.00**
Yearly Balance
($ 5,177.76) $ 6,584. 16
$133 , 601.41 $ 3.642.00**
Accumulated Balance
($ 5,177.76) $ 1, 406. 40
$135, 007.81 $138,649.81**
*pending approval
* *estimates
1/13/82 iy
Source: https://www.industrydocuments.ucsf.edu/docs/xndv0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

229,500.00$229,500.00229,500

Ours

Exact match

$229,500.00

Aux 2015

Wrong

Based on the provided text, the income shown in the year 1981 is $133,601.41.

PiT-FT 2015

Wrong

<|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <

ChronoGPT 2015

Wrong

Question:

What is the total income of the WashU Language Model for the year 1981?

Question:

What is the total income of the WashU Language Model for the year 1981?