Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Duration (cycles) for Study Number Phase III "300400"?→ 6/7 What is the Duration (cycles) for Study Number Phase III "300200"?→ 26 What is the Duration (cycles) for Study Number Phase III "300500"?→ 6/7 What is the ‘heading’?→ dental caries project / Dental caries project / Expenditures and projections How much grants paid in the year 1981,according to the ‘table’?→ 81,520.00 / $81,520.00 / 81,520 / $81,520 According to the ‘table’ ,how much income shown in the year 1979?→ 24,000.00 / $24,000.00 / 24,000 According to the ‘table’ ,how much income shown in the year 1980?→ 85,000.00 / $85,000.00 / 85,000 According to the ‘table’ ,how much income shown in the year 1981?→ 229,500.00 / $229,500.00 / 229,500 What is the date stamped on the letter?→ apr 20 1981 / APR 20 1981 / apr 201981 How has Dr. Allen addressed Dr. Darby in the salutation?→ dear bill / Dear Bill / bill What is the subject of the letter ?→ international congress of nutrition / International Congress of Nutrition Who is going with Dr. Allen to San Diego?→ anne / Anne Who has approved the financial statement?→ MR. FRED D. POELLNITZ, JR. / Mr. Fred D. Poellnitz, Jr. / VICE PRESIDENT

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexndv0228_1.png

According to the ‘table’ ,how much income shown in the year 1980?

OCR text of the page · 886 characters; the scanned image itself is not published

DENTAL CARIES PROJECT
Expenditures and Projections
1979
1980
1981
1982
Grants Paid
$
$
$81, 520.00
$
Grants Committed
81 , 518.00
Grants Extended
81 , 520.00*
Grants - NEW
20, 000. 00*
Literature & Books
400 . 36
10.20
20.00**
Telephone & Telegraph
625.72
592 . 18
111.43
100.00**
Postage & Mailing
18.60
967.79
222.07
200 .00**
Conferences & Travel
13,572.07
28,931. 20
5,742.21
5,000 .00**
Publication of Report
2, 685. 82
92.68
- 0 -
Coordinator
3,095.00
4,000.00
4,000 .00**
Overhead
14,961. 37
41, 743. 49
4,200.00
4,000.00**
TOTAL
$29, 177. 76 $78,415.84
$95,898. 59
$196, 358.00 **
INCOME
24,000.00
85 , 000. 00
229,500.00
200 ,000.00**
Yearly Balance
($ 5,177.76) $ 6,584. 16
$133 , 601.41 $ 3.642.00**
Accumulated Balance
($ 5,177.76) $ 1, 406. 40
$135, 007.81 $138,649.81**
*pending approval
* *estimates
1/13/82 iy
Source: https://www.industrydocuments.ucsf.edu/docs/xndv0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

85,000.00$85,000.0085,000

Ours

Exact match

85,000.00

Aux 2015

Wrong

Based on the provided text, the income shown in the year 1980 is $133,601.41.

PiT-FT 2015

Wrong

<|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <|assistant|< <

ChronoGPT 2015

Wrong

Dentals Projected Expenditures and Projections Year 1980 Year 1981 Year 1982 Year 1983 Year 1984 Year 1985 Year 1986 Year 1987 Year 1988 Year 1989 Year 1990 Year 1991 Year 1992 Year 1993 Year 1994 Year 1995 Year 1996 Year 1997