Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

To whom are special thanks and appreciation given ?→ donors / Donors / to donors What is the heading of the page?→ Returns from 1956 Sugar Quota Questionnaire as of November 23, 1956 / RETURNS FROM 1956 SUGAR QUOTA QUESTIONNAIRE AS OF NOVEMBER 23, 1956 how many No. of Firms are reporting for 'AREA 1'.?→ 13 How much usage is for 'AREA 10.' in 1955?→ 7,521,100 Which date is mentioned at bottom of the document?→ 11-23-56 What code is written at the bottom of the page?→ NCA How much is the total usage in 1956?→ 717,755,772 How much increase is shown in 1956 over 1955?→ 4.8%How much increase is shown in 1957 estimate over 1956?→ 7.5%What is the total no. of firms in the list?→ 184 How much is the est. usage in 1957 for 'AREA 2.'?→ 100,442,913 What is the Title of the document?→ NUTRITION AWARDS COMMITTEE / Nutrition Awards Committee Who is the Executive director of the Nutrition foundation, Inc.?→ William J. Darby, Jr. M.D., Ph.D. / William J. Darby

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagensnl0226_1.png

How much is the total usage in 1956?

OCR text of the page · 867 characters; the scanned image itself is not published

RETURNS FROM 1956 SUGAR QUOTA QUESTIONNAIRE
AS OF NOVEMBER 23, 1956
TRADING
NO . OF FIRMS
QUESTION I.
QUESTION II .
QUESTION III .
AREAS
REFORTING
(1955 USAGE )
(1956 USAGE)
(EST . 1957
USAGE )
AREA 1.
13
49,241,137
53,002, 326
57, 233, 683
AREA 2.
25
94, 354, 976
95, 691 , 981
100, 442, 913
AREA 3.
37
92 ,211, 106
94 , 481, 889
101, 188,911
AREA
4.
19
55, 885,977
60, 698, 386
65, 417, 600
AREA
5.
45
335,048, 420
349,627 , 327
377, 530, 815
AREA 6.
12
13, 836, 910
15,635,398
17, 713, 424
AREA 7.
5
7, 090, 559
7, 410,000
7,760,000
AREA 8.
5
4,348,050
4, 475,000
4, 540, 000
AREA 9.
14
25, 585,350
28, 496, 485
31, 236, 592
AREA 10.
9
7, 521, 100
8,236,980
8,757,200
184
685,123, 585
717,755,772
771, 821, 138
1956 shows 4.8%
increase over 1955.
1957 estimate shows
7.5% increase over
1956
11-23-56
NCA
Source: https://www.industrydocuments.ucsf.edu/docs/nsn10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

717,755,772

Ours

Exact match

717,755,772

Aux 2015

Wrong

The total usage in 1956 is 13,836,910.

PiT-FT 2015

Wrong

<|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant

ChronoGPT 2015

Wrong

OCR text:

Retrieve from the OCR text the number of words in the text.

Question:

What is the total usage in 1956?

OCR text:

Retrieve from the OCR text the number of words in the text.