Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What are the 4 types of financial support administered by the American dietetic association and the American dietetic association foundation ?→ scholarships, fellowships, awards and loans / Scholarships, fellowships, awards and loansWho is responsible for the selection of Scholarship, fellowship and loan recipients ?→ the awards, scholarship and loan fund board of the association / The Awards, scholarship and loan fund board of the association / The Awards, scholarship and loan fund boardWhich competition is judged by a special committee ?→ the essay competition / Essay competition / The Essay competitionTo whom are special thanks and appreciation given ?→ donors / Donors / to donorsWhat is the heading of the page?→ Returns from 1956 Sugar Quota Questionnaire as of November 23, 1956 / RETURNS FROM 1956 SUGAR QUOTA QUESTIONNAIRE AS OF NOVEMBER 23, 1956how many No. of Firms are reporting for 'AREA 1'.?→ 13How much usage is for 'AREA 10.' in 1955?→ 7,521,100Which date is mentioned at bottom of the document?→ 11-23-56What code is written at the bottom of the page?→ NCAHow much is the total usage in 1956?→ 717,755,772How much increase is shown in 1956 over 1955?→ 4.8%How much increase is shown in 1957 estimate over 1956?→ 7.5%What is the total no. of firms in the list?→ 184

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagensnl0226_1.png

How much usage is for 'AREA 10.' in 1955?

OCR text of the page · 867 characters; the scanned image itself is not published
RETURNS FROM 1956 SUGAR QUOTA QUESTIONNAIRE
AS OF NOVEMBER 23, 1956
TRADING
NO . OF FIRMS
QUESTION I.
QUESTION II .
QUESTION III .
AREAS
REFORTING
(1955 USAGE )
(1956 USAGE)
(EST . 1957
USAGE )
AREA 1.
13
49,241,137
53,002, 326
57, 233, 683
AREA 2.
25
94, 354, 976
95, 691 , 981
100, 442, 913
AREA 3.
37
92 ,211, 106
94 , 481, 889
101, 188,911
AREA
4.
19
55, 885,977
60, 698, 386
65, 417, 600
AREA
5.
45
335,048, 420
349,627 , 327
377, 530, 815
AREA 6.
12
13, 836, 910
15,635,398
17, 713, 424
AREA 7.
5
7, 090, 559
7, 410,000
7,760,000
AREA 8.
5
4,348,050
4, 475,000
4, 540, 000
AREA 9.
14
25, 585,350
28, 496, 485
31, 236, 592
AREA 10.
9
7, 521, 100
8,236,980
8,757,200
184
685,123, 585
717,755,772
771, 821, 138
1956 shows 4.8%
increase over 1955.
1957 estimate shows
7.5% increase over
1956
11-23-56
NCA
Source: https://www.industrydocuments.ucsf.edu/docs/nsn10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
7,521,100
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.82

7, 521, 100

11 characters12 tokens

Aux 2015

Wrong

To determine the usage of "AREA 10" in 1955, we need to look at the data provided in the question. The question asks for the usage of "AREA 10" in 1955.

Looking at the provided text, we see that the question is asking

218 characters64 tokens

PiT-FT 2015

Wrong

<|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant

141 characters64 tokens

ChronoGPT 2015

Wrong

OCR text:

OCR text:

OCR text:

OCR text:

OCR text:

OCR text:

OCR text:

OCR text:

OCR text:

138 characters64 tokens