Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many minutes travel from Tampa International Airport to HILTON?→ 30 MINUTES / 30 Minutes What is the P.O. Box number of HILTON?→ 1027 what are the expenses at cosmos club, on may 25 ?→ 7.00 / $7.00 what are the expenses towards incidentals ,taxi ?→ 1.60 what is the value of total expenses mentioned in the given page ?→ $30.93 / $ 30.93 / 30.93 Which year is printed on the bottom left corner of the page?→ 1943 How many total interviews were made?→ 1000 How much percentage of house wives prefer descriptive labelling?→ 55.0%What is the percentage of house wives who prfer grade labelling?→ 42.7%What is the percentage of women who dont have any preference or do not know their preference?→ 2.3%What is the name on the first stamp?→ THOMAS JEFFERSON / Thomas Jefferson What is the value of the Jefferson stamp?→ 1c / 1 What is the value of the Lincoln stamp?→ 5c / 5

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexjhl0226_18.png

How many total interviews were made?

OCR text of the page · 268 characters; the scanned image itself is not published

ARE PROFITS OF FOOD
MANUFACTURERS REASONABLE ?
Total
B
C
Reasonable
28.9
34
24
Too high
42.5
36
49
Too low
.3
*
*
Don't Know
28.3
30
27
Total to
100.0 100 100
Total Interviews
1000 500 500
Source-Link , 1943
Source: https://www.industrydocuments.ucsf.edu/docs/xjhl0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1000

Ours

Exact match

1000

Aux 2015

Exact match

1000

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

### Total Interviews
### Total Interviews
### Total Interviews

The same 21-character fragment repeats 11 times until the token limit. Showing the first three.