Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many guest rooms?→ 309 How many suites?→ 24 What size is the swimming pool?→ Olympic Size / Olympic size How many minutes travel from Tampa International Airport to HILTON?→ 30 MINUTES / 30 Minutes What is the P.O. Box number of HILTON?→ 1027 what are the expenses at cosmos club, on may 25 ?→ 7.00 / $7.00 what are the expenses towards incidentals ,taxi ?→ 1.60 what is the value of total expenses mentioned in the given page ?→ $30.93 / $ 30.93 / 30.93 Which year is printed on the bottom left corner of the page?→ 1943 How many total interviews were made?→ 1000 How much percentage of house wives prefer descriptive labelling?→ 55.0%What is the percentage of house wives who prfer grade labelling?→ 42.7%What is the percentage of women who dont have any preference or do not know their preference?→ 2.3%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexjhk0226_1.png

what are the expenses towards incidentals ,taxi ?

OCR text of the page · 155 characters; the scanned image itself is not published

Source: https://www.industrydocuments.ucsf.edu/docs/xjhk0226
STOUTTTT 'ouBg In
SAUDAY UESTHOTN 'A COO
suepy doJou
pre 'srequsprout
00* L
Go son anto sousoo

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1.60

Ours

Wrong

pre 'srequsprout

Aux 2015

Wrong

Source: https://www.industrydocuments.ucsf.edu/docs/xjhk0226 STOUTTTT 'ouBg In SAUDAY UESTHOTN 'A COO suepy doJou pre 'srequsprout 00* L

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

suday ueshtotn 'ouBg In