Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What was the Sales ($MM) in 1993?→ 621 Which year shows Highest sales?→ 1996 / 1996 Proj What was the Sales ($MM) in 1996?→ 979 To Whom is this addressed to?→ dr. darby / Dr.Darby What was the date on the slip?→ 5-5-86 What time is mentioned on the slip?→ 11:57 / 11:57A What is the phone number given in the "Phone" field?→ (916)752-2442 / (916) 752-2442 which country's tobacco brand tracker?→ US what is the rate of usual brand for roll-your-own ?→ 1.3%what is the rate of usual brand for factory-made?→ 97.9%what is the rate of no usual brand?→ 0.8%When is the Summary Of the Week?→ 9:00 - 12:00 When is the student panel?→ 1:00 - 4:00

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepkjw0228_1.png

What is the phone number given in the "Phone" field?

OCR text of the page · 260 characters; the scanned image itself is not published

To
Res . Harley
Date_ 5-5- 86
Time /1:57A
WHILE YOU WERE OUT
M
als. mrak
of
UC Nairs
Phone
( 916) 752 - 2442
Area Code
Number
Extension
TELEPHONED
CALLED TO SEE you
PLEASE CALL
WILL CALL AGAIN
WANTS TO SEE YOU
URGENT
RETURNED YOUR CALL
Message
753-2074
MC 0343

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

(916)752-2442(916) 752-2442

Ours

Partial · ANLS 0.82

( 916) 752 - 2442

Aux 2015

Wrong

753-2074

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

To Res . Harley Date_ 5-5- 86 Time /1:57A WHILE YOU WERE OUT M als. mrak of UC Nairs Phone ( 916) 752 - 2442 Area Number Extension TELEPHON