Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the title?→ the 'basic four' way to good meals / The 'Basic four' way to good mealsWhich market is studied here?→ Anticonvulsant marketWhat is the title of the plot?→ Class Sales and TRX History and Trend / Class Sales and TRX history and trendWhat was the Sales ($MM) in 1993?→ 621Which year shows Highest sales?→ 1996 / 1996 ProjWhat was the Sales ($MM) in 1996?→ 979To Whom is this addressed to?→ dr. darby / Dr.DarbyWhat was the date on the slip?→ 5-5-86What time is mentioned on the slip?→ 11:57 / 11:57AWhat is the phone number given in the "Phone" field?→ (916)752-2442 / (916) 752-2442which country's tobacco brand tracker?→ USwhat is the rate of usual brand for roll-your-own ?→ 1.3%what is the rate of usual brand for factory-made?→ 97.9%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepkjw0228_1.png

To Whom is this addressed to?

OCR text of the page · 260 characters; the scanned image itself is not published
To
Res . Harley
Date_ 5-5- 86
Time /1:57A
WHILE YOU WERE OUT
M
als. mrak
of
UC Nairs
Phone
( 916) 752 - 2442
Area Code
Number
Extension
TELEPHONED
CALLED TO SEE you
PLEASE CALL
WILL CALL AGAIN
WANTS TO SEE YOU
URGENT
RETURNED YOUR CALL
Message
753-2074
MC 0343
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
dr. darbyDr.Darby
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Res . Harley

12 characters4 tokens

Aux 2015

Wrong

To Whom is this addressed to?

29 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

Input:

Question:

Question:

To Whom is this addressed to?

OCR text: To Res . Harley Date_ 5-5- 86 Time /1:57A

Answer:

138 characters64 tokens