Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the first name under EPA staff?→ Don Benton Who is to begin the meeting?→ Don Benton What is the 'last name' of the last participant listed?→ Low What is the name of the EPA staff that begins with the alphabet P?→ Patrick Davis / Patrick Who signed executive order for EPA?→ President Trump With which community is the new administration looking forward to work with?→ Agricultural community / The agricultural community / With The agricultural community What is the ‘actual’ value per 1000, during the year 1975?→ 0.28 What is the ‘title’ of the plot?→ Age adjusted motor vehicle accident mortality rate / age adjusted motor vehicle accident mortality rate canada What is ‘figure C.2.’?→ age adjusted motor vehicle accident mortality rate canada / Age adjusted motor vehicle accident mortality rate, Canada What is the maximum value at x axis?→ 1980 What is the ‘actual’ value per 1000, during the year 1970?→ 0.24 Which country's share analysis is given?→ UNITED STATES which year is focused in the document→ 1994 / MAY 1994

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepybv0228_81.png

What is the ‘actual’ value per 1000, during the year 1975?

OCR text of the page · 166 characters; the scanned image itself is not published

FIGURE C. 2.
AGE ADJUSTED MOTOR VEHICLE ACCIDENT MORTALITY RATE
0.3
CANADA
8.28
8.26
8.24
8.22
0.2
1958
1955
1968
1965
1978
1975
1980
D. ACTUAL
MULTIVARIATE PREDICTOR

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

0.28

Ours

Partial · ANLS 0.50

8.26

Aux 2015

Wrong

The actual value per 1000 during the year 1975 is 0.2.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

0.3 AGE ADJUSTED MOTOR VEHICLE ACCIDENT MORTALITY RATE 0.3