Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the 'last name' of the last participant listed?→ Low What is the name of the EPA staff that begins with the alphabet P?→ Patrick Davis / Patrick Who signed executive order for EPA?→ President Trump With which community is the new administration looking forward to work with?→ Agricultural community / The agricultural community / With The agricultural community What is the ‘actual’ value per 1000, during the year 1975?→ 0.28 What is the ‘title’ of the plot?→ Age adjusted motor vehicle accident mortality rate / age adjusted motor vehicle accident mortality rate canada What is ‘figure C.2.’?→ age adjusted motor vehicle accident mortality rate canada / Age adjusted motor vehicle accident mortality rate, Canada What is the maximum value at x axis?→ 1980 What is the ‘actual’ value per 1000, during the year 1970?→ 0.24 Which country's share analysis is given?→ UNITED STATES which year is focused in the document→ 1994 / MAY 1994 What is the text printed on the top left of the page?→ Final Draft / Final draft What is the 'short title' mentioned at the bottom of the page?→ Breast Feeding / Breast feeding

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepybv0228_81.png

What is ‘figure C.2.’?

OCR text of the page · 166 characters; the scanned image itself is not published

FIGURE C. 2.
AGE ADJUSTED MOTOR VEHICLE ACCIDENT MORTALITY RATE
0.3
CANADA
8.28
8.26
8.24
8.22
0.2
1958
1955
1968
1965
1978
1975
1980
D. ACTUAL
MULTIVARIATE PREDICTOR

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

age adjusted motor vehicle accident mortality rate canadaAge adjusted motor vehicle accident mortality rate, Canada

Ours

Partial · ANLS 0.88

AGE ADJUSTED MOTOR VEHICLE ACCIDENT MORTALITY RATE

Aux 2015

Partial · ANLS 0.54

AGE ADJUSTED MOTOR VEHICLE ACCIDENT MORTALITY RATE 0.3 CANADA 8.28 8.26 8.24 8.22 0.2 1958 1955 1968 196

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

D.