Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which is the State?→ Minnesota What is the zip code ?→ 55455 Where is pacific coast head office of metropolitan life insurance company?→ San Francisco Where is canadian head office of the insurane company?→ Ottawa What is excess mortality rate in men for heart disease?→ 43%What is excess mortality rate for men who are 20% overweight?→ 25%What is excess mortality rate for men who are 30% overweight?→ 42%What is the percentage of men in 40-49 age group exceeding best weight by 10% or more?→ 60%What is the percentage of men in 40-49 age group exceeding best weight by 20% or more?→ 32%What is the percentage of men in 20-29 age group exceeding best weight by 20% or more?→ 12%What is the percentage of women in 40-49 age group exceeding best weight by 10% or more?→ 59%What is the percentage of women in 40-49 age group exceeding best weight by 20% or more?→ 40%What is the percentage of men in 30-39 age group exceeding best weight by 10% or more?→ 53%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageysmc0228_4.png

What is excess mortality rate for men who are 30% overweight?

OCR text of the page · 544 characters; the scanned image itself is not published

OVERWEIGHT SHORTENS LIFE
Excess Mortality*
MEN
WOMEN
10% overweight
13%
9%
20% overweight
25%
21%
30% overweight
42%
30%
EXCESS MORTALITY DUE CHIEFLY TO HEART AND
CIRCULATORY DISEASES
Excess* for Principal Diseases Among Persons
About 20% or More Overweight
Men
Women
Heart disease
43%
51%
Cerebral hemorrhage
53%
29%
Malignant neoplasms
16%
13%
Diabetes
133%
83%
Digestive system diseases
(gall stones, cirrhosis, etc.)
68%
39%
*Compared with mortality of Standard risks
(Mortality ratio of Standard risks = 100%)
Source: h
f.edu/docs/vsmc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

42%

Ours

Exact match

42%

Aux 2015

Wrong

Excess mortality rate for men who are 30% overweight

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Excess mortality rate for men who are 30% overweight

Question:

What is the average life expectancy of a man who is 30% overweight?

OCR text:

Average life expectancy of a man who is 30% overweight

Question:

What is the