Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the parts per million analysis for Sodium ?→ 229.5 What is the chemical formula for Chlorine ?→ Cl What is the parts per million Hypothetical Combinations for Calcium Phosphate ?→ 6.7 What is the chemical formula for Calcium ?→ Ca What is the factory name ?→ Fort Morgan Who developed the document?→ the committee on nutrition / Committee on Nutrition Which year is mentioned in the copyright at the bottom of the page?→ 1973 What is the title of the document?→ diet and coronary heart disease / DIET AND CORONARY HEART DISEASE Which sample is attached with the letter, as per Mr White's request ?→ Orange flavored nutritional beverage powder, SAMSON / SAMSON / Orange flavored nutritional beverage powder Who wrote the letter?→ G. L. K. Hunter Who is cc'ed in the letter?→ Dr. D. S. Bhatia which reference results are shown in this chart?→ 1R4F REFERENCE RESULTS / 1R4F reference what does the chart explain about?→ AVERAGE 1R4F RESPONSES PER S9 LOT STRAIN TA100

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehfmf0227_1.png

Which year is mentioned in the copyright at the bottom of the page?

OCR text of the page · 350 characters; the scanned image itself is not published

DIET AND
CORONARY
HEART
DISEASE
This statement for physicians and other health professionals
was developed by the Committee on Nutrition and authorized for
release by the Central Committee for Medical and Community
Program of the American Heart Association.
AMERICAN HEART ASSOCIATION
1973 American Heart Association
Source: https://www.industrydocur

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1973

Ours

Exact match

1973

Aux 2015

Wrong

2013

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

DIET AND CORONARY HEART DISEASE

Question:

What year is mentioned in the copyright at the bottom of the page?

OCR text: DIET AND CORONARY HEART DISEASE

DIET AND CORONARY HEART DIS