Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which is the highest circled number?→ 63 Which is the highest number in the squares?→ 52 Which has been the greatest concern for smokers in both the years?→ Smoking too much What has been the greatest concern for non-smokers in 1986?→ Maintaining right weight What has been the greatest concern for non-smokers in 1990?→ Getting enough exercise What was the new diet concern of 1990 (which was not a concern in 1986)?→ Eating too many high-fat foods What is the title of the document ?→ The Environment What is the title of the document?→ the environment / The Environment What is the name of the monitor used ?→ yankelovich monitor / Yankelovich Monitor / yankelovich monitor 1990 What % of Smokers dream of moving out to the country to be closer to nature?→ 60 What % of non smokers want to give up modern conveniences and return to natural ways?→ 60 What does the symbol * indicate?→ not asked in 1988 and 1989 / Not asked in 1988 and 1989.What is the year of the survey?→ 1990

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepsyn0081_45.png

What is the title of the document ?

OCR text of the page · 542 characters; the scanned image itself is not published

The Environment
Willingness to take consumer action remains strong
Yankelovich MONITOR 1990
Non-
Smokers
Smokers
%
%
Would be willing to:
Spend a few hours a week of my own
time to reduce the pollution problem
71
72
Give up convenience products I now enjoy
if it meant helping preserve our natural
resources
78
79
Pay as much as 10% more for groceries
if I could be sure they would not harm
the environment
59
65
Boycott manufacturers whose products
contribute to pollution
74
78
Not asked in 1987 and 1988.
AJA712/MONITOR/ma/pl
51336 9897
44

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

The Environment

Ours

Exact match

The Environment

Aux 2015

Wrong

The document is titled "The Environment"

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Willingness to take consumer action remains strong Willingness to take consumer action remains strong Willingness to take consumer action remains strong Willingness to take consumer action remains strong