Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepsyn0081_47.png

What does the symbol * indicate?

OCR text of the page · 365 characters; the scanned image itself is not published
The Environment
Rapidly growing interest in nature and the simple life
Yankelovich MONITOR 1990
Non
Smokers
Smokers
%
We should return to more natural ways even
if it means giving up modern conveniences
64
60
More and more I find I dream of moving way
out into the country to be closer to nature
60
57
* Not asked in 1988 and 1989.
RJR712/MONITOR/mg/p
51336 9899
46
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
not asked in 1988 and 1989Not asked in 1988 and 1989.
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Not asked in 1988 and 1989.

27 characters16 tokens

Aux 2015

Wrong
* indicates that the symbol * indicates that the symbol * indicates that the symbol 

The same 28-character fragment repeats 12 times until the token limit. Showing the first three.

356 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

The environment

Question:

What does the symbol * indicate?

OCR text: The environment

The environment

108 characters32 tokens