Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelfvh0227_1.png

What is the word in double quote?

OCR text of the page · 653 characters; the scanned image itself is not published
FIRST YEAR FOLLOW-UP STATUS AS OF 3/22/76
FOR STEPPED AND REFERRED CARE
The attached Table shows the follow-up status at one year from all
available information. The second year follow-up has produced informa-
tion on the whereabouts of some of the "unknown" individuals. Currently
there is a total of 101 persons whose living status was not known for
their one year anniversary. This is less than 1% overall, 0.7% of
stepped care and 1.1% of referred care. The results very from center to
center with several centers accounting for 100% of their participants'
living status.
PRELIMINARY DATA
Source: https://www.industrydocuments.ucsf.edu/docs/Ifvh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Unknown
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

unknown

7 characters2 tokens

Aux 2015

Wrong

101

3 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

The following is a list of the individuals who have been referred to the WashU Language Model Center for their living status.

Step-by-step Answer:

The following is a list of the individuals who have been referred to the WashU Language Model Center for their living status.

282 characters64 tokens