Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehjfk0226_19.png

What is cost of chemicals and supplies?

OCR text of the page · 853 characters; the scanned image itself is not published
$.
2200
3, EXPENDABLE SCIENTIFIC ITEMS AND SERVICES (List major items.
List miscellaneous items in groups up to amounts not exceeding $500.)
a, Liquid Nitrogen
200
b. Chemicals and Supplies
485
d.
685
4. OTHER EXPENSE
a, Travel to scientific meetings in excess of normal institutional policy ... S
150
b. Reprints and publication charges of scientific articles arising from grant,.$
100
S
250
5. TOTAL, exclusive of overhead
10435
6. OVERHEAD, if applicable, 15 % of item 5 (not more than 15%) AneNANANANA
1565
7. TOTAL AMOUNT of proposed budget (item 5 plus item 6)
12000
yum. Tate
Applicant
willie M.
President or Chancellor
Applicant
Southern Methodist University
Institution
Copies: The Robert A. Welch Foundation (12)
Applicant (1)
Date February 24 19 60
President or Chancellor (1)
54-1
Source: https://www.industrydocuments.ucsf.edu/docs/hjfk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
485$485
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

485

3 characters4 tokens

Aux 2015

Wrong

12000

5 characters6 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

63 characters64 tokens