Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemxmg0227_1.png

How much is the expense towards Direct Materials for current period?

OCR text of the page · 529 characters; the scanned image itself is not published
Department of the Amry
Washington University
Lindell & Sinker Boulevards
Coutract No. BA-49-607-10-1026
St. Louis, Missouri 63130
Target/Estimated Costs
207,785.00
Sea lative Coste and Fee Earned
Amount for
Cumulative an's
Current Period
From Incept Lou
To Date of This
Direct Salaries
735.90
89,450.18
Mreet Sistertals
68.26
20,506.65
Freight
18.62
17,830.45
Other Direct Coats
22.83
9.237.80
overhead
Total Amounts Claimed
180, 952.71
Loss: Contract Reserve Wichheld
Source: https://www.industrydocuments.ucsf.edu/docs/mxmg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
68.24
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

735.90

6 characters7 tokens

Aux 2015

Wrong

Department of the Amry Washington University Lindell & Sinker Boulevards Coutract No. BA-49-607-10-1026 St. Louis, Missouri 63130 Target/Estimated Costs 207,785

160 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Department of the Amry Washington University Lindell & Sinker Boulevards Coutract No. BA-49-607-10-1026 St. Louis, Missouri 63130 Target/Estimated Costs 207,785.00 Sea lative Coste and Fee Earned

195 characters64 tokens