Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejnmw0228_1.png

What is the name of the bank?

OCR text of the page · 306 characters; the scanned image itself is not published
W. J. Darby, M. D.
No
157
Route 2 Box 218
Thompson Station, Tenn. 37179
limit 15 1083
87-1
640
Pay to the
0235 0256 01 94-27-83 2120501247
Order of
James Thit Goodrich
$ 525
Five hundred and twentyfunk tion
FirstAmerican Bank
Nashville, Tennessee
Hillsboro Office
1:0640000 17 :0157 321 285
'OOOO0 5 2 500,
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
FirstAmericanBank
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.94

FirstAmerican Bank

18 characters4 tokens

Aux 2015

Wrong

Answer: W. J. Darby, M. D.

26 characters14 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

W. J. Darby, M. D.

18 characters11 tokens