Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefydc0228_10.png

Which city's map is this?

OCR text of the page · 997 characters; the scanned image itself is not published
To Airport
62
462
ydasor is
Points of interest about Evansville
N
10aBid
Avenue
18
rankli
Stree
Virginia Street
Pennsylvania
Street
urt Street
Vine Street
Street
Division Street 14 na /VVZ
Sycamor
Main Street
1
L. Locust Street
Walnut Street
Chestnut Shree
15
Cherry Sire
Look Street
Lincoln Avenue
16
3
OHIO RIVER
LI Eighth Street
Seventh Street
Sixth Street
Fifth Street
Third Street
- First Street
Riverside Drive
KENTUCKY
Kentucky Avenue
Washington Avenue
Fourth Street
Second Street
1. Vanderburgh County Court House
11. Welborn Memorial Baptist Hospital
2. Memorial Coliseum
12. Deaconess Hospital
3. Hotel Mccurdy
13. Evansville College
4. Museum of Arts and Sciences
14. Roberts Municipal Stadium
5. Vendome Hotel
15. Public Library
6. Union Station
16. City Hall
7. Mead Johnson & Company
17. Mesker Memorial Amphitheater and Zoo
8. Bus Terminal
18. Evansville State Hospital
9. Post Office
19. Mead Johnson Main Street Office
10. St. Mary's Hospital
20. Mead Johnson Eighth Street Office
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Evansvilleevansville
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Points of interest about Evansville

35 characters7 tokens

Aux 2015

Wrong

To Airport

10 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana Odell, Indiana

144 characters58 tokens