Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelmmf0227_3.png

What does a great vacation area deserve?

OCR text of the page · 931 characters; the scanned image itself is not published
1
A great
vacation area
deserves a great
4
vacation resort.
superb. 300 luxurious soundproof guest
rooms, including 14 suites. Each with
individually-controlled air conditioning,
color TV, oversized beds and tasteful decor.
And amenities like a huge heated pool
and pool deck, shops, covered outdoor
walkways and beautiful landscaping.
Conveniences like room service, car
rental, laundry and dry cleaning, travel
1. Bahia Mar Tower
Main Desk
agency, theater tickets and free parking.
The Seaview Restaurant
And 10 meeting rooms for groups from
Spyglass Lounge
20 to 1,200.
Meeting Rooms
Shops
Bahia Mar. In scenic Fort Lauderdale.
Convention Center
Where you can enjoy a great ocean resort
in an ideal resort city.
2. Bahia Mar South Wing
Patio Cafe
Patio Cafe Lounge
3. Pool/Patio Deck
Snack Bar
Shops
Seagrape Bar
4. Marine Store
Marina Control Tower
Offices
Fuel Dock
Source: https://www.industrydocuments.ucsf.edu/docs/Immf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
a great vacation resortA great vacation Resort
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.96

a great vacation resort.

24 characters6 tokens

Aux 2015

Wrong

The great vacation area deserves a great vacation resort.

57 characters11 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
  1. Great
  2. Great
  3. Great
  4. Great
  5. Great
  6. Great
  7. Great
  8. Great
  9. Great
  10. Great
90 characters39 tokens