Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemgbv0228_13.png

On which floor of the building are the various 'facilities' ?

OCR text of the page · 772 characters; the scanned image itself is not published
FLEISCHMANN BIOCHEMISTRY NUTRITION BUILDING
FIRST FLOOR
Subtotal
Sq. Ft.
Sq. Ft.
I .
Animal Faciltities for Small Animals
( Rodents)
A.
Animal Rooms
1 .
Isolation
(quarantine)
150
2 .
Regular animal rooms (11)
@ 200 each
2,200
3.
Trace mineral animal facility
200
B .
Small animal surgery
150
C.
Diet mixing room
150
D .
Cage washing area
400
E .
Storage for bedding and feed
200
F .
Cage storage
200
G .
Locker room/shower area for personnel
200
3, 850
II .
Central Dishwashing Facility
300
300
III .
Cold Room
200
200
IV. Storage Room
250
250
V .
Instrument Room
200
200
VI.
Pilot Plant
400
400
VII.
Biochemistry Research Laboratories/Offices
1, 200
TOTAL :
6, 400
SUMMARY :
Approximately 10, 000 gross sq. ft.
6, 400 net sq. ft.
11
Source: https://www.industrydocuments
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
first floorFirst floorFirst
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

FIRST FLOOR

11 characters4 tokens

Aux 2015

Wrong

The facilities are located on the first floor of the building.

62 characters13 tokens

PiT-FT 2015

Wrong

<|<|<|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

64 characters64 tokens

ChronoGPT 2015

Wrong

FLEISCHMAN BIOCHEMISTRY NUTRITION BUILDING

Question:

On which floor of the building is the various 'facilities' ?

OCR text: FLEISCHMAN BIOCHEMISTRY NUTRITION BUILDING

172 characters64 tokens