Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepxvx0227_1.png

What is the name of the sugar factory ?

OCR text of the page · 579 characters; the scanned image itself is not published
A
Great Western
Welcome
to
pure
Sugar
Goodland, Kansas
SATURDAY, JUNE 8, 1968
AGRICULTURAL
WAREHOUSE
PULP PELLET WAREHOUSE
PULP DRYER
MATERIAL YARD
PELLET BIN
& SCALE
BEET HANDLING
LIME
KILN
RAIL SIDING
KANCOL SUGAR FACTORY
STORE
MAIN
ROOM
Goodland, Kansas
OFFICE
BLDG
BLDG
PLOT PLAN of STRUCTURES
(SUGAR PROCESSING)
MACHINE
SHO
BOILER
HOUSE
LOCKERS
SACKING
SUGAR WAREHOUSE
(BULK CAR LOADING)
RAIL SIDING
HHHHHHHHHHH
5 MILES TO GOODLAND
28 MILES TO BURLINGTON
2020
BULK SUGAR STORAGE BINS
VIA U. S. 24 ( INTERSTATE 70)
Source: https://www.industrydocuments.ucsf.edu/docs/pxvx0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Kancol Sugar factoryKancol sugar factoryGood land,Kansas
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Kancol Sugar Factory

20 characters6 tokens

Aux 2015

Partial · ANLS 0.56

Great Western Sugar Factory

27 characters5 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Sugar Factory Sugar Goodland, Kansas Sugar Goodland, Kansas Sugar Goodland, Kansas Sugar Goodland, Kansas Sugar Sugar

117 characters41 tokens