Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezznp0227_107.png

what is the heading of the page?

OCR text of the page · 695 characters; the scanned image itself is not published
ADMINISTRATIVE DIVISION PERSONNEL
John R. March .
. . . . . . .
President
Eldon Jones . . . .
. . . . . Business Manager
Elmo Cypert . ..
. . . . . . . Maintenance
Glenn Elmore
Print Shop Supervisor
Eva Franks . . . .
Cafeteria-Laundry
Ruby Nell Gay
Cook
Robert Gillham
Bookkeeper
Glenn Houchin . .
Printer
Karen Jackson . .
. .
Secretary
Jack Jewell .
Plant Engineer
Dan Jones . ..
. . Maintenance
Bill Kendall . .
. . . . . Janitor
Ivan Lawson . .
Photographer
Ronnie Morris .
Turf & Horticulture
Jack Pletcher . . . . .
. . . Printer
Carol Richardson
Secretary
Jackie Skidmore
2 . .
Secretary
Linda Surber . . ..
. . Receptionist
7
Source: https://www.industrydocuments.ucsf edu/docs/zznp0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
administrative division personnelAdministrative Division Personnel
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

ADMINISTRATIVE DIVISION PERSONNEL

33 characters8 tokens

Aux 2015

Exact match

ADMINISTRATIVE DIVISION PERSONNEL

33 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: ADMINISTRATIVE DIVISION PERSONNEL John R. March . . . . . . . . President Eldon Jones . . . . . . . Business Manager Elmo Cypert . . . . . . . . . President

166 characters64 tokens