Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefshk0226_7.png

Who has the first reservation at Aspen Square?

OCR text of the page · 620 characters; the scanned image itself is not published
RESERVATIONS AT ASPEN SQUARE 1/30 - 2/1/69
Joan Brink
Mr. and Mrs. Jackson Spears, Jr.
Donna W. Campbell
Mr. and Mrs. Dave Bruns
Peggy Pacey
Mr. and Mrs. Richard Von Kaenel
Martin Romm
Mr. and Mrs. Harry Roadman
George F. Ackerman
Mr. John L. Crum, Jr.
Michael Baum
Mr. and Mrs. S. Bragg
David J. Bryan
Charles L. Elliot
Paul R. Kelley
Alfred H. Kingon
Matthew Levison
Leonard Marx, Jr.
John W. Peel
L. Richard Wenzel
Eddie J. Sharpe
Clinton 0. Mayer III
William R. Thompson
Larry DuBois
Al Naylor
Granville McGee
Allen Boyar
Michael Mccafferty
Dick Wyandotte
Source: https://www.industrydocuments.ucsf.edu/docs/fshk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Joan Brink
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Joan Brink

10 characters5 tokens

Aux 2015

Wrong

Mr. and Mrs. Dave Bruns

23 characters9 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Mr. and Mrs. Jackson Spears, Jr.

32 characters10 tokens