Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefshk0226_7.png

For which dates are the reservations made for?

OCR text of the page · 620 characters; the scanned image itself is not published
RESERVATIONS AT ASPEN SQUARE 1/30 - 2/1/69
Joan Brink
Mr. and Mrs. Jackson Spears, Jr.
Donna W. Campbell
Mr. and Mrs. Dave Bruns
Peggy Pacey
Mr. and Mrs. Richard Von Kaenel
Martin Romm
Mr. and Mrs. Harry Roadman
George F. Ackerman
Mr. John L. Crum, Jr.
Michael Baum
Mr. and Mrs. S. Bragg
David J. Bryan
Charles L. Elliot
Paul R. Kelley
Alfred H. Kingon
Matthew Levison
Leonard Marx, Jr.
John W. Peel
L. Richard Wenzel
Eddie J. Sharpe
Clinton 0. Mayer III
William R. Thompson
Larry DuBois
Al Naylor
Granville McGee
Allen Boyar
Michael Mccafferty
Dick Wyandotte
Source: https://www.industrydocuments.ucsf.edu/docs/fshk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1/30 - 2/1/69
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1/30 - 2/1/69

13 characters13 tokens

Aux 2015

Wrong

RESERVATIONS AT ASPEN SQUARE 1/30 - 2/1/69

42 characters21 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: RESERVATIONS AT ASPEN SQUARE 1/30 - 2/1/69 Joan Brink Mr. and Mrs. Jackson Spears, Jr. Donna W. Campbell Mr. and Mrs. Dave Bruns Peggy Pacey Mr. and Mrs

162 characters64 tokens