Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegrmp0227_14.png

According to the footnote, what does ' * ' stand for ?

OCR text of the page · 964 characters; the scanned image itself is not published
VISITING
COMMITTEES
Department of Aeronautics and
Astronautics
Angus N. MacDonald
Chairman
Benjamin P. Blasingame*
Ralph M. Davison* *
Daniel J. Fink* *
Joseph G. Gavin, Jr.*
Crawford H. Greenewalt
Lucius P. Gregg, Jr.*
George C. Grogan, Jr.
Willis M. Hawkins**
D. Brainerd Holmes*
Franklin W. Kolk*
Robert G. Loewy"*
Wilfred D. MacDonnell
John H. Richardson*
William R. Sears**
Thornton A. Wilson* *
School of Architecture and Planning
I. M. Pei
Chairman
Donald S. Appleyard*
Denise Scott Brown* *
John M. Dixon
Anthony Downs* *
John P. Eberhard*
W. H. Krome George
William E. Hartmann"*
Ada Louise Huxtable* *
Vernon E. Jordan, Ir.
Frank T. Keefe* *
Burnham Kelly"
Norman B. Leventhal
John S. Reynolds*
James W. Rouse* *
Paul P. Shepherd
Frederick A. Stahl*
John E. Zuccotti* *
Names without notations indicate nominees by
the Corporation
Nominees by the Alumni Association
*Nominees by the President
Source: https://www.industrydocuments.ucsf. edu/docs/grmp0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Nominees by the Alumni AssociationNominees by the alumni association
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.53

Nominees by the President

25 characters7 tokens

Aux 2015

Wrong

9 characters6 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT

Instruction:

Question: What does ' * ' stand for ?

OCR text: Visiting Committees Department of Aeronautics and Astronautics Angus N. MacDonald Chairman Benjamin P. Blasingame*

193 characters64 tokens