Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegrmp0227_14.png

Who is the chairman of the 'School of architecture and planning ' ?

OCR text of the page · 964 characters; the scanned image itself is not published
VISITING
COMMITTEES
Department of Aeronautics and
Astronautics
Angus N. MacDonald
Chairman
Benjamin P. Blasingame*
Ralph M. Davison* *
Daniel J. Fink* *
Joseph G. Gavin, Jr.*
Crawford H. Greenewalt
Lucius P. Gregg, Jr.*
George C. Grogan, Jr.
Willis M. Hawkins**
D. Brainerd Holmes*
Franklin W. Kolk*
Robert G. Loewy"*
Wilfred D. MacDonnell
John H. Richardson*
William R. Sears**
Thornton A. Wilson* *
School of Architecture and Planning
I. M. Pei
Chairman
Donald S. Appleyard*
Denise Scott Brown* *
John M. Dixon
Anthony Downs* *
John P. Eberhard*
W. H. Krome George
William E. Hartmann"*
Ada Louise Huxtable* *
Vernon E. Jordan, Ir.
Frank T. Keefe* *
Burnham Kelly"
Norman B. Leventhal
John S. Reynolds*
James W. Rouse* *
Paul P. Shepherd
Frederick A. Stahl*
John E. Zuccotti* *
Names without notations indicate nominees by
the Corporation
Nominees by the Alumni Association
*Nominees by the President
Source: https://www.industrydocuments.ucsf. edu/docs/grmp0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
I. M. Pei
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

I. M. Pei

9 characters7 tokens

Aux 2015

Wrong

Chairman

8 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT

Instruction:

You are ChronoGPT, a large language model trained by Manela Lab at WashU.

OCR text: Visiting Committees Department of Aeronautics and Astronautics Angus N. MacDonald Department of Aer

212 characters64 tokens