Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezpyp0227_4.png

Who is the chairman of the Scientific advisory committee?

OCR text of the page · 480 characters; the scanned image itself is not published
PRESENT ORGANIZATION STRUCTURE
Trustees
Directors
(14 public, 66 industry)
(2 public, 15 industry
2 ex officio
Chairman
Chairman & Vice Chairman
(public)
(industry)
Foundation Employees
President
(& Ex Officio Director)
Executive Secretary & Treasurer
Staff
Scientific
Food Industries
Advisory
Advisory Committee
Committee
(64 industry)
(11 public, 3 industry,
2 Foundation Staff)
Chairman - (Industry)
Chairman - Foundation Pres.
Nutrition Education
Advisory Committee
(5 Public)
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Foundation Pres.
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Chairman - (Industry)

21 characters7 tokens

Aux 2015

Wrong

Chairman

8 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Chairman - (Public) Chairman - (Industry) Chairman - (Public) Chairman - (Public) Chairman - (Public) Chairman - (Public) Chairman - (Public) Chairman - (Public) Chairman - (Public)

181 characters64 tokens