Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegxmw0227_1.png

Which country's flag is it?

OCR text of the page · 355 characters; the scanned image itself is not published
YALE UNIVERSITY
SCHOOL OF MEDICINE
DEPARTMENT OF EPIDEMIOLOGY AND PUBLIC HEALTH
60 COLLEGE STREET
NEW HAVEN, CONNECTICUT 065 10
THE LAND OF THE FREE. THE
USA 15c
HOME OF THE BRAVE
Dr. M. Hitchcock
Yale School of Medicine
Dept. of Epidemiology&Public
60 College St.
Health
New Haven, Conn. 06510
Source: https://www.industrydocuments.ucsf.edu/docs/gxmw0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
USA
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

USA

3 characters2 tokens

Aux 2015

Wrong

Yale University

15 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Yale University SCHOOL OF MEDICINE DEPARTMENT OF EPIDEMIOLOGY & PUBLIC HEALTH 60 COLLEGE STREET NEW HAVEN, CONNECTICUT 06510 THE LAND OF THE FREE DR. M. HITCHCOCK Y

164 characters64 tokens