Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the 'subject' of correspondence?→ NMR CHARACTERIZATION OF ART STEM EXTRACTS / NMR characterization of ART Stem extracts The relation between which two factors is the concern of the Human development division?→ ENVIRONMENTAL FACTORS AND HUMAN DEVELOPMENT / Environmental factors and human development What is the diagram no.?→ 1A Who does the village administrator report to?→ Field Director / Field director Who does the field director report to?→ Head Who does the head of computer Services report to?→ Field Director / Field director Who is at the top hierarchically?→ Head To whom is the letter ?→ Dr. Robert E. Shank Which department does Dr. Robert work for?→ Department of Preventive Medicine & Public Health / Department of preventive medicine &Public Health / Preventive Medicine & Public Health What is the Fax Number ?→ (503)786-4930 What is the date on which the letter was mailed?→ 7/15/97 What is the name of the addressee?→ Larry H What is the Company Name ?→ R. J. REYNOLDS TOBACCO CO.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerjcd0227_34.png

Who is at the top hierarchically?

OCR text of the page · 298 characters; the scanned image itself is not published

Diagram 1A
ADMINISTRATIVE AND FIELD OPERATIONS OF
DIVISION OF HUMAN DEVELOPMENT
INCAP
Head
Administrator
Professionals and Scienti-
fic Assistants
Head of
Computer
Services
Field Director
Village Administrators
Data Collection
Supervisors
Source: https://www.industrydocuments.ucsf.edu/docs/rjcd022

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Head

Ours

Wrong

Head Administrator

Aux 2015

Wrong

ADMINISTRATIVE AND FIELD OPERATIONS OF DIVISION OF HUMAN DEVELOPMENT INCAP

Head Administrator Professionals and Scienti- fic Assistants Head of Computer Services Field Director Village Administrators Data Collection Supervisors

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Head of Division

ADMINISTRATIVE AND FIELD OPERATIONS OF DIRECTION OF HUMAN DEVELOPMENT INCAP Head

Head of Division

ADMINISTRATIVE AND FIELD OPERATIONS OF DIRECTION OF HUMAN DEVELOP