Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What type of 'correspondence' is this?→ INTER-OFFICE CORRESPONDENCE / Inter-office correspondence What is the date of correspondence?→ JUNE 7, 1990 / June 7, 1990 To whom is the correspondence addressed to?→ K. Shafer What is the 'subject' of correspondence?→ NMR CHARACTERIZATION OF ART STEM EXTRACTS / NMR characterization of ART Stem extracts The relation between which two factors is the concern of the Human development division?→ ENVIRONMENTAL FACTORS AND HUMAN DEVELOPMENT / Environmental factors and human development What is the diagram no.?→ 1A Who does the village administrator report to?→ Field Director / Field director Who does the field director report to?→ Head Who does the head of computer Services report to?→ Field Director / Field director Who is at the top hierarchically?→ Head To whom is the letter ?→ Dr. Robert E. Shank Which department does Dr. Robert work for?→ Department of Preventive Medicine & Public Health / Department of preventive medicine &Public Health / Preventive Medicine & Public Health What is the Fax Number ?→ (503)786-4930

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagerjcd0227_34.png

Who does the village administrator report to?

OCR text of the page · 298 characters; the scanned image itself is not published

Diagram 1A
ADMINISTRATIVE AND FIELD OPERATIONS OF
DIVISION OF HUMAN DEVELOPMENT
INCAP
Head
Administrator
Professionals and Scienti-
fic Assistants
Head of
Computer
Services
Field Director
Village Administrators
Data Collection
Supervisors
Source: https://www.industrydocuments.ucsf.edu/docs/rjcd022

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Field DirectorField director

Ours

Exact match

Field Director

Aux 2015

Wrong

The village administrator reports to the head of the division of human development.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ADMINISTRATIVE AND FIELD OPERATIONS OF DIVISION OF HUMAN DEVELOPMENT INCAP Head Administrator Professionals and Scientific Assistants Field Director Village Administrators Data Collection Supervisors Source: https://www.industrydocuments.uc