Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegtjc0228_4.png

Who is directly above the Asst. Dir., Office of Editorial and information services?

OCR text of the page · 1,024 characters; the scanned image itself is not published
ORGANIZATIONAL CHART - OFFICE OF BIOMEDICAL STUDIES
FEDERATION
BOARD
SIX MEMBER
SOCIETIES
EXECUTIVE
COMMITTEE
EXECUTIVE
DIRECTOR
EXEC.
ASSISTANT
BOARD
OF
DIRECTOR
SCIENTIFIC CONSULTANTS
OFFICE OF BIOMEDICAL
STUDIES
COMMITT
BIOLOGICAL
HANDBOOKS
OFFICE OF
BIOLOGICAL
OFFICE OF
HANDBOOKS
SCIENTIFIC
LIBRARY
LIFE SCIENCES
PERSONNEL
RESEARCH OFFICE
TRANSLATIONS
PROJECT
DIRECTORY
PLACEMENT
NSF
NRSTP
ORGANIZATIONAL CHART - OFFICE OF EDITORIAL AND INFORMATION SERVICES
FEDERATION
SIX
BOARD
MEMBER
SOCIETIES
PUBLICATIONS
POLICY
EXECUTIVE
COMMITTEE
COMMITTEE
EXECUTIVE
DIRECTOR
EXEC
ASS'T
EDITORIAL
COMMITTEE
DIRECTOR, OFFICE OF
EDITORIAL AND INFORMATION SERVICES
ASST. DIR., OFFICE OF
EDITORIAL AND INFORMATION SERVICES
EDITORIAL AND
REDACTORY SERVICES
PUBLICATION
SERVICES
F.P.
AJCN
JN
ADVERTISING
REPRINTS
ALTERATIONS & ILLUSTRATIONS
CHARGES TO AUTHORS
This office will report to the
Director, Office of Editorial
and information Services
for editorial duties and to
the Comptroller for all
business matters
3
F.edu/docs/atic0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
DIRECTOR, OFFICE OF EDITORIAL AND INFORMATION SERVICESDirector, Office of Editorial and Information Services
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

DIRECTOR, OFFICE OF EDITORIAL AND INFORMATION SERVICES

54 characters13 tokens

Aux 2015

Wrong

The question asks for the "directly above" the "Asst. Dir., Office of Editorial and Information Services". Based on the OCR text, the answer is:

Asst. Dir., Office of Editorial and Information Services

This is the correct answer, as the text explicitly states: "Asst

272 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ORGANIZATIONAL CHART - OFFICE OF EDITORIAL AND INFORMATION SERVICES FEDERATION SIX BOARD SOCIETIES EXECUTIVE COMMITTEE DIRECTOR EXECUTIVE DIRECTOR EXECUTIVE DIRECT

163 characters64 tokens