Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqfkw0227_1.png

What does C stand for?

OCR text of the page · 2,383 characters; the scanned image itself is not published
Initial Review Groups
NFORMATION
Institutes/Divisions
for
The NIH
MANAGEMENT
. Scientific Community
Extramural
. Advisory Councils
M
Congress
System
PLANNING
INPUT
Institutes
P
OUTPUT
Office of the
Provides
ANALYSIS
. Initial Review Groups
Director - NIH
and
COORDINATION
Advisory Councils
Other Government Agencies
and General Public
NIH EXTRAMURAL ACTIVITIES
DESIGN OBJECTIVES
The extramural programs of NIH are carried out
IMPAC is a system, the primary objective of
through its various grant and award mechanisms
which is the establishment and maintenance of a
designed to assist public and other nonprofit in-
data base from which complete, accurate, and up-
NIH
stitutions and individuals to expand and improve
to-date reports to all levels of management can
research activities in the health sciences and re-
be generated. To establish such a data base, it
lated fields. NIH extramural activities cover the
was necessary to integrate data processing with
Research Grant, Regional Medical program, Re-
the processing of the review and award operations
search Fellowship, Training Grant, Research
Career, Research Facility, and National Library
of the National Institutes of Health. In this man-
ner, IMPAC builds the required data base while it
of Medicine programs. IMPAC is a computer-based
provides each initial review group and advisory
system which:
council with the necessary documents and reports
Computer based information system
required prior to and subsequent to each step in
on the Extramural Program of NI H
1. Serves as the primary authoritative reporting
the application review process. Similarly, the
system on NIH extramural activities;
award notice as well as peripheral supporting doc-
2. Participates in and records the extramural
uments are prepared by IMPAC and furnished to
activities of NIH, about which a data base is
the Institutes for issuance. The continuing inter-
developed;
action which occurs between IMPAC and the re-
view groups and Institutes and Divisions during the
3. Assists in the processing of project applica-
review and award process insures the development
tions submitted in the extramural programs
of a complete, accurate, and timely data base.
U. S. Department of Health, Education, and Welfare
National Institutes of Health
through the review and award processes of NIH.
Source: https://www.industrydocuments.ucsf.edu/docs/qfkw02
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Coordination
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

activities

10 characters2 tokens

Aux 2015

Wrong

Based on the OCR text, the question is asking for the acronym C that appears in the text.

Looking at the provided text:

"Initial Review Groups" → "NFORMATION" "Information" → "Institutes/Divisions" "Divisions" → "for" "

225 characters64 tokens

PiT-FT 2015

Wrong

<|<<> <|<<> <|<<> <|<<> <|<<> <|<<> <|<<> <|<<> <|<<> <|<<> <|<<

64 characters64 tokens

ChronoGPT 2015

Wrong

Institutions

  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
  • NIH
132 characters64 tokens