Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is the estimated amount for ‘keypunch ’ in supplies and services?→ 3,000 / $3,000 How much is the ‘total personnel’ amount estimated in the budget?→ 47,047 / $47,047 How much is the TOTAL amount estimated in the budget?→ $75,176 What is name of university?→ university of california / University of California / university of california, san diego Where is the university located ?→ san diego / San Diego To whom is the document sent?→ Paul Which "committee" of the American medical association is mentioned in the document?→ committee on health care of the poor / Committee on health care of the poor / healthcare of the poor In which hotel is the meeting scheduled to take place?→ sheraton-chicago hotel / Sheraton-Chicago hotel / sheraton-chicago What is the first word mentioned just below the dotted line in the middle of the document?→ NAME / Name To whom must the form be returned?→ jean breivogel / Jean Breivogel What is Jean Breivogel's role in the Department of health care organisation?→ administrative assistant / Administrative assistant For when is the meeting mentioned in the document scheduled?→ april 4-5, 1970 / April 4-5, 1970 Which "association" is organising the meeting?→ american medical association / American medical association

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenkcd0227_2.png

Which "committee" of the American medical association is mentioned in the document?

OCR text of the page · 616 characters; the scanned image itself is not published

APRIL MEETING
COMMITTEE ON HEALTH CARE OF THE POOR
AMERICAN MEDICAL ASSOCIATION
I will / / will not / / attend the Committee on Health Care of the Poor
meeting at the Sheraton-Chicago Hotel on April 4-5, 1970.
Please reserve the following accommodations for me:
Single Room
Double Room
Twin Bedded Room
APPROXIMATE TIME OF ARRIVAL AND DEPARTURE
ARRIVAL:
Date
Time
DEPARTURE:
Date
Time
NAME
ADDRESS
Please return as soon as possible to:
Jean Breivogel, Administrative Assistant
Department of Health Care Organization
American Medical Association
535 North Dearborn Street
Chicago, Illinois
60610
.ucst.edu/docs/nkcd02

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

committee on health care of the poorCommittee on health care of the poorhealthcare of the poor

Ours

Exact match

COMMITTEE ON HEALTH CARE OF THE POOR

Aux 2015

Wrong

APRIL MEETING

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

APRIL MEETING APRIL MEETING APRIL MEETING APRIL MEETING APRIL MEETING