Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagephgl0228_3.png

By 9:00 a.m. guests are coming to which room?

OCR text of the page · 940 characters; the scanned image itself is not published
2
Seminar Program
Monday, May 31
Chairmen-J.A. Cogan/L.D. Fraser
9:00 a.m.
Provincial Room
W.O. Twaits
Welcome and Introduction
POLLUTION-
H.H. Clare
Definition, Effects, Organization
OIL IN PERSPECTIVE-
R.M. Maier
1) Demand/Supply
J.C. Underhill
2) Frontier/Offshore Logistics
THE ARCTIC AND OIL-
R.A. Hemstock
Environmental Considerations
12:30 p.m.
London Room
LUNCHEON
2:00 p.m.
Provincial Room
COMPANY/INDUSTRY/PLANT REQUIREMENTS
Gordon Haight
1) Producing
A. W. Wirth
2) Refining
R.S. Grout
3) Transportation
5:45-6:45 p.m.
New York Room
RECEPTION-DINNER
Tuesday, June 1
9:00 a.m.
Provincial Room
George Brydon
CONSUMER IMPLICATIONS
D.L. McGillivray
W.N. Sande
12:30 p.m.
Starlight Room
LUNCHEON
2:00 p.m.
Provincial Room
Dr. D.A.L. Auld
THE BROAD SOCIAL COST/BENEFIT PICTURE
University of Guelph
Dr. Arthur Smith
CLOSING DISCUSSION
Chairman,
The Economic Council
of Canada
Source: https://www.industrydocuments.ucsf.edu/docs/phg10228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Provincial Room
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Provincial Room

15 characters4 tokens

Aux 2015

Wrong

Seminar Program Monday, May 31 Chairmen-J.A. Cogan/L.D. Fraser 9:00 a.m. Provincial Room W.O. Twaits Welcome and Introduction POLLUTION- H.H. Clare Definition, Effects, Organization OIL

185 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
  1. Chlorophyll
  2. Chlorophyll
  3. Chlorophyll
  4. Chlorophyll
  5. Chlorophyll
  6. Chlorophyll
  7. Chlorophyll
  8. Chlorophyll
  9. Chlorophyll 10
137 characters64 tokens