Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegkpk0226_1.png

Which meeting is the Mr. Rizzuto referring to?

OCR text of the page · 606 characters; the scanned image itself is not published
Amstar
CORPORATION
1261 AVENUE OF THE AMERICAS, NEW YORK, N. Y. 10020 . (212) 489-8000
Research & Development Division
266 Kent Avenue
Brooklyn, New York 11211
July 23, 1976
Dr. Paul Saltman
University of California, San Diego
Office of the Vice Chancellor
Academic Affairs
LaJolla, CA 92093
Dear Paul:
Enclosed is a check for $419.00 representing your
expenses incconnection with our Food and Nutrition Advisory
Council meeting.
We were very pleased that you were able
to attend.
Sincerely yours,
A. B. Rizzuto
Director of Research
ABR/jf
Enc .
Source: https://www.industrydocuments.ucsf.edu/docs/gkpk0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Food and Nutrition Advisory Council meetingFood and nutrition advisory council meeting
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Food and Nutrition Advisory Council meeting

43 characters7 tokens

Aux 2015

Partial · ANLS 0.68

The meeting is the Food and Nutrition Advisory Council meeting.

63 characters12 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT 1261 AVENUE OF THE AMERICAS, NEW YORK, N. Y. 10020

July 23, 1976 Dr. Paul Saltman University of California, San Diego Office of the Vice Chancellor Academic Affairs LaJolla, CA 92093

193 characters64 tokens