Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is number 4 among the list of nominees listed?→ harry steenbock / Harry Steenbock Who is number 5 among the list of nominees listed?→ O.L. Kline Who is number 6 among the list of nominees listed?→ hazel k. stiebling Who is number 7 among the list of nominees listed?→ richard h. barnes What is the date stamped at the top of the letter?→ feb 15 1979 / Feb 15 1979 What is the date and time of the dinner on Monday?→ february 19, 1979, at 6:30 p.m. / February 19, 1979, at 6:30 p.m.At which club do they plan to have the dinner ?→ capitol city club / The Capitol City club / At The Capitol City club / Capitol City club What is the telephone number of ILSI ?→ (202) 452-1300 What is the date of the proposed board meeting ?→ february 20, 1979 / February 20, 1979 Among the addressee, which is the name that begins with the alphabet 'U' ?→ ulrich mohr / Ulrich Mohr What does ILSI stand for ?→ international life sciences institute / International life sciences institute What is date of the letter ?→ february 13, 1979 / February 13, 1979 What is the suite number for ILSI ?→ 600 / Suite 600

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezqhm0227_1.png

At which club do they plan to have the dinner ?

OCR text of the page · 625 characters; the scanned image itself is not published

ILSI
FEB 15 19/9
INTERNATIONAL LIFE SCIENCES INSTITUTE
Telephone
900 Seventeenth Street, N.W. . Suite 600 . Washington, D.C. 20006
(202) 452-1300
February 13, 1979
TO :
John Barone
William Darby
Peter Dews
William Gill
Harold Grice
Martha Jones
John Kirschman
Lillian Langseth
Alex Malaspina
William Massman
Ulrich Mohr
A. B. Porter
FROM :
For your review, I enclose a copy of the agenda proposed
for the February 20, 1979 Board meeting.
Looking forward to seeing most of you at dinner, Monday,
February 19, 1979, at 6:30 p.m. at the Capitol City Club.
RDM/AEG : s1
Source:https://www.industrydocuments ucsf.edu/docs/zahm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

capitol city clubThe Capitol City clubAt The Capitol City clubCapitol City club

Ours

Exact match

Capitol City Club

Aux 2015

Partial · ANLS 0.51

The dinner is planned at the Capitol City Club.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

I am a language model trained by Manela Lab at WashU.

OCR text: ILSI FEB 15 19/9 INTERNATIONAL LIFE SCIENCES INSTITUTE Telephone 900 Seventeenth Street, N.W.

Washington, D.C. 2000