Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezqhm0227_1.png

Among the addressee, which is the name that begins with the alphabet 'U' ?

OCR text of the page · 625 characters; the scanned image itself is not published
ILSI
FEB 15 19/9
INTERNATIONAL LIFE SCIENCES INSTITUTE
Telephone
900 Seventeenth Street, N.W. . Suite 600 . Washington, D.C. 20006
(202) 452-1300
February 13, 1979
TO :
John Barone
William Darby
Peter Dews
William Gill
Harold Grice
Martha Jones
John Kirschman
Lillian Langseth
Alex Malaspina
William Massman
Ulrich Mohr
A. B. Porter
FROM :
For your review, I enclose a copy of the agenda proposed
for the February 20, 1979 Board meeting.
Looking forward to seeing most of you at dinner, Monday,
February 19, 1979, at 6:30 p.m. at the Capitol City Club.
RDM/AEG : s1
Source:https://www.industrydocuments ucsf.edu/docs/zahm0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
ulrich mohrUlrich Mohr
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Ulrich Mohr

11 characters5 tokens

Aux 2015

Wrong

The name that begins with the alphabet 'U' is "International Life Sciences Institute".

86 characters18 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

I am a language model trained by Manela Lab at WashU.

OCR text: ILSI FEB 15 19/9 INTERNATIONAL LIFE SCIENCES INSTITUTE Telephone 900 Seventeenth Street, N.W. . Suite 600 Washington, D.C

186 characters64 tokens