Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexngv0228_3.png

What is the date stamped on the letter?

OCR text of the page · 705 characters; the scanned image itself is not published
Dr. R. J. L. Allen, OBE, 63 Abbotsbury Close, London W14 8EQ, England. Telephone : 01-603 5829
JLA/FLA
9th April 1981.
Dr. W. J. Darby, M.D. PhD.
REED APR 201981
The Nutrition Foundation, Inc.
489 Fifth Avenue,
New York,
N. Y. 10017,
U. S. A.
Dear Bill,
International Congress of Nutrition
Thank you for your letter of March 30 about the Nutrition
Foundations' meetings.
Although we have corresponded on this matter,
I return the enclosed form for the sake of good order.
You may like to know that Anne is coming with me to San
Diego.
We are planning a short holiday afterwards in Baja, California.
Kind regards.
Yours sincerely,
R. J. L. Allen
Source: https://www.industrydocuments.ucsf.edu/docs/xnay0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
apr 20 1981APR 20 1981apr 201981
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.50

9th April 1981

14 characters9 tokens

Aux 2015

Wrong

9th April 1981.

15 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Dr. R. J. L. Allen, OBE, 63 Abbotsbury Close, London W14 8EQ, England.

Date:

9th April 1981

ChronoGPT, a large language model trained by Manela Lab at WashU, is

164 characters64 tokens